2024-03-30T01:35:45.779 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-30T01:35:45.779 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --verbose --archive /home/teuthworker/archive/rishabh-2024-03-29_18:05:24-fs-wip-rishabh-testing-20240327.051042-reef-testing-default-smithi/7629323 --name rishabh-2024-03-29_18:05:24-fs-wip-rishabh-testing-20240327.051042-reef-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/recovery-fs} -- /home/teuthworker/archive/rishabh-2024-03-29_18:05:24-fs-wip-rishabh-testing-20240327.051042-reef-testing-default-smithi/7629323/orig.config.yaml 2024-03-30T01:35:45.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T01:35:45.909 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-03-29_18:05:24-fs-wip-rishabh-testing-20240327.051042-reef-testing-default-smithi/7629323 branch: wip-rishabh-testing-20240327.051042-reef description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/recovery-fs} email: null first_in_suite: false job_id: '7629323' kernel: client: branch: testing flavor: default kdb: true sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2024-03-29_18:05:24-fs-wip-rishabh-testing-20240327.051042-reef-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240327.051042-reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 470100a4ccbcf7769052bf09a5413881ccf1b97f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 470100a4ccbcf7769052bf09a5413881ccf1b97f kclient: syntax: v1 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240327.051042-reef sha1: 470100a4ccbcf7769052bf09a5413881ccf1b97f owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8052 sha1: 470100a4ccbcf7769052bf09a5413881ccf1b97f sleep_before_teardown: 0 subset: 497/512 suite: fs suite_branch: wip-rishabh-testing-20240327.051042-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_470100a4ccbcf7769052bf09a5413881ccf1b97f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 470100a4ccbcf7769052bf09a5413881ccf1b97f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi133.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOSuTrqf4XLFxbxEGVf3lm4FTHfI2eVG8nvVoSuw1yJKr7E7bP+mRHT+oAAQEwaZ4xu1xJqmmPmIEzTbbYTO3zk= smithi137.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOqmzwCL+rBy2C4wUVFStlUDYJcUFIqIDFMGspGAl4hYeLtG+p+tu0DdMAZBRVQqAjo7tbBP9D+saAJ6F1WSNhg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_recovery_fs teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-29_18:05:24 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-30T01:35:45.909 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_470100a4ccbcf7769052bf09a5413881ccf1b97f/qa; will attempt to use it 2024-03-30T01:35:45.910 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_470100a4ccbcf7769052bf09a5413881ccf1b97f/qa/tasks 2024-03-30T01:35:45.910 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-30T01:35:45.912 INFO:teuthology.task.internal:Checking packages... 2024-03-30T01:35:45.936 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '470100a4ccbcf7769052bf09a5413881ccf1b97f' 2024-03-30T01:35:45.936 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-30T01:35:45.937 INFO:teuthology.packaging:ref: None 2024-03-30T01:35:45.937 INFO:teuthology.packaging:tag: None 2024-03-30T01:35:45.937 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240327.051042-reef 2024-03-30T01:35:45.937 INFO:teuthology.packaging:sha1: 470100a4ccbcf7769052bf09a5413881ccf1b97f 2024-03-30T01:35:45.937 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240327.051042-reef 2024-03-30T01:35:46.083 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1018.g470100a4 2024-03-30T01:35:46.084 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-30T01:35:46.091 INFO:teuthology.task.internal:no buildpackages task found 2024-03-30T01:35:46.091 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-30T01:35:46.112 INFO:teuthology.task.internal:Saving configuration 2024-03-30T01:35:46.129 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-30T01:35:46.135 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-30T01:35:46.161 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-29_18:05:24-fs-wip-rishabh-testing-20240327.051042-reef-testing-default-smithi/7629323', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 01:30:37.879677', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOSuTrqf4XLFxbxEGVf3lm4FTHfI2eVG8nvVoSuw1yJKr7E7bP+mRHT+oAAQEwaZ4xu1xJqmmPmIEzTbbYTO3zk='} 2024-03-30T01:35:46.184 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-29_18:05:24-fs-wip-rishabh-testing-20240327.051042-reef-testing-default-smithi/7629323', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 01:30:37.878272', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOqmzwCL+rBy2C4wUVFStlUDYJcUFIqIDFMGspGAl4hYeLtG+p+tu0DdMAZBRVQqAjo7tbBP9D+saAJ6F1WSNhg='} 2024-03-30T01:35:46.184 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-30T01:35:46.190 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-03-30T01:35:46.190 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-03-30T01:35:46.191 INFO:teuthology.run_tasks:Running task console_log... 2024-03-30T01:35:46.265 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4cd454c160>, signals=[15]) 2024-03-30T01:35:46.265 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-30T01:35:46.271 INFO:teuthology.task.internal:Opening connections... 2024-03-30T01:35:46.271 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi133.front.sepia.ceph.com 2024-03-30T01:35:46.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T01:35:46.367 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi137.front.sepia.ceph.com 2024-03-30T01:35:46.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T01:35:46.456 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-30T01:35:46.463 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2024-03-30T01:35:46.481 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2024-03-30T01:35:46.481 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-03-30T01:35:46.538 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2024-03-30T01:35:46.538 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="9" 2024-03-30T01:35:46.538 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2024-03-30T01:35:46.539 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2024-03-30T01:35:46.539 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="9" 2024-03-30T01:35:46.539 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el9" 2024-03-30T01:35:46.539 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-30T01:35:46.539 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-03-30T01:35:46.539 INFO:teuthology.orchestra.run.smithi133.stdout:LOGO="fedora-logo-icon" 2024-03-30T01:35:46.539 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-30T01:35:46.539 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2024-03-30T01:35:46.539 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-30T01:35:46.539 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-30T01:35:46.539 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-30T01:35:46.540 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-03-30T01:35:46.556 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-03-30T01:35:46.574 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-03-30T01:35:46.574 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-03-30T01:35:46.631 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2024-03-30T01:35:46.632 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="9" 2024-03-30T01:35:46.632 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2024-03-30T01:35:46.632 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2024-03-30T01:35:46.632 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="9" 2024-03-30T01:35:46.632 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el9" 2024-03-30T01:35:46.632 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-30T01:35:46.632 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-03-30T01:35:46.632 INFO:teuthology.orchestra.run.smithi137.stdout:LOGO="fedora-logo-icon" 2024-03-30T01:35:46.632 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-30T01:35:46.632 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2024-03-30T01:35:46.632 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-30T01:35:46.632 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-30T01:35:46.632 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-30T01:35:46.633 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-03-30T01:35:46.656 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-30T01:35:46.666 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-30T01:35:46.671 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-30T01:35:46.672 DEBUG:teuthology.orchestra.run.smithi133:> test '!' -e /home/ubuntu/cephtest 2024-03-30T01:35:46.674 DEBUG:teuthology.orchestra.run.smithi137:> test '!' -e /home/ubuntu/cephtest 2024-03-30T01:35:46.690 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-30T01:35:46.696 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-30T01:35:46.696 DEBUG:teuthology.orchestra.run.smithi133:> test -z $(ls -A /var/lib/ceph) 2024-03-30T01:35:46.731 DEBUG:teuthology.orchestra.run.smithi137:> test -z $(ls -A /var/lib/ceph) 2024-03-30T01:35:46.831 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-30T01:35:46.885 INFO:teuthology.run_tasks:Running task kernel... 2024-03-30T01:35:46.899 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'} 2024-03-30T01:35:46.899 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-03-30T01:35:46.899 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-03-30T01:35:46.900 DEBUG:teuthology.orchestra.run.smithi133:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-30T01:35:46.900 DEBUG:teuthology.orchestra.run.smithi137:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-30T01:35:46.916 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T01:35:46.917 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-03-30T01:35:46.920 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T01:35:46.921 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-03-30T01:35:47.133 DEBUG:teuthology.task.kernel:sha1 for client.1 is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-30T01:35:47.133 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-03-30T01:35:47.134 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-03-30T01:35:47.151 INFO:teuthology.orchestra.run.smithi137.stdout:5.14.0-361.el9.x86_64 2024-03-30T01:35:47.151 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-30T01:35:47.151 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-30T01:35:47.151 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum upgrade -y linux-firmware 2024-03-30T01:35:47.201 DEBUG:teuthology.task.kernel:sha1 for client.0 is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-30T01:35:47.201 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-03-30T01:35:47.201 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2024-03-30T01:35:47.218 INFO:teuthology.orchestra.run.smithi133.stdout:5.14.0-361.el9.x86_64 2024-03-30T01:35:47.218 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-30T01:35:47.219 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-30T01:35:47.219 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum upgrade -y linux-firmware 2024-03-30T01:35:49.445 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-03-30T01:35:49.496 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS-9 - AppStream 9.3 MB/s | 6.7 MB 00:00 2024-03-30T01:35:50.863 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS-9 - BaseOS 7.4 MB/s | 2.0 MB 00:00 2024-03-30T01:35:51.387 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS-9 - BaseOS 2.6 MB/s | 2.0 MB 00:00 2024-03-30T01:35:52.770 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.0 MB 00:01 2024-03-30T01:35:56.929 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 19 MB 00:03 2024-03-30T01:36:01.082 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - CRB 9.8 MB/s | 6.1 MB 00:00 2024-03-30T01:36:02.513 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 16 kB 00:00 2024-03-30T01:36:04.284 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-03-30T01:36:09.290 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-03-30T01:36:11.648 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-03-30T01:36:11.659 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-03-30T01:36:11.659 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-03-30T01:36:11.659 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-03-30T01:36:11.659 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrading: 2024-03-30T01:36:11.659 INFO:teuthology.orchestra.run.smithi137.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-30T01:36:11.659 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:36:11.660 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-03-30T01:36:11.660 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-03-30T01:36:11.660 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrade 1 Package 2024-03-30T01:36:11.660 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:36:11.660 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 375 M 2024-03-30T01:36:11.660 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-03-30T01:36:20.706 INFO:teuthology.orchestra.run.smithi137.stdout:linux-firmware-20240219-143.el9.noarch.rpm 41 MB/s | 375 MB 00:09 2024-03-30T01:36:20.707 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-03-30T01:36:20.708 INFO:teuthology.orchestra.run.smithi137.stdout:Total 41 MB/s | 375 MB 00:09 2024-03-30T01:36:20.708 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-03-30T01:36:20.791 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-03-30T01:36:20.791 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-03-30T01:36:23.181 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-03-30T01:36:23.181 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-03-30T01:36:29.637 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-03-30T01:36:29.849 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-30T01:36:29.940 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-30T01:36:31.293 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-30T01:36:31.293 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-30T01:36:31.676 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-30T01:36:31.677 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:36:31.677 INFO:teuthology.orchestra.run.smithi137.stdout:Upgraded: 2024-03-30T01:36:31.677 INFO:teuthology.orchestra.run.smithi137.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-30T01:36:31.677 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:36:31.677 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-03-30T01:36:31.983 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.1... 2024-03-30T01:36:31.983 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-30T01:36:32.215 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-03-30T01:36:32.216 DEBUG:teuthology.orchestra.run.smithi137:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-30T01:36:32.218 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi137.front.sepia.ceph.com to complete... 2024-03-30T01:36:45.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30 01:36:45 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-30T01:36:45.989 INFO:teuthology.orchestra.run.smithi137.stderr:FINISHED --2024-03-30 01:36:45-- 2024-03-30T01:36:45.989 INFO:teuthology.orchestra.run.smithi137.stderr:Total wall clock time: 14s 2024-03-30T01:36:45.989 INFO:teuthology.orchestra.run.smithi137.stderr:Downloaded: 1 files, 321M in 13s (23.9 MB/s) 2024-03-30T01:36:45.992 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.1... 2024-03-30T01:36:45.992 DEBUG:teuthology.orchestra.run.smithi137:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-30T01:36:47.916 INFO:teuthology.orchestra.run.smithi137.stdout:Verifying... ######################################## 2024-03-30T01:36:47.967 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing... ######################################## 2024-03-30T01:36:48.046 INFO:teuthology.orchestra.run.smithi137.stdout:Updating / installing... 2024-03-30T01:36:55.508 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-03-30T01:37:11.195 INFO:teuthology.orchestra.run.smithi137.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-30T01:37:26.563 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - BaseOS 87 kB/s | 8.0 MB 01:34 2024-03-30T01:37:28.716 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-03-30T01:37:32.958 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - CRB 9.1 MB/s | 6.1 MB 00:00 2024-03-30T01:37:33.613 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi137.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-30T01:37:33.613 DEBUG:teuthology.orchestra.run.smithi137:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-30T01:37:33.688 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-03-30T01:37:33.688 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-03-30T01:37:33.688 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-03-30T01:37:33.688 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-03-30T01:37:33.688 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-03-30T01:37:33.688 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-03-30T01:37:33.688 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-03-30T01:37:33.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-30T01:37:33.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-30T01:37:33.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-30T01:37:33.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-30T01:37:33.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-30T01:37:33.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-30T01:37:33.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-30T01:37:33.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-30T01:37:33.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-30T01:37:33.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-30T01:37:33.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-30T01:37:33.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-30T01:37:33.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-30T01:37:33.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-30T01:37:33.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-30T01:37:33.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-30T01:37:33.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-30T01:37:33.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-30T01:37:33.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-30T01:37:33.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-30T01:37:33.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-03-30T01:37:33.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-03-30T01:37:33.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-03-30T01:37:33.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-30T01:37:33.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-03-30T01:37:33.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-30T01:37:33.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-30T01:37:33.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-03-30T01:37:33.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-03-30T01:37:33.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-03-30T01:37:33.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-03-30T01:37:33.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-03-30T01:37:33.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-03-30T01:37:33.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-03-30T01:37:33.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-03-30T01:37:33.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-30T01:37:33.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-03-30T01:37:33.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-03-30T01:37:33.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-03-30T01:37:33.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-03-30T01:37:33.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-03-30T01:37:33.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-03-30T01:37:33.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-03-30T01:37:33.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-03-30T01:37:33.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-03-30T01:37:33.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-03-30T01:37:33.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-03-30T01:37:33.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-03-30T01:37:33.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-03-30T01:37:33.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-03-30T01:37:33.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-03-30T01:37:33.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-03-30T01:37:33.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-03-30T01:37:33.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-03-30T01:37:33.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-03-30T01:37:33.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-03-30T01:37:33.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-03-30T01:37:33.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-03-30T01:37:33.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-03-30T01:37:33.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-03-30T01:37:33.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-03-30T01:37:33.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-03-30T01:37:33.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-03-30T01:37:33.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-03-30T01:37:33.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-03-30T01:37:33.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-03-30T01:37:33.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-03-30T01:37:33.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-03-30T01:37:33.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-03-30T01:37:33.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-03-30T01:37:33.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-03-30T01:37:33.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-03-30T01:37:33.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-03-30T01:37:33.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-03-30T01:37:33.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-03-30T01:37:33.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-03-30T01:37:33.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-03-30T01:37:33.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-03-30T01:37:33.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-03-30T01:37:33.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-03-30T01:37:33.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-30T01:37:33.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-03-30T01:37:33.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-03-30T01:37:33.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-03-30T01:37:33.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-03-30T01:37:33.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-03-30T01:37:33.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-03-30T01:37:33.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-03-30T01:37:33.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-03-30T01:37:33.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-03-30T01:37:33.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-03-30T01:37:33.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-03-30T01:37:33.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-03-30T01:37:33.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-03-30T01:37:33.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-03-30T01:37:33.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-03-30T01:37:33.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-03-30T01:37:33.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-03-30T01:37:33.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-03-30T01:37:33.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-03-30T01:37:33.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-03-30T01:37:33.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-03-30T01:37:33.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-03-30T01:37:33.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-03-30T01:37:33.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-03-30T01:37:33.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-30T01:37:33.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-30T01:37:33.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-03-30T01:37:33.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-03-30T01:37:33.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-03-30T01:37:33.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-03-30T01:37:33.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-03-30T01:37:33.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-03-30T01:37:33.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-03-30T01:37:33.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-03-30T01:37:33.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-03-30T01:37:33.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-03-30T01:37:33.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-03-30T01:37:33.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-03-30T01:37:33.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-03-30T01:37:33.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-30T01:37:33.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-30T01:37:33.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-03-30T01:37:33.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-03-30T01:37:33.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-03-30T01:37:33.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-03-30T01:37:33.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-03-30T01:37:33.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-03-30T01:37:33.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-03-30T01:37:33.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-03-30T01:37:33.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-03-30T01:37:33.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-03-30T01:37:33.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-03-30T01:37:33.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-03-30T01:37:33.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-03-30T01:37:33.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-03-30T01:37:33.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-03-30T01:37:33.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-03-30T01:37:33.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-03-30T01:37:33.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-03-30T01:37:33.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-03-30T01:37:33.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-03-30T01:37:33.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-03-30T01:37:33.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-03-30T01:37:33.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-03-30T01:37:33.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-03-30T01:37:33.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-03-30T01:37:33.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-03-30T01:37:33.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-03-30T01:37:33.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-30T01:37:33.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-30T01:37:33.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-03-30T01:37:33.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-03-30T01:37:33.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-03-30T01:37:33.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-03-30T01:37:33.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-03-30T01:37:33.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-03-30T01:37:33.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-03-30T01:37:33.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-03-30T01:37:33.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-03-30T01:37:33.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-03-30T01:37:33.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-03-30T01:37:33.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-30T01:37:33.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-03-30T01:37:33.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-03-30T01:37:33.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-03-30T01:37:33.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-03-30T01:37:33.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-03-30T01:37:33.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-03-30T01:37:33.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-03-30T01:37:33.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-30T01:37:33.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-03-30T01:37:33.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-03-30T01:37:33.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-03-30T01:37:33.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-03-30T01:37:33.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-03-30T01:37:33.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-03-30T01:37:33.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-30T01:37:33.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-30T01:37:33.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-30T01:37:33.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-03-30T01:37:33.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-30T01:37:33.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-03-30T01:37:33.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-30T01:37:33.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-30T01:37:33.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-30T01:37:33.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-30T01:37:33.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-30T01:37:33.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-30T01:37:33.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-03-30T01:37:33.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-03-30T01:37:33.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-03-30T01:37:33.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-03-30T01:37:33.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-03-30T01:37:33.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-03-30T01:37:33.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-03-30T01:37:33.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-30T01:37:33.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-30T01:37:33.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-30T01:37:33.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-30T01:37:33.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-30T01:37:33.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-03-30T01:37:33.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-03-30T01:37:33.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-03-30T01:37:33.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-30T01:37:33.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-30T01:37:33.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-30T01:37:33.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-30T01:37:33.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-30T01:37:33.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-30T01:37:33.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-03-30T01:37:33.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-03-30T01:37:33.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-30T01:37:33.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-03-30T01:37:33.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-03-30T01:37:33.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-03-30T01:37:33.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-03-30T01:37:33.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-30T01:37:33.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-30T01:37:33.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-30T01:37:33.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-03-30T01:37:33.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-03-30T01:37:33.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-03-30T01:37:33.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-30T01:37:33.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-03-30T01:37:33.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-03-30T01:37:33.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-03-30T01:37:33.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-30T01:37:33.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-03-30T01:37:33.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-03-30T01:37:33.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-30T01:37:33.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-03-30T01:37:33.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-30T01:37:33.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-03-30T01:37:33.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-03-30T01:37:33.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-03-30T01:37:33.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-03-30T01:37:33.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-03-30T01:37:33.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-03-30T01:37:33.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-03-30T01:37:33.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-03-30T01:37:33.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-03-30T01:37:33.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-03-30T01:37:33.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-03-30T01:37:33.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-03-30T01:37:33.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-03-30T01:37:33.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-03-30T01:37:33.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-03-30T01:37:33.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-03-30T01:37:33.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-30T01:37:33.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-03-30T01:37:33.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-03-30T01:37:33.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-30T01:37:33.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-03-30T01:37:33.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-03-30T01:37:33.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-03-30T01:37:33.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-03-30T01:37:33.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-03-30T01:37:33.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-03-30T01:37:33.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-03-30T01:37:33.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-03-30T01:37:33.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-03-30T01:37:33.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-03-30T01:37:33.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-03-30T01:37:33.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-30T01:37:33.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-30T01:37:33.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-03-30T01:37:33.708 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-03-30T01:37:33.708 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-03-30T01:37:33.708 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-03-30T01:37:33.708 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-03-30T01:37:33.708 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-03-30T01:37:33.708 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-03-30T01:37:33.708 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-03-30T01:37:33.708 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-30T01:37:33.708 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-30T01:37:33.709 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-03-30T01:37:33.709 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-03-30T01:37:33.709 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-03-30T01:37:33.709 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-03-30T01:37:33.709 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-03-30T01:37:33.709 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-03-30T01:37:33.709 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-03-30T01:37:33.709 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-03-30T01:37:33.709 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-03-30T01:37:33.709 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-30T01:37:33.710 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-03-30T01:37:33.710 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-30T01:37:33.710 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-30T01:37:33.710 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-30T01:37:33.710 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-30T01:37:33.710 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-30T01:37:33.710 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-30T01:37:33.710 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-30T01:37:33.710 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-30T01:37:33.711 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-30T01:37:33.711 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-03-30T01:37:33.711 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-03-30T01:37:33.711 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-03-30T01:37:33.711 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-30T01:37:33.711 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-03-30T01:37:33.712 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-03-30T01:37:33.712 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-03-30T01:37:33.712 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-03-30T01:37:33.712 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-03-30T01:37:33.712 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-30T01:37:33.712 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-03-30T01:37:33.713 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-03-30T01:37:33.713 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-03-30T01:37:33.713 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-03-30T01:37:33.713 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-03-30T01:37:33.713 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-03-30T01:37:33.713 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-03-30T01:37:33.714 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-03-30T01:37:33.714 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-03-30T01:37:33.714 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-03-30T01:37:33.714 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-03-30T01:37:33.714 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-03-30T01:37:33.714 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-03-30T01:37:33.715 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-03-30T01:37:33.715 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-03-30T01:37:33.715 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-03-30T01:37:33.715 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-03-30T01:37:33.716 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-03-30T01:37:33.716 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-03-30T01:37:33.716 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-30T01:37:33.716 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-03-30T01:37:33.716 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-03-30T01:37:33.716 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-03-30T01:37:33.717 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-03-30T01:37:33.717 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-03-30T01:37:33.717 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-03-30T01:37:33.717 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-03-30T01:37:33.717 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-03-30T01:37:33.717 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-03-30T01:37:33.717 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-03-30T01:37:33.718 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-03-30T01:37:33.718 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-03-30T01:37:33.718 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-03-30T01:37:33.718 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-03-30T01:37:33.718 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-03-30T01:37:33.719 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-03-30T01:37:33.719 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-03-30T01:37:33.719 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-03-30T01:37:33.719 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-03-30T01:37:33.719 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-30T01:37:33.719 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-03-30T01:37:33.720 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-03-30T01:37:33.720 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-30T01:37:33.720 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-03-30T01:37:33.720 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-03-30T01:37:33.720 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-03-30T01:37:33.720 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-03-30T01:37:33.720 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-03-30T01:37:33.720 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-03-30T01:37:33.721 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-03-30T01:37:33.721 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-03-30T01:37:33.721 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-03-30T01:37:33.721 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-03-30T01:37:33.721 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-03-30T01:37:33.721 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-03-30T01:37:33.721 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-03-30T01:37:33.721 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-03-30T01:37:33.721 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-30T01:37:33.721 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-03-30T01:37:33.721 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-03-30T01:37:33.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-03-30T01:37:33.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-03-30T01:37:33.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-03-30T01:37:33.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-03-30T01:37:33.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-03-30T01:37:33.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-03-30T01:37:33.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-03-30T01:37:33.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-03-30T01:37:33.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-03-30T01:37:33.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-03-30T01:37:33.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-03-30T01:37:33.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-03-30T01:37:33.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-03-30T01:37:33.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-03-30T01:37:33.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-03-30T01:37:33.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-03-30T01:37:33.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-03-30T01:37:33.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-03-30T01:37:33.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-03-30T01:37:33.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-03-30T01:37:33.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-03-30T01:37:33.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-03-30T01:37:33.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-03-30T01:37:33.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-03-30T01:37:33.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-03-30T01:37:33.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-03-30T01:37:33.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-03-30T01:37:33.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-03-30T01:37:33.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-03-30T01:37:33.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-03-30T01:37:33.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-03-30T01:37:33.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-03-30T01:37:33.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-03-30T01:37:33.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-03-30T01:37:33.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-03-30T01:37:33.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-03-30T01:37:33.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-03-30T01:37:33.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-03-30T01:37:33.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-03-30T01:37:33.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-03-30T01:37:33.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-03-30T01:37:33.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-03-30T01:37:33.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-03-30T01:37:33.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-03-30T01:37:33.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-03-30T01:37:33.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-03-30T01:37:33.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-30T01:37:33.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-30T01:37:33.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-30T01:37:33.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-30T01:37:33.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-30T01:37:33.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-30T01:37:33.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-30T01:37:33.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-30T01:37:33.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-30T01:37:33.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-30T01:37:33.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-30T01:37:33.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-30T01:37:33.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-03-30T01:37:33.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-03-30T01:37:33.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-03-30T01:37:33.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-30T01:37:33.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-03-30T01:37:33.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-03-30T01:37:33.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-03-30T01:37:33.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-03-30T01:37:33.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-03-30T01:37:33.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-03-30T01:37:33.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-03-30T01:37:33.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-03-30T01:37:33.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-03-30T01:37:33.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-03-30T01:37:33.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-03-30T01:37:33.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-03-30T01:37:33.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-03-30T01:37:33.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-03-30T01:37:33.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-03-30T01:37:33.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-03-30T01:37:33.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-03-30T01:37:33.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-03-30T01:37:33.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-03-30T01:37:33.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-03-30T01:37:33.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-03-30T01:37:33.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-03-30T01:37:33.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-03-30T01:37:33.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-03-30T01:37:33.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-03-30T01:37:33.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-03-30T01:37:33.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-03-30T01:37:33.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-30T01:37:33.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-30T01:37:33.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-03-30T01:37:33.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-30T01:37:33.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-30T01:37:33.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-30T01:37:33.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-30T01:37:33.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-30T01:37:33.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-30T01:37:33.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-30T01:37:33.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-30T01:37:33.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-30T01:37:33.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-30T01:37:33.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-30T01:37:33.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-30T01:37:33.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-30T01:37:33.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-30T01:37:33.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-30T01:37:33.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-30T01:37:33.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-30T01:37:33.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-30T01:37:33.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-30T01:37:33.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-30T01:37:33.730 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-30T01:37:33.730 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-30T01:37:33.730 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-30T01:37:33.730 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-03-30T01:37:33.730 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-03-30T01:37:33.730 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-30T01:37:33.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-03-30T01:37:33.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-03-30T01:37:33.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-03-30T01:37:33.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-03-30T01:37:33.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-30T01:37:33.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-03-30T01:37:33.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-30T01:37:33.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-30T01:37:33.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-30T01:37:33.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-30T01:37:33.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-30T01:37:33.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-03-30T01:37:33.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-03-30T01:37:33.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-30T01:37:33.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-03-30T01:37:33.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-30T01:37:33.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-03-30T01:37:33.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-30T01:37:33.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-03-30T01:37:33.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-30T01:37:33.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-03-30T01:37:33.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-03-30T01:37:33.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-30T01:37:33.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-03-30T01:37:33.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-30T01:37:33.733 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-03-30T01:37:33.733 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-30T01:37:33.733 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-03-30T01:37:33.733 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-30T01:37:33.733 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-03-30T01:37:33.733 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-30T01:37:33.733 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-03-30T01:37:33.733 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-03-30T01:37:33.733 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-30T01:37:33.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-30T01:37:33.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-03-30T01:37:33.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-03-30T01:37:33.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-03-30T01:37:33.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-30T01:37:33.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-03-30T01:37:33.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-03-30T01:37:33.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-03-30T01:37:33.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-03-30T01:37:33.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-30T01:37:33.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-03-30T01:37:33.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-30T01:37:33.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-30T01:37:33.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-30T01:37:33.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-03-30T01:37:33.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-30T01:37:33.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-03-30T01:37:33.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-03-30T01:37:33.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-03-30T01:37:33.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-30T01:37:33.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-03-30T01:37:33.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-03-30T01:37:33.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-03-30T01:37:33.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-03-30T01:37:33.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-03-30T01:37:33.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-03-30T01:37:33.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-03-30T01:37:33.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-03-30T01:37:33.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-30T01:37:33.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-30T01:37:33.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-30T01:37:33.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-30T01:37:33.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-30T01:37:33.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-30T01:37:33.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-30T01:37:33.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-30T01:37:33.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-30T01:37:33.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-03-30T01:37:33.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-03-30T01:37:33.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-03-30T01:37:33.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-03-30T01:37:33.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-03-30T01:37:33.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-03-30T01:37:33.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-03-30T01:37:33.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-03-30T01:37:33.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-03-30T01:37:33.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-03-30T01:37:33.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-03-30T01:37:33.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-03-30T01:37:33.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-03-30T01:37:33.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-03-30T01:37:33.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-03-30T01:37:33.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-03-30T01:37:33.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-03-30T01:37:33.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-03-30T01:37:33.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-03-30T01:37:33.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-30T01:37:33.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-03-30T01:37:33.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-03-30T01:37:33.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-03-30T01:37:33.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-03-30T01:37:33.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-03-30T01:37:33.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-03-30T01:37:33.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-03-30T01:37:33.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-03-30T01:37:33.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-03-30T01:37:33.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-03-30T01:37:33.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-03-30T01:37:33.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-03-30T01:37:33.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-03-30T01:37:33.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-03-30T01:37:33.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-03-30T01:37:33.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-03-30T01:37:33.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-03-30T01:37:33.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-03-30T01:37:33.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-03-30T01:37:33.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-03-30T01:37:33.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-03-30T01:37:33.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-03-30T01:37:33.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-03-30T01:37:33.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-30T01:37:33.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-03-30T01:37:33.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-03-30T01:37:33.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-03-30T01:37:33.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-03-30T01:37:33.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-03-30T01:37:33.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-03-30T01:37:33.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-03-30T01:37:33.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-30T01:37:33.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-03-30T01:37:33.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-03-30T01:37:33.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-03-30T01:37:33.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-03-30T01:37:33.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-03-30T01:37:33.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-03-30T01:37:33.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-30T01:37:33.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-30T01:37:33.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-03-30T01:37:33.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-03-30T01:37:33.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-03-30T01:37:33.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-03-30T01:37:33.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-03-30T01:37:33.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-30T01:37:33.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-03-30T01:37:33.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-30T01:37:33.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-30T01:37:33.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-30T01:37:33.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-03-30T01:37:33.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-03-30T01:37:33.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-03-30T01:37:33.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-03-30T01:37:33.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-03-30T01:37:33.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-30T01:37:33.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-03-30T01:37:33.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-03-30T01:37:33.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-03-30T01:37:33.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-03-30T01:37:33.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-03-30T01:37:33.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-30T01:37:33.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-30T01:37:33.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-30T01:37:33.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-03-30T01:37:33.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-30T01:37:33.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-03-30T01:37:33.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-03-30T01:37:33.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-03-30T01:37:33.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-03-30T01:37:33.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-30T01:37:33.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-30T01:37:33.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-30T01:37:33.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-30T01:37:33.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-03-30T01:37:33.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-30T01:37:33.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-30T01:37:33.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-30T01:37:33.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-30T01:37:33.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-03-30T01:37:33.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-30T01:37:33.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-03-30T01:37:33.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-30T01:37:33.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-03-30T01:37:33.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-30T01:37:33.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-03-30T01:37:33.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-30T01:37:33.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-03-30T01:37:33.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-30T01:37:33.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-30T01:37:33.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-30T01:37:33.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-03-30T01:37:33.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-03-30T01:37:33.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-30T01:37:33.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-30T01:37:33.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-30T01:37:33.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-30T01:37:33.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-30T01:37:33.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-03-30T01:37:33.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-30T01:37:33.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-30T01:37:33.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-03-30T01:37:33.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-30T01:37:33.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-30T01:37:33.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-30T01:37:33.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-30T01:37:33.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-30T01:37:33.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-03-30T01:37:33.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-30T01:37:33.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-30T01:37:33.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-03-30T01:37:33.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-03-30T01:37:33.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-30T01:37:33.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-03-30T01:37:33.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-30T01:37:33.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-30T01:37:33.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-30T01:37:33.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-30T01:37:33.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-30T01:37:33.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-30T01:37:33.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-30T01:37:33.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-30T01:37:33.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-30T01:37:33.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-30T01:37:33.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-03-30T01:37:33.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-03-30T01:37:33.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-30T01:37:33.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-03-30T01:37:33.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-03-30T01:37:33.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-30T01:37:33.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-30T01:37:33.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-30T01:37:33.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-30T01:37:33.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-30T01:37:33.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-30T01:37:33.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-03-30T01:37:33.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-30T01:37:33.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-30T01:37:33.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-03-30T01:37:33.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-03-30T01:37:33.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-03-30T01:37:33.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-30T01:37:33.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-03-30T01:37:33.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-03-30T01:37:33.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-03-30T01:37:33.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-30T01:37:33.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-03-30T01:37:33.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-30T01:37:33.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-03-30T01:37:33.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-30T01:37:33.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-03-30T01:37:33.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-30T01:37:33.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-03-30T01:37:33.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-30T01:37:33.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-03-30T01:37:33.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-30T01:37:33.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-03-30T01:37:33.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-30T01:37:33.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-03-30T01:37:33.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-30T01:37:33.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-30T01:37:33.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-30T01:37:33.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-30T01:37:33.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-30T01:37:33.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-03-30T01:37:33.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-03-30T01:37:33.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-30T01:37:33.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-30T01:37:33.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-30T01:37:33.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-03-30T01:37:33.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-30T01:37:33.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-30T01:37:33.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-30T01:37:33.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-30T01:37:33.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-30T01:37:33.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-30T01:37:33.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-03-30T01:37:33.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-30T01:37:33.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-03-30T01:37:33.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-30T01:37:33.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-30T01:37:33.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-03-30T01:37:33.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-30T01:37:33.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-30T01:37:33.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-03-30T01:37:33.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-30T01:37:33.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-03-30T01:37:33.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-30T01:37:33.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-03-30T01:37:33.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-30T01:37:33.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-30T01:37:33.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-03-30T01:37:33.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-30T01:37:33.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-30T01:37:33.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-30T01:37:33.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-30T01:37:33.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-30T01:37:33.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-03-30T01:37:33.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-30T01:37:33.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-03-30T01:37:33.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-30T01:37:33.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-30T01:37:33.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-30T01:37:33.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-30T01:37:33.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-03-30T01:37:33.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-30T01:37:33.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-03-30T01:37:33.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-30T01:37:33.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-03-30T01:37:33.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-30T01:37:33.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-03-30T01:37:33.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-30T01:37:33.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-30T01:37:33.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-03-30T01:37:33.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-30T01:37:33.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-30T01:37:33.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-30T01:37:33.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-30T01:37:33.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-03-30T01:37:33.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-30T01:37:33.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-30T01:37:33.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-30T01:37:33.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-03-30T01:37:33.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-30T01:37:33.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-30T01:37:33.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-30T01:37:33.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-30T01:37:33.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-03-30T01:37:33.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-30T01:37:33.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-03-30T01:37:33.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-30T01:37:33.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-03-30T01:37:33.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-30T01:37:33.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-30T01:37:33.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-03-30T01:37:33.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-30T01:37:33.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-30T01:37:33.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-03-30T01:37:33.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-30T01:37:33.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-03-30T01:37:33.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-03-30T01:37:33.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-30T01:37:33.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-03-30T01:37:33.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-30T01:37:33.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-03-30T01:37:33.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-03-30T01:37:33.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-30T01:37:33.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-03-30T01:37:33.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-03-30T01:37:33.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-03-30T01:37:33.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-03-30T01:37:33.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-30T01:37:33.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-30T01:37:33.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-30T01:37:33.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-03-30T01:37:33.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-03-30T01:37:33.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-03-30T01:37:33.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-03-30T01:37:33.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-03-30T01:37:33.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-30T01:37:33.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-30T01:37:33.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-03-30T01:37:33.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-03-30T01:37:33.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-30T01:37:33.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-30T01:37:33.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-30T01:37:33.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-03-30T01:37:33.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-03-30T01:37:33.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-03-30T01:37:33.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-03-30T01:37:33.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-03-30T01:37:33.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-03-30T01:37:33.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-03-30T01:37:33.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-03-30T01:37:33.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-03-30T01:37:33.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-03-30T01:37:33.757 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-03-30T01:37:33.757 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-03-30T01:37:33.757 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-03-30T01:37:33.757 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-03-30T01:37:33.757 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-03-30T01:37:33.757 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-03-30T01:37:33.757 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-03-30T01:37:33.758 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-03-30T01:37:33.758 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-30T01:37:33.758 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-03-30T01:37:33.758 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-30T01:37:33.758 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-30T01:37:33.758 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-30T01:37:33.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-30T01:37:33.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-03-30T01:37:33.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-03-30T01:37:33.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-03-30T01:37:33.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-03-30T01:37:33.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-03-30T01:37:33.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-03-30T01:37:33.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-03-30T01:37:33.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-03-30T01:37:33.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-03-30T01:37:33.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-03-30T01:37:33.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-30T01:37:33.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-30T01:37:33.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-30T01:37:33.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-03-30T01:37:33.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-30T01:37:33.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-03-30T01:37:33.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-03-30T01:37:33.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-03-30T01:37:33.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-03-30T01:37:33.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-30T01:37:33.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-03-30T01:37:33.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-03-30T01:37:33.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-03-30T01:37:33.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-30T01:37:33.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-03-30T01:37:33.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-03-30T01:37:33.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-03-30T01:37:33.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-03-30T01:37:33.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-03-30T01:37:33.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-03-30T01:37:33.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-03-30T01:37:33.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-03-30T01:37:33.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-03-30T01:37:33.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-03-30T01:37:33.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-03-30T01:37:33.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-03-30T01:37:33.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-03-30T01:37:33.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-03-30T01:37:33.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-30T01:37:33.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-03-30T01:37:33.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-30T01:37:33.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-03-30T01:37:33.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-03-30T01:37:33.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-03-30T01:37:33.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-03-30T01:37:33.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-30T01:37:33.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-03-30T01:37:33.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-03-30T01:37:33.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-30T01:37:33.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-03-30T01:37:33.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-03-30T01:37:33.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-30T01:37:33.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-03-30T01:37:33.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-30T01:37:33.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-30T01:37:33.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-30T01:37:33.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-30T01:37:33.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-30T01:37:33.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-30T01:37:33.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-30T01:37:33.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-30T01:37:33.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-30T01:37:33.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-03-30T01:37:33.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-03-30T01:37:33.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-30T01:37:33.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-03-30T01:37:33.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-30T01:37:33.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-30T01:37:33.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-30T01:37:33.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-30T01:37:33.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-30T01:37:33.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-30T01:37:33.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-30T01:37:33.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-30T01:37:33.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-30T01:37:33.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-03-30T01:37:33.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-03-30T01:37:33.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-30T01:37:33.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-30T01:37:33.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-03-30T01:37:33.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-03-30T01:37:33.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-30T01:37:33.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-30T01:37:33.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-03-30T01:37:33.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-03-30T01:37:33.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-03-30T01:37:33.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-03-30T01:37:33.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-03-30T01:37:33.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-03-30T01:37:33.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-30T01:37:33.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-30T01:37:33.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-30T01:37:33.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-30T01:37:33.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-30T01:37:33.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-30T01:37:33.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-30T01:37:33.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-30T01:37:33.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-30T01:37:33.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-30T01:37:33.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-03-30T01:37:33.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-30T01:37:33.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-30T01:37:33.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-30T01:37:33.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-30T01:37:33.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-30T01:37:33.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-30T01:37:33.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-03-30T01:37:33.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-30T01:37:33.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-30T01:37:33.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-30T01:37:33.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-30T01:37:33.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-30T01:37:33.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-30T01:37:33.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-30T01:37:33.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-30T01:37:33.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-30T01:37:33.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-30T01:37:33.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-30T01:37:33.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-30T01:37:33.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-03-30T01:37:33.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-03-30T01:37:33.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-03-30T01:37:33.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-03-30T01:37:33.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-03-30T01:37:33.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-03-30T01:37:33.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-03-30T01:37:33.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-03-30T01:37:33.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-30T01:37:33.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-03-30T01:37:33.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-03-30T01:37:33.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-30T01:37:33.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-30T01:37:33.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-03-30T01:37:33.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-03-30T01:37:33.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-30T01:37:33.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-03-30T01:37:33.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-03-30T01:37:33.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-30T01:37:33.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-03-30T01:37:33.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-03-30T01:37:33.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-03-30T01:37:33.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-30T01:37:33.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-03-30T01:37:33.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-30T01:37:33.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-03-30T01:37:33.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-03-30T01:37:33.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-30T01:37:33.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-03-30T01:37:33.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-30T01:37:33.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-30T01:37:33.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-30T01:37:33.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-30T01:37:33.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-30T01:37:33.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-03-30T01:37:33.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-03-30T01:37:33.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-30T01:37:33.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-30T01:37:33.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-30T01:37:33.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-30T01:37:33.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-03-30T01:37:33.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-03-30T01:37:33.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-30T01:37:33.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-03-30T01:37:33.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-03-30T01:37:33.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-30T01:37:33.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-30T01:37:33.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-03-30T01:37:33.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-03-30T01:37:33.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-03-30T01:37:33.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-03-30T01:37:33.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-03-30T01:37:33.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-03-30T01:37:33.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-03-30T01:37:33.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-03-30T01:37:33.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-03-30T01:37:33.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-03-30T01:37:33.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-30T01:37:33.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-30T01:37:33.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-03-30T01:37:33.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-03-30T01:37:33.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-03-30T01:37:33.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-30T01:37:33.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-03-30T01:37:33.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-03-30T01:37:33.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-03-30T01:37:33.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-30T01:37:33.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-03-30T01:37:33.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-03-30T01:37:33.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-30T01:37:33.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-30T01:37:33.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-30T01:37:33.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-03-30T01:37:33.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-30T01:37:33.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-03-30T01:37:33.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-30T01:37:33.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-03-30T01:37:33.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-03-30T01:37:33.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-30T01:37:33.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-03-30T01:37:33.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-03-30T01:37:33.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-03-30T01:37:33.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-30T01:37:33.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-30T01:37:33.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-03-30T01:37:33.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-30T01:37:33.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-03-30T01:37:33.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-03-30T01:37:33.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-30T01:37:33.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-30T01:37:33.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-30T01:37:33.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-30T01:37:33.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-30T01:37:33.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-03-30T01:37:33.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-03-30T01:37:33.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-03-30T01:37:33.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-03-30T01:37:33.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-30T01:37:33.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-03-30T01:37:33.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-30T01:37:33.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-03-30T01:37:33.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-03-30T01:37:33.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-03-30T01:37:33.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-03-30T01:37:33.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-03-30T01:37:33.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-30T01:37:33.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-03-30T01:37:33.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-30T01:37:33.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-03-30T01:37:33.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-03-30T01:37:33.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-03-30T01:37:33.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-03-30T01:37:33.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-03-30T01:37:33.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-03-30T01:37:33.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-30T01:37:33.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-03-30T01:37:33.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-03-30T01:37:33.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-03-30T01:37:33.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-30T01:37:33.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-30T01:37:33.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-30T01:37:33.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-30T01:37:33.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-30T01:37:33.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-30T01:37:33.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-30T01:37:33.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-30T01:37:33.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-30T01:37:33.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-30T01:37:33.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-30T01:37:33.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-30T01:37:33.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-30T01:37:33.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-30T01:37:33.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-30T01:37:33.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-30T01:37:33.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-30T01:37:33.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-30T01:37:33.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-03-30T01:37:33.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-03-30T01:37:33.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-30T01:37:33.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-03-30T01:37:33.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-03-30T01:37:33.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-03-30T01:37:33.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-03-30T01:37:33.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-03-30T01:37:33.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-30T01:37:33.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-03-30T01:37:33.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-03-30T01:37:33.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-30T01:37:33.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-03-30T01:37:33.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-03-30T01:37:33.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-30T01:37:33.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-03-30T01:37:33.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-30T01:37:33.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-03-30T01:37:33.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-03-30T01:37:33.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-03-30T01:37:33.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-03-30T01:37:33.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-03-30T01:37:33.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-03-30T01:37:33.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-03-30T01:37:33.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-03-30T01:37:33.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-03-30T01:37:33.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-30T01:37:33.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-03-30T01:37:33.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-03-30T01:37:33.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-03-30T01:37:33.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-30T01:37:33.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-03-30T01:37:33.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-03-30T01:37:33.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-03-30T01:37:33.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-03-30T01:37:33.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-03-30T01:37:33.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-03-30T01:37:33.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-03-30T01:37:33.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-03-30T01:37:33.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-03-30T01:37:33.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-03-30T01:37:33.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-03-30T01:37:33.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-30T01:37:33.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-03-30T01:37:33.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-03-30T01:37:33.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-03-30T01:37:33.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-30T01:37:33.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-30T01:37:33.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-03-30T01:37:33.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-03-30T01:37:33.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-30T01:37:33.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-03-30T01:37:33.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-03-30T01:37:33.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-03-30T01:37:33.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-03-30T01:37:33.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-03-30T01:37:33.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-03-30T01:37:33.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-03-30T01:37:33.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-30T01:37:33.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-03-30T01:37:33.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-03-30T01:37:33.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-03-30T01:37:33.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-30T01:37:33.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-30T01:37:33.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-03-30T01:37:33.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-30T01:37:33.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-30T01:37:33.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-30T01:37:33.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-03-30T01:37:33.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-03-30T01:37:33.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-03-30T01:37:33.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-03-30T01:37:33.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-30T01:37:33.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-03-30T01:37:33.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-30T01:37:33.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-30T01:37:33.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-30T01:37:33.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-03-30T01:37:33.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-03-30T01:37:33.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-03-30T01:37:33.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-03-30T01:37:33.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-03-30T01:37:33.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-03-30T01:37:33.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-03-30T01:37:33.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-03-30T01:37:33.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-03-30T01:37:33.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-03-30T01:37:33.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-03-30T01:37:33.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-03-30T01:37:33.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-03-30T01:37:33.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-03-30T01:37:33.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-30T01:37:33.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-03-30T01:37:33.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-03-30T01:37:33.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-30T01:37:33.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-30T01:37:33.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-03-30T01:37:33.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-30T01:37:33.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-03-30T01:37:33.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-03-30T01:37:33.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-30T01:37:33.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-03-30T01:37:33.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-03-30T01:37:33.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-30T01:37:33.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-30T01:37:33.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-30T01:37:33.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-30T01:37:33.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-30T01:37:33.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-30T01:37:33.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-30T01:37:33.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-03-30T01:37:33.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-30T01:37:33.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-30T01:37:33.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-30T01:37:33.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-30T01:37:33.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-30T01:37:33.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-03-30T01:37:33.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-03-30T01:37:33.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-30T01:37:33.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-30T01:37:33.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-30T01:37:33.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-03-30T01:37:33.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-03-30T01:37:33.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-30T01:37:33.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-30T01:37:33.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-03-30T01:37:33.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-30T01:37:33.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-03-30T01:37:33.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-03-30T01:37:33.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-30T01:37:33.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-03-30T01:37:33.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-03-30T01:37:33.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-03-30T01:37:33.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-03-30T01:37:33.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-03-30T01:37:33.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-03-30T01:37:33.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-30T01:37:33.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-03-30T01:37:33.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-03-30T01:37:33.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-03-30T01:37:33.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-03-30T01:37:33.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-03-30T01:37:33.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-30T01:37:33.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-30T01:37:33.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-03-30T01:37:33.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-03-30T01:37:33.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-03-30T01:37:33.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-03-30T01:37:33.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-03-30T01:37:33.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-03-30T01:37:33.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-30T01:37:33.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-30T01:37:33.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-30T01:37:33.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-30T01:37:33.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-30T01:37:33.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-30T01:37:33.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-30T01:37:33.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-30T01:37:33.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-30T01:37:33.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-30T01:37:33.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-30T01:37:33.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-03-30T01:37:33.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-03-30T01:37:33.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-30T01:37:33.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-30T01:37:33.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-30T01:37:33.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-03-30T01:37:33.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-03-30T01:37:33.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-30T01:37:33.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-30T01:37:33.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-03-30T01:37:33.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-03-30T01:37:33.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-30T01:37:33.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-30T01:37:33.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-03-30T01:37:33.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-03-30T01:37:33.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-03-30T01:37:33.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-30T01:37:33.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-30T01:37:33.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-30T01:37:33.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-30T01:37:33.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-03-30T01:37:33.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-30T01:37:33.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-03-30T01:37:33.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-30T01:37:33.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-30T01:37:33.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-30T01:37:33.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-03-30T01:37:33.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-03-30T01:37:33.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-03-30T01:37:33.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-30T01:37:33.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-03-30T01:37:33.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-03-30T01:37:33.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-03-30T01:37:33.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-03-30T01:37:33.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-30T01:37:33.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-03-30T01:37:33.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-03-30T01:37:33.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-30T01:37:33.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-03-30T01:37:33.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-03-30T01:37:33.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-03-30T01:37:33.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-03-30T01:37:33.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-03-30T01:37:33.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-03-30T01:37:33.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-03-30T01:37:33.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-03-30T01:37:33.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-03-30T01:37:33.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-03-30T01:37:33.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-03-30T01:37:33.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-03-30T01:37:33.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-03-30T01:37:33.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-03-30T01:37:33.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-03-30T01:37:33.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-03-30T01:37:33.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-03-30T01:37:33.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-03-30T01:37:33.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-03-30T01:37:33.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-03-30T01:37:33.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-03-30T01:37:33.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-30T01:37:33.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-03-30T01:37:33.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-03-30T01:37:33.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-03-30T01:37:33.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-03-30T01:37:33.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-03-30T01:37:33.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-03-30T01:37:33.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-03-30T01:37:33.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-03-30T01:37:33.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-03-30T01:37:33.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-03-30T01:37:33.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-03-30T01:37:33.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-03-30T01:37:33.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-03-30T01:37:33.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-03-30T01:37:33.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-03-30T01:37:33.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-03-30T01:37:33.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-03-30T01:37:33.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-03-30T01:37:33.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-03-30T01:37:33.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-03-30T01:37:33.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-03-30T01:37:33.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-03-30T01:37:33.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-03-30T01:37:33.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-03-30T01:37:33.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-03-30T01:37:33.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-03-30T01:37:33.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-03-30T01:37:33.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-30T01:37:33.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-03-30T01:37:33.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-30T01:37:33.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-03-30T01:37:33.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-30T01:37:33.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-03-30T01:37:33.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-03-30T01:37:33.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-03-30T01:37:33.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-03-30T01:37:33.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-03-30T01:37:33.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-03-30T01:37:33.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-03-30T01:37:33.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-03-30T01:37:33.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-03-30T01:37:33.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-03-30T01:37:33.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-03-30T01:37:33.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-03-30T01:37:33.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-03-30T01:37:33.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-03-30T01:37:33.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-03-30T01:37:33.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-03-30T01:37:33.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-03-30T01:37:33.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-03-30T01:37:33.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-03-30T01:37:33.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-03-30T01:37:33.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-03-30T01:37:33.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-03-30T01:37:33.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-03-30T01:37:33.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-03-30T01:37:33.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-03-30T01:37:33.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-03-30T01:37:33.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-03-30T01:37:33.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-03-30T01:37:33.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-03-30T01:37:33.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-03-30T01:37:33.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-03-30T01:37:33.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-03-30T01:37:33.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-03-30T01:37:33.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-03-30T01:37:33.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-03-30T01:37:33.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-03-30T01:37:33.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-03-30T01:37:33.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-03-30T01:37:33.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-03-30T01:37:33.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-03-30T01:37:33.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-03-30T01:37:33.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-03-30T01:37:33.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-03-30T01:37:33.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-03-30T01:37:33.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-03-30T01:37:33.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-03-30T01:37:33.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-03-30T01:37:33.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-03-30T01:37:33.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-03-30T01:37:33.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-03-30T01:37:33.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-03-30T01:37:33.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-03-30T01:37:33.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-03-30T01:37:33.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-03-30T01:37:33.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-03-30T01:37:33.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-03-30T01:37:33.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-03-30T01:37:33.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-03-30T01:37:33.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-03-30T01:37:33.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-30T01:37:33.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-03-30T01:37:33.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-03-30T01:37:33.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-03-30T01:37:33.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-30T01:37:33.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-03-30T01:37:33.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-30T01:37:33.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-03-30T01:37:33.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-30T01:37:33.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-03-30T01:37:33.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-30T01:37:33.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-30T01:37:33.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-30T01:37:33.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-03-30T01:37:33.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-03-30T01:37:33.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-03-30T01:37:33.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-03-30T01:37:33.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-03-30T01:37:33.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-03-30T01:37:33.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-03-30T01:37:33.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-03-30T01:37:33.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-03-30T01:37:33.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-03-30T01:37:33.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-03-30T01:37:33.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-03-30T01:37:33.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-03-30T01:37:33.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-03-30T01:37:33.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-03-30T01:37:33.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-03-30T01:37:33.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-03-30T01:37:33.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-03-30T01:37:33.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-03-30T01:37:33.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-03-30T01:37:33.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-03-30T01:37:33.800 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-03-30T01:37:33.800 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-03-30T01:37:33.800 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-03-30T01:37:33.800 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-03-30T01:37:33.800 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-03-30T01:37:33.800 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-03-30T01:37:33.800 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-03-30T01:37:33.800 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-03-30T01:37:33.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-30T01:37:33.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-03-30T01:37:33.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-03-30T01:37:33.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-03-30T01:37:33.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-03-30T01:37:33.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-03-30T01:37:33.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-03-30T01:37:33.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-03-30T01:37:33.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-03-30T01:37:33.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-03-30T01:37:33.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-03-30T01:37:33.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-03-30T01:37:33.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-03-30T01:37:33.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-03-30T01:37:33.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-03-30T01:37:33.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-03-30T01:37:33.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-03-30T01:37:33.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-03-30T01:37:33.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-30T01:37:33.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-03-30T01:37:33.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-03-30T01:37:33.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-03-30T01:37:33.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-03-30T01:37:33.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-03-30T01:37:33.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-03-30T01:37:33.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-03-30T01:37:33.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-03-30T01:37:33.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-03-30T01:37:33.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-03-30T01:37:33.803 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-03-30T01:37:33.803 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-03-30T01:37:33.803 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-03-30T01:37:33.803 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-30T01:37:33.803 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-03-30T01:37:33.803 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-03-30T01:37:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-03-30T01:37:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-03-30T01:37:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-03-30T01:37:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-03-30T01:37:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-03-30T01:37:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-03-30T01:37:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-03-30T01:37:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-03-30T01:37:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-03-30T01:37:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-03-30T01:37:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-03-30T01:37:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-03-30T01:37:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-03-30T01:37:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-03-30T01:37:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-03-30T01:37:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-03-30T01:37:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-03-30T01:37:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-03-30T01:37:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-03-30T01:37:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-03-30T01:37:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-30T01:37:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-30T01:37:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-30T01:37:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-30T01:37:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-30T01:37:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-30T01:37:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-30T01:37:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-30T01:37:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-30T01:37:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-30T01:37:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-30T01:37:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-30T01:37:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-30T01:37:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-30T01:37:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-30T01:37:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-30T01:37:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-30T01:37:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-30T01:37:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-30T01:37:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-30T01:37:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-03-30T01:37:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-30T01:37:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-30T01:37:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-30T01:37:33.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-03-30T01:37:33.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-03-30T01:37:33.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-03-30T01:37:33.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-03-30T01:37:33.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-03-30T01:37:33.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-03-30T01:37:33.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-03-30T01:37:33.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-03-30T01:37:33.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-03-30T01:37:33.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-03-30T01:37:33.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-03-30T01:37:33.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-03-30T01:37:33.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-03-30T01:37:33.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-03-30T01:37:33.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-03-30T01:37:33.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-03-30T01:37:33.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-03-30T01:37:33.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-03-30T01:37:33.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-03-30T01:37:33.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-03-30T01:37:33.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-30T01:37:33.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-03-30T01:37:33.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-30T01:37:33.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-03-30T01:37:33.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-03-30T01:37:33.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-03-30T01:37:33.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-03-30T01:37:33.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-03-30T01:37:33.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-03-30T01:37:33.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-03-30T01:37:33.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-03-30T01:37:33.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-03-30T01:37:33.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-03-30T01:37:33.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-03-30T01:37:33.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-03-30T01:37:33.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-30T01:37:33.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-30T01:37:33.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-30T01:37:33.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-30T01:37:33.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-30T01:37:33.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-30T01:37:33.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-30T01:37:33.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-30T01:37:33.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-30T01:37:33.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-30T01:37:33.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-30T01:37:33.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-30T01:37:33.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-30T01:37:33.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-30T01:37:33.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-30T01:37:33.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-30T01:37:33.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-30T01:37:33.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-30T01:37:33.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-30T01:37:33.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-30T01:37:33.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-30T01:37:33.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-03-30T01:37:33.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-03-30T01:37:33.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-03-30T01:37:33.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-03-30T01:37:33.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-03-30T01:37:33.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-03-30T01:37:33.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-03-30T01:37:33.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-03-30T01:37:33.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-03-30T01:37:33.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-03-30T01:37:33.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-03-30T01:37:33.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-03-30T01:37:33.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-03-30T01:37:33.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-03-30T01:37:33.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-03-30T01:37:33.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-03-30T01:37:33.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-30T01:37:33.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-03-30T01:37:33.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-03-30T01:37:33.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-03-30T01:37:33.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-03-30T01:37:33.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-03-30T01:37:33.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-30T01:37:33.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-03-30T01:37:33.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-03-30T01:37:33.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-03-30T01:37:33.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-30T01:37:33.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-30T01:37:33.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-30T01:37:33.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-30T01:37:33.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-30T01:37:33.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-30T01:37:33.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-30T01:37:33.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-30T01:37:33.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-30T01:37:33.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-30T01:37:33.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-30T01:37:33.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-30T01:37:33.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-30T01:37:33.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-30T01:37:33.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-30T01:37:33.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-30T01:37:33.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-30T01:37:33.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-30T01:37:33.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-30T01:37:33.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-30T01:37:33.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-30T01:37:33.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-30T01:37:33.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-30T01:37:33.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-30T01:37:33.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-03-30T01:37:33.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-03-30T01:37:33.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-30T01:37:33.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-03-30T01:37:33.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-03-30T01:37:33.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-03-30T01:37:33.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-03-30T01:37:33.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-30T01:37:33.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-03-30T01:37:33.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-03-30T01:37:33.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-03-30T01:37:33.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-03-30T01:37:33.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-03-30T01:37:33.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-03-30T01:37:33.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-03-30T01:37:33.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-03-30T01:37:33.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-03-30T01:37:33.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-03-30T01:37:33.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-03-30T01:37:33.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-03-30T01:37:33.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-03-30T01:37:33.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-03-30T01:37:33.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-30T01:37:33.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-30T01:37:33.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-30T01:37:33.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-30T01:37:33.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-30T01:37:33.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-30T01:37:33.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-30T01:37:33.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-30T01:37:33.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-30T01:37:33.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-30T01:37:33.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-30T01:37:33.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-30T01:37:33.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-30T01:37:33.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-30T01:37:33.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-30T01:37:33.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-03-30T01:37:33.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-30T01:37:33.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-30T01:37:33.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-30T01:37:33.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-30T01:37:33.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-30T01:37:33.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-30T01:37:33.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-30T01:37:33.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-30T01:37:33.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-30T01:37:33.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-30T01:37:33.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-30T01:37:33.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-30T01:37:33.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-30T01:37:33.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-30T01:37:33.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-03-30T01:37:33.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-03-30T01:37:33.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-30T01:37:33.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-30T01:37:33.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-30T01:37:33.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-30T01:37:33.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-30T01:37:33.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-30T01:37:33.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-30T01:37:33.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-30T01:37:33.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-30T01:37:33.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-30T01:37:33.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-30T01:37:33.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-30T01:37:33.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-30T01:37:33.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-03-30T01:37:33.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-30T01:37:33.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-03-30T01:37:33.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-03-30T01:37:33.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-30T01:37:33.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-30T01:37:33.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-03-30T01:37:33.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-03-30T01:37:33.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-30T01:37:33.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-30T01:37:33.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-03-30T01:37:33.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-03-30T01:37:33.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-30T01:37:33.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-03-30T01:37:33.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-30T01:37:33.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-30T01:37:33.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-03-30T01:37:33.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-03-30T01:37:33.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-03-30T01:37:33.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-30T01:37:33.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-03-30T01:37:33.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-30T01:37:33.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-03-30T01:37:33.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-03-30T01:37:33.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-03-30T01:37:33.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-03-30T01:37:33.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-03-30T01:37:33.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-03-30T01:37:33.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-03-30T01:37:33.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-03-30T01:37:33.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-03-30T01:37:33.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-03-30T01:37:33.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-03-30T01:37:33.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-03-30T01:37:33.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-03-30T01:37:33.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-03-30T01:37:33.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-30T01:37:33.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-30T01:37:33.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-30T01:37:33.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-03-30T01:37:33.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-03-30T01:37:33.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-03-30T01:37:33.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-03-30T01:37:33.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-30T01:37:33.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-03-30T01:37:33.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-03-30T01:37:33.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-30T01:37:33.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-03-30T01:37:33.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-03-30T01:37:33.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-30T01:37:33.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-03-30T01:37:33.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-30T01:37:33.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-03-30T01:37:33.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-30T01:37:33.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-30T01:37:33.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-03-30T01:37:33.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-03-30T01:37:33.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-03-30T01:37:33.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-03-30T01:37:33.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-03-30T01:37:33.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-03-30T01:37:33.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-03-30T01:37:33.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-03-30T01:37:33.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-03-30T01:37:33.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-03-30T01:37:33.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-03-30T01:37:33.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-03-30T01:37:33.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-03-30T01:37:33.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-03-30T01:37:33.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-03-30T01:37:33.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-03-30T01:37:33.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-03-30T01:37:33.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-03-30T01:37:33.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-03-30T01:37:33.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-03-30T01:37:33.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-03-30T01:37:33.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-03-30T01:37:33.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-03-30T01:37:33.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-03-30T01:37:33.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-03-30T01:37:33.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-03-30T01:37:33.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-03-30T01:37:33.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-03-30T01:37:33.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-03-30T01:37:33.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-03-30T01:37:33.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-03-30T01:37:33.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-03-30T01:37:33.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-03-30T01:37:33.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-03-30T01:37:33.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-03-30T01:37:33.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-03-30T01:37:33.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-03-30T01:37:33.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-03-30T01:37:33.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-03-30T01:37:33.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-03-30T01:37:33.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-03-30T01:37:33.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-03-30T01:37:33.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-03-30T01:37:33.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-03-30T01:37:33.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-03-30T01:37:33.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-03-30T01:37:33.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-03-30T01:37:33.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-03-30T01:37:33.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-03-30T01:37:33.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-03-30T01:37:33.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-03-30T01:37:33.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-03-30T01:37:33.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-03-30T01:37:33.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-03-30T01:37:33.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-03-30T01:37:33.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-03-30T01:37:33.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-03-30T01:37:33.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-03-30T01:37:33.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-03-30T01:37:33.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-03-30T01:37:33.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-03-30T01:37:33.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-03-30T01:37:33.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-03-30T01:37:33.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-03-30T01:37:33.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-03-30T01:37:33.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-03-30T01:37:33.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-03-30T01:37:33.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-03-30T01:37:33.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-03-30T01:37:33.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-03-30T01:37:33.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-03-30T01:37:33.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-03-30T01:37:33.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-03-30T01:37:33.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-03-30T01:37:33.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-03-30T01:37:33.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-03-30T01:37:33.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-03-30T01:37:33.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-03-30T01:37:33.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-03-30T01:37:33.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-03-30T01:37:33.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-03-30T01:37:33.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-03-30T01:37:33.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-03-30T01:37:33.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-03-30T01:37:33.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-03-30T01:37:33.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-03-30T01:37:33.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-03-30T01:37:33.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-03-30T01:37:33.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-03-30T01:37:33.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-03-30T01:37:33.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-03-30T01:37:33.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-03-30T01:37:33.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-03-30T01:37:33.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-03-30T01:37:33.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-03-30T01:37:33.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-03-30T01:37:33.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-03-30T01:37:33.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-03-30T01:37:33.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-03-30T01:37:33.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-03-30T01:37:33.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-03-30T01:37:33.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-03-30T01:37:33.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-03-30T01:37:33.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-03-30T01:37:33.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-03-30T01:37:33.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-03-30T01:37:33.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-03-30T01:37:33.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-03-30T01:37:33.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-03-30T01:37:33.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-03-30T01:37:33.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-03-30T01:37:33.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-03-30T01:37:33.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-03-30T01:37:33.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-03-30T01:37:33.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-03-30T01:37:33.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-30T01:37:33.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-30T01:37:33.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-03-30T01:37:33.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-03-30T01:37:33.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-30T01:37:33.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-03-30T01:37:33.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-03-30T01:37:33.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-03-30T01:37:33.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-03-30T01:37:33.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-03-30T01:37:33.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-03-30T01:37:33.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-30T01:37:33.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-30T01:37:33.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-03-30T01:37:33.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-30T01:37:33.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-30T01:37:33.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-03-30T01:37:33.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-30T01:37:33.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-03-30T01:37:33.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-03-30T01:37:33.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-03-30T01:37:33.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-30T01:37:33.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-03-30T01:37:33.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-03-30T01:37:33.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-03-30T01:37:33.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-03-30T01:37:33.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-03-30T01:37:33.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-03-30T01:37:33.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-03-30T01:37:33.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-03-30T01:37:33.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-03-30T01:37:33.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-03-30T01:37:33.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-03-30T01:37:33.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-03-30T01:37:33.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-03-30T01:37:33.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-03-30T01:37:33.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-03-30T01:37:33.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-03-30T01:37:33.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-03-30T01:37:33.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-03-30T01:37:33.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-30T01:37:33.839 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-03-30T01:37:33.839 DEBUG:teuthology.orchestra.run.smithi137:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-30T01:37:33.861 INFO:teuthology.orchestra.run.smithi137.stdout:postinstall scriptlet (using /bin/sh): 2024-03-30T01:37:33.861 INFO:teuthology.orchestra.run.smithi137.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-30T01:37:33.862 INFO:teuthology.orchestra.run.smithi137.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-30T01:37:33.862 INFO:teuthology.orchestra.run.smithi137.stdout:fi 2024-03-30T01:37:33.862 INFO:teuthology.orchestra.run.smithi137.stdout:for file in vmlinuz System.map config; do 2024-03-30T01:37:33.862 INFO:teuthology.orchestra.run.smithi137.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-03-30T01:37:33.862 INFO:teuthology.orchestra.run.smithi137.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-03-30T01:37:33.862 INFO:teuthology.orchestra.run.smithi137.stdout: fi 2024-03-30T01:37:33.862 INFO:teuthology.orchestra.run.smithi137.stdout:done 2024-03-30T01:37:33.862 INFO:teuthology.orchestra.run.smithi137.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-30T01:37:33.862 INFO:teuthology.orchestra.run.smithi137.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-30T01:37:33.862 INFO:teuthology.orchestra.run.smithi137.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-03-30T01:37:33.863 INFO:teuthology.orchestra.run.smithi137.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-30T01:37:33.863 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-03-30T01:37:33.863 INFO:teuthology.orchestra.run.smithi137.stdout:fi 2024-03-30T01:37:33.863 INFO:teuthology.orchestra.run.smithi137.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-30T01:37:33.863 INFO:teuthology.orchestra.run.smithi137.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-30T01:37:33.863 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-03-30T01:37:33.863 INFO:teuthology.orchestra.run.smithi137.stdout:fi 2024-03-30T01:37:33.863 DEBUG:teuthology.orchestra.run.smithi137:> sudo rpm -qi grub2-tools 2024-03-30T01:37:33.935 INFO:teuthology.orchestra.run.smithi137.stdout:Name : grub2-tools 2024-03-30T01:37:33.935 INFO:teuthology.orchestra.run.smithi137.stdout:Epoch : 1 2024-03-30T01:37:33.935 INFO:teuthology.orchestra.run.smithi137.stdout:Version : 2.06 2024-03-30T01:37:33.935 INFO:teuthology.orchestra.run.smithi137.stdout:Release : 68.el9 2024-03-30T01:37:33.935 INFO:teuthology.orchestra.run.smithi137.stdout:Architecture: x86_64 2024-03-30T01:37:33.935 INFO:teuthology.orchestra.run.smithi137.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-30T01:37:33.935 INFO:teuthology.orchestra.run.smithi137.stdout:Group : Unspecified 2024-03-30T01:37:33.935 INFO:teuthology.orchestra.run.smithi137.stdout:Size : 8264254 2024-03-30T01:37:33.935 INFO:teuthology.orchestra.run.smithi137.stdout:License : GPLv3+ 2024-03-30T01:37:33.935 INFO:teuthology.orchestra.run.smithi137.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-30T01:37:33.935 INFO:teuthology.orchestra.run.smithi137.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-30T01:37:33.935 INFO:teuthology.orchestra.run.smithi137.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-30T01:37:33.935 INFO:teuthology.orchestra.run.smithi137.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-30T01:37:33.936 INFO:teuthology.orchestra.run.smithi137.stdout:Packager : builder@centos.org 2024-03-30T01:37:33.936 INFO:teuthology.orchestra.run.smithi137.stdout:Vendor : CentOS 2024-03-30T01:37:33.936 INFO:teuthology.orchestra.run.smithi137.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-30T01:37:33.936 INFO:teuthology.orchestra.run.smithi137.stdout:Summary : Support tools for GRUB. 2024-03-30T01:37:33.936 INFO:teuthology.orchestra.run.smithi137.stdout:Description : 2024-03-30T01:37:33.936 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:37:33.936 INFO:teuthology.orchestra.run.smithi137.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-30T01:37:33.936 INFO:teuthology.orchestra.run.smithi137.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-30T01:37:33.936 INFO:teuthology.orchestra.run.smithi137.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-30T01:37:33.936 INFO:teuthology.orchestra.run.smithi137.stdout:hardware devices. 2024-03-30T01:37:33.936 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:37:33.936 INFO:teuthology.orchestra.run.smithi137.stdout:This subpackage provides tools for support of all platforms. 2024-03-30T01:37:33.937 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-30T01:37:33.937 INFO:teuthology.task.kernel:Updating grub on smithi137 to boot 6.8.0-g1df0c7e8a235 2024-03-30T01:37:33.937 DEBUG:teuthology.orchestra.run.smithi137:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-30T01:37:34.541 INFO:teuthology.orchestra.run.smithi137.stderr:Generating grub configuration file ... 2024-03-30T01:37:34.548 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 16 kB 00:00 2024-03-30T01:37:35.949 INFO:teuthology.orchestra.run.smithi137.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-30T01:37:35.988 INFO:teuthology.orchestra.run.smithi137.stderr:done 2024-03-30T01:37:35.991 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-03-30T01:37:36.005 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.W9G7MICfhH 2024-03-30T01:37:36.006 DEBUG:teuthology.orchestra.run.smithi137:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.W9G7MICfhH 2024-03-30T01:37:36.074 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.W9G7MICfhH 2024-03-30T01:37:36.218 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.W9G7MICfhH is 6KB 2024-03-30T01:37:36.267 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.W9G7MICfhH 2024-03-30T01:37:36.283 DEBUG:teuthology.orchestra.run.smithi137:> sudo /bin/ls /boot/loader/entries || true 2024-03-30T01:37:36.346 INFO:teuthology.orchestra.run.smithi137.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-30T01:37:36.346 INFO:teuthology.orchestra.run.smithi137.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-30T01:37:36.347 INFO:teuthology.orchestra.run.smithi137.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-30T01:37:36.347 INFO:teuthology.orchestra.run.smithi137.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-03-30T01:37:36.348 DEBUG:teuthology.orchestra.run.smithi137:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-03-30T01:37:36.514 DEBUG:teuthology.orchestra.run.smithi137:> sudo shutdown -r now 2024-03-30T01:37:39.882 INFO:teuthology.orchestra.run.smithi133.stdout:Extra Packages for Enterprise Linux 4.0 MB/s | 21 MB 00:05 2024-03-30T01:37:44.890 INFO:teuthology.orchestra.run.smithi133.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-03-30T01:37:47.280 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-03-30T01:37:47.289 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-03-30T01:37:47.289 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-03-30T01:37:47.289 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-03-30T01:37:47.289 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrading: 2024-03-30T01:37:47.289 INFO:teuthology.orchestra.run.smithi133.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-30T01:37:47.289 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:37:47.289 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-03-30T01:37:47.289 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-03-30T01:37:47.290 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrade 1 Package 2024-03-30T01:37:47.290 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:37:47.290 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 375 M 2024-03-30T01:37:47.290 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-03-30T01:37:54.366 INFO:teuthology.orchestra.run.smithi133.stdout:linux-firmware-20240219-143.el9.noarch.rpm 53 MB/s | 375 MB 00:07 2024-03-30T01:37:54.367 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-03-30T01:37:54.367 INFO:teuthology.orchestra.run.smithi133.stdout:Total 53 MB/s | 375 MB 00:07 2024-03-30T01:37:54.367 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-03-30T01:37:54.453 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-03-30T01:37:54.453 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-03-30T01:37:56.930 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-03-30T01:37:56.930 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-03-30T01:38:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-03-30T01:38:03.673 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-30T01:38:03.748 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-30T01:38:04.964 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-30T01:38:04.965 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-30T01:38:05.356 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-30T01:38:05.357 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:38:05.357 INFO:teuthology.orchestra.run.smithi133.stdout:Upgraded: 2024-03-30T01:38:05.357 INFO:teuthology.orchestra.run.smithi133.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-30T01:38:05.357 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:38:05.357 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-03-30T01:38:05.653 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.0... 2024-03-30T01:38:05.654 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-30T01:38:05.874 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-03-30T01:38:05.874 DEBUG:teuthology.orchestra.run.smithi133:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-30T01:38:05.876 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi133.front.sepia.ceph.com to complete... 2024-03-30T01:38:06.517 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-03-30T01:38:06.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-03-30T01:38:06.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T01:38:17.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30 01:38:17 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-30T01:38:17.478 INFO:teuthology.orchestra.run.smithi133.stderr:FINISHED --2024-03-30 01:38:17-- 2024-03-30T01:38:17.478 INFO:teuthology.orchestra.run.smithi133.stderr:Total wall clock time: 12s 2024-03-30T01:38:17.478 INFO:teuthology.orchestra.run.smithi133.stderr:Downloaded: 1 files, 321M in 11s (28.6 MB/s) 2024-03-30T01:38:17.482 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.0... 2024-03-30T01:38:17.483 DEBUG:teuthology.orchestra.run.smithi133:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-30T01:38:19.415 INFO:teuthology.orchestra.run.smithi133.stdout:Verifying... ######################################## 2024-03-30T01:38:19.523 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing... ######################################## 2024-03-30T01:38:19.603 INFO:teuthology.orchestra.run.smithi133.stdout:Updating / installing... 2024-03-30T01:38:24.926 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-03-30T01:38:27.118 INFO:teuthology.orchestra.run.smithi133.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-03-30T01:38:33.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-03-30T01:38:33.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T01:38:36.990 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-03-30T01:38:42.896 INFO:teuthology.orchestra.run.smithi133.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-30T01:38:49.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-03-30T01:38:49.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T01:38:52.158 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-03-30T01:39:05.363 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi133.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-30T01:39:05.364 DEBUG:teuthology.orchestra.run.smithi133:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-30T01:39:05.441 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-03-30T01:39:05.441 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-03-30T01:39:05.441 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-03-30T01:39:05.442 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-03-30T01:39:05.442 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-03-30T01:39:05.442 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-03-30T01:39:05.442 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-03-30T01:39:05.442 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-30T01:39:05.442 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-30T01:39:05.442 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-30T01:39:05.442 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-30T01:39:05.442 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-30T01:39:05.442 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-30T01:39:05.442 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-30T01:39:05.443 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-30T01:39:05.443 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-30T01:39:05.443 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-30T01:39:05.443 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-30T01:39:05.443 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-30T01:39:05.443 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-30T01:39:05.443 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-30T01:39:05.443 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-30T01:39:05.443 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-30T01:39:05.443 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-30T01:39:05.443 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-30T01:39:05.443 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-30T01:39:05.444 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-30T01:39:05.444 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-03-30T01:39:05.444 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-03-30T01:39:05.444 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-03-30T01:39:05.444 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-30T01:39:05.444 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-03-30T01:39:05.444 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-30T01:39:05.444 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-30T01:39:05.444 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-03-30T01:39:05.444 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-03-30T01:39:05.444 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-03-30T01:39:05.444 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-03-30T01:39:05.444 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-03-30T01:39:05.444 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-03-30T01:39:05.444 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-03-30T01:39:05.445 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-03-30T01:39:05.445 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-30T01:39:05.445 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-03-30T01:39:05.445 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-03-30T01:39:05.445 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-03-30T01:39:05.445 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-03-30T01:39:05.445 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-03-30T01:39:05.445 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-03-30T01:39:05.445 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-03-30T01:39:05.445 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-03-30T01:39:05.445 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-03-30T01:39:05.445 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-03-30T01:39:05.446 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-03-30T01:39:05.446 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-03-30T01:39:05.446 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-03-30T01:39:05.446 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-03-30T01:39:05.446 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-03-30T01:39:05.446 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-03-30T01:39:05.446 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-03-30T01:39:05.446 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-03-30T01:39:05.446 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-03-30T01:39:05.446 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-03-30T01:39:05.446 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-03-30T01:39:05.446 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-03-30T01:39:05.446 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-03-30T01:39:05.446 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-03-30T01:39:05.447 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-03-30T01:39:05.447 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-03-30T01:39:05.447 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-03-30T01:39:05.447 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-03-30T01:39:05.447 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-03-30T01:39:05.447 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-03-30T01:39:05.447 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-03-30T01:39:05.447 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-03-30T01:39:05.447 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-03-30T01:39:05.447 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-03-30T01:39:05.447 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-03-30T01:39:05.447 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-03-30T01:39:05.447 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-03-30T01:39:05.447 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-03-30T01:39:05.447 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-03-30T01:39:05.447 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-03-30T01:39:05.448 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-03-30T01:39:05.448 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-03-30T01:39:05.448 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-03-30T01:39:05.448 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-03-30T01:39:05.448 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-30T01:39:05.448 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-03-30T01:39:05.448 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-03-30T01:39:05.448 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-03-30T01:39:05.448 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-03-30T01:39:05.448 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-03-30T01:39:05.448 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-03-30T01:39:05.448 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-03-30T01:39:05.448 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-03-30T01:39:05.448 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-03-30T01:39:05.449 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-03-30T01:39:05.449 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-03-30T01:39:05.449 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-03-30T01:39:05.449 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-03-30T01:39:05.449 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-03-30T01:39:05.449 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-03-30T01:39:05.449 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-03-30T01:39:05.449 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-03-30T01:39:05.449 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-03-30T01:39:05.449 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-03-30T01:39:05.449 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-03-30T01:39:05.449 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-03-30T01:39:05.450 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-03-30T01:39:05.450 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-03-30T01:39:05.450 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-03-30T01:39:05.450 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-30T01:39:05.450 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-30T01:39:05.450 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-03-30T01:39:05.450 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-03-30T01:39:05.450 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-03-30T01:39:05.450 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-03-30T01:39:05.450 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-03-30T01:39:05.450 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-03-30T01:39:05.450 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-03-30T01:39:05.450 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-03-30T01:39:05.451 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-03-30T01:39:05.451 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-03-30T01:39:05.451 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-03-30T01:39:05.451 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-03-30T01:39:05.451 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-03-30T01:39:05.451 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-30T01:39:05.451 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-30T01:39:05.451 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-03-30T01:39:05.451 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-03-30T01:39:05.451 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-03-30T01:39:05.451 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-03-30T01:39:05.451 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-03-30T01:39:05.451 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-03-30T01:39:05.451 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-03-30T01:39:05.451 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-03-30T01:39:05.451 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-03-30T01:39:05.452 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-03-30T01:39:05.452 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-03-30T01:39:05.452 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-03-30T01:39:05.452 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-03-30T01:39:05.452 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-03-30T01:39:05.452 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-03-30T01:39:05.452 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-03-30T01:39:05.452 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-03-30T01:39:05.452 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-03-30T01:39:05.452 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-03-30T01:39:05.452 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-03-30T01:39:05.452 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-03-30T01:39:05.452 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-03-30T01:39:05.452 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-03-30T01:39:05.453 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-03-30T01:39:05.453 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-03-30T01:39:05.453 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-03-30T01:39:05.453 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-03-30T01:39:05.453 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-30T01:39:05.453 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-30T01:39:05.453 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-03-30T01:39:05.453 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-03-30T01:39:05.453 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-03-30T01:39:05.453 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-03-30T01:39:05.453 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-03-30T01:39:05.453 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-03-30T01:39:05.453 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-03-30T01:39:05.453 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-03-30T01:39:05.454 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-03-30T01:39:05.454 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-03-30T01:39:05.454 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-03-30T01:39:05.454 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-30T01:39:05.454 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-03-30T01:39:05.454 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-03-30T01:39:05.454 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-03-30T01:39:05.454 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-03-30T01:39:05.454 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-03-30T01:39:05.454 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-03-30T01:39:05.454 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-03-30T01:39:05.454 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-30T01:39:05.454 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-03-30T01:39:05.455 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-03-30T01:39:05.455 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-03-30T01:39:05.455 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-03-30T01:39:05.455 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-03-30T01:39:05.455 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-03-30T01:39:05.455 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-30T01:39:05.455 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-30T01:39:05.455 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-30T01:39:05.455 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-03-30T01:39:05.455 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-30T01:39:05.455 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-03-30T01:39:05.455 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-30T01:39:05.455 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-30T01:39:05.455 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-30T01:39:05.456 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-30T01:39:05.456 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-30T01:39:05.456 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-30T01:39:05.456 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-03-30T01:39:05.456 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-03-30T01:39:05.456 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-03-30T01:39:05.456 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-03-30T01:39:05.456 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-03-30T01:39:05.456 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-03-30T01:39:05.456 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-03-30T01:39:05.456 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-30T01:39:05.456 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-30T01:39:05.456 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-30T01:39:05.456 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-30T01:39:05.457 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-30T01:39:05.457 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-03-30T01:39:05.457 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-03-30T01:39:05.457 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-03-30T01:39:05.457 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-30T01:39:05.457 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-30T01:39:05.457 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-30T01:39:05.457 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-30T01:39:05.457 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-30T01:39:05.457 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-30T01:39:05.457 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-03-30T01:39:05.457 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-03-30T01:39:05.457 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-30T01:39:05.457 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-03-30T01:39:05.458 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-03-30T01:39:05.458 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-03-30T01:39:05.458 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-03-30T01:39:05.458 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-30T01:39:05.458 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-30T01:39:05.458 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-30T01:39:05.458 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-03-30T01:39:05.458 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-03-30T01:39:05.458 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-03-30T01:39:05.458 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-30T01:39:05.458 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-03-30T01:39:05.458 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-03-30T01:39:05.458 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-03-30T01:39:05.458 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-30T01:39:05.459 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-03-30T01:39:05.459 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-03-30T01:39:05.459 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-30T01:39:05.459 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-03-30T01:39:05.459 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-30T01:39:05.459 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-03-30T01:39:05.459 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-03-30T01:39:05.459 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-03-30T01:39:05.459 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-03-30T01:39:05.459 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-03-30T01:39:05.459 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-03-30T01:39:05.459 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-03-30T01:39:05.459 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-03-30T01:39:05.459 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-03-30T01:39:05.459 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-03-30T01:39:05.460 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-03-30T01:39:05.460 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-03-30T01:39:05.460 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-03-30T01:39:05.460 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-03-30T01:39:05.460 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-03-30T01:39:05.460 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-03-30T01:39:05.460 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-30T01:39:05.460 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-03-30T01:39:05.460 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-03-30T01:39:05.460 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-30T01:39:05.460 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-03-30T01:39:05.460 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-03-30T01:39:05.460 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-03-30T01:39:05.460 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-03-30T01:39:05.460 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-03-30T01:39:05.461 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-03-30T01:39:05.461 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-03-30T01:39:05.461 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-03-30T01:39:05.461 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-03-30T01:39:05.461 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-03-30T01:39:05.461 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-03-30T01:39:05.461 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-30T01:39:05.461 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-30T01:39:05.461 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-03-30T01:39:05.461 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-03-30T01:39:05.461 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-03-30T01:39:05.461 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-03-30T01:39:05.461 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-03-30T01:39:05.461 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-03-30T01:39:05.461 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-03-30T01:39:05.461 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-03-30T01:39:05.462 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-30T01:39:05.462 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-30T01:39:05.462 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-03-30T01:39:05.462 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-03-30T01:39:05.462 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-03-30T01:39:05.462 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-03-30T01:39:05.462 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-03-30T01:39:05.462 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-03-30T01:39:05.462 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-03-30T01:39:05.462 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-03-30T01:39:05.462 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-03-30T01:39:05.462 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-30T01:39:05.462 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-03-30T01:39:05.462 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-30T01:39:05.463 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-30T01:39:05.463 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-30T01:39:05.463 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-30T01:39:05.463 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-30T01:39:05.463 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-30T01:39:05.463 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-30T01:39:05.463 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-30T01:39:05.463 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-30T01:39:05.463 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-03-30T01:39:05.463 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-03-30T01:39:05.463 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-03-30T01:39:05.463 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-30T01:39:05.463 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-03-30T01:39:05.463 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-03-30T01:39:05.464 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-03-30T01:39:05.464 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-03-30T01:39:05.464 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-03-30T01:39:05.464 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-30T01:39:05.464 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-03-30T01:39:05.464 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-03-30T01:39:05.464 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-03-30T01:39:05.464 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-03-30T01:39:05.464 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-03-30T01:39:05.464 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-03-30T01:39:05.464 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-03-30T01:39:05.464 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-03-30T01:39:05.464 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-03-30T01:39:05.464 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-03-30T01:39:05.465 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-03-30T01:39:05.465 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-03-30T01:39:05.465 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-03-30T01:39:05.465 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-03-30T01:39:05.465 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-03-30T01:39:05.465 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-03-30T01:39:05.465 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-03-30T01:39:05.465 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-03-30T01:39:05.465 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-03-30T01:39:05.465 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-30T01:39:05.465 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-03-30T01:39:05.465 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-03-30T01:39:05.465 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-03-30T01:39:05.465 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-03-30T01:39:05.465 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-03-30T01:39:05.466 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-03-30T01:39:05.466 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-03-30T01:39:05.466 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-03-30T01:39:05.466 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-03-30T01:39:05.466 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-03-30T01:39:05.466 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-03-30T01:39:05.466 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-03-30T01:39:05.466 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-03-30T01:39:05.466 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-03-30T01:39:05.466 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-03-30T01:39:05.466 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-03-30T01:39:05.466 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-03-30T01:39:05.466 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-03-30T01:39:05.466 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-03-30T01:39:05.466 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-30T01:39:05.467 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-03-30T01:39:05.467 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-03-30T01:39:05.467 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-30T01:39:05.467 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-03-30T01:39:05.467 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-03-30T01:39:05.467 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-03-30T01:39:05.467 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-03-30T01:39:05.467 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-03-30T01:39:05.467 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-03-30T01:39:05.467 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-03-30T01:39:05.467 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-03-30T01:39:05.467 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-03-30T01:39:05.467 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-03-30T01:39:05.467 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-03-30T01:39:05.467 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-03-30T01:39:05.468 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-03-30T01:39:05.468 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-03-30T01:39:05.468 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-30T01:39:05.468 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-03-30T01:39:05.468 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-03-30T01:39:05.468 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-03-30T01:39:05.468 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-03-30T01:39:05.468 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-03-30T01:39:05.468 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-03-30T01:39:05.468 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-03-30T01:39:05.468 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-03-30T01:39:05.468 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-03-30T01:39:05.468 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-03-30T01:39:05.468 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-03-30T01:39:05.469 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-03-30T01:39:05.469 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-03-30T01:39:05.469 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-03-30T01:39:05.469 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-03-30T01:39:05.469 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-03-30T01:39:05.469 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-03-30T01:39:05.469 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-03-30T01:39:05.469 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-03-30T01:39:05.469 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-03-30T01:39:05.469 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-03-30T01:39:05.469 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-03-30T01:39:05.469 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-03-30T01:39:05.469 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-03-30T01:39:05.469 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-03-30T01:39:05.469 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-03-30T01:39:05.469 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-03-30T01:39:05.470 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-03-30T01:39:05.470 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-03-30T01:39:05.470 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-03-30T01:39:05.470 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-03-30T01:39:05.470 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-03-30T01:39:05.470 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-03-30T01:39:05.470 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-03-30T01:39:05.470 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-03-30T01:39:05.470 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-03-30T01:39:05.470 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-03-30T01:39:05.470 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-03-30T01:39:05.470 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-03-30T01:39:05.470 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-03-30T01:39:05.470 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-03-30T01:39:05.471 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-03-30T01:39:05.471 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-03-30T01:39:05.471 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-03-30T01:39:05.471 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-03-30T01:39:05.471 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-03-30T01:39:05.471 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-03-30T01:39:05.471 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-03-30T01:39:05.471 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-30T01:39:05.471 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-30T01:39:05.471 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-30T01:39:05.471 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-30T01:39:05.471 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-30T01:39:05.471 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-30T01:39:05.471 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-30T01:39:05.471 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-30T01:39:05.472 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-30T01:39:05.472 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-30T01:39:05.472 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-30T01:39:05.472 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-30T01:39:05.472 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-03-30T01:39:05.472 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-03-30T01:39:05.472 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-03-30T01:39:05.472 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-30T01:39:05.472 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-03-30T01:39:05.472 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-03-30T01:39:05.472 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-03-30T01:39:05.473 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-03-30T01:39:05.473 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-03-30T01:39:05.473 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-03-30T01:39:05.473 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-03-30T01:39:05.473 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-03-30T01:39:05.473 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-03-30T01:39:05.473 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-03-30T01:39:05.473 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-03-30T01:39:05.473 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-03-30T01:39:05.473 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-03-30T01:39:05.474 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-03-30T01:39:05.474 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-03-30T01:39:05.474 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-03-30T01:39:05.474 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-03-30T01:39:05.474 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-03-30T01:39:05.474 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-03-30T01:39:05.474 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-03-30T01:39:05.474 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-03-30T01:39:05.474 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-03-30T01:39:05.474 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-03-30T01:39:05.474 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-03-30T01:39:05.474 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-03-30T01:39:05.474 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-03-30T01:39:05.474 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-03-30T01:39:05.474 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-30T01:39:05.475 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-30T01:39:05.475 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-03-30T01:39:05.475 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-30T01:39:05.475 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-30T01:39:05.475 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-30T01:39:05.475 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-30T01:39:05.475 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-30T01:39:05.475 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-30T01:39:05.475 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-30T01:39:05.475 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-30T01:39:05.475 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-30T01:39:05.475 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-30T01:39:05.475 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-30T01:39:05.475 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-30T01:39:05.475 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-30T01:39:05.476 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-30T01:39:05.476 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-30T01:39:05.476 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-30T01:39:05.476 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-30T01:39:05.476 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-30T01:39:05.476 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-30T01:39:05.476 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-30T01:39:05.476 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-30T01:39:05.476 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-30T01:39:05.476 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-30T01:39:05.476 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-03-30T01:39:05.476 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-03-30T01:39:05.476 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-30T01:39:05.476 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-03-30T01:39:05.476 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-03-30T01:39:05.476 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-03-30T01:39:05.477 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-03-30T01:39:05.477 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-30T01:39:05.477 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-03-30T01:39:05.477 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-30T01:39:05.477 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-30T01:39:05.477 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-30T01:39:05.477 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-30T01:39:05.477 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-30T01:39:05.477 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-03-30T01:39:05.477 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-03-30T01:39:05.477 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-30T01:39:05.477 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-03-30T01:39:05.477 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-30T01:39:05.477 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-03-30T01:39:05.478 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-30T01:39:05.478 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-03-30T01:39:05.478 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-30T01:39:05.478 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-03-30T01:39:05.478 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-03-30T01:39:05.478 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-30T01:39:05.478 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-03-30T01:39:05.478 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-30T01:39:05.478 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-03-30T01:39:05.478 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-30T01:39:05.478 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-03-30T01:39:05.478 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-30T01:39:05.478 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-03-30T01:39:05.478 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-30T01:39:05.479 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-03-30T01:39:05.479 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-03-30T01:39:05.479 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-30T01:39:05.479 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-30T01:39:05.479 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-03-30T01:39:05.479 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-03-30T01:39:05.479 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-03-30T01:39:05.479 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-30T01:39:05.479 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-03-30T01:39:05.479 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-03-30T01:39:05.479 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-03-30T01:39:05.479 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-03-30T01:39:05.479 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-30T01:39:05.479 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-03-30T01:39:05.480 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-30T01:39:05.480 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-30T01:39:05.480 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-30T01:39:05.480 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-03-30T01:39:05.480 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-30T01:39:05.480 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-03-30T01:39:05.480 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-03-30T01:39:05.480 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-03-30T01:39:05.480 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-30T01:39:05.480 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-03-30T01:39:05.480 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-03-30T01:39:05.480 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-03-30T01:39:05.480 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-03-30T01:39:05.480 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-03-30T01:39:05.481 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-03-30T01:39:05.481 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-03-30T01:39:05.481 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-03-30T01:39:05.481 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-30T01:39:05.481 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-30T01:39:05.481 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-30T01:39:05.481 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-30T01:39:05.481 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-30T01:39:05.481 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-30T01:39:05.481 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-30T01:39:05.481 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-30T01:39:05.481 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-30T01:39:05.481 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-03-30T01:39:05.482 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-03-30T01:39:05.482 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-03-30T01:39:05.482 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-03-30T01:39:05.482 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-03-30T01:39:05.482 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-03-30T01:39:05.482 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-03-30T01:39:05.482 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-03-30T01:39:05.482 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-03-30T01:39:05.482 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-03-30T01:39:05.482 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-03-30T01:39:05.482 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-03-30T01:39:05.482 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-03-30T01:39:05.482 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-03-30T01:39:05.482 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-03-30T01:39:05.483 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-03-30T01:39:05.483 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-03-30T01:39:05.483 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-03-30T01:39:05.483 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-03-30T01:39:05.483 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-30T01:39:05.483 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-03-30T01:39:05.483 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-03-30T01:39:05.483 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-03-30T01:39:05.483 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-03-30T01:39:05.483 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-03-30T01:39:05.483 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-03-30T01:39:05.483 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-03-30T01:39:05.483 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-03-30T01:39:05.483 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-03-30T01:39:05.484 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-03-30T01:39:05.484 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-03-30T01:39:05.484 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-03-30T01:39:05.484 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-03-30T01:39:05.484 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-03-30T01:39:05.484 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-03-30T01:39:05.484 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-03-30T01:39:05.484 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-03-30T01:39:05.484 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-03-30T01:39:05.484 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-03-30T01:39:05.484 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-03-30T01:39:05.484 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-03-30T01:39:05.484 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-03-30T01:39:05.484 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-03-30T01:39:05.484 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-30T01:39:05.485 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-03-30T01:39:05.485 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-03-30T01:39:05.485 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-03-30T01:39:05.485 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-03-30T01:39:05.485 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-03-30T01:39:05.485 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-03-30T01:39:05.485 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-03-30T01:39:05.485 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-30T01:39:05.485 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-03-30T01:39:05.485 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-03-30T01:39:05.485 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-03-30T01:39:05.485 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-03-30T01:39:05.485 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-03-30T01:39:05.486 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-03-30T01:39:05.486 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-30T01:39:05.486 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-30T01:39:05.486 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-03-30T01:39:05.486 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-03-30T01:39:05.486 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-03-30T01:39:05.486 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-03-30T01:39:05.486 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-03-30T01:39:05.486 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-30T01:39:05.486 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-03-30T01:39:05.486 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-30T01:39:05.486 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-30T01:39:05.486 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-30T01:39:05.486 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-03-30T01:39:05.487 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-03-30T01:39:05.487 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-03-30T01:39:05.487 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-03-30T01:39:05.487 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-03-30T01:39:05.487 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-30T01:39:05.487 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-03-30T01:39:05.487 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-03-30T01:39:05.487 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-03-30T01:39:05.487 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-03-30T01:39:05.487 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-03-30T01:39:05.487 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-30T01:39:05.487 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-30T01:39:05.487 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-30T01:39:05.488 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-03-30T01:39:05.488 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-30T01:39:05.488 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-03-30T01:39:05.488 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-03-30T01:39:05.488 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-03-30T01:39:05.488 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-03-30T01:39:05.488 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-30T01:39:05.488 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-30T01:39:05.488 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-30T01:39:05.488 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-30T01:39:05.488 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-03-30T01:39:05.488 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-30T01:39:05.488 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-30T01:39:05.488 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-30T01:39:05.488 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-30T01:39:05.489 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-03-30T01:39:05.489 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-30T01:39:05.489 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-03-30T01:39:05.489 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-30T01:39:05.489 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-03-30T01:39:05.489 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-30T01:39:05.489 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-03-30T01:39:05.489 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-30T01:39:05.489 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-03-30T01:39:05.489 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-30T01:39:05.489 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-30T01:39:05.489 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-30T01:39:05.489 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-03-30T01:39:05.489 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-03-30T01:39:05.489 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-30T01:39:05.489 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-30T01:39:05.489 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-30T01:39:05.490 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-30T01:39:05.490 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-30T01:39:05.490 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-03-30T01:39:05.490 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-30T01:39:05.490 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-30T01:39:05.490 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-03-30T01:39:05.490 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-30T01:39:05.490 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-30T01:39:05.490 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-30T01:39:05.490 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-30T01:39:05.490 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-30T01:39:05.490 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-03-30T01:39:05.490 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-30T01:39:05.490 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-30T01:39:05.491 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-03-30T01:39:05.491 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-03-30T01:39:05.491 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-30T01:39:05.491 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-03-30T01:39:05.491 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-30T01:39:05.491 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-30T01:39:05.491 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-30T01:39:05.491 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-30T01:39:05.491 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-30T01:39:05.491 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-30T01:39:05.491 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-30T01:39:05.491 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-30T01:39:05.491 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-30T01:39:05.492 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-30T01:39:05.492 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-03-30T01:39:05.492 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-03-30T01:39:05.492 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-30T01:39:05.492 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-03-30T01:39:05.492 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-03-30T01:39:05.492 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-30T01:39:05.492 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-30T01:39:05.492 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-30T01:39:05.492 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-30T01:39:05.492 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-30T01:39:05.492 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-30T01:39:05.492 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-03-30T01:39:05.492 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-30T01:39:05.493 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-30T01:39:05.493 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-03-30T01:39:05.493 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-03-30T01:39:05.493 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-03-30T01:39:05.493 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-30T01:39:05.493 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-03-30T01:39:05.493 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-03-30T01:39:05.493 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-03-30T01:39:05.493 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-30T01:39:05.493 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-03-30T01:39:05.493 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-30T01:39:05.493 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-03-30T01:39:05.494 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-30T01:39:05.494 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-03-30T01:39:05.494 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-30T01:39:05.494 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-03-30T01:39:05.494 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-30T01:39:05.494 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-03-30T01:39:05.494 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-30T01:39:05.494 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-03-30T01:39:05.494 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-30T01:39:05.494 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-03-30T01:39:05.494 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-30T01:39:05.494 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-30T01:39:05.494 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-30T01:39:05.494 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-30T01:39:05.495 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-30T01:39:05.495 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-03-30T01:39:05.495 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-03-30T01:39:05.495 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-30T01:39:05.495 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-30T01:39:05.495 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-30T01:39:05.495 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-03-30T01:39:05.495 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-30T01:39:05.495 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-30T01:39:05.495 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-30T01:39:05.495 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-30T01:39:05.495 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-30T01:39:05.495 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-30T01:39:05.495 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-03-30T01:39:05.496 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-30T01:39:05.496 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-03-30T01:39:05.496 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-30T01:39:05.496 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-30T01:39:05.496 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-03-30T01:39:05.496 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-30T01:39:05.496 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-30T01:39:05.496 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-03-30T01:39:05.496 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-30T01:39:05.496 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-03-30T01:39:05.496 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-30T01:39:05.496 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-03-30T01:39:05.496 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-30T01:39:05.496 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-30T01:39:05.497 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-03-30T01:39:05.497 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-30T01:39:05.497 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-30T01:39:05.497 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-30T01:39:05.497 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-30T01:39:05.497 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-30T01:39:05.497 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-03-30T01:39:05.497 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-30T01:39:05.497 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-03-30T01:39:05.497 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-30T01:39:05.497 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-30T01:39:05.497 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-30T01:39:05.497 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-30T01:39:05.497 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-03-30T01:39:05.497 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-30T01:39:05.498 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-03-30T01:39:05.498 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-30T01:39:05.498 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-03-30T01:39:05.498 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-30T01:39:05.498 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-03-30T01:39:05.498 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-30T01:39:05.498 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-30T01:39:05.498 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-03-30T01:39:05.498 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-30T01:39:05.498 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-30T01:39:05.498 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-30T01:39:05.498 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-30T01:39:05.498 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-03-30T01:39:05.498 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-30T01:39:05.498 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-30T01:39:05.499 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-30T01:39:05.499 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-03-30T01:39:05.499 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-30T01:39:05.499 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-30T01:39:05.499 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-30T01:39:05.499 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-30T01:39:05.499 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-03-30T01:39:05.499 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-30T01:39:05.499 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-03-30T01:39:05.499 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-30T01:39:05.499 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-03-30T01:39:05.499 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-30T01:39:05.499 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-30T01:39:05.499 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-03-30T01:39:05.500 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-30T01:39:05.500 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-30T01:39:05.500 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-03-30T01:39:05.500 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-30T01:39:05.500 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-03-30T01:39:05.500 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-03-30T01:39:05.500 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-30T01:39:05.500 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-03-30T01:39:05.500 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-30T01:39:05.500 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-03-30T01:39:05.500 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-03-30T01:39:05.500 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-30T01:39:05.500 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-03-30T01:39:05.500 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-03-30T01:39:05.500 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-03-30T01:39:05.500 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-03-30T01:39:05.501 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-30T01:39:05.501 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-30T01:39:05.501 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-30T01:39:05.501 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-03-30T01:39:05.501 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-03-30T01:39:05.501 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-03-30T01:39:05.501 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-03-30T01:39:05.501 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-03-30T01:39:05.501 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-30T01:39:05.501 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-30T01:39:05.501 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-03-30T01:39:05.501 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-03-30T01:39:05.501 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-30T01:39:05.501 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-30T01:39:05.501 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-30T01:39:05.502 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-03-30T01:39:05.502 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-03-30T01:39:05.502 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-03-30T01:39:05.502 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-03-30T01:39:05.502 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-03-30T01:39:05.502 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-03-30T01:39:05.502 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-03-30T01:39:05.502 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-03-30T01:39:05.502 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-03-30T01:39:05.502 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-03-30T01:39:05.502 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-03-30T01:39:05.502 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-03-30T01:39:05.502 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-03-30T01:39:05.502 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-03-30T01:39:05.502 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-03-30T01:39:05.503 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-03-30T01:39:05.503 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-03-30T01:39:05.503 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-03-30T01:39:05.503 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-30T01:39:05.503 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-03-30T01:39:05.503 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-30T01:39:05.503 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-30T01:39:05.503 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-30T01:39:05.503 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-30T01:39:05.503 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-03-30T01:39:05.503 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-03-30T01:39:05.503 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-03-30T01:39:05.503 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-03-30T01:39:05.503 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-03-30T01:39:05.503 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-03-30T01:39:05.504 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-03-30T01:39:05.504 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-03-30T01:39:05.504 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-03-30T01:39:05.504 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-03-30T01:39:05.504 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-30T01:39:05.504 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-30T01:39:05.504 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-30T01:39:05.504 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-03-30T01:39:05.504 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-30T01:39:05.504 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-03-30T01:39:05.504 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-03-30T01:39:05.504 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-03-30T01:39:05.504 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-03-30T01:39:05.504 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-30T01:39:05.504 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-03-30T01:39:05.505 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-03-30T01:39:05.505 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-03-30T01:39:05.505 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-30T01:39:05.505 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-03-30T01:39:05.505 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-03-30T01:39:05.505 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-03-30T01:39:05.505 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-03-30T01:39:05.505 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-03-30T01:39:05.505 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-03-30T01:39:05.505 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-03-30T01:39:05.505 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-03-30T01:39:05.505 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-03-30T01:39:05.505 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-03-30T01:39:05.505 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-03-30T01:39:05.505 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-03-30T01:39:05.506 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-03-30T01:39:05.506 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-03-30T01:39:05.506 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-30T01:39:05.506 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-03-30T01:39:05.506 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-30T01:39:05.506 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-03-30T01:39:05.506 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-03-30T01:39:05.506 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-03-30T01:39:05.506 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-03-30T01:39:05.506 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-30T01:39:05.506 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-03-30T01:39:05.506 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-03-30T01:39:05.506 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-30T01:39:05.506 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-03-30T01:39:05.507 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-03-30T01:39:05.507 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-30T01:39:05.507 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-03-30T01:39:05.507 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-30T01:39:05.507 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-30T01:39:05.507 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-30T01:39:05.507 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-30T01:39:05.507 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-30T01:39:05.507 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-30T01:39:05.507 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-30T01:39:05.507 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-30T01:39:05.507 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-30T01:39:05.507 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-03-30T01:39:05.507 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-03-30T01:39:05.508 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-30T01:39:05.508 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-03-30T01:39:05.508 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-30T01:39:05.508 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-30T01:39:05.508 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-30T01:39:05.508 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-30T01:39:05.508 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-30T01:39:05.508 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-30T01:39:05.508 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-30T01:39:05.508 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-30T01:39:05.508 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-30T01:39:05.508 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-03-30T01:39:05.508 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-03-30T01:39:05.508 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-30T01:39:05.508 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-30T01:39:05.508 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-03-30T01:39:05.509 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-03-30T01:39:05.509 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-30T01:39:05.509 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-30T01:39:05.509 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-03-30T01:39:05.509 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-03-30T01:39:05.509 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-03-30T01:39:05.509 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-03-30T01:39:05.509 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-03-30T01:39:05.509 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-03-30T01:39:05.509 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-30T01:39:05.509 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-30T01:39:05.509 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-30T01:39:05.509 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-30T01:39:05.509 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-30T01:39:05.509 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-30T01:39:05.510 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-30T01:39:05.510 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-30T01:39:05.510 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-30T01:39:05.510 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-30T01:39:05.510 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-03-30T01:39:05.510 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-30T01:39:05.510 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-30T01:39:05.510 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-30T01:39:05.510 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-30T01:39:05.510 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-30T01:39:05.510 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-30T01:39:05.510 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-03-30T01:39:05.510 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-30T01:39:05.510 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-30T01:39:05.510 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-30T01:39:05.511 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-30T01:39:05.511 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-30T01:39:05.511 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-30T01:39:05.511 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-30T01:39:05.511 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-30T01:39:05.511 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-30T01:39:05.511 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-30T01:39:05.511 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-30T01:39:05.511 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-30T01:39:05.511 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-03-30T01:39:05.511 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-03-30T01:39:05.511 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-03-30T01:39:05.511 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-03-30T01:39:05.511 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-03-30T01:39:05.511 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-03-30T01:39:05.512 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-03-30T01:39:05.512 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-03-30T01:39:05.512 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-30T01:39:05.512 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-03-30T01:39:05.512 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-03-30T01:39:05.512 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-30T01:39:05.512 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-30T01:39:05.512 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-03-30T01:39:05.512 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-03-30T01:39:05.512 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-30T01:39:05.512 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-03-30T01:39:05.512 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-03-30T01:39:05.512 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-30T01:39:05.512 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-03-30T01:39:05.512 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-03-30T01:39:05.513 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-03-30T01:39:05.513 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-30T01:39:05.513 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-03-30T01:39:05.513 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-30T01:39:05.513 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-03-30T01:39:05.513 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-03-30T01:39:05.513 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-30T01:39:05.513 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-03-30T01:39:05.513 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-30T01:39:05.513 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-30T01:39:05.513 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-30T01:39:05.513 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-30T01:39:05.513 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-30T01:39:05.513 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-03-30T01:39:05.513 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-03-30T01:39:05.514 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-30T01:39:05.514 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-30T01:39:05.514 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-30T01:39:05.514 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-30T01:39:05.514 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-03-30T01:39:05.514 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-03-30T01:39:05.514 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-30T01:39:05.514 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-03-30T01:39:05.514 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-03-30T01:39:05.514 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-30T01:39:05.514 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-30T01:39:05.514 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-03-30T01:39:05.514 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-03-30T01:39:05.514 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-03-30T01:39:05.515 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-03-30T01:39:05.515 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-03-30T01:39:05.515 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-03-30T01:39:05.515 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-03-30T01:39:05.515 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-03-30T01:39:05.515 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-03-30T01:39:05.515 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-03-30T01:39:05.515 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-30T01:39:05.515 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-30T01:39:05.515 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-03-30T01:39:05.515 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-03-30T01:39:05.515 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-03-30T01:39:05.515 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-30T01:39:05.516 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-03-30T01:39:05.516 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-03-30T01:39:05.516 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-03-30T01:39:05.516 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-30T01:39:05.516 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-03-30T01:39:05.516 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-03-30T01:39:05.516 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-30T01:39:05.516 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-30T01:39:05.516 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-30T01:39:05.516 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-03-30T01:39:05.516 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-30T01:39:05.516 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-03-30T01:39:05.516 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-30T01:39:05.516 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-03-30T01:39:05.516 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-03-30T01:39:05.517 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-30T01:39:05.517 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-03-30T01:39:05.517 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-03-30T01:39:05.517 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-03-30T01:39:05.517 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-30T01:39:05.517 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-30T01:39:05.517 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-03-30T01:39:05.517 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-30T01:39:05.517 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-03-30T01:39:05.517 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-03-30T01:39:05.517 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-30T01:39:05.517 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-30T01:39:05.517 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-30T01:39:05.517 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-30T01:39:05.517 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-30T01:39:05.518 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-03-30T01:39:05.518 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-03-30T01:39:05.518 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-03-30T01:39:05.518 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-03-30T01:39:05.518 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-30T01:39:05.518 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-03-30T01:39:05.518 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-30T01:39:05.518 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-03-30T01:39:05.518 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-03-30T01:39:05.518 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-03-30T01:39:05.518 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-03-30T01:39:05.518 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-03-30T01:39:05.518 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-30T01:39:05.518 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-03-30T01:39:05.519 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-30T01:39:05.519 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-03-30T01:39:05.519 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-03-30T01:39:05.519 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-03-30T01:39:05.519 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-03-30T01:39:05.519 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-03-30T01:39:05.519 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-03-30T01:39:05.519 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-30T01:39:05.519 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-03-30T01:39:05.519 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-03-30T01:39:05.519 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-03-30T01:39:05.519 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-30T01:39:05.519 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-30T01:39:05.519 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-30T01:39:05.519 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-30T01:39:05.520 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-30T01:39:05.520 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-30T01:39:05.520 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-30T01:39:05.520 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-30T01:39:05.520 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-30T01:39:05.520 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-30T01:39:05.520 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-30T01:39:05.520 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-30T01:39:05.520 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-30T01:39:05.520 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-30T01:39:05.520 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-30T01:39:05.520 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-30T01:39:05.520 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-30T01:39:05.520 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-30T01:39:05.520 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-03-30T01:39:05.521 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-03-30T01:39:05.521 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-30T01:39:05.521 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-03-30T01:39:05.521 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-03-30T01:39:05.521 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-03-30T01:39:05.521 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-03-30T01:39:05.521 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-03-30T01:39:05.521 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-30T01:39:05.521 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-03-30T01:39:05.521 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-03-30T01:39:05.521 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-30T01:39:05.521 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-03-30T01:39:05.521 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-03-30T01:39:05.521 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-30T01:39:05.522 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-03-30T01:39:05.522 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-30T01:39:05.522 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-03-30T01:39:05.522 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-03-30T01:39:05.522 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-03-30T01:39:05.522 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-03-30T01:39:05.522 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-03-30T01:39:05.522 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-03-30T01:39:05.522 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-03-30T01:39:05.522 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-03-30T01:39:05.522 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-03-30T01:39:05.522 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-30T01:39:05.522 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-03-30T01:39:05.522 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-03-30T01:39:05.523 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-03-30T01:39:05.523 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-30T01:39:05.523 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-03-30T01:39:05.523 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-03-30T01:39:05.523 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-03-30T01:39:05.523 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-03-30T01:39:05.523 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-03-30T01:39:05.523 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-03-30T01:39:05.523 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-03-30T01:39:05.523 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-03-30T01:39:05.523 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-03-30T01:39:05.523 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-03-30T01:39:05.523 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-03-30T01:39:05.523 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-30T01:39:05.523 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-03-30T01:39:05.524 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-03-30T01:39:05.524 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-03-30T01:39:05.524 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-30T01:39:05.524 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-30T01:39:05.524 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-03-30T01:39:05.524 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-03-30T01:39:05.524 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-30T01:39:05.524 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-03-30T01:39:05.524 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-03-30T01:39:05.524 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-03-30T01:39:05.524 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-03-30T01:39:05.524 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-03-30T01:39:05.524 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-03-30T01:39:05.524 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-03-30T01:39:05.524 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-30T01:39:05.525 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-03-30T01:39:05.525 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-03-30T01:39:05.525 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-03-30T01:39:05.525 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-30T01:39:05.525 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-30T01:39:05.525 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-03-30T01:39:05.525 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-30T01:39:05.525 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-30T01:39:05.525 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-30T01:39:05.525 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-03-30T01:39:05.525 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-03-30T01:39:05.525 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-03-30T01:39:05.525 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-03-30T01:39:05.525 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-30T01:39:05.525 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-03-30T01:39:05.526 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-30T01:39:05.526 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-30T01:39:05.526 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-30T01:39:05.526 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-03-30T01:39:05.526 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-03-30T01:39:05.526 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-03-30T01:39:05.526 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-03-30T01:39:05.526 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-03-30T01:39:05.526 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-03-30T01:39:05.526 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-03-30T01:39:05.526 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-03-30T01:39:05.526 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-03-30T01:39:05.526 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-03-30T01:39:05.526 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-03-30T01:39:05.526 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-03-30T01:39:05.527 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-03-30T01:39:05.527 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-03-30T01:39:05.527 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-30T01:39:05.527 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-03-30T01:39:05.527 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-03-30T01:39:05.527 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-30T01:39:05.527 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-30T01:39:05.527 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-03-30T01:39:05.527 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-30T01:39:05.527 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-03-30T01:39:05.527 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-03-30T01:39:05.527 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-30T01:39:05.527 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-03-30T01:39:05.527 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-03-30T01:39:05.528 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-30T01:39:05.528 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-30T01:39:05.528 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-30T01:39:05.528 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-30T01:39:05.528 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-30T01:39:05.528 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-30T01:39:05.528 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-30T01:39:05.528 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-03-30T01:39:05.528 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-30T01:39:05.528 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-30T01:39:05.528 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-30T01:39:05.528 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-30T01:39:05.528 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-30T01:39:05.528 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-03-30T01:39:05.528 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-03-30T01:39:05.529 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-30T01:39:05.529 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-30T01:39:05.529 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-30T01:39:05.529 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-03-30T01:39:05.529 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-03-30T01:39:05.529 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-30T01:39:05.529 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-30T01:39:05.529 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-03-30T01:39:05.529 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-30T01:39:05.529 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-03-30T01:39:05.529 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-03-30T01:39:05.529 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-30T01:39:05.529 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-03-30T01:39:05.529 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-03-30T01:39:05.529 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-03-30T01:39:05.529 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-03-30T01:39:05.530 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-03-30T01:39:05.530 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-03-30T01:39:05.530 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-30T01:39:05.530 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-03-30T01:39:05.530 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-03-30T01:39:05.530 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-03-30T01:39:05.530 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-03-30T01:39:05.530 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-03-30T01:39:05.530 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-30T01:39:05.530 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-30T01:39:05.530 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-03-30T01:39:05.530 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-03-30T01:39:05.530 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-03-30T01:39:05.531 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-03-30T01:39:05.531 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-03-30T01:39:05.531 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-03-30T01:39:05.531 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-30T01:39:05.531 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-30T01:39:05.531 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-30T01:39:05.531 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-30T01:39:05.531 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-30T01:39:05.531 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-30T01:39:05.531 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-30T01:39:05.531 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-30T01:39:05.531 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-30T01:39:05.531 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-30T01:39:05.531 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-30T01:39:05.532 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-03-30T01:39:05.532 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-03-30T01:39:05.532 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-30T01:39:05.532 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-30T01:39:05.532 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-30T01:39:05.532 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-03-30T01:39:05.532 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-03-30T01:39:05.532 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-30T01:39:05.532 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-30T01:39:05.532 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-03-30T01:39:05.532 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-03-30T01:39:05.532 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-30T01:39:05.532 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-30T01:39:05.532 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-03-30T01:39:05.533 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-03-30T01:39:05.533 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-03-30T01:39:05.533 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-30T01:39:05.533 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-30T01:39:05.533 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-30T01:39:05.533 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-30T01:39:05.533 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-03-30T01:39:05.533 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-30T01:39:05.533 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-03-30T01:39:05.533 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-30T01:39:05.533 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-30T01:39:05.533 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-30T01:39:05.533 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-03-30T01:39:05.533 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-03-30T01:39:05.533 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-03-30T01:39:05.534 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-30T01:39:05.534 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-03-30T01:39:05.534 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-03-30T01:39:05.534 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-03-30T01:39:05.534 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-03-30T01:39:05.534 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-30T01:39:05.534 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-03-30T01:39:05.534 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-03-30T01:39:05.534 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-30T01:39:05.534 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-03-30T01:39:05.534 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-03-30T01:39:05.534 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-03-30T01:39:05.534 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-03-30T01:39:05.535 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-03-30T01:39:05.535 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-03-30T01:39:05.535 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-03-30T01:39:05.535 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-03-30T01:39:05.535 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-03-30T01:39:05.535 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-03-30T01:39:05.535 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-03-30T01:39:05.535 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-03-30T01:39:05.535 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-03-30T01:39:05.535 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-03-30T01:39:05.535 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-03-30T01:39:05.535 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-03-30T01:39:05.535 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-03-30T01:39:05.535 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-03-30T01:39:05.536 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-03-30T01:39:05.536 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-03-30T01:39:05.536 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-03-30T01:39:05.536 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-30T01:39:05.536 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-03-30T01:39:05.536 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-03-30T01:39:05.536 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-03-30T01:39:05.536 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-03-30T01:39:05.536 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-03-30T01:39:05.536 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-03-30T01:39:05.536 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-03-30T01:39:05.536 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-03-30T01:39:05.536 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-03-30T01:39:05.536 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-03-30T01:39:05.537 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-03-30T01:39:05.537 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-03-30T01:39:05.537 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-03-30T01:39:05.537 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-03-30T01:39:05.537 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-03-30T01:39:05.537 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-03-30T01:39:05.537 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-03-30T01:39:05.537 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-03-30T01:39:05.537 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-03-30T01:39:05.537 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-03-30T01:39:05.537 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-03-30T01:39:05.537 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-03-30T01:39:05.537 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-03-30T01:39:05.537 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-03-30T01:39:05.537 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-03-30T01:39:05.538 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-03-30T01:39:05.538 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-03-30T01:39:05.538 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-30T01:39:05.538 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-03-30T01:39:05.538 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-30T01:39:05.538 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-03-30T01:39:05.538 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-30T01:39:05.538 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-03-30T01:39:05.538 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-03-30T01:39:05.538 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-03-30T01:39:05.538 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-03-30T01:39:05.538 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-03-30T01:39:05.538 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-03-30T01:39:05.538 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-03-30T01:39:05.539 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-03-30T01:39:05.539 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-03-30T01:39:05.539 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-03-30T01:39:05.539 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-03-30T01:39:05.539 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-03-30T01:39:05.539 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-03-30T01:39:05.539 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-03-30T01:39:05.539 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-03-30T01:39:05.539 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-03-30T01:39:05.539 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-03-30T01:39:05.539 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-03-30T01:39:05.539 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-03-30T01:39:05.539 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-03-30T01:39:05.539 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-03-30T01:39:05.539 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-03-30T01:39:05.540 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-03-30T01:39:05.540 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-03-30T01:39:05.540 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-03-30T01:39:05.540 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-03-30T01:39:05.540 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-03-30T01:39:05.540 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-03-30T01:39:05.540 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-03-30T01:39:05.540 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-03-30T01:39:05.540 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-03-30T01:39:05.540 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-03-30T01:39:05.540 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-03-30T01:39:05.540 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-03-30T01:39:05.540 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-03-30T01:39:05.540 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-03-30T01:39:05.540 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-03-30T01:39:05.540 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-03-30T01:39:05.541 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-03-30T01:39:05.541 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-03-30T01:39:05.541 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-03-30T01:39:05.541 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-03-30T01:39:05.541 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-03-30T01:39:05.541 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-03-30T01:39:05.541 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-03-30T01:39:05.541 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-03-30T01:39:05.541 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-03-30T01:39:05.541 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-03-30T01:39:05.541 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-03-30T01:39:05.541 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-03-30T01:39:05.541 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-03-30T01:39:05.541 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-03-30T01:39:05.541 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-03-30T01:39:05.541 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-03-30T01:39:05.542 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-03-30T01:39:05.542 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-03-30T01:39:05.542 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-03-30T01:39:05.542 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-03-30T01:39:05.542 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-03-30T01:39:05.542 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-30T01:39:05.542 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-03-30T01:39:05.542 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-03-30T01:39:05.542 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-03-30T01:39:05.542 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-30T01:39:05.542 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-03-30T01:39:05.542 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-30T01:39:05.542 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-03-30T01:39:05.543 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-30T01:39:05.543 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-03-30T01:39:05.543 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-30T01:39:05.543 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-30T01:39:05.543 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-30T01:39:05.543 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-03-30T01:39:05.543 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-03-30T01:39:05.543 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-03-30T01:39:05.543 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-03-30T01:39:05.543 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-03-30T01:39:05.543 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-03-30T01:39:05.543 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-03-30T01:39:05.543 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-03-30T01:39:05.543 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-03-30T01:39:05.543 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-03-30T01:39:05.544 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-03-30T01:39:05.544 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-03-30T01:39:05.544 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-03-30T01:39:05.544 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-03-30T01:39:05.544 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-03-30T01:39:05.544 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-03-30T01:39:05.544 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-03-30T01:39:05.544 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-03-30T01:39:05.544 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-03-30T01:39:05.544 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-03-30T01:39:05.544 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-03-30T01:39:05.544 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-03-30T01:39:05.544 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-03-30T01:39:05.544 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-03-30T01:39:05.544 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-03-30T01:39:05.545 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-03-30T01:39:05.545 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-03-30T01:39:05.545 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-03-30T01:39:05.545 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-03-30T01:39:05.545 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-30T01:39:05.545 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-03-30T01:39:05.545 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-03-30T01:39:05.545 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-03-30T01:39:05.545 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-03-30T01:39:05.545 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-03-30T01:39:05.545 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-03-30T01:39:05.545 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-03-30T01:39:05.545 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-03-30T01:39:05.546 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-03-30T01:39:05.546 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-03-30T01:39:05.546 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-03-30T01:39:05.546 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-03-30T01:39:05.546 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-03-30T01:39:05.546 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-03-30T01:39:05.546 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-03-30T01:39:05.546 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-03-30T01:39:05.546 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-03-30T01:39:05.546 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-30T01:39:05.546 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-03-30T01:39:05.546 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-03-30T01:39:05.546 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-03-30T01:39:05.547 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-03-30T01:39:05.547 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-03-30T01:39:05.547 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-03-30T01:39:05.547 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-03-30T01:39:05.547 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-03-30T01:39:05.547 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-03-30T01:39:05.547 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-03-30T01:39:05.547 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-03-30T01:39:05.547 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-03-30T01:39:05.547 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-03-30T01:39:05.547 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-30T01:39:05.547 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-03-30T01:39:05.547 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-03-30T01:39:05.548 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-03-30T01:39:05.548 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-03-30T01:39:05.548 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-03-30T01:39:05.548 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-03-30T01:39:05.548 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-03-30T01:39:05.548 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-03-30T01:39:05.548 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-03-30T01:39:05.548 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-03-30T01:39:05.548 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-03-30T01:39:05.548 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-03-30T01:39:05.548 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-03-30T01:39:05.548 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-03-30T01:39:05.548 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-03-30T01:39:05.549 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-03-30T01:39:05.549 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-03-30T01:39:05.549 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-03-30T01:39:05.549 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-03-30T01:39:05.549 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-03-30T01:39:05.549 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-03-30T01:39:05.549 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-03-30T01:39:05.549 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-30T01:39:05.549 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-30T01:39:05.549 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-30T01:39:05.549 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-30T01:39:05.549 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-30T01:39:05.549 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-30T01:39:05.550 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-30T01:39:05.550 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-30T01:39:05.550 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-30T01:39:05.550 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-30T01:39:05.550 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-30T01:39:05.550 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-30T01:39:05.550 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-30T01:39:05.550 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-30T01:39:05.550 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-30T01:39:05.550 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-30T01:39:05.550 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-30T01:39:05.550 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-30T01:39:05.550 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-30T01:39:05.551 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-30T01:39:05.551 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-03-30T01:39:05.551 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-30T01:39:05.551 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-30T01:39:05.551 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-30T01:39:05.551 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-03-30T01:39:05.551 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-03-30T01:39:05.551 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-03-30T01:39:05.551 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-03-30T01:39:05.551 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-03-30T01:39:05.551 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-03-30T01:39:05.551 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-03-30T01:39:05.551 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-03-30T01:39:05.551 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-03-30T01:39:05.551 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-03-30T01:39:05.552 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-03-30T01:39:05.552 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-03-30T01:39:05.552 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-03-30T01:39:05.552 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-03-30T01:39:05.552 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-03-30T01:39:05.552 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-03-30T01:39:05.552 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-03-30T01:39:05.552 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-03-30T01:39:05.552 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-03-30T01:39:05.552 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-03-30T01:39:05.552 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-30T01:39:05.552 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-03-30T01:39:05.552 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-30T01:39:05.552 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-03-30T01:39:05.553 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-03-30T01:39:05.553 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-03-30T01:39:05.553 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-03-30T01:39:05.553 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-03-30T01:39:05.553 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-03-30T01:39:05.553 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-03-30T01:39:05.553 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-03-30T01:39:05.553 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-03-30T01:39:05.553 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-03-30T01:39:05.553 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-03-30T01:39:05.553 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-03-30T01:39:05.553 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-30T01:39:05.553 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-30T01:39:05.553 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-30T01:39:05.553 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-30T01:39:05.554 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-30T01:39:05.554 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-30T01:39:05.554 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-30T01:39:05.554 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-30T01:39:05.554 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-30T01:39:05.554 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-30T01:39:05.554 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-30T01:39:05.554 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-30T01:39:05.554 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-30T01:39:05.554 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-30T01:39:05.554 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-30T01:39:05.554 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-30T01:39:05.554 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-30T01:39:05.554 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-30T01:39:05.555 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-30T01:39:05.555 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-30T01:39:05.555 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-30T01:39:05.555 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-03-30T01:39:05.555 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-03-30T01:39:05.555 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-03-30T01:39:05.555 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-03-30T01:39:05.555 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-03-30T01:39:05.555 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-03-30T01:39:05.555 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-03-30T01:39:05.555 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-03-30T01:39:05.555 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-03-30T01:39:05.555 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-03-30T01:39:05.555 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-03-30T01:39:05.556 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-03-30T01:39:05.556 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-03-30T01:39:05.556 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-03-30T01:39:05.556 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-03-30T01:39:05.556 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-03-30T01:39:05.556 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-30T01:39:05.556 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-03-30T01:39:05.556 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-03-30T01:39:05.556 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-03-30T01:39:05.556 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-03-30T01:39:05.556 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-03-30T01:39:05.556 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-30T01:39:05.556 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-03-30T01:39:05.556 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-03-30T01:39:05.556 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-03-30T01:39:05.557 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-30T01:39:05.557 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-30T01:39:05.557 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-30T01:39:05.557 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-30T01:39:05.557 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-30T01:39:05.557 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-30T01:39:05.557 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-30T01:39:05.557 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-30T01:39:05.557 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-30T01:39:05.557 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-30T01:39:05.557 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-30T01:39:05.557 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-30T01:39:05.557 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-30T01:39:05.557 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-30T01:39:05.558 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-30T01:39:05.558 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-30T01:39:05.558 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-30T01:39:05.558 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-30T01:39:05.558 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-30T01:39:05.558 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-30T01:39:05.558 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-30T01:39:05.558 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-30T01:39:05.558 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-30T01:39:05.558 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-30T01:39:05.558 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-03-30T01:39:05.558 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-03-30T01:39:05.558 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-30T01:39:05.558 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-03-30T01:39:05.559 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-03-30T01:39:05.559 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-03-30T01:39:05.559 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-03-30T01:39:05.559 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-30T01:39:05.559 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-03-30T01:39:05.559 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-03-30T01:39:05.559 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-03-30T01:39:05.559 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-03-30T01:39:05.559 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-03-30T01:39:05.559 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-03-30T01:39:05.559 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-03-30T01:39:05.559 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-03-30T01:39:05.559 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-03-30T01:39:05.559 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-03-30T01:39:05.559 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-03-30T01:39:05.560 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-03-30T01:39:05.560 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-03-30T01:39:05.560 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-03-30T01:39:05.560 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-30T01:39:05.560 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-30T01:39:05.560 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-30T01:39:05.560 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-30T01:39:05.560 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-30T01:39:05.560 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-30T01:39:05.560 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-30T01:39:05.560 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-30T01:39:05.560 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-30T01:39:05.560 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-30T01:39:05.560 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-30T01:39:05.561 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-30T01:39:05.561 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-30T01:39:05.561 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-30T01:39:05.561 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-30T01:39:05.561 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-03-30T01:39:05.561 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-30T01:39:05.561 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-30T01:39:05.561 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-30T01:39:05.561 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-30T01:39:05.561 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-30T01:39:05.561 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-30T01:39:05.561 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-30T01:39:05.561 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-30T01:39:05.561 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-30T01:39:05.561 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-30T01:39:05.562 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-30T01:39:05.562 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-30T01:39:05.562 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-30T01:39:05.562 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-30T01:39:05.562 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-03-30T01:39:05.562 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-03-30T01:39:05.562 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-30T01:39:05.562 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-30T01:39:05.562 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-30T01:39:05.562 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-30T01:39:05.562 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-30T01:39:05.562 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-30T01:39:05.562 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-30T01:39:05.562 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-30T01:39:05.562 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-30T01:39:05.563 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-30T01:39:05.563 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-30T01:39:05.563 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-30T01:39:05.563 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-30T01:39:05.563 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-03-30T01:39:05.563 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-30T01:39:05.563 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-03-30T01:39:05.563 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-03-30T01:39:05.563 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-30T01:39:05.563 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-30T01:39:05.563 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-03-30T01:39:05.563 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-03-30T01:39:05.563 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-30T01:39:05.563 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-30T01:39:05.563 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-03-30T01:39:05.564 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-03-30T01:39:05.564 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-30T01:39:05.564 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-03-30T01:39:05.564 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-30T01:39:05.564 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-30T01:39:05.564 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-03-30T01:39:05.564 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-03-30T01:39:05.564 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-03-30T01:39:05.564 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-30T01:39:05.564 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-03-30T01:39:05.564 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-30T01:39:05.564 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-03-30T01:39:05.564 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-03-30T01:39:05.565 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-03-30T01:39:05.565 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-03-30T01:39:05.565 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-03-30T01:39:05.565 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-03-30T01:39:05.565 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-03-30T01:39:05.565 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-03-30T01:39:05.565 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-03-30T01:39:05.565 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-03-30T01:39:05.565 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-03-30T01:39:05.565 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-03-30T01:39:05.565 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-03-30T01:39:05.565 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-03-30T01:39:05.565 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-30T01:39:05.565 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-30T01:39:05.566 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-30T01:39:05.566 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-03-30T01:39:05.566 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-03-30T01:39:05.566 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-03-30T01:39:05.566 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-03-30T01:39:05.566 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-30T01:39:05.566 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-03-30T01:39:05.566 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-03-30T01:39:05.566 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-30T01:39:05.566 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-03-30T01:39:05.566 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-03-30T01:39:05.566 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-30T01:39:05.567 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-03-30T01:39:05.567 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-30T01:39:05.567 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-03-30T01:39:05.567 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-30T01:39:05.567 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-30T01:39:05.567 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-03-30T01:39:05.567 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-03-30T01:39:05.567 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-03-30T01:39:05.567 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-03-30T01:39:05.567 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-03-30T01:39:05.567 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-03-30T01:39:05.567 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-03-30T01:39:05.567 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-03-30T01:39:05.567 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-03-30T01:39:05.568 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-03-30T01:39:05.568 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-03-30T01:39:05.568 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-03-30T01:39:05.568 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-03-30T01:39:05.568 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-03-30T01:39:05.568 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-03-30T01:39:05.568 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-03-30T01:39:05.568 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-03-30T01:39:05.568 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-03-30T01:39:05.568 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-03-30T01:39:05.568 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-03-30T01:39:05.568 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-03-30T01:39:05.568 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-03-30T01:39:05.568 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-03-30T01:39:05.569 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-03-30T01:39:05.569 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-03-30T01:39:05.569 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-03-30T01:39:05.569 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-03-30T01:39:05.569 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-03-30T01:39:05.569 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-03-30T01:39:05.569 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-03-30T01:39:05.569 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-03-30T01:39:05.569 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-03-30T01:39:05.569 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-03-30T01:39:05.569 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-03-30T01:39:05.569 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-03-30T01:39:05.569 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-03-30T01:39:05.569 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-03-30T01:39:05.570 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-03-30T01:39:05.570 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-03-30T01:39:05.570 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-03-30T01:39:05.570 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-03-30T01:39:05.570 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-03-30T01:39:05.570 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-03-30T01:39:05.570 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-03-30T01:39:05.570 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-03-30T01:39:05.570 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-03-30T01:39:05.570 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-03-30T01:39:05.570 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-03-30T01:39:05.571 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-03-30T01:39:05.571 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-03-30T01:39:05.571 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-03-30T01:39:05.571 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-03-30T01:39:05.571 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-03-30T01:39:05.571 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-03-30T01:39:05.571 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-03-30T01:39:05.571 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-03-30T01:39:05.571 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-03-30T01:39:05.571 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-03-30T01:39:05.571 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-03-30T01:39:05.571 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-03-30T01:39:05.571 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-03-30T01:39:05.571 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-03-30T01:39:05.572 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-03-30T01:39:05.572 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-03-30T01:39:05.572 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-03-30T01:39:05.572 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-03-30T01:39:05.572 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-03-30T01:39:05.572 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-03-30T01:39:05.572 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-03-30T01:39:05.572 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-03-30T01:39:05.572 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-03-30T01:39:05.572 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-03-30T01:39:05.572 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-03-30T01:39:05.572 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-03-30T01:39:05.572 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-03-30T01:39:05.572 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-03-30T01:39:05.572 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-03-30T01:39:05.573 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-03-30T01:39:05.573 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-03-30T01:39:05.573 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-03-30T01:39:05.573 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-03-30T01:39:05.573 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-03-30T01:39:05.573 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-03-30T01:39:05.573 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-03-30T01:39:05.573 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-03-30T01:39:05.573 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-03-30T01:39:05.573 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-03-30T01:39:05.573 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-03-30T01:39:05.573 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-03-30T01:39:05.573 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-03-30T01:39:05.573 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-03-30T01:39:05.573 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-03-30T01:39:05.574 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-03-30T01:39:05.574 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-03-30T01:39:05.574 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-03-30T01:39:05.574 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-03-30T01:39:05.574 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-03-30T01:39:05.574 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-03-30T01:39:05.574 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-03-30T01:39:05.574 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-03-30T01:39:05.574 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-03-30T01:39:05.574 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-03-30T01:39:05.574 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-03-30T01:39:05.574 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-03-30T01:39:05.574 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-03-30T01:39:05.574 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-03-30T01:39:05.575 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-03-30T01:39:05.575 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-03-30T01:39:05.575 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-03-30T01:39:05.575 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-03-30T01:39:05.575 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-03-30T01:39:05.575 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-03-30T01:39:05.575 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-03-30T01:39:05.575 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-03-30T01:39:05.575 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-03-30T01:39:05.575 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-30T01:39:05.575 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-30T01:39:05.575 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-03-30T01:39:05.575 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-03-30T01:39:05.575 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-30T01:39:05.575 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-03-30T01:39:05.576 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-03-30T01:39:05.576 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-03-30T01:39:05.576 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-03-30T01:39:05.576 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-03-30T01:39:05.576 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-03-30T01:39:05.576 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-30T01:39:05.576 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-30T01:39:05.576 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-03-30T01:39:05.576 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-30T01:39:05.576 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-30T01:39:05.576 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-03-30T01:39:05.576 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-30T01:39:05.576 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-03-30T01:39:05.576 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-03-30T01:39:05.576 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-03-30T01:39:05.577 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-30T01:39:05.577 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-03-30T01:39:05.577 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-03-30T01:39:05.577 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-03-30T01:39:05.577 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-03-30T01:39:05.577 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-03-30T01:39:05.577 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-03-30T01:39:05.577 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-03-30T01:39:05.577 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-03-30T01:39:05.577 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-03-30T01:39:05.577 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-03-30T01:39:05.577 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-03-30T01:39:05.577 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-03-30T01:39:05.577 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-03-30T01:39:05.577 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-03-30T01:39:05.578 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-03-30T01:39:05.578 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-03-30T01:39:05.578 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-03-30T01:39:05.578 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-03-30T01:39:05.578 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-30T01:39:05.582 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-03-30T01:39:05.582 DEBUG:teuthology.orchestra.run.smithi133:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-30T01:39:05.605 INFO:teuthology.orchestra.run.smithi133.stdout:postinstall scriptlet (using /bin/sh): 2024-03-30T01:39:05.605 INFO:teuthology.orchestra.run.smithi133.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-30T01:39:05.605 INFO:teuthology.orchestra.run.smithi133.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-30T01:39:05.605 INFO:teuthology.orchestra.run.smithi133.stdout:fi 2024-03-30T01:39:05.605 INFO:teuthology.orchestra.run.smithi133.stdout:for file in vmlinuz System.map config; do 2024-03-30T01:39:05.605 INFO:teuthology.orchestra.run.smithi133.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-03-30T01:39:05.605 INFO:teuthology.orchestra.run.smithi133.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-03-30T01:39:05.605 INFO:teuthology.orchestra.run.smithi133.stdout: fi 2024-03-30T01:39:05.605 INFO:teuthology.orchestra.run.smithi133.stdout:done 2024-03-30T01:39:05.605 INFO:teuthology.orchestra.run.smithi133.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-30T01:39:05.605 INFO:teuthology.orchestra.run.smithi133.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-30T01:39:05.605 INFO:teuthology.orchestra.run.smithi133.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-03-30T01:39:05.606 INFO:teuthology.orchestra.run.smithi133.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-30T01:39:05.606 INFO:teuthology.orchestra.run.smithi133.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-03-30T01:39:05.606 INFO:teuthology.orchestra.run.smithi133.stdout:fi 2024-03-30T01:39:05.606 INFO:teuthology.orchestra.run.smithi133.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-30T01:39:05.606 INFO:teuthology.orchestra.run.smithi133.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-30T01:39:05.606 INFO:teuthology.orchestra.run.smithi133.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-03-30T01:39:05.606 INFO:teuthology.orchestra.run.smithi133.stdout:fi 2024-03-30T01:39:05.607 DEBUG:teuthology.orchestra.run.smithi133:> sudo rpm -qi grub2-tools 2024-03-30T01:39:05.682 INFO:teuthology.orchestra.run.smithi133.stdout:Name : grub2-tools 2024-03-30T01:39:05.682 INFO:teuthology.orchestra.run.smithi133.stdout:Epoch : 1 2024-03-30T01:39:05.682 INFO:teuthology.orchestra.run.smithi133.stdout:Version : 2.06 2024-03-30T01:39:05.682 INFO:teuthology.orchestra.run.smithi133.stdout:Release : 68.el9 2024-03-30T01:39:05.682 INFO:teuthology.orchestra.run.smithi133.stdout:Architecture: x86_64 2024-03-30T01:39:05.682 INFO:teuthology.orchestra.run.smithi133.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-30T01:39:05.682 INFO:teuthology.orchestra.run.smithi133.stdout:Group : Unspecified 2024-03-30T01:39:05.682 INFO:teuthology.orchestra.run.smithi133.stdout:Size : 8264254 2024-03-30T01:39:05.682 INFO:teuthology.orchestra.run.smithi133.stdout:License : GPLv3+ 2024-03-30T01:39:05.683 INFO:teuthology.orchestra.run.smithi133.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-30T01:39:05.683 INFO:teuthology.orchestra.run.smithi133.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-30T01:39:05.683 INFO:teuthology.orchestra.run.smithi133.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-30T01:39:05.683 INFO:teuthology.orchestra.run.smithi133.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-30T01:39:05.683 INFO:teuthology.orchestra.run.smithi133.stdout:Packager : builder@centos.org 2024-03-30T01:39:05.683 INFO:teuthology.orchestra.run.smithi133.stdout:Vendor : CentOS 2024-03-30T01:39:05.683 INFO:teuthology.orchestra.run.smithi133.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-30T01:39:05.683 INFO:teuthology.orchestra.run.smithi133.stdout:Summary : Support tools for GRUB. 2024-03-30T01:39:05.683 INFO:teuthology.orchestra.run.smithi133.stdout:Description : 2024-03-30T01:39:05.683 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:39:05.683 INFO:teuthology.orchestra.run.smithi133.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-30T01:39:05.683 INFO:teuthology.orchestra.run.smithi133.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-30T01:39:05.683 INFO:teuthology.orchestra.run.smithi133.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-30T01:39:05.684 INFO:teuthology.orchestra.run.smithi133.stdout:hardware devices. 2024-03-30T01:39:05.684 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:39:05.684 INFO:teuthology.orchestra.run.smithi133.stdout:This subpackage provides tools for support of all platforms. 2024-03-30T01:39:05.685 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-30T01:39:05.685 INFO:teuthology.task.kernel:Updating grub on smithi133 to boot 6.8.0-g1df0c7e8a235 2024-03-30T01:39:05.685 DEBUG:teuthology.orchestra.run.smithi133:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-30T01:39:06.240 INFO:teuthology.orchestra.run.smithi133.stderr:Generating grub configuration file ... 2024-03-30T01:39:07.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-03-30T01:39:07.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T01:39:07.636 INFO:teuthology.orchestra.run.smithi133.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-30T01:39:07.676 INFO:teuthology.orchestra.run.smithi133.stderr:done 2024-03-30T01:39:07.678 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2024-03-30T01:39:07.693 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.0Qmy1cKHIe 2024-03-30T01:39:07.725 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0Qmy1cKHIe 2024-03-30T01:39:07.762 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.0Qmy1cKHIe 2024-03-30T01:39:07.898 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.0Qmy1cKHIe is 6KB 2024-03-30T01:39:07.947 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.0Qmy1cKHIe 2024-03-30T01:39:07.961 DEBUG:teuthology.orchestra.run.smithi133:> sudo /bin/ls /boot/loader/entries || true 2024-03-30T01:39:08.033 INFO:teuthology.orchestra.run.smithi133.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-30T01:39:08.034 INFO:teuthology.orchestra.run.smithi133.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-30T01:39:08.034 INFO:teuthology.orchestra.run.smithi133.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-30T01:39:08.034 INFO:teuthology.orchestra.run.smithi133.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-03-30T01:39:08.035 DEBUG:teuthology.orchestra.run.smithi133:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-03-30T01:39:08.172 DEBUG:teuthology.orchestra.run.smithi133:> sudo shutdown -r now 2024-03-30T01:39:10.238 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-03-30T01:39:28.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-03-30T01:39:28.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T01:39:28.951 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-03-30T01:39:29.638 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-03-30T01:39:29.638 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.8.0-g1df0c7e8a235"... 2024-03-30T01:39:29.639 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-03-30T01:39:29.677 INFO:teuthology.orchestra.run.smithi137.stdout:6.8.0-g1df0c7e8a235 2024-03-30T01:39:29.678 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-03-30T01:39:29.678 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-30T01:39:29.678 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-30T01:39:30.679 DEBUG:teuthology.parallel:result is None 2024-03-30T01:39:38.175 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-30T01:39:38.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-03-30T01:39:38.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T01:40:12.702 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-03-30T01:40:21.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-03-30T01:40:21.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T01:40:40.094 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-03-30T01:40:52.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-03-30T01:40:52.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T01:40:54.325 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-03-30T01:40:54.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-03-30T01:40:55.019 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.8.0-g1df0c7e8a235"... 2024-03-30T01:40:55.019 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2024-03-30T01:40:55.061 INFO:teuthology.orchestra.run.smithi133.stdout:6.8.0-g1df0c7e8a235 2024-03-30T01:40:55.061 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-03-30T01:40:55.061 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-30T01:40:55.062 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-30T01:40:56.064 DEBUG:teuthology.parallel:result is None 2024-03-30T01:40:56.064 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-30T01:40:56.072 INFO:teuthology.task.internal:Creating test directory... 2024-03-30T01:40:56.072 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-30T01:40:56.081 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-30T01:40:56.139 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-30T01:40:56.146 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-30T01:40:56.157 INFO:teuthology.task.internal:Creating archive directory... 2024-03-30T01:40:56.157 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-30T01:40:56.164 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-30T01:40:56.242 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-30T01:40:56.248 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-30T01:40:56.248 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-30T01:40:56.256 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-30T01:40:56.378 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T01:40:56.430 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T01:40:56.451 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T01:40:56.498 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T01:40:56.503 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-30T01:40:56.510 INFO:teuthology.task.internal:Configuring sudo... 2024-03-30T01:40:56.511 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-30T01:40:56.515 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-30T01:40:56.613 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-30T01:40:56.622 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-30T01:40:56.622 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-30T01:40:56.627 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-30T01:40:56.677 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T01:40:56.778 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T01:40:56.879 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T01:40:56.945 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T01:40:57.044 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:40:57.044 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-30T01:40:57.131 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T01:40:57.217 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T01:40:57.321 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T01:40:57.411 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T01:40:57.513 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:40:57.513 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-30T01:40:57.603 DEBUG:teuthology.orchestra.run.smithi133:> sudo service rsyslog restart 2024-03-30T01:40:57.609 DEBUG:teuthology.orchestra.run.smithi137:> sudo service rsyslog restart 2024-03-30T01:40:57.717 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-30T01:40:57.799 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-30T01:40:58.006 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-30T01:40:58.015 INFO:teuthology.task.internal:Starting timer... 2024-03-30T01:40:58.015 INFO:teuthology.run_tasks:Running task pcp... 2024-03-30T01:40:58.029 INFO:teuthology.run_tasks:Running task selinux... 2024-03-30T01:40:58.038 DEBUG:teuthology.orchestra.run.smithi133:> sudo service auditd rotate 2024-03-30T01:40:58.135 INFO:teuthology.orchestra.run.smithi133.stdout:Rotating logs: 2024-03-30T01:40:58.139 DEBUG:teuthology.orchestra.run.smithi137:> sudo service auditd rotate 2024-03-30T01:40:58.259 INFO:teuthology.orchestra.run.smithi137.stdout:Rotating logs: 2024-03-30T01:40:58.265 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-30T01:40:58.265 DEBUG:teuthology.orchestra.run.smithi133:> /usr/sbin/getenforce 2024-03-30T01:40:58.317 INFO:teuthology.orchestra.run.smithi133.stdout:Permissive 2024-03-30T01:40:58.317 DEBUG:teuthology.orchestra.run.smithi137:> /usr/sbin/getenforce 2024-03-30T01:40:58.371 INFO:teuthology.orchestra.run.smithi137.stdout:Permissive 2024-03-30T01:40:58.371 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi133.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi137.front.sepia.ceph.com': 'permissive'} 2024-03-30T01:40:58.371 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-30T01:40:58.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T01:40:58.448 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-30T01:40:58.526 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T01:40:58.527 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-30T01:40:58.527 DEBUG:teuthology.orchestra.run.smithi133:> sudo /usr/sbin/setenforce permissive 2024-03-30T01:40:58.612 DEBUG:teuthology.orchestra.run.smithi137:> sudo /usr/sbin/setenforce permissive 2024-03-30T01:40:58.710 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-30T01:40:58.721 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-30T01:40:58.738 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-30T01:40:58.739 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi133.front.sepia.ceph.com,smithi137.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-30T01:46:53.774 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi133.front.sepia.ceph.com'), Remote(name='ubuntu@smithi137.front.sepia.ceph.com')] 2024-03-30T01:46:53.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-03-30T01:46:53.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T01:46:53.925 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-03-30T01:46:54.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-03-30T01:46:54.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-03-30T01:46:54.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T01:46:54.224 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-03-30T01:46:54.392 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-03-30T01:46:54.392 INFO:teuthology.run_tasks:Running task clock... 2024-03-30T01:46:54.403 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-30T01:46:54.403 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-30T01:46:54.404 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T01:46:54.411 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-30T01:46:54.411 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T01:46:54.504 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-30T01:46:54.511 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-30T01:46:54.555 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-30T01:46:54.561 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-30T01:46:54.644 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: ntpd: command not found 2024-03-30T01:46:54.658 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: ntpd: command not found 2024-03-30T01:46:54.683 INFO:teuthology.orchestra.run.smithi133.stdout:506 Cannot talk to daemon 2024-03-30T01:46:54.700 INFO:teuthology.orchestra.run.smithi137.stdout:506 Cannot talk to daemon 2024-03-30T01:46:54.730 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-30T01:46:54.752 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-30T01:46:54.779 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-30T01:46:54.801 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-30T01:46:54.906 INFO:teuthology.orchestra.run.smithi133.stderr:bash: line 1: ntpq: command not found 2024-03-30T01:46:54.912 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-30T01:46:54.913 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2024-03-30T01:46:54.913 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T01:46:54.913 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T01:46:54.913 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T01:46:54.913 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T01:46:54.926 INFO:teuthology.orchestra.run.smithi137.stderr:bash: line 1: ntpq: command not found 2024-03-30T01:46:54.934 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-30T01:46:54.934 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2024-03-30T01:46:54.934 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T01:46:54.934 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T01:46:54.934 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T01:46:54.934 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T01:46:54.936 INFO:teuthology.run_tasks:Running task install... 2024-03-30T01:46:54.944 DEBUG:teuthology.task.install:project ceph 2024-03-30T01:46:54.944 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '470100a4ccbcf7769052bf09a5413881ccf1b97f'}} 2024-03-30T01:46:54.944 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '470100a4ccbcf7769052bf09a5413881ccf1b97f'} 2024-03-30T01:46:54.944 INFO:teuthology.task.install:Using flavor: default 2024-03-30T01:46:54.950 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-30T01:46:54.950 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-03-30T01:46:54.951 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '470100a4ccbcf7769052bf09a5413881ccf1b97f', 'tag': None, 'wait_for_package': False} 2024-03-30T01:46:54.951 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=470100a4ccbcf7769052bf09a5413881ccf1b97f 2024-03-30T01:46:54.953 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '470100a4ccbcf7769052bf09a5413881ccf1b97f', 'tag': None, 'wait_for_package': False} 2024-03-30T01:46:54.954 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=470100a4ccbcf7769052bf09a5413881ccf1b97f 2024-03-30T01:46:55.097 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240327.051042-reef/470100a4ccbcf7769052bf09a5413881ccf1b97f/centos/9/flavors/default/ 2024-03-30T01:46:55.098 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1018.g470100a4 2024-03-30T01:46:55.103 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240327.051042-reef/470100a4ccbcf7769052bf09a5413881ccf1b97f/centos/9/flavors/default/ 2024-03-30T01:46:55.103 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1018.g470100a4 2024-03-30T01:46:55.278 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240327.051042-reef/470100a4ccbcf7769052bf09a5413881ccf1b97f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240327.051042-reef/470100a4ccbcf7769052bf09a5413881ccf1b97f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240327.051042-reef/470100a4ccbcf7769052bf09a5413881ccf1b97f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-30T01:46:55.279 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:46:55.279 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-30T01:46:55.283 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240327.051042-reef/470100a4ccbcf7769052bf09a5413881ccf1b97f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240327.051042-reef/470100a4ccbcf7769052bf09a5413881ccf1b97f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240327.051042-reef/470100a4ccbcf7769052bf09a5413881ccf1b97f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-30T01:46:55.283 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:46:55.283 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-30T01:46:55.379 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-30T01:46:55.380 DEBUG:teuthology.orchestra.run.smithi133:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/470100a4ccbcf7769052bf09a5413881ccf1b97f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-30T01:46:55.385 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-30T01:46:55.385 DEBUG:teuthology.orchestra.run.smithi137:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/470100a4ccbcf7769052bf09a5413881ccf1b97f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-30T01:46:55.515 DEBUG:teuthology.orchestra.run.smithi133:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-30T01:46:55.523 DEBUG:teuthology.orchestra.run.smithi137:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-30T01:46:55.643 DEBUG:teuthology.orchestra.run.smithi133:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-30T01:46:55.653 DEBUG:teuthology.orchestra.run.smithi137:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-30T01:46:55.731 INFO:teuthology.orchestra.run.smithi133.stdout:check_obsoletes = 1 2024-03-30T01:46:55.735 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum clean all 2024-03-30T01:46:55.739 INFO:teuthology.orchestra.run.smithi137.stdout:check_obsoletes = 1 2024-03-30T01:46:55.744 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum clean all 2024-03-30T01:46:56.090 INFO:teuthology.orchestra.run.smithi133.stdout:74 files removed 2024-03-30T01:46:56.106 INFO:teuthology.orchestra.run.smithi137.stdout:74 files removed 2024-03-30T01:46:56.129 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-30T01:46:56.148 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-30T01:46:57.070 INFO:teuthology.orchestra.run.smithi137.stdout:ceph packages for x86_64 188 kB/s | 77 kB 00:00 2024-03-30T01:46:57.155 INFO:teuthology.orchestra.run.smithi133.stdout:ceph packages for x86_64 148 kB/s | 77 kB 00:00 2024-03-30T01:46:57.562 INFO:teuthology.orchestra.run.smithi137.stdout:ceph noarch packages 25 kB/s | 9.9 kB 00:00 2024-03-30T01:46:57.639 INFO:teuthology.orchestra.run.smithi133.stdout:ceph noarch packages 25 kB/s | 9.9 kB 00:00 2024-03-30T01:46:58.098 INFO:teuthology.orchestra.run.smithi137.stdout:ceph source packages 4.0 kB/s | 1.8 kB 00:00 2024-03-30T01:46:58.189 INFO:teuthology.orchestra.run.smithi133.stdout:ceph source packages 3.9 kB/s | 1.8 kB 00:00 2024-03-30T01:46:58.876 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-03-30T01:46:59.143 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS-9 - AppStream 6.9 MB/s | 6.7 MB 00:00 2024-03-30T01:47:00.518 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS-9 - BaseOS 5.3 MB/s | 2.0 MB 00:00 2024-03-30T01:47:00.801 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS-9 - BaseOS 6.4 MB/s | 2.0 MB 00:00 2024-03-30T01:47:01.814 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - BaseOS 8.8 MB/s | 8.0 MB 00:00 2024-03-30T01:47:02.107 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - BaseOS 8.6 MB/s | 8.0 MB 00:00 2024-03-30T01:47:04.321 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - AppStream 15 MB/s | 19 MB 00:01 2024-03-30T01:47:05.982 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - AppStream 7.1 MB/s | 19 MB 00:02 2024-03-30T01:47:16.800 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - CRB 731 kB/s | 6.1 MB 00:08 2024-03-30T01:47:18.742 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 16 kB 00:00 2024-03-30T01:47:20.602 INFO:teuthology.orchestra.run.smithi133.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-03-30T01:47:26.518 INFO:teuthology.orchestra.run.smithi133.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-03-30T01:47:29.308 INFO:teuthology.orchestra.run.smithi133.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-30T01:47:29.310 INFO:teuthology.orchestra.run.smithi133.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-30T01:47:29.328 INFO:teuthology.orchestra.run.smithi133.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-30T01:47:29.330 INFO:teuthology.orchestra.run.smithi133.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-30T01:47:29.331 INFO:teuthology.orchestra.run.smithi133.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-30T01:47:29.332 INFO:teuthology.orchestra.run.smithi133.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-30T01:47:29.335 INFO:teuthology.orchestra.run.smithi133.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-30T01:47:29.338 INFO:teuthology.orchestra.run.smithi133.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-30T01:47:29.339 INFO:teuthology.orchestra.run.smithi133.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-30T01:47:29.425 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-03-30T01:47:29.441 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================================ 2024-03-30T01:47:29.441 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-03-30T01:47:29.441 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================================ 2024-03-30T01:47:29.441 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-03-30T01:47:29.441 INFO:teuthology.orchestra.run.smithi133.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-30T01:47:29.441 INFO:teuthology.orchestra.run.smithi133.stdout: ceph x86_64 2:18.2.2-1018.g470100a4.el9 ceph 6.5 k 2024-03-30T01:47:29.442 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base x86_64 2:18.2.2-1018.g470100a4.el9 ceph 5.1 M 2024-03-30T01:47:29.442 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse x86_64 2:18.2.2-1018.g470100a4.el9 ceph 844 k 2024-03-30T01:47:29.442 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1018.g470100a4.el9 ceph 142 k 2024-03-30T01:47:29.442 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr x86_64 2:18.2.2-1018.g470100a4.el9 ceph 1.4 M 2024-03-30T01:47:29.442 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1018.g470100a4.el9 ceph-noarch 138 k 2024-03-30T01:47:29.442 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1018.g470100a4.el9 ceph-noarch 1.8 M 2024-03-30T01:47:29.442 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1018.g470100a4.el9 ceph-noarch 7.4 M 2024-03-30T01:47:29.442 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook noarch 2:18.2.2-1018.g470100a4.el9 ceph-noarch 49 k 2024-03-30T01:47:29.442 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw x86_64 2:18.2.2-1018.g470100a4.el9 ceph 7.7 M 2024-03-30T01:47:29.442 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test x86_64 2:18.2.2-1018.g470100a4.el9 ceph 40 M 2024-03-30T01:47:29.442 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-volume noarch 2:18.2.2-1018.g470100a4.el9 ceph-noarch 264 k 2024-03-30T01:47:29.442 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm noarch 2:18.2.2-1018.g470100a4.el9 ceph-noarch 224 k 2024-03-30T01:47:29.443 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-mirror x86_64 2:18.2.2-1018.g470100a4.el9 ceph 221 k 2024-03-30T01:47:29.443 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-top noarch 2:18.2.2-1018.g470100a4.el9 ceph-noarch 18 k 2024-03-30T01:47:29.443 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-30T01:47:29.443 INFO:teuthology.orchestra.run.smithi133.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-30T01:47:29.443 INFO:teuthology.orchestra.run.smithi133.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-30T01:47:29.443 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel x86_64 2:18.2.2-1018.g470100a4.el9 ceph 31 k 2024-03-30T01:47:29.443 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2 x86_64 2:18.2.2-1018.g470100a4.el9 ceph 702 k 2024-03-30T01:47:29.444 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel x86_64 2:18.2.2-1018.g470100a4.el9 ceph 127 k 2024-03-30T01:47:29.444 INFO:teuthology.orchestra.run.smithi133.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-30T01:47:29.444 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-30T01:47:29.444 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-30T01:47:29.444 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-03-30T01:47:29.444 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-03-30T01:47:29.444 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-03-30T01:47:29.444 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs x86_64 2:18.2.2-1018.g470100a4.el9 ceph 162 k 2024-03-30T01:47:29.444 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados x86_64 2:18.2.2-1018.g470100a4.el9 ceph 321 k 2024-03-30T01:47:29.444 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd x86_64 2:18.2.2-1018.g470100a4.el9 ceph 298 k 2024-03-30T01:47:29.444 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw x86_64 2:18.2.2-1018.g470100a4.el9 ceph 99 k 2024-03-30T01:47:29.445 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse x86_64 2:18.2.2-1018.g470100a4.el9 ceph 87 k 2024-03-30T01:47:29.445 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror x86_64 2:18.2.2-1018.g470100a4.el9 ceph 3.0 M 2024-03-30T01:47:29.445 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd x86_64 2:18.2.2-1018.g470100a4.el9 ceph 172 k 2024-03-30T01:47:29.445 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-30T01:47:29.445 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrading: 2024-03-30T01:47:29.445 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager x86_64 1:1.47.2-1.el9 CentOS-BaseOS 2.3 M 2024-03-30T01:47:29.445 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 CentOS-BaseOS 1.8 M 2024-03-30T01:47:29.445 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 CentOS-BaseOS 41 k 2024-03-30T01:47:29.445 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 CentOS-BaseOS 247 k 2024-03-30T01:47:29.445 INFO:teuthology.orchestra.run.smithi133.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-30T01:47:29.445 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-30T01:47:29.446 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-30T01:47:29.446 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-30T01:47:29.446 INFO:teuthology.orchestra.run.smithi133.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-30T01:47:29.446 INFO:teuthology.orchestra.run.smithi133.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-30T01:47:29.446 INFO:teuthology.orchestra.run.smithi133.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-30T01:47:29.446 INFO:teuthology.orchestra.run.smithi133.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-30T01:47:29.446 INFO:teuthology.orchestra.run.smithi133.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-30T01:47:29.446 INFO:teuthology.orchestra.run.smithi133.stdout: librados2 x86_64 2:18.2.2-1018.g470100a4.el9 ceph 3.3 M 2024-03-30T01:47:29.446 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1 x86_64 2:18.2.2-1018.g470100a4.el9 ceph 3.0 M 2024-03-30T01:47:29.446 INFO:teuthology.orchestra.run.smithi133.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-30T01:47:29.446 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-30T01:47:29.446 INFO:teuthology.orchestra.run.smithi133.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-30T01:47:29.446 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-30T01:47:29.447 INFO:teuthology.orchestra.run.smithi133.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-30T01:47:29.447 INFO:teuthology.orchestra.run.smithi133.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-30T01:47:29.447 INFO:teuthology.orchestra.run.smithi133.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-30T01:47:29.447 INFO:teuthology.orchestra.run.smithi133.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-30T01:47:29.447 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-30T01:47:29.447 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-03-30T01:47:29.447 INFO:teuthology.orchestra.run.smithi133.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-30T01:47:29.447 INFO:teuthology.orchestra.run.smithi133.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-30T01:47:29.447 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common x86_64 2:18.2.2-1018.g470100a4.el9 ceph 18 M 2024-03-30T01:47:29.447 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1018.g470100a4.el9 ceph-noarch 23 k 2024-03-30T01:47:29.447 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds x86_64 2:18.2.2-1018.g470100a4.el9 ceph 2.1 M 2024-03-30T01:47:29.447 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1018.g470100a4.el9 ceph-noarch 245 k 2024-03-30T01:47:29.447 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon x86_64 2:18.2.2-1018.g470100a4.el9 ceph 4.7 M 2024-03-30T01:47:29.447 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd x86_64 2:18.2.2-1018.g470100a4.el9 ceph 16 M 2024-03-30T01:47:29.448 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1018.g470100a4.el9 ceph-noarch 15 k 2024-03-30T01:47:29.448 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux x86_64 2:18.2.2-1018.g470100a4.el9 ceph 25 k 2024-03-30T01:47:29.448 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-30T01:47:29.448 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-30T01:47:29.448 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-30T01:47:29.448 INFO:teuthology.orchestra.run.smithi133.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-03-30T01:47:29.448 INFO:teuthology.orchestra.run.smithi133.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-30T01:47:29.448 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-30T01:47:29.448 INFO:teuthology.orchestra.run.smithi133.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-30T01:47:29.448 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-30T01:47:29.448 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-30T01:47:29.448 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite x86_64 2:18.2.2-1018.g470100a4.el9 ceph 166 k 2024-03-30T01:47:29.449 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-30T01:47:29.449 INFO:teuthology.orchestra.run.smithi133.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-30T01:47:29.449 INFO:teuthology.orchestra.run.smithi133.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-30T01:47:29.449 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-30T01:47:29.449 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-30T01:47:29.449 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1 x86_64 2:18.2.2-1018.g470100a4.el9 ceph 475 k 2024-03-30T01:47:29.449 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-30T01:47:29.449 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2 x86_64 2:18.2.2-1018.g470100a4.el9 ceph 4.5 M 2024-03-30T01:47:29.449 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-30T01:47:29.449 INFO:teuthology.orchestra.run.smithi133.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-30T01:47:29.449 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-30T01:47:29.449 INFO:teuthology.orchestra.run.smithi133.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-30T01:47:29.449 INFO:teuthology.orchestra.run.smithi133.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-30T01:47:29.450 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-30T01:47:29.450 INFO:teuthology.orchestra.run.smithi133.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-30T01:47:29.450 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-03-30T01:47:29.450 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-30T01:47:29.450 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-30T01:47:29.450 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-30T01:47:29.450 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-30T01:47:29.451 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse x86_64 2:18.2.2-1018.g470100a4.el9 ceph 45 k 2024-03-30T01:47:29.451 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common x86_64 2:18.2.2-1018.g470100a4.el9 ceph 129 k 2024-03-30T01:47:29.451 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-30T01:47:29.451 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-30T01:47:29.451 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-30T01:47:29.451 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-30T01:47:29.451 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-30T01:47:29.451 INFO:teuthology.orchestra.run.smithi133.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-30T01:47:29.451 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-30T01:47:29.451 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-30T01:47:29.451 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-30T01:47:29.451 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-30T01:47:29.451 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-30T01:47:29.451 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-30T01:47:29.451 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-30T01:47:29.452 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-30T01:47:29.452 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-30T01:47:29.452 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-30T01:47:29.452 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-30T01:47:29.452 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-30T01:47:29.452 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-30T01:47:29.452 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-30T01:47:29.452 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-30T01:47:29.452 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-30T01:47:29.452 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-30T01:47:29.452 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-30T01:47:29.452 INFO:teuthology.orchestra.run.smithi133.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-30T01:47:29.452 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-30T01:47:29.452 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-30T01:47:29.452 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-30T01:47:29.453 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-30T01:47:29.453 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-30T01:47:29.453 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-30T01:47:29.453 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-30T01:47:29.453 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-30T01:47:29.453 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-30T01:47:29.453 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-30T01:47:29.453 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-30T01:47:29.453 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-30T01:47:29.453 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-30T01:47:29.453 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-30T01:47:29.453 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-30T01:47:29.453 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-30T01:47:29.453 INFO:teuthology.orchestra.run.smithi133.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-30T01:47:29.453 INFO:teuthology.orchestra.run.smithi133.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-30T01:47:29.453 INFO:teuthology.orchestra.run.smithi133.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-30T01:47:29.454 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-30T01:47:29.454 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-30T01:47:29.454 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-30T01:47:29.454 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-30T01:47:29.454 INFO:teuthology.orchestra.run.smithi133.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-30T01:47:29.454 INFO:teuthology.orchestra.run.smithi133.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-30T01:47:29.454 INFO:teuthology.orchestra.run.smithi133.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-30T01:47:29.454 INFO:teuthology.orchestra.run.smithi133.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-30T01:47:29.454 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-30T01:47:29.454 INFO:teuthology.orchestra.run.smithi133.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-30T01:47:29.454 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:47:29.454 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-03-30T01:47:29.454 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================================ 2024-03-30T01:47:29.454 INFO:teuthology.orchestra.run.smithi133.stdout:Install 132 Packages 2024-03-30T01:47:29.455 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrade 24 Packages 2024-03-30T01:47:29.455 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:47:29.455 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 204 M 2024-03-30T01:47:29.455 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-03-30T01:47:30.277 INFO:teuthology.orchestra.run.smithi133.stdout:(1/156): ceph-18.2.2-1018.g470100a4.el9.x86_64. 27 kB/s | 6.5 kB 00:00 2024-03-30T01:47:30.478 INFO:teuthology.orchestra.run.smithi133.stdout:(2/156): ceph-fuse-18.2.2-1018.g470100a4.el9.x8 4.1 MB/s | 844 kB 00:00 2024-03-30T01:47:30.528 INFO:teuthology.orchestra.run.smithi133.stdout:(3/156): ceph-immutable-object-cache-18.2.2-101 2.8 MB/s | 142 kB 00:00 2024-03-30T01:47:30.778 INFO:teuthology.orchestra.run.smithi133.stdout:(4/156): ceph-mds-18.2.2-1018.g470100a4.el9.x86 8.5 MB/s | 2.1 MB 00:00 2024-03-30T01:47:30.970 INFO:teuthology.orchestra.run.smithi133.stdout:(5/156): ceph-mgr-18.2.2-1018.g470100a4.el9.x86 7.6 MB/s | 1.4 MB 00:00 2024-03-30T01:47:31.070 INFO:teuthology.orchestra.run.smithi133.stdout:(6/156): ceph-base-18.2.2-1018.g470100a4.el9.x8 4.9 MB/s | 5.1 MB 00:01 2024-03-30T01:47:31.629 INFO:teuthology.orchestra.run.smithi133.stdout:(7/156): ceph-mon-18.2.2-1018.g470100a4.el9.x86 7.1 MB/s | 4.7 MB 00:00 2024-03-30T01:47:32.596 INFO:teuthology.orchestra.run.smithi133.stdout:(8/156): ceph-common-18.2.2-1018.g470100a4.el9. 7.2 MB/s | 18 MB 00:02 2024-03-30T01:47:32.821 INFO:teuthology.orchestra.run.smithi133.stdout:(9/156): ceph-osd-18.2.2-1018.g470100a4.el9.x86 9.4 MB/s | 16 MB 00:01 2024-03-30T01:47:32.846 INFO:teuthology.orchestra.run.smithi133.stdout:(10/156): ceph-selinux-18.2.2-1018.g470100a4.el 101 kB/s | 25 kB 00:00 2024-03-30T01:47:33.006 INFO:teuthology.orchestra.run.smithi133.stdout:(11/156): ceph-radosgw-18.2.2-1018.g470100a4.el 5.6 MB/s | 7.7 MB 00:01 2024-03-30T01:47:33.039 INFO:teuthology.orchestra.run.smithi133.stdout:(12/156): cephfs-mirror-18.2.2-1018.g470100a4.e 1.1 MB/s | 221 kB 00:00 2024-03-30T01:47:33.082 INFO:teuthology.orchestra.run.smithi133.stdout:(13/156): libcephfs-devel-18.2.2-1018.g470100a4 419 kB/s | 31 kB 00:00 2024-03-30T01:47:33.140 INFO:teuthology.orchestra.run.smithi133.stdout:(14/156): libcephsqlite-18.2.2-1018.g470100a4.e 2.8 MB/s | 166 kB 00:00 2024-03-30T01:47:33.173 INFO:teuthology.orchestra.run.smithi133.stdout:(15/156): libcephfs2-18.2.2-1018.g470100a4.el9. 5.2 MB/s | 702 kB 00:00 2024-03-30T01:47:33.206 INFO:teuthology.orchestra.run.smithi133.stdout:(16/156): librados-devel-18.2.2-1018.g470100a4. 1.9 MB/s | 127 kB 00:00 2024-03-30T01:47:33.257 INFO:teuthology.orchestra.run.smithi133.stdout:(17/156): libradosstriper1-18.2.2-1018.g470100a 5.6 MB/s | 475 kB 00:00 2024-03-30T01:47:33.357 INFO:teuthology.orchestra.run.smithi133.stdout:(18/156): python3-ceph-argparse-18.2.2-1018.g47 454 kB/s | 45 kB 00:00 2024-03-30T01:47:33.449 INFO:teuthology.orchestra.run.smithi133.stdout:(19/156): python3-ceph-common-18.2.2-1018.g4701 1.4 MB/s | 129 kB 00:00 2024-03-30T01:47:33.541 INFO:teuthology.orchestra.run.smithi133.stdout:(20/156): python3-cephfs-18.2.2-1018.g470100a4. 1.7 MB/s | 162 kB 00:00 2024-03-30T01:47:33.642 INFO:teuthology.orchestra.run.smithi133.stdout:(21/156): python3-rados-18.2.2-1018.g470100a4.e 3.2 MB/s | 321 kB 00:00 2024-03-30T01:47:33.767 INFO:teuthology.orchestra.run.smithi133.stdout:(22/156): librgw2-18.2.2-1018.g470100a4.el9.x86 8.0 MB/s | 4.5 MB 00:00 2024-03-30T01:47:33.800 INFO:teuthology.orchestra.run.smithi133.stdout:(23/156): python3-rbd-18.2.2-1018.g470100a4.el9 1.8 MB/s | 298 kB 00:00 2024-03-30T01:47:33.825 INFO:teuthology.orchestra.run.smithi133.stdout:(24/156): python3-rgw-18.2.2-1018.g470100a4.el9 1.7 MB/s | 99 kB 00:00 2024-03-30T01:47:33.875 INFO:teuthology.orchestra.run.smithi133.stdout:(25/156): rbd-fuse-18.2.2-1018.g470100a4.el9.x8 1.1 MB/s | 87 kB 00:00 2024-03-30T01:47:33.976 INFO:teuthology.orchestra.run.smithi133.stdout:(26/156): rbd-nbd-18.2.2-1018.g470100a4.el9.x86 1.7 MB/s | 172 kB 00:00 2024-03-30T01:47:34.067 INFO:teuthology.orchestra.run.smithi133.stdout:(27/156): ceph-grafana-dashboards-18.2.2-1018.g 257 kB/s | 23 kB 00:00 2024-03-30T01:47:34.201 INFO:teuthology.orchestra.run.smithi133.stdout:(28/156): rbd-mirror-18.2.2-1018.g470100a4.el9. 8.0 MB/s | 3.0 MB 00:00 2024-03-30T01:47:34.235 INFO:teuthology.orchestra.run.smithi133.stdout:(29/156): ceph-mgr-cephadm-18.2.2-1018.g470100a 833 kB/s | 138 kB 00:00 2024-03-30T01:47:34.477 INFO:teuthology.orchestra.run.smithi133.stdout:(30/156): ceph-mgr-dashboard-18.2.2-1018.g47010 6.5 MB/s | 1.8 MB 00:00 2024-03-30T01:47:34.568 INFO:teuthology.orchestra.run.smithi133.stdout:(31/156): ceph-mgr-modules-core-18.2.2-1018.g47 2.6 MB/s | 245 kB 00:00 2024-03-30T01:47:34.644 INFO:teuthology.orchestra.run.smithi133.stdout:(32/156): ceph-mgr-rook-18.2.2-1018.g470100a4.e 664 kB/s | 49 kB 00:00 2024-03-30T01:47:34.711 INFO:teuthology.orchestra.run.smithi133.stdout:(33/156): ceph-prometheus-alerts-18.2.2-1018.g4 227 kB/s | 15 kB 00:00 2024-03-30T01:47:34.803 INFO:teuthology.orchestra.run.smithi133.stdout:(34/156): ceph-volume-18.2.2-1018.g470100a4.el9 2.8 MB/s | 264 kB 00:00 2024-03-30T01:47:34.895 INFO:teuthology.orchestra.run.smithi133.stdout:(35/156): cephadm-18.2.2-1018.g470100a4.el9.noa 2.4 MB/s | 224 kB 00:00 2024-03-30T01:47:35.003 INFO:teuthology.orchestra.run.smithi133.stdout:(36/156): cephfs-top-18.2.2-1018.g470100a4.el9. 170 kB/s | 18 kB 00:00 2024-03-30T01:47:35.137 INFO:teuthology.orchestra.run.smithi133.stdout:(37/156): ceph-mgr-diskprediction-local-18.2.2- 8.2 MB/s | 7.4 MB 00:00 2024-03-30T01:47:35.679 INFO:teuthology.orchestra.run.smithi133.stdout:(38/156): ceph-test-18.2.2-1018.g470100a4.el9.x 14 MB/s | 40 MB 00:02 2024-03-30T01:47:35.746 INFO:teuthology.orchestra.run.smithi133.stdout:(39/156): automake-1.16.2-8.el9.noarch.rpm 893 kB/s | 662 kB 00:00 2024-03-30T01:47:35.763 INFO:teuthology.orchestra.run.smithi133.stdout:(40/156): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 106 kB 00:00 2024-03-30T01:47:35.805 INFO:teuthology.orchestra.run.smithi133.stdout:(41/156): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 307 kB 00:00 2024-03-30T01:47:35.830 INFO:teuthology.orchestra.run.smithi133.stdout:(42/156): flexiblas-3.0.4-8.el9.x86_64.rpm 477 kB/s | 32 kB 00:00 2024-03-30T01:47:36.039 INFO:teuthology.orchestra.run.smithi133.stdout:(43/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-03-30T01:47:36.064 INFO:teuthology.orchestra.run.smithi133.stdout:(44/156): flexiblas-openblas-openmp-3.0.4-8.el9 75 kB/s | 17 kB 00:00 2024-03-30T01:47:36.106 INFO:teuthology.orchestra.run.smithi133.stdout:(45/156): libaio-devel-0.3.111-13.el9.x86_64.rp 260 kB/s | 10 kB 00:00 2024-03-30T01:47:36.131 INFO:teuthology.orchestra.run.smithi133.stdout:(46/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 159 kB 00:00 2024-03-30T01:47:36.181 INFO:teuthology.orchestra.run.smithi133.stdout:(47/156): bison-3.7.4-5.el9.x86_64.rpm 942 kB/s | 920 kB 00:00 2024-03-30T01:47:36.206 INFO:teuthology.orchestra.run.smithi133.stdout:(48/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 447 kB/s | 44 kB 00:00 2024-03-30T01:47:36.248 INFO:teuthology.orchestra.run.smithi133.stdout:(49/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.6 MB/s | 661 kB 00:00 2024-03-30T01:47:36.274 INFO:teuthology.orchestra.run.smithi133.stdout:(50/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 780 kB/s | 46 kB 00:00 2024-03-30T01:47:36.316 INFO:teuthology.orchestra.run.smithi133.stdout:(51/156): libtool-2.4.6-45.el9.x86_64.rpm 5.6 MB/s | 578 kB 00:00 2024-03-30T01:47:36.341 INFO:teuthology.orchestra.run.smithi133.stdout:(52/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 282 kB 00:00 2024-03-30T01:47:36.374 INFO:teuthology.orchestra.run.smithi133.stdout:(53/156): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.2 MB/s | 217 kB 00:00 2024-03-30T01:47:36.408 INFO:teuthology.orchestra.run.smithi133.stdout:(54/156): openblas-0.3.21-2.el9.x86_64.rpm 533 kB/s | 34 kB 00:00 2024-03-30T01:47:36.542 INFO:teuthology.orchestra.run.smithi133.stdout:(55/156): openblas-openmp-0.3.21-2.el9.x86_64.r 24 MB/s | 4.7 MB 00:00 2024-03-30T01:47:36.675 INFO:teuthology.orchestra.run.smithi133.stdout:(56/156): postgresql-13.14-1.el9.x86_64.rpm 5.2 MB/s | 1.5 MB 00:00 2024-03-30T01:47:36.709 INFO:teuthology.orchestra.run.smithi133.stdout:(57/156): postgresql-contrib-13.14-1.el9.x86_64 2.8 MB/s | 817 kB 00:00 2024-03-30T01:47:36.734 INFO:teuthology.orchestra.run.smithi133.stdout:(58/156): postgresql-private-libs-13.14-1.el9.x 735 kB/s | 132 kB 00:00 2024-03-30T01:47:36.976 INFO:teuthology.orchestra.run.smithi133.stdout:(59/156): python3-jsonpatch-1.21-16.el9.noarch. 103 kB/s | 24 kB 00:00 2024-03-30T01:47:37.084 INFO:teuthology.orchestra.run.smithi133.stdout:(60/156): postgresql-server-13.14-1.el9.x86_64. 15 MB/s | 5.7 MB 00:00 2024-03-30T01:47:37.201 INFO:teuthology.orchestra.run.smithi133.stdout:(61/156): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 5.8 MB 00:00 2024-03-30T01:47:37.226 INFO:teuthology.orchestra.run.smithi133.stdout:(62/156): python3-jsonpointer-2.0-4.el9.noarch. 74 kB/s | 18 kB 00:00 2024-03-30T01:47:37.243 INFO:teuthology.orchestra.run.smithi133.stdout:(63/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.5 MB/s | 144 kB 00:00 2024-03-30T01:47:37.269 INFO:teuthology.orchestra.run.smithi133.stdout:(64/156): python3-markupsafe-1.1.1-12.el9.x86_6 483 kB/s | 32 kB 00:00 2024-03-30T01:47:37.436 INFO:teuthology.orchestra.run.smithi133.stdout:(65/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 4.8 MB 00:00 2024-03-30T01:47:37.469 INFO:teuthology.orchestra.run.smithi133.stdout:(66/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 217 kB 00:00 2024-03-30T01:47:37.494 INFO:teuthology.orchestra.run.smithi133.stdout:(67/156): python3-oauthlib-3.1.1-5.el9.noarch.r 828 kB/s | 174 kB 00:00 2024-03-30T01:47:37.520 INFO:teuthology.orchestra.run.smithi133.stdout:(68/156): python3-packaging-20.9-5.el9.noarch.r 858 kB/s | 69 kB 00:00 2024-03-30T01:47:37.537 INFO:teuthology.orchestra.run.smithi133.stdout:(69/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 41 kB 00:00 2024-03-30T01:47:37.562 INFO:teuthology.orchestra.run.smithi133.stdout:(70/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 132 kB 00:00 2024-03-30T01:47:37.595 INFO:teuthology.orchestra.run.smithi133.stdout:(71/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.8 MB/s | 211 kB 00:00 2024-03-30T01:47:37.612 INFO:teuthology.orchestra.run.smithi133.stdout:(72/156): python3-pytz-2021.1-5.el9.noarch.rpm 999 kB/s | 47 kB 00:00 2024-03-30T01:47:37.629 INFO:teuthology.orchestra.run.smithi133.stdout:(73/156): python3-requests-oauthlib-1.3.0-12.el 668 kB/s | 43 kB 00:00 2024-03-30T01:47:37.696 INFO:teuthology.orchestra.run.smithi133.stdout:(74/156): python3-toml-0.10.2-6.el9.noarch.rpm 736 kB/s | 39 kB 00:00 2024-03-30T01:47:37.730 INFO:teuthology.orchestra.run.smithi133.stdout:(75/156): socat-1.7.4.1-5.el9.x86_64.rpm 3.4 MB/s | 300 kB 00:00 2024-03-30T01:47:37.805 INFO:teuthology.orchestra.run.smithi133.stdout:(76/156): uuid-1.6.2-55.el9.x86_64.rpm 537 kB/s | 56 kB 00:00 2024-03-30T01:47:37.864 INFO:teuthology.orchestra.run.smithi133.stdout:(77/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 522 kB/s | 63 kB 00:00 2024-03-30T01:47:38.097 INFO:teuthology.orchestra.run.smithi133.stdout:(78/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-03-30T01:47:38.122 INFO:teuthology.orchestra.run.smithi133.stdout:(79/156): zlib-devel-1.2.11-40.el9.x86_64.rpm 144 kB/s | 44 kB 00:00 2024-03-30T01:47:38.147 INFO:teuthology.orchestra.run.smithi133.stdout:(80/156): fuse-2.9.9-15.el9.x86_64.rpm 291 kB/s | 79 kB 00:00 2024-03-30T01:47:38.181 INFO:teuthology.orchestra.run.smithi133.stdout:(81/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.9 MB/s | 241 kB 00:00 2024-03-30T01:47:38.232 INFO:teuthology.orchestra.run.smithi133.stdout:(82/156): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-03-30T01:47:38.257 INFO:teuthology.orchestra.run.smithi133.stdout:(83/156): python3-ply-3.11-14.el9.noarch.rpm 976 kB/s | 103 kB 00:00 2024-03-30T01:47:38.282 INFO:teuthology.orchestra.run.smithi133.stdout:(84/156): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 124 kB 00:00 2024-03-30T01:47:38.316 INFO:teuthology.orchestra.run.smithi133.stdout:(85/156): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2024-03-30T01:47:38.924 INFO:teuthology.orchestra.run.smithi133.stdout:(86/156): libquadmath-11.4.1-3.el9.x86_64.rpm 321 kB/s | 195 kB 00:00 2024-03-30T01:47:39.074 INFO:teuthology.orchestra.run.smithi133.stdout:(87/156): python3-requests-2.25.1-8.el9.noarch. 836 kB/s | 125 kB 00:00 2024-03-30T01:47:39.183 INFO:teuthology.orchestra.run.smithi133.stdout:(88/156): elfutils-libelf-devel-0.190-2.el9.x86 200 kB/s | 21 kB 00:00 2024-03-30T01:47:39.275 INFO:teuthology.orchestra.run.smithi133.stdout:(89/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 280 kB/s | 25 kB 00:00 2024-03-30T01:47:39.633 INFO:teuthology.orchestra.run.smithi133.stdout:(90/156): openssl-devel-3.0.7-27.el9.x86_64.rpm 12 MB/s | 4.1 MB 00:00 2024-03-30T01:47:39.783 INFO:teuthology.orchestra.run.smithi133.stdout:(91/156): python3-devel-3.9.17-2.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-03-30T01:47:39.909 INFO:teuthology.orchestra.run.smithi133.stdout:(92/156): python3-jinja2-2.11.3-5.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-03-30T01:47:40.042 INFO:teuthology.orchestra.run.smithi133.stdout:(93/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 706 kB/s | 94 kB 00:00 2024-03-30T01:47:40.476 INFO:teuthology.orchestra.run.smithi133.stdout:(94/156): jq-1.6-16.el9.x86_64.rpm 84 kB/s | 187 kB 00:02 2024-03-30T01:47:40.518 INFO:teuthology.orchestra.run.smithi133.stdout:(95/156): fmt-8.1.1-5.el9.x86_64.rpm 233 kB/s | 111 kB 00:00 2024-03-30T01:47:40.635 INFO:teuthology.orchestra.run.smithi133.stdout:(96/156): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.9 MB/s | 309 kB 00:00 2024-03-30T01:47:41.043 INFO:teuthology.orchestra.run.smithi133.stdout:(97/156): libarrow-9.0.0-10.el9.x86_64.rpm 8.4 MB/s | 4.4 MB 00:00 2024-03-30T01:47:41.068 INFO:teuthology.orchestra.run.smithi133.stdout:(98/156): libarrow-doc-9.0.0-10.el9.noarch.rpm 60 kB/s | 26 kB 00:00 2024-03-30T01:47:41.161 INFO:teuthology.orchestra.run.smithi133.stdout:(99/156): liboath-2.6.7-2.el9.x86_64.rpm 534 kB/s | 49 kB 00:00 2024-03-30T01:47:41.211 INFO:teuthology.orchestra.run.smithi133.stdout:(100/156): libunwind-1.6.2-1.el9.x86_64.rpm 478 kB/s | 67 kB 00:00 2024-03-30T01:47:41.336 INFO:teuthology.orchestra.run.smithi133.stdout:(101/156): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.7 MB/s | 838 kB 00:00 2024-03-30T01:47:41.370 INFO:teuthology.orchestra.run.smithi133.stdout:(102/156): python3-asyncssh-2.13.2-5.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-03-30T01:47:41.445 INFO:teuthology.orchestra.run.smithi133.stdout:(103/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 421 kB/s | 43 kB 00:00 2024-03-30T01:47:41.470 INFO:teuthology.orchestra.run.smithi133.stdout:(104/156): python3-cachetools-4.2.4-1.el9.noarc 323 kB/s | 32 kB 00:00 2024-03-30T01:47:41.546 INFO:teuthology.orchestra.run.smithi133.stdout:(105/156): python3-certifi-2021.10.8-2.el9.noar 151 kB/s | 15 kB 00:00 2024-03-30T01:47:41.571 INFO:teuthology.orchestra.run.smithi133.stdout:(106/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-03-30T01:47:41.654 INFO:teuthology.orchestra.run.smithi133.stdout:(107/156): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-03-30T01:47:41.763 INFO:teuthology.orchestra.run.smithi133.stdout:(108/156): python3-google-auth-2.28.2-1.el9.noa 1.0 MB/s | 203 kB 00:00 2024-03-30T01:47:41.805 INFO:teuthology.orchestra.run.smithi133.stdout:(109/156): python3-jaraco-8.2.1-3.el9.noarch.rp 72 kB/s | 11 kB 00:00 2024-03-30T01:47:41.838 INFO:teuthology.orchestra.run.smithi133.stdout:(110/156): python3-jaraco-classes-3.2.1-5.el9.n 237 kB/s | 18 kB 00:00 2024-03-30T01:47:41.872 INFO:teuthology.orchestra.run.smithi133.stdout:(111/156): python3-jaraco-collections-3.0.0-8.e 349 kB/s | 23 kB 00:00 2024-03-30T01:47:41.981 INFO:teuthology.orchestra.run.smithi133.stdout:(112/156): python3-jaraco-functools-3.5.0-2.el9 137 kB/s | 19 kB 00:00 2024-03-30T01:47:41.997 INFO:teuthology.orchestra.run.smithi133.stdout:(113/156): python3-jaraco-text-3.2.0-6.el9.noar 158 kB/s | 20 kB 00:00 2024-03-30T01:47:42.140 INFO:teuthology.orchestra.run.smithi133.stdout:(114/156): python3-kubernetes-26.1.0-2.el9.noar 7.3 MB/s | 1.0 MB 00:00 2024-03-30T01:47:42.156 INFO:teuthology.orchestra.run.smithi133.stdout:(115/156): python3-logutils-0.3.5-21.el9.noarch 294 kB/s | 46 kB 00:00 2024-03-30T01:47:42.232 INFO:teuthology.orchestra.run.smithi133.stdout:(116/156): python3-more-itertools-8.12.0-2.el9. 866 kB/s | 79 kB 00:00 2024-03-30T01:47:42.257 INFO:teuthology.orchestra.run.smithi133.stdout:(117/156): python3-natsort-7.1.1-5.el9.noarch.r 581 kB/s | 58 kB 00:00 2024-03-30T01:47:42.316 INFO:teuthology.orchestra.run.smithi133.stdout:(118/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-03-30T01:47:42.341 INFO:teuthology.orchestra.run.smithi133.stdout:(119/156): python3-portend-3.1.0-2.el9.noarch.r 198 kB/s | 16 kB 00:00 2024-03-30T01:47:42.391 INFO:teuthology.orchestra.run.smithi133.stdout:(120/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-03-30T01:47:42.425 INFO:teuthology.orchestra.run.smithi133.stdout:(121/156): python3-repoze-lru-0.7-16.el9.noarch 370 kB/s | 31 kB 00:00 2024-03-30T01:47:42.483 INFO:teuthology.orchestra.run.smithi133.stdout:(122/156): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-03-30T01:47:42.509 INFO:teuthology.orchestra.run.smithi133.stdout:(123/156): python3-rsa-4.9-2.el9.noarch.rpm 711 kB/s | 59 kB 00:00 2024-03-30T01:47:42.567 INFO:teuthology.orchestra.run.smithi133.stdout:(124/156): python3-tempora-5.0.0-2.el9.noarch.r 434 kB/s | 36 kB 00:00 2024-03-30T01:47:42.592 INFO:teuthology.orchestra.run.smithi133.stdout:(125/156): python3-typing-extensions-4.4.0-2.el 615 kB/s | 51 kB 00:00 2024-03-30T01:47:42.651 INFO:teuthology.orchestra.run.smithi133.stdout:(126/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-03-30T01:47:42.685 INFO:teuthology.orchestra.run.smithi133.stdout:(127/156): python3-websocket-client-1.2.3-2.el9 980 kB/s | 90 kB 00:00 2024-03-30T01:47:42.752 INFO:teuthology.orchestra.run.smithi133.stdout:(128/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-03-30T01:47:42.785 INFO:teuthology.orchestra.run.smithi133.stdout:(129/156): python3-zc-lockfile-2.0-10.el9.noarc 200 kB/s | 20 kB 00:00 2024-03-30T01:47:42.844 INFO:teuthology.orchestra.run.smithi133.stdout:(130/156): re2-20211101-3.el9.x86_64.rpm 2.1 MB/s | 192 kB 00:00 2024-03-30T01:47:43.061 INFO:teuthology.orchestra.run.smithi133.stdout:(131/156): thrift-0.15.0-2.el9.x86_64.rpm 5.8 MB/s | 1.6 MB 00:00 2024-03-30T01:47:43.235 INFO:teuthology.orchestra.run.smithi133.stdout:(132/156): librados2-18.2.2-1018.g470100a4.el9. 8.4 MB/s | 3.3 MB 00:00 2024-03-30T01:47:43.362 INFO:teuthology.orchestra.run.smithi133.stdout:(133/156): NetworkManager-1.47.2-1.el9.x86_64.r 18 MB/s | 2.3 MB 00:00 2024-03-30T01:47:43.462 INFO:teuthology.orchestra.run.smithi133.stdout:(134/156): NetworkManager-libnm-1.47.2-1.el9.x8 18 MB/s | 1.8 MB 00:00 2024-03-30T01:47:43.504 INFO:teuthology.orchestra.run.smithi133.stdout:(135/156): NetworkManager-team-1.47.2-1.el9.x86 1.0 MB/s | 41 kB 00:00 2024-03-30T01:47:43.554 INFO:teuthology.orchestra.run.smithi133.stdout:(136/156): NetworkManager-tui-1.47.2-1.el9.x86_ 4.9 MB/s | 247 kB 00:00 2024-03-30T01:47:43.638 INFO:teuthology.orchestra.run.smithi133.stdout:(137/156): librbd1-18.2.2-1018.g470100a4.el9.x8 5.2 MB/s | 3.0 MB 00:00 2024-03-30T01:47:43.679 INFO:teuthology.orchestra.run.smithi133.stdout:(138/156): xfsdump-3.1.12-4.el9.x86_64.rpm 2.5 MB/s | 321 kB 00:00 2024-03-30T01:47:43.880 INFO:teuthology.orchestra.run.smithi133.stdout:(139/156): elfutils-debuginfod-client-0.190-2.e 182 kB/s | 36 kB 00:00 2024-03-30T01:47:44.155 INFO:teuthology.orchestra.run.smithi133.stdout:(140/156): elfutils-libelf-0.190-2.el9.x86_64.r 701 kB/s | 192 kB 00:00 2024-03-30T01:47:44.355 INFO:teuthology.orchestra.run.smithi133.stdout:(141/156): elfutils-libs-0.190-2.el9.x86_64.rpm 1.3 MB/s | 256 kB 00:00 2024-03-30T01:47:44.481 INFO:teuthology.orchestra.run.smithi133.stdout:(142/156): libacl-2.3.1-4.el9.x86_64.rpm 185 kB/s | 23 kB 00:00 2024-03-30T01:47:44.589 INFO:teuthology.orchestra.run.smithi133.stdout:(143/156): libblkid-2.37.4-18.el9.x86_64.rpm 1.0 MB/s | 108 kB 00:00 2024-03-30T01:47:44.698 INFO:teuthology.orchestra.run.smithi133.stdout:(144/156): libfdisk-2.37.4-18.el9.x86_64.rpm 1.4 MB/s | 155 kB 00:00 2024-03-30T01:47:44.807 INFO:teuthology.orchestra.run.smithi133.stdout:(145/156): libmount-2.37.4-18.el9.x86_64.rpm 1.2 MB/s | 136 kB 00:00 2024-03-30T01:47:44.915 INFO:teuthology.orchestra.run.smithi133.stdout:(146/156): libsmartcols-2.37.4-18.el9.x86_64.rp 593 kB/s | 64 kB 00:00 2024-03-30T01:47:45.015 INFO:teuthology.orchestra.run.smithi133.stdout:(147/156): libuuid-2.37.4-18.el9.x86_64.rpm 288 kB/s | 29 kB 00:00 2024-03-30T01:47:45.057 INFO:teuthology.orchestra.run.smithi133.stdout:(148/156): acl-2.3.1-4.el9.x86_64.rpm 50 kB/s | 71 kB 00:01 2024-03-30T01:47:45.233 INFO:teuthology.orchestra.run.smithi133.stdout:(149/156): openssl-3.0.7-27.el9.x86_64.rpm 5.6 MB/s | 1.2 MB 00:00 2024-03-30T01:47:45.466 INFO:teuthology.orchestra.run.smithi133.stdout:(150/156): util-linux-2.37.4-18.el9.x86_64.rpm 9.8 MB/s | 2.3 MB 00:00 2024-03-30T01:47:45.591 INFO:teuthology.orchestra.run.smithi133.stdout:(151/156): util-linux-core-2.37.4-18.el9.x86_64 3.7 MB/s | 465 kB 00:00 2024-03-30T01:47:45.692 INFO:teuthology.orchestra.run.smithi133.stdout:(152/156): util-linux-user-2.37.4-18.el9.x86_64 313 kB/s | 31 kB 00:00 2024-03-30T01:47:45.825 INFO:teuthology.orchestra.run.smithi133.stdout:(153/156): xfsprogs-6.3.0-1.el9.x86_64.rpm 8.1 MB/s | 1.1 MB 00:00 2024-03-30T01:47:45.951 INFO:teuthology.orchestra.run.smithi133.stdout:(154/156): libacl-devel-2.3.1-4.el9.x86_64.rpm 598 kB/s | 74 kB 00:00 2024-03-30T01:47:47.826 INFO:teuthology.orchestra.run.smithi133.stdout:(155/156): libgfortran-11.4.1-3.el9.x86_64.rpm 84 kB/s | 803 kB 00:09 2024-03-30T01:48:18.823 INFO:teuthology.orchestra.run.smithi133.stdout:(156/156): openssl-libs-3.0.7-27.el9.x86_64.rpm 65 kB/s | 2.2 MB 00:33 2024-03-30T01:48:18.832 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-03-30T01:48:18.833 INFO:teuthology.orchestra.run.smithi133.stdout:Total 4.1 MB/s | 204 MB 00:49 2024-03-30T01:48:19.908 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-03-30T01:48:20.278 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-03-30T01:48:20.278 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-03-30T01:48:22.557 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-03-30T01:48:22.557 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-03-30T01:48:29.047 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-03-30T01:48:29.148 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/180 2024-03-30T01:48:29.188 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/180 2024-03-30T01:48:29.218 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/180 2024-03-30T01:48:29.262 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/180 2024-03-30T01:48:29.384 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/180 2024-03-30T01:48:29.480 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/180 2024-03-30T01:48:29.534 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/180 2024-03-30T01:48:29.567 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/180 2024-03-30T01:48:29.658 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/180 2024-03-30T01:48:30.057 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/180 2024-03-30T01:48:30.090 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librados2-2:18.2.2-1018.g470100a4.el9.x86_64 10/180 2024-03-30T01:48:30.235 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-2:18.2.2-1018.g470100a4.el9.x86_64 10/180 2024-03-30T01:48:30.266 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs2-2:18.2.2-1018.g470100a4.el9.x86_64 11/180 2024-03-30T01:48:30.412 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephfs2-2:18.2.2-1018.g470100a4.el9.x86_64 11/180 2024-03-30T01:48:30.448 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rados-2:18.2.2-1018.g470100a4.el9.x86_64 12/180 2024-03-30T01:48:30.501 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/180 2024-03-30T01:48:30.770 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/180 2024-03-30T01:48:30.830 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/180 2024-03-30T01:48:30.854 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephsqlite-2:18.2.2-1018.g470100a4.el9.x86_64 16/180 2024-03-30T01:48:31.002 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1018.g470100a4.el9.x86_64 16/180 2024-03-30T01:48:31.030 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libradosstriper1-2:18.2.2-1018.g470100a4.el9.x86 17/180 2024-03-30T01:48:31.120 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1018.g470100a4.el9.x86 17/180 2024-03-30T01:48:31.185 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/180 2024-03-30T01:48:31.247 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 19/180 2024-03-30T01:48:31.574 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 20/180 2024-03-30T01:48:31.771 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 21/180 2024-03-30T01:48:31.842 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 21/180 2024-03-30T01:48:32.031 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 22/180 2024-03-30T01:48:32.099 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 22/180 2024-03-30T01:48:32.492 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 22/180 2024-03-30T01:48:32.529 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 23/180 2024-03-30T01:48:32.584 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : liboath-2.6.7-2.el9.x86_64 24/180 2024-03-30T01:48:32.644 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 25/180 2024-03-30T01:48:32.754 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 26/180 2024-03-30T01:48:32.818 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/180 2024-03-30T01:48:32.861 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/180 2024-03-30T01:48:32.950 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 29/180 2024-03-30T01:48:32.993 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 30/180 2024-03-30T01:48:33.026 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 31/180 2024-03-30T01:48:33.107 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 32/180 2024-03-30T01:48:33.148 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-common-2:18.2.2-1018.g470100a4.el9. 33/180 2024-03-30T01:48:33.196 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-argparse-2:18.2.2-1018.g470100a4.el 34/180 2024-03-30T01:48:33.296 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cephfs-2:18.2.2-1018.g470100a4.el9.x86_6 35/180 2024-03-30T01:48:33.462 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/180 2024-03-30T01:48:33.524 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/180 2024-03-30T01:48:34.205 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/180 2024-03-30T01:48:34.297 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/180 2024-03-30T01:48:34.397 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/180 2024-03-30T01:48:34.465 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 41/180 2024-03-30T01:48:34.480 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - CRB 74 kB/s | 6.1 MB 01:24 2024-03-30T01:48:34.499 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 41/180 2024-03-30T01:48:34.567 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 42/180 2024-03-30T01:48:34.630 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librados-devel-2:18.2.2-1018.g470100a4.el9.x86_6 43/180 2024-03-30T01:48:34.672 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/180 2024-03-30T01:48:35.077 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 45/180 2024-03-30T01:48:35.322 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 46/180 2024-03-30T01:48:35.395 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 47/180 2024-03-30T01:48:35.440 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 48/180 2024-03-30T01:48:35.654 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/180 2024-03-30T01:48:35.703 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 50/180 2024-03-30T01:48:35.843 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : re2-1:20211101-3.el9.x86_64 51/180 2024-03-30T01:48:35.882 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 52/180 2024-03-30T01:48:35.947 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 53/180 2024-03-30T01:48:36.032 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/180 2024-03-30T01:48:36.065 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/180 2024-03-30T01:48:36.094 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/180 2024-03-30T01:48:36.151 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/180 2024-03-30T01:48:36.209 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/180 2024-03-30T01:48:36.262 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 59/180 2024-03-30T01:48:36.451 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 60/180 2024-03-30T01:48:36.506 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 61/180 2024-03-30T01:48:36.549 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/180 2024-03-30T01:48:36.677 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/180 2024-03-30T01:48:36.712 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 64/180 2024-03-30T01:48:36.748 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/180 2024-03-30T01:48:36.778 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/180 2024-03-30T01:48:36.815 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 67/180 2024-03-30T01:48:36.955 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : fmt-8.1.1-5.el9.x86_64 68/180 2024-03-30T01:48:37.013 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 69/180 2024-03-30T01:48:37.055 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 16 kB 00:01 2024-03-30T01:48:37.091 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ply-3.11-14.el9.noarch 70/180 2024-03-30T01:48:37.171 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 71/180 2024-03-30T01:48:37.417 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 72/180 2024-03-30T01:48:37.473 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 73/180 2024-03-30T01:48:37.684 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 74/180 2024-03-30T01:48:37.729 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/180 2024-03-30T01:48:37.769 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/180 2024-03-30T01:48:37.798 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : fuse-2.9.9-15.el9.x86_64 77/180 2024-03-30T01:48:37.839 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 78/180 2024-03-30T01:48:37.884 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 79/180 2024-03-30T01:48:37.939 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : uuid-1.6.2-55.el9.x86_64 80/180 2024-03-30T01:48:37.978 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 81/180 2024-03-30T01:48:38.103 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 82/180 2024-03-30T01:48:38.148 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 83/180 2024-03-30T01:48:38.183 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 84/180 2024-03-30T01:48:38.238 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 85/180 2024-03-30T01:48:38.278 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 86/180 2024-03-30T01:48:38.419 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 87/180 2024-03-30T01:48:38.467 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 88/180 2024-03-30T01:48:38.530 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 89/180 2024-03-30T01:48:38.675 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-packaging-20.9-5.el9.noarch 90/180 2024-03-30T01:48:38.740 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 91/180 2024-03-30T01:48:38.763 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-03-30T01:48:39.716 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/180 2024-03-30T01:48:39.764 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 93/180 2024-03-30T01:48:39.797 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 94/180 2024-03-30T01:48:39.830 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 95/180 2024-03-30T01:48:40.073 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-0.3.21-2.el9.x86_64 96/180 2024-03-30T01:48:40.110 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 97/180 2024-03-30T01:48:40.210 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/180 2024-03-30T01:48:40.981 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/180 2024-03-30T01:48:41.105 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 100/180 2024-03-30T01:48:42.605 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 101/180 2024-03-30T01:48:42.695 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 102/180 2024-03-30T01:48:42.732 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 103/180 2024-03-30T01:48:42.764 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : jq-1.6-16.el9.x86_64 104/180 2024-03-30T01:48:42.804 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 105/180 2024-03-30T01:48:43.171 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 106/180 2024-03-30T01:48:43.203 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librbd1-2:18.2.2-1018.g470100a4.el9.x86_64 107/180 2024-03-30T01:48:43.314 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-2:18.2.2-1018.g470100a4.el9.x86_64 107/180 2024-03-30T01:48:43.342 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rbd-2:18.2.2-1018.g470100a4.el9.x86_64 108/180 2024-03-30T01:48:43.398 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 109/180 2024-03-30T01:48:43.862 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 110/180 2024-03-30T01:48:43.889 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librgw2-2:18.2.2-1018.g470100a4.el9.x86_64 111/180 2024-03-30T01:48:43.979 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librgw2-2:18.2.2-1018.g470100a4.el9.x86_64 111/180 2024-03-30T01:48:44.007 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rgw-2:18.2.2-1018.g470100a4.el9.x86_64 112/180 2024-03-30T01:48:44.690 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-03-30T01:48:46.390 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:18.2.2-1018.g470100a4.el9.x86_64 113/180 2024-03-30T01:48:46.437 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-common-2:18.2.2-1018.g470100a4.el9.x86_64 113/180 2024-03-30T01:48:47.048 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:18.2.2-1018.g470100a4.el9.x86_64 113/180 2024-03-30T01:48:47.090 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-base-2:18.2.2-1018.g470100a4.el9.x86_64 114/180 2024-03-30T01:48:47.245 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-base-2:18.2.2-1018.g470100a4.el9.x86_64 114/180 2024-03-30T01:48:47.245 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-30T01:48:47.245 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-30T01:48:47.246 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:48:47.313 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-selinux-2:18.2.2-1018.g470100a4.el9.x86_64 115/180 2024-03-30T01:48:47.385 INFO:teuthology.orchestra.run.smithi137.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-30T01:48:47.386 INFO:teuthology.orchestra.run.smithi137.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-30T01:48:47.407 INFO:teuthology.orchestra.run.smithi137.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-30T01:48:47.408 INFO:teuthology.orchestra.run.smithi137.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-30T01:48:47.410 INFO:teuthology.orchestra.run.smithi137.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-30T01:48:47.411 INFO:teuthology.orchestra.run.smithi137.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-30T01:48:47.413 INFO:teuthology.orchestra.run.smithi137.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-30T01:48:47.417 INFO:teuthology.orchestra.run.smithi137.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-30T01:48:47.418 INFO:teuthology.orchestra.run.smithi137.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-30T01:48:47.503 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-03-30T01:48:47.521 INFO:teuthology.orchestra.run.smithi137.stdout:============================================================================================ 2024-03-30T01:48:47.521 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-03-30T01:48:47.521 INFO:teuthology.orchestra.run.smithi137.stdout:============================================================================================ 2024-03-30T01:48:47.521 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-03-30T01:48:47.521 INFO:teuthology.orchestra.run.smithi137.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-30T01:48:47.521 INFO:teuthology.orchestra.run.smithi137.stdout: ceph x86_64 2:18.2.2-1018.g470100a4.el9 ceph 6.5 k 2024-03-30T01:48:47.521 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base x86_64 2:18.2.2-1018.g470100a4.el9 ceph 5.1 M 2024-03-30T01:48:47.522 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse x86_64 2:18.2.2-1018.g470100a4.el9 ceph 844 k 2024-03-30T01:48:47.522 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1018.g470100a4.el9 ceph 142 k 2024-03-30T01:48:47.522 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr x86_64 2:18.2.2-1018.g470100a4.el9 ceph 1.4 M 2024-03-30T01:48:47.522 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1018.g470100a4.el9 ceph-noarch 138 k 2024-03-30T01:48:47.522 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1018.g470100a4.el9 ceph-noarch 1.8 M 2024-03-30T01:48:47.522 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1018.g470100a4.el9 ceph-noarch 7.4 M 2024-03-30T01:48:47.522 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook noarch 2:18.2.2-1018.g470100a4.el9 ceph-noarch 49 k 2024-03-30T01:48:47.522 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw x86_64 2:18.2.2-1018.g470100a4.el9 ceph 7.7 M 2024-03-30T01:48:47.522 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test x86_64 2:18.2.2-1018.g470100a4.el9 ceph 40 M 2024-03-30T01:48:47.522 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-volume noarch 2:18.2.2-1018.g470100a4.el9 ceph-noarch 264 k 2024-03-30T01:48:47.522 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm noarch 2:18.2.2-1018.g470100a4.el9 ceph-noarch 224 k 2024-03-30T01:48:47.522 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-mirror x86_64 2:18.2.2-1018.g470100a4.el9 ceph 221 k 2024-03-30T01:48:47.523 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-top noarch 2:18.2.2-1018.g470100a4.el9 ceph-noarch 18 k 2024-03-30T01:48:47.523 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-30T01:48:47.523 INFO:teuthology.orchestra.run.smithi137.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-30T01:48:47.523 INFO:teuthology.orchestra.run.smithi137.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-30T01:48:47.523 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel x86_64 2:18.2.2-1018.g470100a4.el9 ceph 31 k 2024-03-30T01:48:47.523 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2 x86_64 2:18.2.2-1018.g470100a4.el9 ceph 702 k 2024-03-30T01:48:47.523 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel x86_64 2:18.2.2-1018.g470100a4.el9 ceph 127 k 2024-03-30T01:48:47.523 INFO:teuthology.orchestra.run.smithi137.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-30T01:48:47.523 INFO:teuthology.orchestra.run.smithi137.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-30T01:48:47.523 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-30T01:48:47.523 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-03-30T01:48:47.523 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-03-30T01:48:47.523 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-03-30T01:48:47.523 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs x86_64 2:18.2.2-1018.g470100a4.el9 ceph 162 k 2024-03-30T01:48:47.524 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados x86_64 2:18.2.2-1018.g470100a4.el9 ceph 321 k 2024-03-30T01:48:47.524 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd x86_64 2:18.2.2-1018.g470100a4.el9 ceph 298 k 2024-03-30T01:48:47.524 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw x86_64 2:18.2.2-1018.g470100a4.el9 ceph 99 k 2024-03-30T01:48:47.524 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse x86_64 2:18.2.2-1018.g470100a4.el9 ceph 87 k 2024-03-30T01:48:47.524 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror x86_64 2:18.2.2-1018.g470100a4.el9 ceph 3.0 M 2024-03-30T01:48:47.524 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd x86_64 2:18.2.2-1018.g470100a4.el9 ceph 172 k 2024-03-30T01:48:47.524 INFO:teuthology.orchestra.run.smithi137.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-30T01:48:47.524 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrading: 2024-03-30T01:48:47.524 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager x86_64 1:1.47.2-1.el9 CentOS-BaseOS 2.3 M 2024-03-30T01:48:47.524 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 CentOS-BaseOS 1.8 M 2024-03-30T01:48:47.524 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 CentOS-BaseOS 41 k 2024-03-30T01:48:47.524 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 CentOS-BaseOS 247 k 2024-03-30T01:48:47.524 INFO:teuthology.orchestra.run.smithi137.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-30T01:48:47.524 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-30T01:48:47.524 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-30T01:48:47.525 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-30T01:48:47.525 INFO:teuthology.orchestra.run.smithi137.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-30T01:48:47.525 INFO:teuthology.orchestra.run.smithi137.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-30T01:48:47.525 INFO:teuthology.orchestra.run.smithi137.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-30T01:48:47.525 INFO:teuthology.orchestra.run.smithi137.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-30T01:48:47.525 INFO:teuthology.orchestra.run.smithi137.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-30T01:48:47.525 INFO:teuthology.orchestra.run.smithi137.stdout: librados2 x86_64 2:18.2.2-1018.g470100a4.el9 ceph 3.3 M 2024-03-30T01:48:47.525 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1 x86_64 2:18.2.2-1018.g470100a4.el9 ceph 3.0 M 2024-03-30T01:48:47.525 INFO:teuthology.orchestra.run.smithi137.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-30T01:48:47.525 INFO:teuthology.orchestra.run.smithi137.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-30T01:48:47.525 INFO:teuthology.orchestra.run.smithi137.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-30T01:48:47.525 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-30T01:48:47.525 INFO:teuthology.orchestra.run.smithi137.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-30T01:48:47.525 INFO:teuthology.orchestra.run.smithi137.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-30T01:48:47.526 INFO:teuthology.orchestra.run.smithi137.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-30T01:48:47.526 INFO:teuthology.orchestra.run.smithi137.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-30T01:48:47.526 INFO:teuthology.orchestra.run.smithi137.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-30T01:48:47.526 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-03-30T01:48:47.526 INFO:teuthology.orchestra.run.smithi137.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-30T01:48:47.526 INFO:teuthology.orchestra.run.smithi137.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-30T01:48:47.526 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common x86_64 2:18.2.2-1018.g470100a4.el9 ceph 18 M 2024-03-30T01:48:47.526 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1018.g470100a4.el9 ceph-noarch 23 k 2024-03-30T01:48:47.526 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds x86_64 2:18.2.2-1018.g470100a4.el9 ceph 2.1 M 2024-03-30T01:48:47.526 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1018.g470100a4.el9 ceph-noarch 245 k 2024-03-30T01:48:47.526 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon x86_64 2:18.2.2-1018.g470100a4.el9 ceph 4.7 M 2024-03-30T01:48:47.526 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd x86_64 2:18.2.2-1018.g470100a4.el9 ceph 16 M 2024-03-30T01:48:47.526 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1018.g470100a4.el9 ceph-noarch 15 k 2024-03-30T01:48:47.527 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux x86_64 2:18.2.2-1018.g470100a4.el9 ceph 25 k 2024-03-30T01:48:47.527 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-30T01:48:47.527 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-30T01:48:47.527 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-30T01:48:47.527 INFO:teuthology.orchestra.run.smithi137.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-03-30T01:48:47.527 INFO:teuthology.orchestra.run.smithi137.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-30T01:48:47.527 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-30T01:48:47.527 INFO:teuthology.orchestra.run.smithi137.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-30T01:48:47.527 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-30T01:48:47.527 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-30T01:48:47.527 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite x86_64 2:18.2.2-1018.g470100a4.el9 ceph 166 k 2024-03-30T01:48:47.527 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-30T01:48:47.527 INFO:teuthology.orchestra.run.smithi137.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-30T01:48:47.527 INFO:teuthology.orchestra.run.smithi137.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-30T01:48:47.528 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-30T01:48:47.528 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-30T01:48:47.528 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1 x86_64 2:18.2.2-1018.g470100a4.el9 ceph 475 k 2024-03-30T01:48:47.528 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-30T01:48:47.528 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2 x86_64 2:18.2.2-1018.g470100a4.el9 ceph 4.5 M 2024-03-30T01:48:47.528 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-30T01:48:47.528 INFO:teuthology.orchestra.run.smithi137.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-30T01:48:47.528 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-30T01:48:47.528 INFO:teuthology.orchestra.run.smithi137.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-30T01:48:47.528 INFO:teuthology.orchestra.run.smithi137.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-30T01:48:47.528 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-30T01:48:47.528 INFO:teuthology.orchestra.run.smithi137.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-30T01:48:47.528 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-03-30T01:48:47.528 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-30T01:48:47.528 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-30T01:48:47.529 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-30T01:48:47.529 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-30T01:48:47.529 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse x86_64 2:18.2.2-1018.g470100a4.el9 ceph 45 k 2024-03-30T01:48:47.529 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common x86_64 2:18.2.2-1018.g470100a4.el9 ceph 129 k 2024-03-30T01:48:47.529 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-30T01:48:47.529 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-30T01:48:47.529 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-30T01:48:47.529 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-30T01:48:47.529 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-30T01:48:47.529 INFO:teuthology.orchestra.run.smithi137.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-30T01:48:47.529 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-30T01:48:47.529 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-30T01:48:47.529 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-30T01:48:47.529 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-30T01:48:47.529 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-30T01:48:47.530 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-30T01:48:47.530 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-30T01:48:47.530 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-30T01:48:47.530 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-30T01:48:47.530 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-30T01:48:47.530 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-30T01:48:47.530 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-30T01:48:47.530 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-30T01:48:47.530 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-30T01:48:47.530 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-30T01:48:47.530 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-30T01:48:47.530 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-30T01:48:47.530 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-30T01:48:47.530 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-30T01:48:47.531 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-30T01:48:47.531 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-30T01:48:47.531 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-30T01:48:47.531 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-30T01:48:47.531 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-30T01:48:47.531 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-30T01:48:47.531 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-30T01:48:47.531 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-30T01:48:47.531 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-30T01:48:47.531 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-30T01:48:47.531 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-30T01:48:47.531 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-30T01:48:47.531 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-30T01:48:47.531 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-30T01:48:47.531 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-30T01:48:47.532 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-30T01:48:47.532 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-30T01:48:47.532 INFO:teuthology.orchestra.run.smithi137.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-30T01:48:47.532 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-30T01:48:47.532 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-30T01:48:47.532 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-30T01:48:47.532 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-30T01:48:47.532 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-30T01:48:47.532 INFO:teuthology.orchestra.run.smithi137.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-30T01:48:47.532 INFO:teuthology.orchestra.run.smithi137.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-30T01:48:47.532 INFO:teuthology.orchestra.run.smithi137.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-30T01:48:47.532 INFO:teuthology.orchestra.run.smithi137.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-30T01:48:47.532 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-30T01:48:47.532 INFO:teuthology.orchestra.run.smithi137.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-30T01:48:47.532 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:48:47.532 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-03-30T01:48:47.533 INFO:teuthology.orchestra.run.smithi137.stdout:============================================================================================ 2024-03-30T01:48:47.533 INFO:teuthology.orchestra.run.smithi137.stdout:Install 132 Packages 2024-03-30T01:48:47.533 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrade 24 Packages 2024-03-30T01:48:47.533 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:48:47.533 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 204 M 2024-03-30T01:48:47.533 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-03-30T01:48:48.399 INFO:teuthology.orchestra.run.smithi137.stdout:(1/156): ceph-18.2.2-1018.g470100a4.el9.x86_64. 18 kB/s | 6.5 kB 00:00 2024-03-30T01:48:48.800 INFO:teuthology.orchestra.run.smithi137.stdout:(2/156): ceph-fuse-18.2.2-1018.g470100a4.el9.x8 2.1 MB/s | 844 kB 00:00 2024-03-30T01:48:48.883 INFO:teuthology.orchestra.run.smithi137.stdout:(3/156): ceph-immutable-object-cache-18.2.2-101 1.7 MB/s | 142 kB 00:00 2024-03-30T01:48:51.100 INFO:teuthology.orchestra.run.smithi137.stdout:(4/156): ceph-mds-18.2.2-1018.g470100a4.el9.x86 974 kB/s | 2.1 MB 00:02 2024-03-30T01:48:51.341 INFO:teuthology.orchestra.run.smithi137.stdout:(5/156): ceph-base-18.2.2-1018.g470100a4.el9.x8 1.5 MB/s | 5.1 MB 00:03 2024-03-30T01:48:52.534 INFO:teuthology.orchestra.run.smithi137.stdout:(6/156): ceph-common-18.2.2-1018.g470100a4.el9. 4.1 MB/s | 18 MB 00:04 2024-03-30T01:48:52.584 INFO:teuthology.orchestra.run.smithi137.stdout:(7/156): ceph-mgr-18.2.2-1018.g470100a4.el9.x86 1.0 MB/s | 1.4 MB 00:01 2024-03-30T01:48:52.818 INFO:teuthology.orchestra.run.smithi137.stdout:(8/156): ceph-mon-18.2.2-1018.g470100a4.el9.x86 3.2 MB/s | 4.7 MB 00:01 2024-03-30T01:48:52.884 INFO:teuthology.orchestra.run.smithi137.stdout:(9/156): ceph-selinux-18.2.2-1018.g470100a4.el9 385 kB/s | 25 kB 00:00 2024-03-30T01:48:54.635 INFO:teuthology.orchestra.run.smithi137.stdout:(10/156): ceph-osd-18.2.2-1018.g470100a4.el9.x8 7.9 MB/s | 16 MB 00:02 2024-03-30T01:48:54.693 INFO:teuthology.orchestra.run.smithi137.stdout:(11/156): cephfs-mirror-18.2.2-1018.g470100a4.e 3.8 MB/s | 221 kB 00:00 2024-03-30T01:48:54.743 INFO:teuthology.orchestra.run.smithi137.stdout:(12/156): libcephfs-devel-18.2.2-1018.g470100a4 631 kB/s | 31 kB 00:00 2024-03-30T01:48:54.898 INFO:teuthology.orchestra.run.smithi137.stdout:(13/156): libcephfs2-18.2.2-1018.g470100a4.el9. 4.5 MB/s | 702 kB 00:00 2024-03-30T01:48:54.952 INFO:teuthology.orchestra.run.smithi137.stdout:(14/156): libcephsqlite-18.2.2-1018.g470100a4.e 3.1 MB/s | 166 kB 00:00 2024-03-30T01:48:55.011 INFO:teuthology.orchestra.run.smithi137.stdout:(15/156): librados-devel-18.2.2-1018.g470100a4. 2.2 MB/s | 127 kB 00:00 2024-03-30T01:48:55.186 INFO:teuthology.orchestra.run.smithi137.stdout:(16/156): ceph-radosgw-18.2.2-1018.g470100a4.el 3.0 MB/s | 7.7 MB 00:02 2024-03-30T01:48:55.219 INFO:teuthology.orchestra.run.smithi137.stdout:(17/156): libradosstriper1-18.2.2-1018.g470100a 2.2 MB/s | 475 kB 00:00 2024-03-30T01:48:55.270 INFO:teuthology.orchestra.run.smithi137.stdout:(18/156): python3-ceph-argparse-18.2.2-1018.g47 913 kB/s | 45 kB 00:00 2024-03-30T01:48:55.320 INFO:teuthology.orchestra.run.smithi137.stdout:(19/156): python3-ceph-common-18.2.2-1018.g4701 2.6 MB/s | 129 kB 00:00 2024-03-30T01:48:55.370 INFO:teuthology.orchestra.run.smithi137.stdout:(20/156): python3-cephfs-18.2.2-1018.g470100a4. 3.2 MB/s | 162 kB 00:00 2024-03-30T01:48:55.459 INFO:teuthology.orchestra.run.smithi137.stdout:(21/156): python3-rados-18.2.2-1018.g470100a4.e 3.6 MB/s | 321 kB 00:00 2024-03-30T01:48:55.521 INFO:teuthology.orchestra.run.smithi137.stdout:(22/156): python3-rbd-18.2.2-1018.g470100a4.el9 4.8 MB/s | 298 kB 00:00 2024-03-30T01:48:55.571 INFO:teuthology.orchestra.run.smithi137.stdout:(23/156): python3-rgw-18.2.2-1018.g470100a4.el9 2.0 MB/s | 99 kB 00:00 2024-03-30T01:48:55.621 INFO:teuthology.orchestra.run.smithi137.stdout:(24/156): rbd-fuse-18.2.2-1018.g470100a4.el9.x8 1.7 MB/s | 87 kB 00:00 2024-03-30T01:48:56.013 INFO:teuthology.orchestra.run.smithi137.stdout:(25/156): rbd-mirror-18.2.2-1018.g470100a4.el9. 7.6 MB/s | 3.0 MB 00:00 2024-03-30T01:48:56.072 INFO:teuthology.orchestra.run.smithi137.stdout:(26/156): rbd-nbd-18.2.2-1018.g470100a4.el9.x86 3.0 MB/s | 172 kB 00:00 2024-03-30T01:48:56.130 INFO:teuthology.orchestra.run.smithi137.stdout:(27/156): ceph-grafana-dashboards-18.2.2-1018.g 408 kB/s | 23 kB 00:00 2024-03-30T01:48:56.222 INFO:teuthology.orchestra.run.smithi137.stdout:(28/156): librgw2-18.2.2-1018.g470100a4.el9.x86 4.3 MB/s | 4.5 MB 00:01 2024-03-30T01:48:56.248 INFO:teuthology.orchestra.run.smithi137.stdout:(29/156): ceph-mgr-cephadm-18.2.2-1018.g470100a 1.2 MB/s | 138 kB 00:00 2024-03-30T01:48:56.631 INFO:teuthology.orchestra.run.smithi137.stdout:(30/156): ceph-mgr-dashboard-18.2.2-1018.g47010 4.4 MB/s | 1.8 MB 00:00 2024-03-30T01:48:56.723 INFO:teuthology.orchestra.run.smithi137.stdout:(31/156): ceph-mgr-modules-core-18.2.2-1018.g47 2.6 MB/s | 245 kB 00:00 2024-03-30T01:48:56.782 INFO:teuthology.orchestra.run.smithi137.stdout:(32/156): ceph-mgr-rook-18.2.2-1018.g470100a4.e 851 kB/s | 49 kB 00:00 2024-03-30T01:48:56.840 INFO:teuthology.orchestra.run.smithi137.stdout:(33/156): ceph-prometheus-alerts-18.2.2-1018.g4 259 kB/s | 15 kB 00:00 2024-03-30T01:48:56.932 INFO:teuthology.orchestra.run.smithi137.stdout:(34/156): ceph-volume-18.2.2-1018.g470100a4.el9 2.8 MB/s | 264 kB 00:00 2024-03-30T01:48:57.108 INFO:teuthology.orchestra.run.smithi137.stdout:(35/156): ceph-mgr-diskprediction-local-18.2.2- 8.6 MB/s | 7.4 MB 00:00 2024-03-30T01:48:57.133 INFO:teuthology.orchestra.run.smithi137.stdout:(36/156): cephadm-18.2.2-1018.g470100a4.el9.noa 1.1 MB/s | 224 kB 00:00 2024-03-30T01:48:57.150 INFO:teuthology.orchestra.run.smithi137.stdout:(37/156): cephfs-top-18.2.2-1018.g470100a4.el9. 445 kB/s | 18 kB 00:00 2024-03-30T01:48:57.500 INFO:teuthology.orchestra.run.smithi137.stdout:(38/156): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 662 kB 00:00 2024-03-30T01:48:57.592 INFO:teuthology.orchestra.run.smithi137.stdout:(39/156): bison-3.7.4-5.el9.x86_64.rpm 2.0 MB/s | 920 kB 00:00 2024-03-30T01:48:57.618 INFO:teuthology.orchestra.run.smithi137.stdout:(40/156): boost-program-options-1.75.0-8.el9.x8 931 kB/s | 106 kB 00:00 2024-03-30T01:48:57.651 INFO:teuthology.orchestra.run.smithi137.stdout:(41/156): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 307 kB 00:00 2024-03-30T01:48:57.676 INFO:teuthology.orchestra.run.smithi137.stdout:(42/156): flexiblas-3.0.4-8.el9.x86_64.rpm 574 kB/s | 32 kB 00:00 2024-03-30T01:48:57.818 INFO:teuthology.orchestra.run.smithi137.stdout:(43/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2024-03-30T01:48:57.844 INFO:teuthology.orchestra.run.smithi137.stdout:(44/156): flexiblas-openblas-openmp-3.0.4-8.el9 106 kB/s | 17 kB 00:00 2024-03-30T01:48:57.885 INFO:teuthology.orchestra.run.smithi137.stdout:(45/156): libaio-devel-0.3.111-13.el9.x86_64.rp 250 kB/s | 10 kB 00:00 2024-03-30T01:48:57.911 INFO:teuthology.orchestra.run.smithi137.stdout:(46/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 159 kB 00:00 2024-03-30T01:48:57.936 INFO:teuthology.orchestra.run.smithi137.stdout:(47/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 910 kB/s | 44 kB 00:00 2024-03-30T01:48:57.986 INFO:teuthology.orchestra.run.smithi137.stdout:(48/156): librdkafka-1.6.1-102.el9.x86_64.rpm 8.7 MB/s | 661 kB 00:00 2024-03-30T01:48:58.028 INFO:teuthology.orchestra.run.smithi137.stdout:(49/156): libtool-2.4.6-45.el9.x86_64.rpm 6.3 MB/s | 578 kB 00:00 2024-03-30T01:48:58.081 INFO:teuthology.orchestra.run.smithi137.stdout:(50/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 494 kB/s | 46 kB 00:00 2024-03-30T01:48:58.120 INFO:teuthology.orchestra.run.smithi137.stdout:(51/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.0 MB/s | 282 kB 00:00 2024-03-30T01:48:58.146 INFO:teuthology.orchestra.run.smithi137.stdout:(52/156): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.5 MB/s | 217 kB 00:00 2024-03-30T01:48:58.171 INFO:teuthology.orchestra.run.smithi137.stdout:(53/156): openblas-0.3.21-2.el9.x86_64.rpm 718 kB/s | 34 kB 00:00 2024-03-30T01:48:58.355 INFO:teuthology.orchestra.run.smithi137.stdout:(54/156): openblas-openmp-0.3.21-2.el9.x86_64.r 23 MB/s | 4.7 MB 00:00 2024-03-30T01:48:58.413 INFO:teuthology.orchestra.run.smithi137.stdout:(55/156): postgresql-13.14-1.el9.x86_64.rpm 6.5 MB/s | 1.5 MB 00:00 2024-03-30T01:48:58.455 INFO:teuthology.orchestra.run.smithi137.stdout:(56/156): postgresql-contrib-13.14-1.el9.x86_64 9.1 MB/s | 817 kB 00:00 2024-03-30T01:48:58.489 INFO:teuthology.orchestra.run.smithi137.stdout:(57/156): postgresql-private-libs-13.14-1.el9.x 1.9 MB/s | 132 kB 00:00 2024-03-30T01:48:58.764 INFO:teuthology.orchestra.run.smithi137.stdout:(58/156): postgresql-server-13.14-1.el9.x86_64. 19 MB/s | 5.7 MB 00:00 2024-03-30T01:48:58.914 INFO:teuthology.orchestra.run.smithi137.stdout:(59/156): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 5.8 MB 00:00 2024-03-30T01:48:58.939 INFO:teuthology.orchestra.run.smithi137.stdout:(60/156): python3-jsonpatch-1.21-16.el9.noarch. 153 kB/s | 24 kB 00:00 2024-03-30T01:48:58.981 INFO:teuthology.orchestra.run.smithi137.stdout:(61/156): python3-jsonpointer-2.0-4.el9.noarch. 447 kB/s | 18 kB 00:00 2024-03-30T01:48:58.998 INFO:teuthology.orchestra.run.smithi137.stdout:(62/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 144 kB 00:00 2024-03-30T01:48:59.024 INFO:teuthology.orchestra.run.smithi137.stdout:(63/156): python3-markupsafe-1.1.1-12.el9.x86_6 795 kB/s | 32 kB 00:00 2024-03-30T01:48:59.182 INFO:teuthology.orchestra.run.smithi137.stdout:(64/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 4.8 MB 00:00 2024-03-30T01:48:59.236 INFO:teuthology.orchestra.run.smithi137.stdout:(65/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 217 kB 00:00 2024-03-30T01:48:59.274 INFO:teuthology.orchestra.run.smithi137.stdout:(66/156): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 69 kB 00:00 2024-03-30T01:48:59.300 INFO:teuthology.orchestra.run.smithi137.stdout:(67/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.8 MB/s | 174 kB 00:00 2024-03-30T01:48:59.325 INFO:teuthology.orchestra.run.smithi137.stdout:(68/156): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 41 kB 00:00 2024-03-30T01:48:59.359 INFO:teuthology.orchestra.run.smithi137.stdout:(69/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 132 kB 00:00 2024-03-30T01:48:59.384 INFO:teuthology.orchestra.run.smithi137.stdout:(70/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 211 kB 00:00 2024-03-30T01:48:59.409 INFO:teuthology.orchestra.run.smithi137.stdout:(71/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 47 kB 00:00 2024-03-30T01:48:59.434 INFO:teuthology.orchestra.run.smithi137.stdout:(72/156): python3-requests-oauthlib-1.3.0-12.el 875 kB/s | 43 kB 00:00 2024-03-30T01:48:59.626 INFO:teuthology.orchestra.run.smithi137.stdout:(73/156): python3-toml-0.10.2-6.el9.noarch.rpm 219 kB/s | 39 kB 00:00 2024-03-30T01:48:59.653 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1018.g470100a4.el9.x86_64 115/180 2024-03-30T01:48:59.653 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /sys 2024-03-30T01:48:59.653 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /proc 2024-03-30T01:48:59.653 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /mnt 2024-03-30T01:48:59.653 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /var/tmp 2024-03-30T01:48:59.653 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /home 2024-03-30T01:48:59.653 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /root 2024-03-30T01:48:59.653 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /tmp 2024-03-30T01:48:59.653 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:48:59.885 INFO:teuthology.orchestra.run.smithi137.stdout:(74/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-03-30T01:48:59.886 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-volume-2:18.2.2-1018.g470100a4.el9.noarch 116/180 2024-03-30T01:48:59.919 INFO:teuthology.orchestra.run.smithi137.stdout:(75/156): socat-1.7.4.1-5.el9.x86_64.rpm 1.0 MB/s | 300 kB 00:00 2024-03-30T01:48:59.936 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-volume-2:18.2.2-1018.g470100a4.el9.noarch 116/180 2024-03-30T01:48:59.936 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T01:48:59.936 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-30T01:48:59.936 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:48:59.944 INFO:teuthology.orchestra.run.smithi137.stdout:(76/156): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2024-03-30T01:48:59.969 INFO:teuthology.orchestra.run.smithi137.stdout:(77/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 63 kB 00:00 2024-03-30T01:48:59.995 INFO:teuthology.orchestra.run.smithi137.stdout:(78/156): zlib-devel-1.2.11-40.el9.x86_64.rpm 902 kB/s | 44 kB 00:00 2024-03-30T01:49:00.020 INFO:teuthology.orchestra.run.smithi137.stdout:(79/156): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2024-03-30T01:49:00.053 INFO:teuthology.orchestra.run.smithi137.stdout:(80/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.1 MB/s | 241 kB 00:00 2024-03-30T01:49:00.104 INFO:teuthology.orchestra.run.smithi137.stdout:(81/156): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-03-30T01:49:00.129 INFO:teuthology.orchestra.run.smithi137.stdout:(82/156): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 103 kB 00:00 2024-03-30T01:49:00.154 INFO:teuthology.orchestra.run.smithi137.stdout:(83/156): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2024-03-30T01:49:00.188 INFO:teuthology.orchestra.run.smithi137.stdout:(84/156): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2024-03-30T01:49:00.622 INFO:teuthology.orchestra.run.smithi137.stdout:(85/156): ceph-test-18.2.2-1018.g470100a4.el9.x 5.1 MB/s | 40 MB 00:07 2024-03-30T01:49:00.730 INFO:teuthology.orchestra.run.smithi137.stdout:(86/156): jq-1.6-16.el9.x86_64.rpm 327 kB/s | 187 kB 00:00 2024-03-30T01:49:00.822 INFO:teuthology.orchestra.run.smithi137.stdout:(87/156): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-03-30T01:49:00.964 INFO:teuthology.orchestra.run.smithi137.stdout:(88/156): libquadmath-11.4.1-3.el9.x86_64.rpm 573 kB/s | 195 kB 00:00 2024-03-30T01:49:01.298 INFO:teuthology.orchestra.run.smithi137.stdout:(89/156): libgfortran-11.4.1-3.el9.x86_64.rpm 724 kB/s | 803 kB 00:01 2024-03-30T01:49:01.497 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-osd-2:18.2.2-1018.g470100a4.el9.x86_64 117/180 2024-03-30T01:49:01.542 INFO:teuthology.orchestra.run.smithi137.stdout:(90/156): elfutils-libelf-devel-0.190-2.el9.x86 30 kB/s | 21 kB 00:00 2024-03-30T01:49:01.575 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-osd-2:18.2.2-1018.g470100a4.el9.x86_64 117/180 2024-03-30T01:49:01.575 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T01:49:01.576 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-30T01:49:01.576 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-30T01:49:01.576 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-30T01:49:01.576 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:49:01.640 INFO:teuthology.orchestra.run.smithi137.stdout:(91/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 38 kB/s | 25 kB 00:00 2024-03-30T01:49:01.797 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mds-2:18.2.2-1018.g470100a4.el9.x86_64 118/180 2024-03-30T01:49:01.866 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mds-2:18.2.2-1018.g470100a4.el9.x86_64 118/180 2024-03-30T01:49:01.866 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T01:49:01.866 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-30T01:49:01.866 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-30T01:49:01.866 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-30T01:49:01.866 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:49:02.339 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mon-2:18.2.2-1018.g470100a4.el9.x86_64 119/180 2024-03-30T01:49:02.414 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mon-2:18.2.2-1018.g470100a4.el9.x86_64 119/180 2024-03-30T01:49:02.414 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T01:49:02.414 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-30T01:49:02.414 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-30T01:49:02.415 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-30T01:49:02.415 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:49:02.533 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : automake-1.16.2-8.el9.noarch 120/180 2024-03-30T01:49:02.590 INFO:teuthology.orchestra.run.smithi137.stdout:(92/156): python3-devel-3.9.17-2.el9.x86_64.rpm 251 kB/s | 245 kB 00:00 2024-03-30T01:49:02.648 INFO:teuthology.orchestra.run.smithi137.stdout:(93/156): python3-jinja2-2.11.3-5.el9.noarch.rp 246 kB/s | 248 kB 00:01 2024-03-30T01:49:02.824 INFO:teuthology.orchestra.run.smithi137.stdout:(94/156): fmt-8.1.1-5.el9.x86_64.rpm 637 kB/s | 111 kB 00:00 2024-03-30T01:49:03.015 INFO:teuthology.orchestra.run.smithi137.stdout:(95/156): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.5 MB/s | 309 kB 00:00 2024-03-30T01:49:03.087 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephadm-2:18.2.2-1018.g470100a4.el9.noarch 121/180 2024-03-30T01:49:03.134 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephadm-2:18.2.2-1018.g470100a4.el9.noarch 121/180 2024-03-30T01:49:03.180 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1018.g470100a4.e 122/180 2024-03-30T01:49:03.216 INFO:teuthology.orchestra.run.smithi137.stdout:(96/156): libarrow-9.0.0-10.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-03-30T01:49:03.266 INFO:teuthology.orchestra.run.smithi137.stdout:(97/156): libarrow-doc-9.0.0-10.el9.noarch.rpm 529 kB/s | 26 kB 00:00 2024-03-30T01:49:03.287 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1018.g470100a4. 123/180 2024-03-30T01:49:03.312 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1018.g470100a4.el9.noa 124/180 2024-03-30T01:49:03.325 INFO:teuthology.orchestra.run.smithi137.stdout:(98/156): liboath-2.6.7-2.el9.x86_64.rpm 838 kB/s | 49 kB 00:00 2024-03-30T01:49:03.375 INFO:teuthology.orchestra.run.smithi137.stdout:(99/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-03-30T01:49:03.442 INFO:teuthology.orchestra.run.smithi137.stdout:(100/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 110 kB/s | 94 kB 00:00 2024-03-30T01:49:03.484 INFO:teuthology.orchestra.run.smithi137.stdout:(101/156): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.6 MB/s | 838 kB 00:00 2024-03-30T01:49:03.543 INFO:teuthology.orchestra.run.smithi137.stdout:(102/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 747 kB/s | 43 kB 00:00 2024-03-30T01:49:03.610 INFO:teuthology.orchestra.run.smithi137.stdout:(103/156): python3-cachetools-4.2.4-1.el9.noarc 489 kB/s | 32 kB 00:00 2024-03-30T01:49:03.641 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1018.g470100a4.el9.noa 124/180 2024-03-30T01:49:03.660 INFO:teuthology.orchestra.run.smithi137.stdout:(104/156): python3-certifi-2021.10.8-2.el9.noar 304 kB/s | 15 kB 00:00 2024-03-30T01:49:03.671 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1018.g470100a4.el9.n 125/180 2024-03-30T01:49:03.693 INFO:teuthology.orchestra.run.smithi137.stdout:(105/156): python3-asyncssh-2.13.2-5.el9.noarch 2.1 MB/s | 548 kB 00:00 2024-03-30T01:49:03.727 INFO:teuthology.orchestra.run.smithi137.stdout:(106/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-03-30T01:49:03.761 INFO:teuthology.orchestra.run.smithi137.stdout:(107/156): python3-cherrypy-18.6.1-2.el9.noarch 5.3 MB/s | 358 kB 00:00 2024-03-30T01:49:03.794 INFO:teuthology.orchestra.run.smithi137.stdout:(108/156): python3-google-auth-2.28.2-1.el9.noa 3.0 MB/s | 203 kB 00:00 2024-03-30T01:49:03.820 INFO:teuthology.orchestra.run.smithi137.stdout:(109/156): python3-jaraco-8.2.1-3.el9.noarch.rp 185 kB/s | 11 kB 00:00 2024-03-30T01:49:03.845 INFO:teuthology.orchestra.run.smithi137.stdout:(110/156): python3-jaraco-classes-3.2.1-5.el9.n 356 kB/s | 18 kB 00:00 2024-03-30T01:49:03.870 INFO:teuthology.orchestra.run.smithi137.stdout:(111/156): python3-jaraco-collections-3.0.0-8.e 469 kB/s | 23 kB 00:00 2024-03-30T01:49:03.895 INFO:teuthology.orchestra.run.smithi137.stdout:(112/156): python3-jaraco-functools-3.5.0-2.el9 394 kB/s | 19 kB 00:00 2024-03-30T01:49:03.920 INFO:teuthology.orchestra.run.smithi137.stdout:(113/156): python3-jaraco-text-3.2.0-6.el9.noar 399 kB/s | 20 kB 00:00 2024-03-30T01:49:03.988 INFO:teuthology.orchestra.run.smithi137.stdout:(114/156): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-03-30T01:49:04.013 INFO:teuthology.orchestra.run.smithi137.stdout:(115/156): python3-logutils-0.3.5-21.el9.noarch 508 kB/s | 46 kB 00:00 2024-03-30T01:49:04.038 INFO:teuthology.orchestra.run.smithi137.stdout:(116/156): python3-more-itertools-8.12.0-2.el9. 1.6 MB/s | 79 kB 00:00 2024-03-30T01:49:04.063 INFO:teuthology.orchestra.run.smithi137.stdout:(117/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-03-30T01:49:04.130 INFO:teuthology.orchestra.run.smithi137.stdout:(118/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-03-30T01:49:04.156 INFO:teuthology.orchestra.run.smithi137.stdout:(119/156): python3-portend-3.1.0-2.el9.noarch.r 180 kB/s | 16 kB 00:00 2024-03-30T01:49:04.181 INFO:teuthology.orchestra.run.smithi137.stdout:(120/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-03-30T01:49:04.206 INFO:teuthology.orchestra.run.smithi137.stdout:(121/156): python3-repoze-lru-0.7-16.el9.noarch 624 kB/s | 31 kB 00:00 2024-03-30T01:49:04.240 INFO:teuthology.orchestra.run.smithi137.stdout:(122/156): python3-routes-2.5.1-5.el9.noarch.rp 3.2 MB/s | 188 kB 00:00 2024-03-30T01:49:04.265 INFO:teuthology.orchestra.run.smithi137.stdout:(123/156): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-03-30T01:49:04.290 INFO:teuthology.orchestra.run.smithi137.stdout:(124/156): python3-tempora-5.0.0-2.el9.noarch.r 724 kB/s | 36 kB 00:00 2024-03-30T01:49:04.324 INFO:teuthology.orchestra.run.smithi137.stdout:(125/156): python3-typing-extensions-4.4.0-2.el 882 kB/s | 51 kB 00:00 2024-03-30T01:49:04.358 INFO:teuthology.orchestra.run.smithi137.stdout:(126/156): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-03-30T01:49:04.383 INFO:teuthology.orchestra.run.smithi137.stdout:(127/156): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-03-30T01:49:04.425 INFO:teuthology.orchestra.run.smithi137.stdout:(128/156): python3-werkzeug-2.0.3-3.el9.1.noarc 6.3 MB/s | 427 kB 00:00 2024-03-30T01:49:04.450 INFO:teuthology.orchestra.run.smithi137.stdout:(129/156): python3-zc-lockfile-2.0-10.el9.noarc 301 kB/s | 20 kB 00:00 2024-03-30T01:49:04.492 INFO:teuthology.orchestra.run.smithi137.stdout:(130/156): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-03-30T01:49:04.606 INFO:teuthology.orchestra.run.smithi137.stdout:(131/156): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-03-30T01:49:04.794 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1018.g470100a4.el9.n 125/180 2024-03-30T01:49:04.813 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1018.g470 126/180 2024-03-30T01:49:04.955 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1018.g470 126/180 2024-03-30T01:49:05.059 INFO:teuthology.orchestra.run.smithi137.stdout:(132/156): librados2-18.2.2-1018.g470100a4.el9. 5.8 MB/s | 3.3 MB 00:00 2024-03-30T01:49:05.128 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1018.g470100a4.el 127/180 2024-03-30T01:49:05.165 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-2:18.2.2-1018.g470100a4.el9.x86_64 128/180 2024-03-30T01:49:05.185 INFO:teuthology.orchestra.run.smithi137.stdout:(133/156): NetworkManager-1.47.2-1.el9.x86_64.r 18 MB/s | 2.3 MB 00:00 2024-03-30T01:49:05.235 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1018.g470100a4.el9.x86_64 128/180 2024-03-30T01:49:05.236 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T01:49:05.236 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-30T01:49:05.236 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-30T01:49:05.236 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-30T01:49:05.236 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:49:05.293 INFO:teuthology.orchestra.run.smithi137.stdout:(134/156): NetworkManager-libnm-1.47.2-1.el9.x8 17 MB/s | 1.8 MB 00:00 2024-03-30T01:49:05.300 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-rook-2:18.2.2-1018.g470100a4.el9.noarch 129/180 2024-03-30T01:49:05.319 INFO:teuthology.orchestra.run.smithi137.stdout:(135/156): NetworkManager-team-1.47.2-1.el9.x86 1.7 MB/s | 41 kB 00:00 2024-03-30T01:49:05.338 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1018.g470100a4.el9.noarch 129/180 2024-03-30T01:49:05.427 INFO:teuthology.orchestra.run.smithi137.stdout:(136/156): librbd1-18.2.2-1018.g470100a4.el9.x8 3.7 MB/s | 3.0 MB 00:00 2024-03-30T01:49:05.431 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-2:18.2.2-1018.g470100a4.el9.x86_64 130/180 2024-03-30T01:49:05.461 INFO:teuthology.orchestra.run.smithi137.stdout:(137/156): NetworkManager-tui-1.47.2-1.el9.x86_ 1.7 MB/s | 247 kB 00:00 2024-03-30T01:49:05.489 INFO:teuthology.orchestra.run.smithi137.stdout:(138/156): xfsdump-3.1.12-4.el9.x86_64.rpm 5.3 MB/s | 321 kB 00:00 2024-03-30T01:49:05.565 INFO:teuthology.orchestra.run.smithi137.stdout:(139/156): acl-2.3.1-4.el9.x86_64.rpm 714 kB/s | 71 kB 00:00 2024-03-30T01:49:05.590 INFO:teuthology.orchestra.run.smithi137.stdout:(140/156): elfutils-debuginfod-client-0.190-2.e 366 kB/s | 36 kB 00:00 2024-03-30T01:49:05.782 INFO:teuthology.orchestra.run.smithi137.stdout:(141/156): elfutils-libelf-0.190-2.el9.x86_64.r 1.0 MB/s | 192 kB 00:00 2024-03-30T01:49:05.815 INFO:teuthology.orchestra.run.smithi137.stdout:(142/156): elfutils-libs-0.190-2.el9.x86_64.rpm 1.1 MB/s | 256 kB 00:00 2024-03-30T01:49:05.874 INFO:teuthology.orchestra.run.smithi137.stdout:(143/156): libacl-2.3.1-4.el9.x86_64.rpm 252 kB/s | 23 kB 00:00 2024-03-30T01:49:05.933 INFO:teuthology.orchestra.run.smithi137.stdout:(144/156): libblkid-2.37.4-18.el9.x86_64.rpm 928 kB/s | 108 kB 00:00 2024-03-30T01:49:06.156 INFO:teuthology.orchestra.run.smithi137.stdout:(145/156): libfdisk-2.37.4-18.el9.x86_64.rpm 551 kB/s | 155 kB 00:00 2024-03-30T01:49:06.192 INFO:teuthology.orchestra.run.smithi137.stdout:(146/156): libmount-2.37.4-18.el9.x86_64.rpm 526 kB/s | 136 kB 00:00 2024-03-30T01:49:06.217 INFO:teuthology.orchestra.run.smithi137.stdout:(147/156): libsmartcols-2.37.4-18.el9.x86_64.rp 1.0 MB/s | 64 kB 00:00 2024-03-30T01:49:06.228 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libtool-2.4.6-45.el9.x86_64 131/180 2024-03-30T01:49:06.251 INFO:teuthology.orchestra.run.smithi137.stdout:(148/156): libuuid-2.37.4-18.el9.x86_64.rpm 497 kB/s | 29 kB 00:00 2024-03-30T01:49:06.260 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-radosgw-2:18.2.2-1018.g470100a4.el9.x86_64 132/180 2024-03-30T01:49:06.327 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1018.g470100a4.el9.x86_64 132/180 2024-03-30T01:49:06.327 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T01:49:06.327 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-30T01:49:06.328 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-30T01:49:06.328 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-30T01:49:06.328 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:49:06.377 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1018.g47010 133/180 2024-03-30T01:49:06.446 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1018.g47010 133/180 2024-03-30T01:49:06.446 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T01:49:06.446 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-30T01:49:06.446 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:49:06.520 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephfs-mirror-2:18.2.2-1018.g470100a4.el9.x86_64 134/180 2024-03-30T01:49:06.568 INFO:teuthology.orchestra.run.smithi137.stdout:(149/156): openssl-3.0.7-27.el9.x86_64.rpm 3.5 MB/s | 1.2 MB 00:00 2024-03-30T01:49:06.594 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1018.g470100a4.el9.x86_64 134/180 2024-03-30T01:49:06.594 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T01:49:06.594 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-30T01:49:06.595 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-30T01:49:06.595 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-30T01:49:06.595 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:49:06.776 INFO:teuthology.orchestra.run.smithi137.stdout:(150/156): openssl-libs-3.0.7-27.el9.x86_64.rpm 4.1 MB/s | 2.2 MB 00:00 2024-03-30T01:49:06.902 INFO:teuthology.orchestra.run.smithi137.stdout:(151/156): util-linux-core-2.37.4-18.el9.x86_64 3.7 MB/s | 465 kB 00:00 2024-03-30T01:49:06.936 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-mirror-2:18.2.2-1018.g470100a4.el9.x86_64 135/180 2024-03-30T01:49:06.968 INFO:teuthology.orchestra.run.smithi137.stdout:(152/156): util-linux-user-2.37.4-18.el9.x86_64 473 kB/s | 31 kB 00:00 2024-03-30T01:49:07.014 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1018.g470100a4.el9.x86_64 135/180 2024-03-30T01:49:07.014 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T01:49:07.014 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-30T01:49:07.014 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-30T01:49:07.014 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-30T01:49:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:49:07.169 INFO:teuthology.orchestra.run.smithi137.stdout:(153/156): util-linux-2.37.4-18.el9.x86_64.rpm 3.8 MB/s | 2.3 MB 00:00 2024-03-30T01:49:07.319 INFO:teuthology.orchestra.run.smithi137.stdout:(154/156): xfsprogs-6.3.0-1.el9.x86_64.rpm 3.1 MB/s | 1.1 MB 00:00 2024-03-30T01:49:07.750 INFO:teuthology.orchestra.run.smithi137.stdout:(155/156): openssl-devel-3.0.7-27.el9.x86_64.rp 656 kB/s | 4.1 MB 00:06 2024-03-30T01:49:07.927 INFO:teuthology.orchestra.run.smithi137.stdout:(156/156): libacl-devel-2.3.1-4.el9.x86_64.rpm 98 kB/s | 74 kB 00:00 2024-03-30T01:49:07.940 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-03-30T01:49:07.940 INFO:teuthology.orchestra.run.smithi137.stdout:Total 10 MB/s | 204 MB 00:20 2024-03-30T01:49:09.008 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-03-30T01:49:09.371 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-03-30T01:49:09.371 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-03-30T01:49:10.983 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-test-2:18.2.2-1018.g470100a4.el9.x86_64 136/180 2024-03-30T01:49:11.028 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-fuse-2:18.2.2-1018.g470100a4.el9.x86_64 137/180 2024-03-30T01:49:11.064 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-nbd-2:18.2.2-1018.g470100a4.el9.x86_64 138/180 2024-03-30T01:49:11.324 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 139/180 2024-03-30T01:49:11.447 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 140/180 2024-03-30T01:49:11.498 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-fuse-2:18.2.2-1018.g470100a4.el9.x86_64 141/180 2024-03-30T01:49:11.499 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-03-30T01:49:11.499 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-03-30T01:49:11.554 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/180 2024-03-30T01:49:11.649 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 143/180 2024-03-30T01:49:11.694 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 144/180 2024-03-30T01:49:11.728 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs-devel-2:18.2.2-1018.g470100a4.el9.x86_ 145/180 2024-03-30T01:49:11.773 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 146/180 2024-03-30T01:49:11.833 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 147/180 2024-03-30T01:49:11.918 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 148/180 2024-03-30T01:49:12.040 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 149/180 2024-03-30T01:49:12.081 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 150/180 2024-03-30T01:49:12.953 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/180 2024-03-30T01:49:13.004 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/180 2024-03-30T01:49:13.059 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/180 2024-03-30T01:49:14.337 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephfs-top-2:18.2.2-1018.g470100a4.el9.noarch 152/180 2024-03-30T01:49:14.418 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 153/180 2024-03-30T01:49:14.464 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/180 2024-03-30T01:49:14.593 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/180 2024-03-30T01:49:14.628 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/180 2024-03-30T01:49:14.661 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 157/180 2024-03-30T01:49:14.696 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 158/180 2024-03-30T01:49:14.766 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 159/180 2024-03-30T01:49:14.767 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/180 2024-03-30T01:49:14.916 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/180 2024-03-30T01:49:14.966 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 161/180 2024-03-30T01:49:14.967 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/180 2024-03-30T01:49:15.096 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/180 2024-03-30T01:49:15.148 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 163/180 2024-03-30T01:49:15.194 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 164/180 2024-03-30T01:49:15.228 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 165/180 2024-03-30T01:49:15.260 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 166/180 2024-03-30T01:49:15.356 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 167/180 2024-03-30T01:49:15.433 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 168/180 2024-03-30T01:49:15.490 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 169/180 2024-03-30T01:49:15.523 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 170/180 2024-03-30T01:49:15.557 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 171/180 2024-03-30T01:49:15.591 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 172/180 2024-03-30T01:49:15.624 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 173/180 2024-03-30T01:49:15.660 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 174/180 2024-03-30T01:49:15.660 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 174/180 2024-03-30T01:49:16.001 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 174/180 2024-03-30T01:49:16.001 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 175/180 2024-03-30T01:49:16.113 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 175/180 2024-03-30T01:49:16.143 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 176/180 2024-03-30T01:49:16.177 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 177/180 2024-03-30T01:49:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 178/180 2024-03-30T01:49:16.253 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 179/180 2024-03-30T01:49:16.372 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 180/180 2024-03-30T01:49:16.628 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 180/180 2024-03-30T01:49:16.629 INFO:teuthology.orchestra.run.smithi133.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-30T01:49:16.629 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:49:18.158 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-03-30T01:49:18.266 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/180 2024-03-30T01:49:18.307 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/180 2024-03-30T01:49:18.386 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/180 2024-03-30T01:49:18.430 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/180 2024-03-30T01:49:18.527 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/180 2024-03-30T01:49:18.641 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/180 2024-03-30T01:49:18.697 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/180 2024-03-30T01:49:18.728 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/180 2024-03-30T01:49:18.815 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/180 2024-03-30T01:49:19.214 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/180 2024-03-30T01:49:19.309 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librados2-2:18.2.2-1018.g470100a4.el9.x86_64 10/180 2024-03-30T01:49:19.460 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:18.2.2-1018.g470100a4.el9.x86_64 10/180 2024-03-30T01:49:19.494 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs2-2:18.2.2-1018.g470100a4.el9.x86_64 11/180 2024-03-30T01:49:19.626 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephfs2-2:18.2.2-1018.g470100a4.el9.x86_64 11/180 2024-03-30T01:49:19.659 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rados-2:18.2.2-1018.g470100a4.el9.x86_64 12/180 2024-03-30T01:49:19.733 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/180 2024-03-30T01:49:20.075 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/180 2024-03-30T01:49:20.133 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/180 2024-03-30T01:49:20.157 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephsqlite-2:18.2.2-1018.g470100a4.el9.x86_64 16/180 2024-03-30T01:49:20.309 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1018.g470100a4.el9.x86_64 16/180 2024-03-30T01:49:20.333 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libradosstriper1-2:18.2.2-1018.g470100a4.el9.x86 17/180 2024-03-30T01:49:20.423 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1018.g470100a4.el9.x86 17/180 2024-03-30T01:49:20.494 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/180 2024-03-30T01:49:20.541 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 19/180 2024-03-30T01:49:20.959 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-2:18.2.2-1018.g470100a4.el9.x86_64 1/180 2024-03-30T01:49:20.959 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-base-2:18.2.2-1018.g470100a4.el9.x86_64 2/180 2024-03-30T01:49:20.959 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-common-2:18.2.2-1018.g470100a4.el9.x86_64 3/180 2024-03-30T01:49:20.959 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-fuse-2:18.2.2-1018.g470100a4.el9.x86_64 4/180 2024-03-30T01:49:20.959 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1018.g47010 5/180 2024-03-30T01:49:20.959 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mds-2:18.2.2-1018.g470100a4.el9.x86_64 6/180 2024-03-30T01:49:20.959 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-2:18.2.2-1018.g470100a4.el9.x86_64 7/180 2024-03-30T01:49:20.959 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mon-2:18.2.2-1018.g470100a4.el9.x86_64 8/180 2024-03-30T01:49:20.959 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-osd-2:18.2.2-1018.g470100a4.el9.x86_64 9/180 2024-03-30T01:49:20.960 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-radosgw-2:18.2.2-1018.g470100a4.el9.x86_64 10/180 2024-03-30T01:49:20.960 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-selinux-2:18.2.2-1018.g470100a4.el9.x86_64 11/180 2024-03-30T01:49:20.960 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-test-2:18.2.2-1018.g470100a4.el9.x86_64 12/180 2024-03-30T01:49:20.960 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephfs-mirror-2:18.2.2-1018.g470100a4.el9.x86_64 13/180 2024-03-30T01:49:20.960 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs-devel-2:18.2.2-1018.g470100a4.el9.x86_ 14/180 2024-03-30T01:49:20.960 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs2-2:18.2.2-1018.g470100a4.el9.x86_64 15/180 2024-03-30T01:49:20.960 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephsqlite-2:18.2.2-1018.g470100a4.el9.x86_64 16/180 2024-03-30T01:49:20.960 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados-devel-2:18.2.2-1018.g470100a4.el9.x86_6 17/180 2024-03-30T01:49:20.960 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libradosstriper1-2:18.2.2-1018.g470100a4.el9.x86 18/180 2024-03-30T01:49:20.960 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librgw2-2:18.2.2-1018.g470100a4.el9.x86_64 19/180 2024-03-30T01:49:20.960 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1018.g470100a4.el 20/180 2024-03-30T01:49:20.960 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-common-2:18.2.2-1018.g470100a4.el9. 21/180 2024-03-30T01:49:20.960 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cephfs-2:18.2.2-1018.g470100a4.el9.x86_6 22/180 2024-03-30T01:49:20.960 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rados-2:18.2.2-1018.g470100a4.el9.x86_64 23/180 2024-03-30T01:49:20.960 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rbd-2:18.2.2-1018.g470100a4.el9.x86_64 24/180 2024-03-30T01:49:20.961 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rgw-2:18.2.2-1018.g470100a4.el9.x86_64 25/180 2024-03-30T01:49:20.961 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-fuse-2:18.2.2-1018.g470100a4.el9.x86_64 26/180 2024-03-30T01:49:20.961 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-mirror-2:18.2.2-1018.g470100a4.el9.x86_64 27/180 2024-03-30T01:49:20.961 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-nbd-2:18.2.2-1018.g470100a4.el9.x86_64 28/180 2024-03-30T01:49:20.961 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1018.g470100a4. 29/180 2024-03-30T01:49:20.961 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1018.g470100a4.el9.noa 30/180 2024-03-30T01:49:20.968 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 20/180 2024-03-30T01:49:20.975 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1018.g470100a4.el9.n 31/180 2024-03-30T01:49:20.975 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1018.g470 32/180 2024-03-30T01:49:20.975 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1018.g470100a4.el 33/180 2024-03-30T01:49:20.975 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1018.g470100a4.el9.noarch 34/180 2024-03-30T01:49:20.975 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1018.g470100a4.e 35/180 2024-03-30T01:49:20.975 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-volume-2:18.2.2-1018.g470100a4.el9.noarch 36/180 2024-03-30T01:49:20.975 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephadm-2:18.2.2-1018.g470100a4.el9.noarch 37/180 2024-03-30T01:49:20.975 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephfs-top-2:18.2.2-1018.g470100a4.el9.noarch 38/180 2024-03-30T01:49:20.975 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/180 2024-03-30T01:49:20.975 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/180 2024-03-30T01:49:20.975 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/180 2024-03-30T01:49:20.975 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flex-2.6.4-9.el9.x86_64 42/180 2024-03-30T01:49:20.975 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 43/180 2024-03-30T01:49:20.976 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 44/180 2024-03-30T01:49:20.976 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 45/180 2024-03-30T01:49:20.976 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 46/180 2024-03-30T01:49:20.976 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 47/180 2024-03-30T01:49:20.976 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 48/180 2024-03-30T01:49:20.976 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 49/180 2024-03-30T01:49:20.976 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 50/180 2024-03-30T01:49:20.976 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 51/180 2024-03-30T01:49:20.976 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 52/180 2024-03-30T01:49:20.976 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 53/180 2024-03-30T01:49:20.976 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 54/180 2024-03-30T01:49:20.976 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 55/180 2024-03-30T01:49:20.976 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : postgresql-13.14-1.el9.x86_64 56/180 2024-03-30T01:49:20.976 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 57/180 2024-03-30T01:49:20.976 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 58/180 2024-03-30T01:49:20.977 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 59/180 2024-03-30T01:49:20.977 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 60/180 2024-03-30T01:49:20.977 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/180 2024-03-30T01:49:20.977 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/180 2024-03-30T01:49:20.977 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/180 2024-03-30T01:49:20.977 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/180 2024-03-30T01:49:20.977 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/180 2024-03-30T01:49:20.977 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/180 2024-03-30T01:49:20.977 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/180 2024-03-30T01:49:20.978 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 68/180 2024-03-30T01:49:20.978 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/180 2024-03-30T01:49:20.978 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 70/180 2024-03-30T01:49:20.978 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 71/180 2024-03-30T01:49:20.978 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 72/180 2024-03-30T01:49:20.978 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 73/180 2024-03-30T01:49:20.978 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 74/180 2024-03-30T01:49:20.978 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 75/180 2024-03-30T01:49:20.978 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 76/180 2024-03-30T01:49:20.978 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 77/180 2024-03-30T01:49:20.978 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 78/180 2024-03-30T01:49:20.978 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 79/180 2024-03-30T01:49:20.978 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 80/180 2024-03-30T01:49:20.978 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 81/180 2024-03-30T01:49:20.978 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 82/180 2024-03-30T01:49:20.979 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ply-3.11-14.el9.noarch 83/180 2024-03-30T01:49:20.979 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 84/180 2024-03-30T01:49:20.979 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 85/180 2024-03-30T01:49:20.979 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : jq-1.6-16.el9.x86_64 86/180 2024-03-30T01:49:20.979 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 87/180 2024-03-30T01:49:20.979 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 88/180 2024-03-30T01:49:20.979 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 89/180 2024-03-30T01:49:20.979 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 90/180 2024-03-30T01:49:20.979 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 91/180 2024-03-30T01:49:20.979 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 92/180 2024-03-30T01:49:20.979 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 93/180 2024-03-30T01:49:20.979 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 94/180 2024-03-30T01:49:20.979 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 95/180 2024-03-30T01:49:20.979 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 96/180 2024-03-30T01:49:20.979 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 97/180 2024-03-30T01:49:20.980 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 98/180 2024-03-30T01:49:20.980 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 99/180 2024-03-30T01:49:20.980 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/180 2024-03-30T01:49:20.980 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/180 2024-03-30T01:49:20.980 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 102/180 2024-03-30T01:49:20.980 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 103/180 2024-03-30T01:49:20.980 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 104/180 2024-03-30T01:49:20.980 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 105/180 2024-03-30T01:49:20.980 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 106/180 2024-03-30T01:49:20.980 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 107/180 2024-03-30T01:49:20.980 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 108/180 2024-03-30T01:49:20.980 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 109/180 2024-03-30T01:49:20.980 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 110/180 2024-03-30T01:49:20.980 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 111/180 2024-03-30T01:49:20.980 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 112/180 2024-03-30T01:49:20.981 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 113/180 2024-03-30T01:49:20.981 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 114/180 2024-03-30T01:49:20.981 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/180 2024-03-30T01:49:20.981 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/180 2024-03-30T01:49:20.981 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/180 2024-03-30T01:49:20.981 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/180 2024-03-30T01:49:20.981 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/180 2024-03-30T01:49:20.981 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/180 2024-03-30T01:49:20.981 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/180 2024-03-30T01:49:20.981 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/180 2024-03-30T01:49:20.981 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/180 2024-03-30T01:49:20.981 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/180 2024-03-30T01:49:20.981 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/180 2024-03-30T01:49:20.981 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/180 2024-03-30T01:49:20.981 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/180 2024-03-30T01:49:20.982 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/180 2024-03-30T01:49:20.982 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/180 2024-03-30T01:49:20.982 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/180 2024-03-30T01:49:20.982 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/180 2024-03-30T01:49:20.982 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/180 2024-03-30T01:49:20.982 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-2:18.2.2-1018.g470100a4.el9.x86_64 133/180 2024-03-30T01:49:20.982 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/180 2024-03-30T01:49:20.982 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-2:18.2.2-1018.g470100a4.el9.x86_64 135/180 2024-03-30T01:49:20.982 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/180 2024-03-30T01:49:20.982 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 137/180 2024-03-30T01:49:20.982 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 138/180 2024-03-30T01:49:20.982 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 139/180 2024-03-30T01:49:20.982 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 140/180 2024-03-30T01:49:20.982 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 141/180 2024-03-30T01:49:20.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 142/180 2024-03-30T01:49:20.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 143/180 2024-03-30T01:49:20.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 144/180 2024-03-30T01:49:20.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 145/180 2024-03-30T01:49:20.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 146/180 2024-03-30T01:49:20.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/180 2024-03-30T01:49:20.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/180 2024-03-30T01:49:20.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 149/180 2024-03-30T01:49:20.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/180 2024-03-30T01:49:20.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 151/180 2024-03-30T01:49:20.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/180 2024-03-30T01:49:20.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 153/180 2024-03-30T01:49:20.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/180 2024-03-30T01:49:20.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/180 2024-03-30T01:49:20.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/180 2024-03-30T01:49:20.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 157/180 2024-03-30T01:49:20.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 158/180 2024-03-30T01:49:20.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 159/180 2024-03-30T01:49:20.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 160/180 2024-03-30T01:49:20.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 161/180 2024-03-30T01:49:20.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 162/180 2024-03-30T01:49:20.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 163/180 2024-03-30T01:49:20.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 164/180 2024-03-30T01:49:20.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 165/180 2024-03-30T01:49:20.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 166/180 2024-03-30T01:49:20.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 167/180 2024-03-30T01:49:20.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 168/180 2024-03-30T01:49:20.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 169/180 2024-03-30T01:49:20.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 170/180 2024-03-30T01:49:20.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 171/180 2024-03-30T01:49:20.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 172/180 2024-03-30T01:49:20.985 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 173/180 2024-03-30T01:49:20.985 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 174/180 2024-03-30T01:49:20.985 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 175/180 2024-03-30T01:49:20.985 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 176/180 2024-03-30T01:49:20.985 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 177/180 2024-03-30T01:49:20.985 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 178/180 2024-03-30T01:49:20.985 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 179/180 2024-03-30T01:49:21.245 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 21/180 2024-03-30T01:49:21.320 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 21/180 2024-03-30T01:49:21.526 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 22/180 2024-03-30T01:49:21.576 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 22/180 2024-03-30T01:49:22.036 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 22/180 2024-03-30T01:49:22.081 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 23/180 2024-03-30T01:49:22.119 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : liboath-2.6.7-2.el9.x86_64 24/180 2024-03-30T01:49:22.188 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 25/180 2024-03-30T01:49:22.310 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 26/180 2024-03-30T01:49:22.384 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/180 2024-03-30T01:49:22.432 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/180 2024-03-30T01:49:22.542 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 29/180 2024-03-30T01:49:22.586 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 30/180 2024-03-30T01:49:22.620 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 31/180 2024-03-30T01:49:22.731 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 32/180 2024-03-30T01:49:22.766 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-common-2:18.2.2-1018.g470100a4.el9. 33/180 2024-03-30T01:49:22.841 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-argparse-2:18.2.2-1018.g470100a4.el 34/180 2024-03-30T01:49:22.949 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cephfs-2:18.2.2-1018.g470100a4.el9.x86_6 35/180 2024-03-30T01:49:23.119 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/180 2024-03-30T01:49:23.185 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/180 2024-03-30T01:49:23.259 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 180/180 2024-03-30T01:49:23.259 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:49:23.259 INFO:teuthology.orchestra.run.smithi133.stdout:Upgraded: 2024-03-30T01:49:23.259 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-30T01:49:23.259 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-30T01:49:23.259 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-30T01:49:23.260 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-30T01:49:23.260 INFO:teuthology.orchestra.run.smithi133.stdout: acl-2.3.1-4.el9.x86_64 2024-03-30T01:49:23.260 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-30T01:49:23.260 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-30T01:49:23.260 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-30T01:49:23.260 INFO:teuthology.orchestra.run.smithi133.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-30T01:49:23.260 INFO:teuthology.orchestra.run.smithi133.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-30T01:49:23.260 INFO:teuthology.orchestra.run.smithi133.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-30T01:49:23.260 INFO:teuthology.orchestra.run.smithi133.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-30T01:49:23.260 INFO:teuthology.orchestra.run.smithi133.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-30T01:49:23.260 INFO:teuthology.orchestra.run.smithi133.stdout: librados2-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.260 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.261 INFO:teuthology.orchestra.run.smithi133.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-30T01:49:23.261 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-30T01:49:23.261 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-30T01:49:23.261 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-30T01:49:23.261 INFO:teuthology.orchestra.run.smithi133.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-30T01:49:23.261 INFO:teuthology.orchestra.run.smithi133.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-30T01:49:23.261 INFO:teuthology.orchestra.run.smithi133.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-30T01:49:23.261 INFO:teuthology.orchestra.run.smithi133.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-30T01:49:23.261 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-30T01:49:23.261 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-03-30T01:49:23.261 INFO:teuthology.orchestra.run.smithi133.stdout: automake-1.16.2-8.el9.noarch 2024-03-30T01:49:23.261 INFO:teuthology.orchestra.run.smithi133.stdout: bison-3.7.4-5.el9.x86_64 2024-03-30T01:49:23.262 INFO:teuthology.orchestra.run.smithi133.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-30T01:49:23.262 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.262 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.262 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.262 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.262 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards-2:18.2.2-1018.g470100a4.el9.noarch 2024-03-30T01:49:23.262 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.262 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.262 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.262 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm-2:18.2.2-1018.g470100a4.el9.noarch 2024-03-30T01:49:23.262 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard-2:18.2.2-1018.g470100a4.el9.noarch 2024-03-30T01:49:23.262 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1018.g470100a4.el9.noarch 2024-03-30T01:49:23.262 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core-2:18.2.2-1018.g470100a4.el9.noarch 2024-03-30T01:49:23.262 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook-2:18.2.2-1018.g470100a4.el9.noarch 2024-03-30T01:49:23.263 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.263 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.263 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts-2:18.2.2-1018.g470100a4.el9.noarch 2024-03-30T01:49:23.263 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.263 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.263 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.263 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-volume-2:18.2.2-1018.g470100a4.el9.noarch 2024-03-30T01:49:23.263 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm-2:18.2.2-1018.g470100a4.el9.noarch 2024-03-30T01:49:23.263 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-mirror-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.263 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-top-2:18.2.2-1018.g470100a4.el9.noarch 2024-03-30T01:49:23.263 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-30T01:49:23.263 INFO:teuthology.orchestra.run.smithi133.stdout: flex-2.6.4-9.el9.x86_64 2024-03-30T01:49:23.264 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-30T01:49:23.264 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-30T01:49:23.264 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-30T01:49:23.264 INFO:teuthology.orchestra.run.smithi133.stdout: fmt-8.1.1-5.el9.x86_64 2024-03-30T01:49:23.264 INFO:teuthology.orchestra.run.smithi133.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-30T01:49:23.264 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-30T01:49:23.264 INFO:teuthology.orchestra.run.smithi133.stdout: jq-1.6-16.el9.x86_64 2024-03-30T01:49:23.264 INFO:teuthology.orchestra.run.smithi133.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-30T01:49:23.264 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-30T01:49:23.264 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-30T01:49:23.264 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.264 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.264 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.264 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-30T01:49:23.264 INFO:teuthology.orchestra.run.smithi133.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-30T01:49:23.265 INFO:teuthology.orchestra.run.smithi133.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-30T01:49:23.265 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-30T01:49:23.265 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-30T01:49:23.265 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.265 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.265 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-30T01:49:23.265 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.265 INFO:teuthology.orchestra.run.smithi133.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-30T01:49:23.265 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-30T01:49:23.265 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-30T01:49:23.265 INFO:teuthology.orchestra.run.smithi133.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-30T01:49:23.265 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-30T01:49:23.265 INFO:teuthology.orchestra.run.smithi133.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-30T01:49:23.266 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-30T01:49:23.266 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-30T01:49:23.266 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-30T01:49:23.266 INFO:teuthology.orchestra.run.smithi133.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-30T01:49:23.266 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-13.14-1.el9.x86_64 2024-03-30T01:49:23.266 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-30T01:49:23.266 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-30T01:49:23.266 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-30T01:49:23.266 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-30T01:49:23.266 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-30T01:49:23.266 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-30T01:49:23.266 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-30T01:49:23.266 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.267 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.267 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.267 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-30T01:49:23.267 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-30T01:49:23.267 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-30T01:49:23.267 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-30T01:49:23.267 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-30T01:49:23.267 INFO:teuthology.orchestra.run.smithi133.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-30T01:49:23.267 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-30T01:49:23.267 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-30T01:49:23.267 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-30T01:49:23.267 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-30T01:49:23.267 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-30T01:49:23.267 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-30T01:49:23.267 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-30T01:49:23.268 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-30T01:49:23.268 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-30T01:49:23.268 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-30T01:49:23.268 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-30T01:49:23.268 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-30T01:49:23.268 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-30T01:49:23.268 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-30T01:49:23.268 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-30T01:49:23.268 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-30T01:49:23.268 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-30T01:49:23.268 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-30T01:49:23.268 INFO:teuthology.orchestra.run.smithi133.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-30T01:49:23.268 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-30T01:49:23.268 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ply-3.11-14.el9.noarch 2024-03-30T01:49:23.269 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-30T01:49:23.269 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-30T01:49:23.269 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-30T01:49:23.269 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-30T01:49:23.269 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-30T01:49:23.269 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-30T01:49:23.269 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-30T01:49:23.269 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.269 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.269 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-30T01:49:23.269 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-30T01:49:23.269 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-30T01:49:23.269 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.269 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-30T01:49:23.270 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-30T01:49:23.270 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-30T01:49:23.270 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-30T01:49:23.270 INFO:teuthology.orchestra.run.smithi133.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-30T01:49:23.270 INFO:teuthology.orchestra.run.smithi133.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-30T01:49:23.270 INFO:teuthology.orchestra.run.smithi133.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-30T01:49:23.270 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-30T01:49:23.270 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-30T01:49:23.270 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-30T01:49:23.270 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-30T01:49:23.270 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.270 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.270 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:49:23.271 INFO:teuthology.orchestra.run.smithi133.stdout: re2-1:20211101-3.el9.x86_64 2024-03-30T01:49:23.271 INFO:teuthology.orchestra.run.smithi133.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-30T01:49:23.271 INFO:teuthology.orchestra.run.smithi133.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-30T01:49:23.271 INFO:teuthology.orchestra.run.smithi133.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-30T01:49:23.271 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-30T01:49:23.271 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-30T01:49:23.271 INFO:teuthology.orchestra.run.smithi133.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-30T01:49:23.271 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:49:23.272 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-03-30T01:49:23.822 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/180 2024-03-30T01:49:23.916 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/180 2024-03-30T01:49:23.945 DEBUG:teuthology.parallel:result is None 2024-03-30T01:49:24.030 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/180 2024-03-30T01:49:24.075 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 41/180 2024-03-30T01:49:24.106 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 41/180 2024-03-30T01:49:24.157 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 42/180 2024-03-30T01:49:24.203 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librados-devel-2:18.2.2-1018.g470100a4.el9.x86_6 43/180 2024-03-30T01:49:24.246 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/180 2024-03-30T01:49:24.650 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 45/180 2024-03-30T01:49:24.870 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 46/180 2024-03-30T01:49:24.981 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 47/180 2024-03-30T01:49:25.043 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 48/180 2024-03-30T01:49:25.254 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/180 2024-03-30T01:49:25.350 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 50/180 2024-03-30T01:49:25.516 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : re2-1:20211101-3.el9.x86_64 51/180 2024-03-30T01:49:25.561 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 52/180 2024-03-30T01:49:25.637 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 53/180 2024-03-30T01:49:25.731 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/180 2024-03-30T01:49:25.778 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/180 2024-03-30T01:49:25.817 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/180 2024-03-30T01:49:25.884 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/180 2024-03-30T01:49:25.941 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/180 2024-03-30T01:49:25.999 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 59/180 2024-03-30T01:49:26.193 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 60/180 2024-03-30T01:49:26.340 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 61/180 2024-03-30T01:49:26.340 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/180 2024-03-30T01:49:26.405 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/180 2024-03-30T01:49:26.450 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 64/180 2024-03-30T01:49:26.493 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/180 2024-03-30T01:49:26.523 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/180 2024-03-30T01:49:26.570 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 67/180 2024-03-30T01:49:26.721 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : fmt-8.1.1-5.el9.x86_64 68/180 2024-03-30T01:49:26.780 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 69/180 2024-03-30T01:49:26.849 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ply-3.11-14.el9.noarch 70/180 2024-03-30T01:49:26.928 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 71/180 2024-03-30T01:49:27.172 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 72/180 2024-03-30T01:49:27.242 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 73/180 2024-03-30T01:49:27.412 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 74/180 2024-03-30T01:49:27.465 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/180 2024-03-30T01:49:27.504 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/180 2024-03-30T01:49:27.543 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : fuse-2.9.9-15.el9.x86_64 77/180 2024-03-30T01:49:27.585 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 78/180 2024-03-30T01:49:27.630 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 79/180 2024-03-30T01:49:27.690 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : uuid-1.6.2-55.el9.x86_64 80/180 2024-03-30T01:49:27.755 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 81/180 2024-03-30T01:49:27.884 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 82/180 2024-03-30T01:49:27.924 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 83/180 2024-03-30T01:49:27.959 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 84/180 2024-03-30T01:49:28.012 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 85/180 2024-03-30T01:49:28.054 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 86/180 2024-03-30T01:49:28.194 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 87/180 2024-03-30T01:49:28.252 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 88/180 2024-03-30T01:49:28.304 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 89/180 2024-03-30T01:49:28.438 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-packaging-20.9-5.el9.noarch 90/180 2024-03-30T01:49:28.509 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 91/180 2024-03-30T01:49:29.461 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/180 2024-03-30T01:49:29.533 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 93/180 2024-03-30T01:49:29.567 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 94/180 2024-03-30T01:49:29.601 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 95/180 2024-03-30T01:49:29.819 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-0.3.21-2.el9.x86_64 96/180 2024-03-30T01:49:29.862 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 97/180 2024-03-30T01:49:29.959 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/180 2024-03-30T01:49:30.733 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/180 2024-03-30T01:49:30.865 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 100/180 2024-03-30T01:49:32.404 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 101/180 2024-03-30T01:49:32.482 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 102/180 2024-03-30T01:49:32.545 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 103/180 2024-03-30T01:49:32.576 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : jq-1.6-16.el9.x86_64 104/180 2024-03-30T01:49:32.617 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 105/180 2024-03-30T01:49:32.979 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 106/180 2024-03-30T01:49:33.036 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librbd1-2:18.2.2-1018.g470100a4.el9.x86_64 107/180 2024-03-30T01:49:33.163 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:18.2.2-1018.g470100a4.el9.x86_64 107/180 2024-03-30T01:49:33.197 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rbd-2:18.2.2-1018.g470100a4.el9.x86_64 108/180 2024-03-30T01:49:33.254 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 109/180 2024-03-30T01:49:33.737 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 110/180 2024-03-30T01:49:33.760 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librgw2-2:18.2.2-1018.g470100a4.el9.x86_64 111/180 2024-03-30T01:49:33.834 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librgw2-2:18.2.2-1018.g470100a4.el9.x86_64 111/180 2024-03-30T01:49:33.861 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rgw-2:18.2.2-1018.g470100a4.el9.x86_64 112/180 2024-03-30T01:49:36.228 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:18.2.2-1018.g470100a4.el9.x86_64 113/180 2024-03-30T01:49:36.265 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-common-2:18.2.2-1018.g470100a4.el9.x86_64 113/180 2024-03-30T01:49:36.867 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:18.2.2-1018.g470100a4.el9.x86_64 113/180 2024-03-30T01:49:36.911 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-base-2:18.2.2-1018.g470100a4.el9.x86_64 114/180 2024-03-30T01:49:37.049 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-base-2:18.2.2-1018.g470100a4.el9.x86_64 114/180 2024-03-30T01:49:37.049 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-30T01:49:37.049 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-30T01:49:37.049 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:49:37.087 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-selinux-2:18.2.2-1018.g470100a4.el9.x86_64 115/180 2024-03-30T01:49:49.912 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1018.g470100a4.el9.x86_64 115/180 2024-03-30T01:49:49.913 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /sys 2024-03-30T01:49:49.913 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /proc 2024-03-30T01:49:49.913 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /mnt 2024-03-30T01:49:49.913 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /var/tmp 2024-03-30T01:49:49.913 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /home 2024-03-30T01:49:49.913 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /root 2024-03-30T01:49:49.913 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /tmp 2024-03-30T01:49:49.913 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:49:50.165 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-volume-2:18.2.2-1018.g470100a4.el9.noarch 116/180 2024-03-30T01:49:50.213 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-volume-2:18.2.2-1018.g470100a4.el9.noarch 116/180 2024-03-30T01:49:50.213 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T01:49:50.213 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-30T01:49:50.213 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:49:51.810 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-osd-2:18.2.2-1018.g470100a4.el9.x86_64 117/180 2024-03-30T01:49:51.913 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-osd-2:18.2.2-1018.g470100a4.el9.x86_64 117/180 2024-03-30T01:49:51.913 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T01:49:51.913 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-30T01:49:51.913 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-30T01:49:51.913 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-30T01:49:51.913 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:49:52.135 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mds-2:18.2.2-1018.g470100a4.el9.x86_64 118/180 2024-03-30T01:49:52.221 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mds-2:18.2.2-1018.g470100a4.el9.x86_64 118/180 2024-03-30T01:49:52.221 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T01:49:52.221 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-30T01:49:52.221 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-30T01:49:52.222 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-30T01:49:52.222 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:49:52.711 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mon-2:18.2.2-1018.g470100a4.el9.x86_64 119/180 2024-03-30T01:49:52.778 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mon-2:18.2.2-1018.g470100a4.el9.x86_64 119/180 2024-03-30T01:49:52.778 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T01:49:52.778 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-30T01:49:52.779 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-30T01:49:52.779 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-30T01:49:52.779 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:49:52.896 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : automake-1.16.2-8.el9.noarch 120/180 2024-03-30T01:49:53.425 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephadm-2:18.2.2-1018.g470100a4.el9.noarch 121/180 2024-03-30T01:49:53.465 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephadm-2:18.2.2-1018.g470100a4.el9.noarch 121/180 2024-03-30T01:49:53.513 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1018.g470100a4.e 122/180 2024-03-30T01:49:53.627 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1018.g470100a4. 123/180 2024-03-30T01:49:53.660 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1018.g470100a4.el9.noa 124/180 2024-03-30T01:49:53.983 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1018.g470100a4.el9.noa 124/180 2024-03-30T01:49:54.052 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1018.g470100a4.el9.n 125/180 2024-03-30T01:49:55.203 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1018.g470100a4.el9.n 125/180 2024-03-30T01:49:55.235 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1018.g470 126/180 2024-03-30T01:49:55.377 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1018.g470 126/180 2024-03-30T01:49:55.541 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1018.g470100a4.el 127/180 2024-03-30T01:49:55.571 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-2:18.2.2-1018.g470100a4.el9.x86_64 128/180 2024-03-30T01:49:55.666 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1018.g470100a4.el9.x86_64 128/180 2024-03-30T01:49:55.666 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T01:49:55.666 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-30T01:49:55.666 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-30T01:49:55.667 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-30T01:49:55.667 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:49:55.738 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-rook-2:18.2.2-1018.g470100a4.el9.noarch 129/180 2024-03-30T01:49:55.775 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1018.g470100a4.el9.noarch 129/180 2024-03-30T01:49:55.854 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-2:18.2.2-1018.g470100a4.el9.x86_64 130/180 2024-03-30T01:49:56.653 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libtool-2.4.6-45.el9.x86_64 131/180 2024-03-30T01:49:56.691 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-radosgw-2:18.2.2-1018.g470100a4.el9.x86_64 132/180 2024-03-30T01:49:56.785 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1018.g470100a4.el9.x86_64 132/180 2024-03-30T01:49:56.786 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T01:49:56.786 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-30T01:49:56.786 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-30T01:49:56.786 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-30T01:49:56.786 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:49:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1018.g47010 133/180 2024-03-30T01:49:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1018.g47010 133/180 2024-03-30T01:49:56.912 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T01:49:56.912 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-30T01:49:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:49:56.992 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-mirror-2:18.2.2-1018.g470100a4.el9.x86_64 134/180 2024-03-30T01:49:57.079 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1018.g470100a4.el9.x86_64 134/180 2024-03-30T01:49:57.079 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T01:49:57.079 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-30T01:49:57.079 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-30T01:49:57.079 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-30T01:49:57.079 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:49:57.459 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-mirror-2:18.2.2-1018.g470100a4.el9.x86_64 135/180 2024-03-30T01:49:57.535 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1018.g470100a4.el9.x86_64 135/180 2024-03-30T01:49:57.535 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T01:49:57.535 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-30T01:49:57.535 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-30T01:49:57.535 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-30T01:49:57.535 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:01.455 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-test-2:18.2.2-1018.g470100a4.el9.x86_64 136/180 2024-03-30T01:50:01.499 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-fuse-2:18.2.2-1018.g470100a4.el9.x86_64 137/180 2024-03-30T01:50:01.536 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-nbd-2:18.2.2-1018.g470100a4.el9.x86_64 138/180 2024-03-30T01:50:01.805 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 139/180 2024-03-30T01:50:01.937 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 140/180 2024-03-30T01:50:01.988 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-fuse-2:18.2.2-1018.g470100a4.el9.x86_64 141/180 2024-03-30T01:50:02.046 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/180 2024-03-30T01:50:02.147 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 143/180 2024-03-30T01:50:02.219 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 144/180 2024-03-30T01:50:02.262 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs-devel-2:18.2.2-1018.g470100a4.el9.x86_ 145/180 2024-03-30T01:50:02.349 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 146/180 2024-03-30T01:50:02.406 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 147/180 2024-03-30T01:50:02.514 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 148/180 2024-03-30T01:50:02.660 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 149/180 2024-03-30T01:50:02.705 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 150/180 2024-03-30T01:50:03.641 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/180 2024-03-30T01:50:03.686 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/180 2024-03-30T01:50:03.742 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/180 2024-03-30T01:50:05.053 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-top-2:18.2.2-1018.g470100a4.el9.noarch 152/180 2024-03-30T01:50:05.149 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 153/180 2024-03-30T01:50:05.198 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/180 2024-03-30T01:50:05.325 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/180 2024-03-30T01:50:05.360 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/180 2024-03-30T01:50:05.393 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 157/180 2024-03-30T01:50:05.444 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 158/180 2024-03-30T01:50:05.486 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 159/180 2024-03-30T01:50:05.486 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/180 2024-03-30T01:50:05.664 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/180 2024-03-30T01:50:05.714 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 161/180 2024-03-30T01:50:05.715 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/180 2024-03-30T01:50:05.844 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/180 2024-03-30T01:50:05.897 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 163/180 2024-03-30T01:50:05.942 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 164/180 2024-03-30T01:50:05.976 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 165/180 2024-03-30T01:50:06.008 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 166/180 2024-03-30T01:50:06.087 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 167/180 2024-03-30T01:50:06.157 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 168/180 2024-03-30T01:50:06.205 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 169/180 2024-03-30T01:50:06.238 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 170/180 2024-03-30T01:50:06.288 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 171/180 2024-03-30T01:50:06.322 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 172/180 2024-03-30T01:50:06.355 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 173/180 2024-03-30T01:50:06.392 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 174/180 2024-03-30T01:50:06.392 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 174/180 2024-03-30T01:50:06.731 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 174/180 2024-03-30T01:50:06.731 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 175/180 2024-03-30T01:50:06.869 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 175/180 2024-03-30T01:50:06.900 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 176/180 2024-03-30T01:50:06.933 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 177/180 2024-03-30T01:50:06.970 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 178/180 2024-03-30T01:50:07.010 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 179/180 2024-03-30T01:50:07.128 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 180/180 2024-03-30T01:50:07.368 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 180/180 2024-03-30T01:50:07.368 INFO:teuthology.orchestra.run.smithi137.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-30T01:50:07.368 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:11.818 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-2:18.2.2-1018.g470100a4.el9.x86_64 1/180 2024-03-30T01:50:11.818 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-base-2:18.2.2-1018.g470100a4.el9.x86_64 2/180 2024-03-30T01:50:11.818 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-common-2:18.2.2-1018.g470100a4.el9.x86_64 3/180 2024-03-30T01:50:11.818 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-fuse-2:18.2.2-1018.g470100a4.el9.x86_64 4/180 2024-03-30T01:50:11.818 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1018.g47010 5/180 2024-03-30T01:50:11.818 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mds-2:18.2.2-1018.g470100a4.el9.x86_64 6/180 2024-03-30T01:50:11.819 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-2:18.2.2-1018.g470100a4.el9.x86_64 7/180 2024-03-30T01:50:11.819 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mon-2:18.2.2-1018.g470100a4.el9.x86_64 8/180 2024-03-30T01:50:11.819 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-osd-2:18.2.2-1018.g470100a4.el9.x86_64 9/180 2024-03-30T01:50:11.819 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-radosgw-2:18.2.2-1018.g470100a4.el9.x86_64 10/180 2024-03-30T01:50:11.819 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-selinux-2:18.2.2-1018.g470100a4.el9.x86_64 11/180 2024-03-30T01:50:11.819 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-test-2:18.2.2-1018.g470100a4.el9.x86_64 12/180 2024-03-30T01:50:11.819 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-mirror-2:18.2.2-1018.g470100a4.el9.x86_64 13/180 2024-03-30T01:50:11.819 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs-devel-2:18.2.2-1018.g470100a4.el9.x86_ 14/180 2024-03-30T01:50:11.819 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs2-2:18.2.2-1018.g470100a4.el9.x86_64 15/180 2024-03-30T01:50:11.819 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephsqlite-2:18.2.2-1018.g470100a4.el9.x86_64 16/180 2024-03-30T01:50:11.819 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados-devel-2:18.2.2-1018.g470100a4.el9.x86_6 17/180 2024-03-30T01:50:11.819 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libradosstriper1-2:18.2.2-1018.g470100a4.el9.x86 18/180 2024-03-30T01:50:11.820 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librgw2-2:18.2.2-1018.g470100a4.el9.x86_64 19/180 2024-03-30T01:50:11.820 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1018.g470100a4.el 20/180 2024-03-30T01:50:11.820 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-common-2:18.2.2-1018.g470100a4.el9. 21/180 2024-03-30T01:50:11.820 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cephfs-2:18.2.2-1018.g470100a4.el9.x86_6 22/180 2024-03-30T01:50:11.820 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rados-2:18.2.2-1018.g470100a4.el9.x86_64 23/180 2024-03-30T01:50:11.820 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rbd-2:18.2.2-1018.g470100a4.el9.x86_64 24/180 2024-03-30T01:50:11.820 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rgw-2:18.2.2-1018.g470100a4.el9.x86_64 25/180 2024-03-30T01:50:11.820 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-fuse-2:18.2.2-1018.g470100a4.el9.x86_64 26/180 2024-03-30T01:50:11.820 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-mirror-2:18.2.2-1018.g470100a4.el9.x86_64 27/180 2024-03-30T01:50:11.820 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-nbd-2:18.2.2-1018.g470100a4.el9.x86_64 28/180 2024-03-30T01:50:11.820 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1018.g470100a4. 29/180 2024-03-30T01:50:11.821 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1018.g470100a4.el9.noa 30/180 2024-03-30T01:50:11.821 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1018.g470100a4.el9.n 31/180 2024-03-30T01:50:11.821 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1018.g470 32/180 2024-03-30T01:50:11.821 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1018.g470100a4.el 33/180 2024-03-30T01:50:11.821 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1018.g470100a4.el9.noarch 34/180 2024-03-30T01:50:11.821 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1018.g470100a4.e 35/180 2024-03-30T01:50:11.821 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-volume-2:18.2.2-1018.g470100a4.el9.noarch 36/180 2024-03-30T01:50:11.821 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephadm-2:18.2.2-1018.g470100a4.el9.noarch 37/180 2024-03-30T01:50:11.821 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-top-2:18.2.2-1018.g470100a4.el9.noarch 38/180 2024-03-30T01:50:11.821 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/180 2024-03-30T01:50:11.821 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/180 2024-03-30T01:50:11.821 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/180 2024-03-30T01:50:11.822 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flex-2.6.4-9.el9.x86_64 42/180 2024-03-30T01:50:11.822 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 43/180 2024-03-30T01:50:11.822 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 44/180 2024-03-30T01:50:11.822 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 45/180 2024-03-30T01:50:11.822 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 46/180 2024-03-30T01:50:11.822 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 47/180 2024-03-30T01:50:11.822 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 48/180 2024-03-30T01:50:11.822 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 49/180 2024-03-30T01:50:11.822 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 50/180 2024-03-30T01:50:11.822 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 51/180 2024-03-30T01:50:11.822 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 52/180 2024-03-30T01:50:11.823 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 53/180 2024-03-30T01:50:11.823 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 54/180 2024-03-30T01:50:11.823 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 55/180 2024-03-30T01:50:11.823 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-13.14-1.el9.x86_64 56/180 2024-03-30T01:50:11.823 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 57/180 2024-03-30T01:50:11.823 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 58/180 2024-03-30T01:50:11.823 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 59/180 2024-03-30T01:50:11.823 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 60/180 2024-03-30T01:50:11.823 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/180 2024-03-30T01:50:11.823 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/180 2024-03-30T01:50:11.823 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/180 2024-03-30T01:50:11.823 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/180 2024-03-30T01:50:11.824 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/180 2024-03-30T01:50:11.824 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/180 2024-03-30T01:50:11.824 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/180 2024-03-30T01:50:11.824 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 68/180 2024-03-30T01:50:11.824 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/180 2024-03-30T01:50:11.824 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 70/180 2024-03-30T01:50:11.824 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 71/180 2024-03-30T01:50:11.824 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 72/180 2024-03-30T01:50:11.824 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 73/180 2024-03-30T01:50:11.824 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 74/180 2024-03-30T01:50:11.824 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 75/180 2024-03-30T01:50:11.824 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 76/180 2024-03-30T01:50:11.825 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 77/180 2024-03-30T01:50:11.825 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 78/180 2024-03-30T01:50:11.825 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 79/180 2024-03-30T01:50:11.825 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 80/180 2024-03-30T01:50:11.825 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 81/180 2024-03-30T01:50:11.825 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 82/180 2024-03-30T01:50:11.825 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ply-3.11-14.el9.noarch 83/180 2024-03-30T01:50:11.825 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 84/180 2024-03-30T01:50:11.825 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 85/180 2024-03-30T01:50:11.825 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : jq-1.6-16.el9.x86_64 86/180 2024-03-30T01:50:11.825 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 87/180 2024-03-30T01:50:11.826 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 88/180 2024-03-30T01:50:11.826 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 89/180 2024-03-30T01:50:11.826 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 90/180 2024-03-30T01:50:11.826 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 91/180 2024-03-30T01:50:11.826 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 92/180 2024-03-30T01:50:11.826 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 93/180 2024-03-30T01:50:11.826 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 94/180 2024-03-30T01:50:11.826 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 95/180 2024-03-30T01:50:11.826 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 96/180 2024-03-30T01:50:11.826 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 97/180 2024-03-30T01:50:11.826 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 98/180 2024-03-30T01:50:11.827 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 99/180 2024-03-30T01:50:11.827 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/180 2024-03-30T01:50:11.827 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/180 2024-03-30T01:50:11.827 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 102/180 2024-03-30T01:50:11.827 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 103/180 2024-03-30T01:50:11.827 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 104/180 2024-03-30T01:50:11.827 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 105/180 2024-03-30T01:50:11.827 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 106/180 2024-03-30T01:50:11.827 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 107/180 2024-03-30T01:50:11.827 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 108/180 2024-03-30T01:50:11.828 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 109/180 2024-03-30T01:50:11.828 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 110/180 2024-03-30T01:50:11.828 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 111/180 2024-03-30T01:50:11.828 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 112/180 2024-03-30T01:50:11.828 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 113/180 2024-03-30T01:50:11.828 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 114/180 2024-03-30T01:50:11.828 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/180 2024-03-30T01:50:11.828 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/180 2024-03-30T01:50:11.828 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/180 2024-03-30T01:50:11.828 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/180 2024-03-30T01:50:11.828 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/180 2024-03-30T01:50:11.828 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/180 2024-03-30T01:50:11.829 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/180 2024-03-30T01:50:11.829 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/180 2024-03-30T01:50:11.829 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/180 2024-03-30T01:50:11.829 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/180 2024-03-30T01:50:11.829 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/180 2024-03-30T01:50:11.829 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/180 2024-03-30T01:50:11.829 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/180 2024-03-30T01:50:11.829 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/180 2024-03-30T01:50:11.829 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/180 2024-03-30T01:50:11.829 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/180 2024-03-30T01:50:11.829 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/180 2024-03-30T01:50:11.829 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/180 2024-03-30T01:50:11.830 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:18.2.2-1018.g470100a4.el9.x86_64 133/180 2024-03-30T01:50:11.830 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/180 2024-03-30T01:50:11.830 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:18.2.2-1018.g470100a4.el9.x86_64 135/180 2024-03-30T01:50:11.830 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/180 2024-03-30T01:50:11.830 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 137/180 2024-03-30T01:50:11.830 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 138/180 2024-03-30T01:50:11.830 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 139/180 2024-03-30T01:50:11.830 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 140/180 2024-03-30T01:50:11.830 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 141/180 2024-03-30T01:50:11.830 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 142/180 2024-03-30T01:50:11.831 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 143/180 2024-03-30T01:50:11.831 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 144/180 2024-03-30T01:50:11.831 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 145/180 2024-03-30T01:50:11.831 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 146/180 2024-03-30T01:50:11.831 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/180 2024-03-30T01:50:11.831 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/180 2024-03-30T01:50:11.831 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 149/180 2024-03-30T01:50:11.831 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/180 2024-03-30T01:50:11.831 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 151/180 2024-03-30T01:50:11.831 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/180 2024-03-30T01:50:11.831 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 153/180 2024-03-30T01:50:11.831 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/180 2024-03-30T01:50:11.832 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/180 2024-03-30T01:50:11.832 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/180 2024-03-30T01:50:11.832 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 157/180 2024-03-30T01:50:11.832 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 158/180 2024-03-30T01:50:11.832 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 159/180 2024-03-30T01:50:11.832 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 160/180 2024-03-30T01:50:11.832 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 161/180 2024-03-30T01:50:11.832 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 162/180 2024-03-30T01:50:11.832 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 163/180 2024-03-30T01:50:11.832 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 164/180 2024-03-30T01:50:11.832 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 165/180 2024-03-30T01:50:11.832 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 166/180 2024-03-30T01:50:11.833 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 167/180 2024-03-30T01:50:11.833 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 168/180 2024-03-30T01:50:11.833 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 169/180 2024-03-30T01:50:11.833 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 170/180 2024-03-30T01:50:11.833 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 171/180 2024-03-30T01:50:11.833 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 172/180 2024-03-30T01:50:11.833 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 173/180 2024-03-30T01:50:11.833 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 174/180 2024-03-30T01:50:11.833 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 175/180 2024-03-30T01:50:11.833 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 176/180 2024-03-30T01:50:11.833 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 177/180 2024-03-30T01:50:11.833 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 178/180 2024-03-30T01:50:11.833 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 179/180 2024-03-30T01:50:14.096 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 180/180 2024-03-30T01:50:14.096 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:14.097 INFO:teuthology.orchestra.run.smithi137.stdout:Upgraded: 2024-03-30T01:50:14.097 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-30T01:50:14.097 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-30T01:50:14.097 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-30T01:50:14.097 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-30T01:50:14.097 INFO:teuthology.orchestra.run.smithi137.stdout: acl-2.3.1-4.el9.x86_64 2024-03-30T01:50:14.097 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-30T01:50:14.097 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-30T01:50:14.097 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-30T01:50:14.097 INFO:teuthology.orchestra.run.smithi137.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-30T01:50:14.097 INFO:teuthology.orchestra.run.smithi137.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-30T01:50:14.097 INFO:teuthology.orchestra.run.smithi137.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-30T01:50:14.097 INFO:teuthology.orchestra.run.smithi137.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-30T01:50:14.098 INFO:teuthology.orchestra.run.smithi137.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-30T01:50:14.098 INFO:teuthology.orchestra.run.smithi137.stdout: librados2-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.098 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.098 INFO:teuthology.orchestra.run.smithi137.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-30T01:50:14.098 INFO:teuthology.orchestra.run.smithi137.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-30T01:50:14.098 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-30T01:50:14.098 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-30T01:50:14.098 INFO:teuthology.orchestra.run.smithi137.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-30T01:50:14.098 INFO:teuthology.orchestra.run.smithi137.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-30T01:50:14.098 INFO:teuthology.orchestra.run.smithi137.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-30T01:50:14.098 INFO:teuthology.orchestra.run.smithi137.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-30T01:50:14.098 INFO:teuthology.orchestra.run.smithi137.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-30T01:50:14.098 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-03-30T01:50:14.099 INFO:teuthology.orchestra.run.smithi137.stdout: automake-1.16.2-8.el9.noarch 2024-03-30T01:50:14.099 INFO:teuthology.orchestra.run.smithi137.stdout: bison-3.7.4-5.el9.x86_64 2024-03-30T01:50:14.099 INFO:teuthology.orchestra.run.smithi137.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-30T01:50:14.099 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.099 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.099 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.099 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.099 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards-2:18.2.2-1018.g470100a4.el9.noarch 2024-03-30T01:50:14.099 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.099 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.099 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.099 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm-2:18.2.2-1018.g470100a4.el9.noarch 2024-03-30T01:50:14.099 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard-2:18.2.2-1018.g470100a4.el9.noarch 2024-03-30T01:50:14.099 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1018.g470100a4.el9.noarch 2024-03-30T01:50:14.100 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core-2:18.2.2-1018.g470100a4.el9.noarch 2024-03-30T01:50:14.100 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook-2:18.2.2-1018.g470100a4.el9.noarch 2024-03-30T01:50:14.100 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.100 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.100 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts-2:18.2.2-1018.g470100a4.el9.noarch 2024-03-30T01:50:14.100 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.100 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.100 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.100 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-volume-2:18.2.2-1018.g470100a4.el9.noarch 2024-03-30T01:50:14.100 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm-2:18.2.2-1018.g470100a4.el9.noarch 2024-03-30T01:50:14.100 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-mirror-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.100 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-top-2:18.2.2-1018.g470100a4.el9.noarch 2024-03-30T01:50:14.100 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-30T01:50:14.101 INFO:teuthology.orchestra.run.smithi137.stdout: flex-2.6.4-9.el9.x86_64 2024-03-30T01:50:14.101 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-30T01:50:14.101 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-30T01:50:14.101 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-30T01:50:14.101 INFO:teuthology.orchestra.run.smithi137.stdout: fmt-8.1.1-5.el9.x86_64 2024-03-30T01:50:14.101 INFO:teuthology.orchestra.run.smithi137.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-30T01:50:14.101 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-30T01:50:14.101 INFO:teuthology.orchestra.run.smithi137.stdout: jq-1.6-16.el9.x86_64 2024-03-30T01:50:14.101 INFO:teuthology.orchestra.run.smithi137.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-30T01:50:14.101 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-30T01:50:14.101 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-30T01:50:14.101 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.101 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.101 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.101 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-30T01:50:14.102 INFO:teuthology.orchestra.run.smithi137.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-30T01:50:14.102 INFO:teuthology.orchestra.run.smithi137.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-30T01:50:14.102 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-30T01:50:14.102 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-30T01:50:14.102 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.102 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.102 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-30T01:50:14.102 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.102 INFO:teuthology.orchestra.run.smithi137.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-30T01:50:14.102 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-30T01:50:14.102 INFO:teuthology.orchestra.run.smithi137.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-30T01:50:14.102 INFO:teuthology.orchestra.run.smithi137.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-30T01:50:14.103 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-30T01:50:14.103 INFO:teuthology.orchestra.run.smithi137.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-30T01:50:14.103 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-30T01:50:14.103 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-30T01:50:14.103 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-30T01:50:14.103 INFO:teuthology.orchestra.run.smithi137.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-30T01:50:14.103 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-13.14-1.el9.x86_64 2024-03-30T01:50:14.103 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-30T01:50:14.103 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-30T01:50:14.103 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-30T01:50:14.103 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-30T01:50:14.104 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-30T01:50:14.104 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-30T01:50:14.104 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-30T01:50:14.104 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.104 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.104 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.104 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-30T01:50:14.104 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-30T01:50:14.104 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-30T01:50:14.104 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-30T01:50:14.104 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-30T01:50:14.104 INFO:teuthology.orchestra.run.smithi137.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-30T01:50:14.104 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-30T01:50:14.104 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-30T01:50:14.105 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-30T01:50:14.105 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-30T01:50:14.105 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-30T01:50:14.105 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-30T01:50:14.105 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-30T01:50:14.105 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-30T01:50:14.105 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-30T01:50:14.105 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-30T01:50:14.105 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-30T01:50:14.105 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-30T01:50:14.105 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-30T01:50:14.105 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-30T01:50:14.105 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-30T01:50:14.106 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-30T01:50:14.106 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-30T01:50:14.106 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-30T01:50:14.106 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-30T01:50:14.106 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-30T01:50:14.106 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ply-3.11-14.el9.noarch 2024-03-30T01:50:14.106 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-30T01:50:14.106 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-30T01:50:14.106 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-30T01:50:14.106 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-30T01:50:14.106 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-30T01:50:14.106 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-30T01:50:14.106 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-30T01:50:14.106 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.107 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.107 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-30T01:50:14.107 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-30T01:50:14.107 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-30T01:50:14.107 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.107 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-30T01:50:14.107 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-30T01:50:14.107 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-30T01:50:14.107 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-30T01:50:14.107 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-30T01:50:14.107 INFO:teuthology.orchestra.run.smithi137.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-30T01:50:14.107 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-30T01:50:14.107 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-30T01:50:14.107 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-30T01:50:14.107 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-30T01:50:14.108 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-30T01:50:14.108 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.108 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.108 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd-2:18.2.2-1018.g470100a4.el9.x86_64 2024-03-30T01:50:14.108 INFO:teuthology.orchestra.run.smithi137.stdout: re2-1:20211101-3.el9.x86_64 2024-03-30T01:50:14.108 INFO:teuthology.orchestra.run.smithi137.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-30T01:50:14.108 INFO:teuthology.orchestra.run.smithi137.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-30T01:50:14.108 INFO:teuthology.orchestra.run.smithi137.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-30T01:50:14.108 INFO:teuthology.orchestra.run.smithi137.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-30T01:50:14.108 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-30T01:50:14.109 INFO:teuthology.orchestra.run.smithi137.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-30T01:50:14.109 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:14.109 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-03-30T01:50:14.864 DEBUG:teuthology.parallel:result is None 2024-03-30T01:50:14.865 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=470100a4ccbcf7769052bf09a5413881ccf1b97f 2024-03-30T01:50:15.227 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-30T01:50:15.300 INFO:teuthology.orchestra.run.smithi133.stdout:18.2.2-1018.g470100a4.el9 2024-03-30T01:50:15.301 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1018.g470100a4.el9 2024-03-30T01:50:15.301 INFO:teuthology.task.install:The correct ceph version 18.2.2-1018.g470100a4 is installed. 2024-03-30T01:50:15.303 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=470100a4ccbcf7769052bf09a5413881ccf1b97f 2024-03-30T01:50:15.448 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-30T01:50:15.507 INFO:teuthology.orchestra.run.smithi137.stdout:18.2.2-1018.g470100a4.el9 2024-03-30T01:50:15.507 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1018.g470100a4.el9 2024-03-30T01:50:15.507 INFO:teuthology.task.install:The correct ceph version 18.2.2-1018.g470100a4 is installed. 2024-03-30T01:50:15.510 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-30T01:50:15.510 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:50:15.510 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-30T01:50:15.612 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:50:15.612 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-30T01:50:15.687 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-30T01:50:15.687 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:50:15.687 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/daemon-helper 2024-03-30T01:50:15.787 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-30T01:50:15.922 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:50:15.922 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/daemon-helper 2024-03-30T01:50:16.002 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-30T01:50:16.131 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-30T01:50:16.131 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:50:16.131 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-30T01:50:16.215 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-30T01:50:16.353 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:50:16.353 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-30T01:50:16.435 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-30T01:50:16.556 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-30T01:50:16.556 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:50:16.556 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/stdin-killer 2024-03-30T01:50:16.653 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-30T01:50:16.743 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:50:16.743 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/stdin-killer 2024-03-30T01:50:16.816 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-30T01:50:16.925 INFO:teuthology.run_tasks:Running task ceph... 2024-03-30T01:50:17.008 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-30T01:50:17.008 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 777 /var/log/ceph 2024-03-30T01:50:17.016 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 777 /var/log/ceph 2024-03-30T01:50:17.105 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-30T01:50:17.105 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-30T01:50:17.112 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-30T01:50:17.198 INFO:tasks.ceph:Creating extra log directories... 2024-03-30T01:50:17.198 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-30T01:50:17.203 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-30T01:50:17.297 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-30T01:50:17.297 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-30T01:50:17.297 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-30T01:50:17.297 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:50:17.297 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-30T01:50:17.350 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-30T01:50:17.611 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-30T01:50:17.711 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:50:17.711 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-30T01:50:17.753 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-30T01:50:17.957 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-30T01:50:18.035 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-30T01:50:18.035 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-30T01:50:18.035 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-03-29_18:05:24-fs-wip-rishabh-testing-20240327.051042-reef-testing-default-smithi/7629323', 'branch': 'wip-rishabh-testing-20240327.051042-reef', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/recovery-fs}', 'email': None, 'first_in_suite': False, 'job_id': '7629323', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2024-03-29_18:05:24-fs-wip-rishabh-testing-20240327.051042-reef-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240327.051042-reef'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '470100a4ccbcf7769052bf09a5413881ccf1b97f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '470100a4ccbcf7769052bf09a5413881ccf1b97f'}}, 'kclient': {'syntax': 'v1'}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240327.051042-reef', 'sha1': '470100a4ccbcf7769052bf09a5413881ccf1b97f'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8052, 'sha1': '470100a4ccbcf7769052bf09a5413881ccf1b97f', 'sleep_before_teardown': 0, 'subset': '497/512', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240327.051042-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_470100a4ccbcf7769052bf09a5413881ccf1b97f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '470100a4ccbcf7769052bf09a5413881ccf1b97f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi133.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOSuTrqf4XLFxbxEGVf3lm4FTHfI2eVG8nvVoSuw1yJKr7E7bP+mRHT+oAAQEwaZ4xu1xJqmmPmIEzTbbYTO3zk=', 'smithi137.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOqmzwCL+rBy2C4wUVFStlUDYJcUFIqIDFMGspGAl4hYeLtG+p+tu0DdMAZBRVQqAjo7tbBP9D+saAJ6F1WSNhg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '470100a4ccbcf7769052bf09a5413881ccf1b97f'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '470100a4ccbcf7769052bf09a5413881ccf1b97f', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_recovery_fs']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-29_18:05:24', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-30T01:50:18.035 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-30T01:50:18.043 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-30T01:50:18.092 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/run/ceph 2024-03-30T01:50:18.097 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/run/ceph 2024-03-30T01:50:18.195 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:50:18.195 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/scratch_devs of=/dev/stdout 2024-03-30T01:50:18.248 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-30T01:50:18.248 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_1 2024-03-30T01:50:18.301 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-30T01:50:18.301 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T01:50:18.301 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 631 Links: 1 2024-03-30T01:50:18.301 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T01:50:18.301 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T01:50:18.301 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-03-30 01:49:17.072149506 +0000 2024-03-30T01:50:18.301 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-03-30 01:46:21.082825693 +0000 2024-03-30T01:50:18.301 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-03-30 01:46:21.082825693 +0000 2024-03-30T01:50:18.301 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-03-30 01:46:21.082825693 +0000 2024-03-30T01:50:18.301 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-30T01:50:18.392 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-03-30T01:50:18.392 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-03-30T01:50:18.392 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.00032121 s, 1.6 MB/s 2024-03-30T01:50:18.396 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-30T01:50:18.454 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_2 2024-03-30T01:50:18.501 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-30T01:50:18.501 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T01:50:18.501 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 653 Links: 1 2024-03-30T01:50:18.501 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T01:50:18.501 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T01:50:18.501 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-03-30 01:49:17.073149487 +0000 2024-03-30T01:50:18.501 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-03-30 01:46:21.633815354 +0000 2024-03-30T01:50:18.501 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-03-30 01:46:21.633815354 +0000 2024-03-30T01:50:18.501 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-03-30 01:46:21.633815354 +0000 2024-03-30T01:50:18.501 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-30T01:50:18.631 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-03-30T01:50:18.631 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-03-30T01:50:18.631 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000355133 s, 1.4 MB/s 2024-03-30T01:50:18.635 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-30T01:50:18.689 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_3 2024-03-30T01:50:18.739 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-30T01:50:18.739 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T01:50:18.739 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 671 Links: 1 2024-03-30T01:50:18.739 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T01:50:18.739 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T01:50:18.739 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-03-30 01:49:17.074149469 +0000 2024-03-30T01:50:18.740 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-03-30 01:46:22.204804640 +0000 2024-03-30T01:50:18.740 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-03-30 01:46:22.204804640 +0000 2024-03-30T01:50:18.740 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-03-30 01:46:22.204804640 +0000 2024-03-30T01:50:18.740 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-30T01:50:18.828 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-03-30T01:50:18.829 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-03-30T01:50:18.829 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000342596 s, 1.5 MB/s 2024-03-30T01:50:18.833 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-30T01:50:18.888 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_4 2024-03-30T01:50:18.937 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-30T01:50:18.938 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T01:50:18.938 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 691 Links: 1 2024-03-30T01:50:18.938 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T01:50:18.938 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T01:50:18.938 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-03-30 01:49:17.074149469 +0000 2024-03-30T01:50:18.938 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-03-30 01:46:22.779793852 +0000 2024-03-30T01:50:18.938 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-03-30 01:46:22.779793852 +0000 2024-03-30T01:50:18.938 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-03-30 01:46:22.779793852 +0000 2024-03-30T01:50:18.938 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-30T01:50:19.024 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-03-30T01:50:19.024 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-03-30T01:50:19.024 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000329727 s, 1.6 MB/s 2024-03-30T01:50:19.028 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-30T01:50:19.083 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-30T01:50:19.083 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:50:19.083 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/scratch_devs of=/dev/stdout 2024-03-30T01:50:19.129 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-30T01:50:19.129 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_1 2024-03-30T01:50:19.212 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-30T01:50:19.212 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T01:50:19.213 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 633 Links: 1 2024-03-30T01:50:19.213 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T01:50:19.213 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T01:50:19.213 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-03-30 01:50:07.786157348 +0000 2024-03-30T01:50:19.213 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-03-30 01:46:21.990435391 +0000 2024-03-30T01:50:19.213 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-03-30 01:46:21.990435391 +0000 2024-03-30T01:50:19.213 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-03-30 01:46:21.990435391 +0000 2024-03-30T01:50:19.213 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-30T01:50:19.323 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-03-30T01:50:19.323 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-03-30T01:50:19.323 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000369642 s, 1.4 MB/s 2024-03-30T01:50:19.327 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-30T01:50:19.368 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_2 2024-03-30T01:50:19.451 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-30T01:50:19.451 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T01:50:19.451 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 651 Links: 1 2024-03-30T01:50:19.451 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T01:50:19.451 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T01:50:19.451 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-03-30 01:50:07.786157348 +0000 2024-03-30T01:50:19.451 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-03-30 01:46:22.548425258 +0000 2024-03-30T01:50:19.451 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-03-30 01:46:22.548425258 +0000 2024-03-30T01:50:19.452 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-03-30 01:46:22.548425258 +0000 2024-03-30T01:50:19.452 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-30T01:50:19.558 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-03-30T01:50:19.559 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-03-30T01:50:19.559 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000293242 s, 1.7 MB/s 2024-03-30T01:50:19.562 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-30T01:50:19.601 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_3 2024-03-30T01:50:19.694 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-30T01:50:19.694 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T01:50:19.694 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 669 Links: 1 2024-03-30T01:50:19.694 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T01:50:19.694 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T01:50:19.694 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-03-30 01:50:07.787157330 +0000 2024-03-30T01:50:19.694 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-03-30 01:46:23.143414453 +0000 2024-03-30T01:50:19.695 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-03-30 01:46:23.143414453 +0000 2024-03-30T01:50:19.695 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-03-30 01:46:23.143414453 +0000 2024-03-30T01:50:19.695 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-30T01:50:19.780 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-03-30T01:50:19.781 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-03-30T01:50:19.781 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000491643 s, 1.0 MB/s 2024-03-30T01:50:19.785 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-30T01:50:19.839 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_4 2024-03-30T01:50:19.884 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-30T01:50:19.884 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T01:50:19.884 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-03-30T01:50:19.884 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T01:50:19.884 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T01:50:19.885 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-03-30 01:50:07.787157330 +0000 2024-03-30T01:50:19.885 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-03-30 01:46:23.708404193 +0000 2024-03-30T01:50:19.885 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-03-30 01:46:23.708404193 +0000 2024-03-30T01:50:19.885 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-03-30 01:46:23.708404193 +0000 2024-03-30T01:50:19.885 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-30T01:50:20.014 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-03-30T01:50:20.014 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-03-30T01:50:20.014 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000361612 s, 1.4 MB/s 2024-03-30T01:50:20.018 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-30T01:50:20.070 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-30T01:50:20.071 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-30T01:50:20.071 INFO:tasks.ceph:Generating config... 2024-03-30T01:50:20.072 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-30T01:50:20.072 INFO:tasks.ceph:[client] debug client = 20 2024-03-30T01:50:20.072 INFO:tasks.ceph:[client] debug ms = 1 2024-03-30T01:50:20.072 INFO:tasks.ceph:[client] pid file = 2024-03-30T01:50:20.072 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-30T01:50:20.072 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-30T01:50:20.072 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-03-30T01:50:20.072 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-30T01:50:20.072 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-30T01:50:20.072 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-30T01:50:20.073 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-30T01:50:20.073 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-30T01:50:20.073 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-30T01:50:20.073 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-30T01:50:20.073 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-30T01:50:20.073 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-30T01:50:20.073 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-30T01:50:20.073 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-30T01:50:20.073 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-30T01:50:20.073 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-30T01:50:20.073 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-30T01:50:20.073 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-30T01:50:20.073 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-30T01:50:20.073 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-30T01:50:20.073 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-30T01:50:20.073 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-30T01:50:20.074 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-30T01:50:20.074 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-30T01:50:20.074 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-30T01:50:20.074 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-30T01:50:20.074 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-30T01:50:20.074 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-30T01:50:20.074 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-30T01:50:20.074 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-30T01:50:20.074 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-30T01:50:20.074 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-30T01:50:20.074 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-30T01:50:20.074 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-30T01:50:20.074 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-30T01:50:20.075 INFO:tasks.ceph:Setting up mon.a... 2024-03-30T01:50:20.075 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-30T01:50:20.212 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.keyring 2024-03-30T01:50:20.221 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-30T01:50:20.353 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-30T01:50:20.439 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.133'), ('mon.b', '172.21.15.137'), ('mon.c', '[v2:172.21.15.137:3301,v1:172.21.15.137:6790]')] 2024-03-30T01:50:20.440 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.133,172.21.15.137,[v2:172.21.15.137:3301,v1:172.21.15.137:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-30T01:50:20.440 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:50:20.440 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-30T01:50:20.490 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.133 --add b 172.21.15.137 --addv c '[v2:172.21.15.137:3301,v1:172.21.15.137:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-30T01:50:20.640 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-30T01:50:20.640 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: generated fsid 10e5f47a-7547-42f1-8bb3-a8ac3aae8cad 2024-03-30T01:50:20.640 INFO:teuthology.orchestra.run.smithi133.stdout:setting min_mon_release = pacific 2024-03-30T01:50:20.640 INFO:teuthology.orchestra.run.smithi133.stdout:epoch 0 2024-03-30T01:50:20.640 INFO:teuthology.orchestra.run.smithi133.stdout:fsid 10e5f47a-7547-42f1-8bb3-a8ac3aae8cad 2024-03-30T01:50:20.640 INFO:teuthology.orchestra.run.smithi133.stdout:last_changed 2024-03-30T01:50:20.635351+0000 2024-03-30T01:50:20.641 INFO:teuthology.orchestra.run.smithi133.stdout:created 2024-03-30T01:50:20.635351+0000 2024-03-30T01:50:20.641 INFO:teuthology.orchestra.run.smithi133.stdout:min_mon_release 16 (pacific) 2024-03-30T01:50:20.641 INFO:teuthology.orchestra.run.smithi133.stdout:election_strategy: 1 2024-03-30T01:50:20.641 INFO:teuthology.orchestra.run.smithi133.stdout:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-03-30T01:50:20.641 INFO:teuthology.orchestra.run.smithi133.stdout:1: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.b 2024-03-30T01:50:20.641 INFO:teuthology.orchestra.run.smithi133.stdout:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-03-30T01:50:20.641 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-30T01:50:20.644 DEBUG:teuthology.orchestra.run.smithi133:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-30T01:50:20.691 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 10e5f47a-7547-42f1-8bb3-a8ac3aae8cad... 2024-03-30T01:50:20.692 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-30T01:50:20.697 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-30T01:50:20.860 INFO:teuthology.orchestra.run.smithi133.stdout:[global] 2024-03-30T01:50:20.860 INFO:teuthology.orchestra.run.smithi133.stdout: chdir = "" 2024-03-30T01:50:20.860 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-30T01:50:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: auth supported = cephx 2024-03-30T01:50:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: filestore xattr use omap = true 2024-03-30T01:50:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: mon clock drift allowed = 1.000 2024-03-30T01:50:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: osd crush chooseleaf type = 0 2024-03-30T01:50:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: auth debug = true 2024-03-30T01:50:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on old message = true 2024-03-30T01:50:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on bug = true 2024-03-30T01:50:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-30T01:50:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: mon pg warn max object skew = 0 2024-03-30T01:50:20.862 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.862 INFO:teuthology.orchestra.run.smithi133.stdout: # disable pg_autoscaler by default for new pools 2024-03-30T01:50:20.862 INFO:teuthology.orchestra.run.smithi133.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-30T01:50:20.862 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.862 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default size = 2 2024-03-30T01:50:20.862 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.862 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow primary affinity = true 2024-03-30T01:50:20.862 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow pg remap = true 2024-03-30T01:50:20.862 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on legacy crush tunables = false 2024-03-30T01:50:20.862 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on crush straw calc version zero = false 2024-03-30T01:50:20.862 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on no sortbitwise = false 2024-03-30T01:50:20.862 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on osd down out interval zero = false 2024-03-30T01:50:20.862 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on too few osds = false 2024-03-30T01:50:20.863 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-30T01:50:20.863 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-30T01:50:20.863 INFO:teuthology.orchestra.run.smithi133.stdout: mon_allow_pool_size_one = true 2024-03-30T01:50:20.863 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.863 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-30T01:50:20.863 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.863 INFO:teuthology.orchestra.run.smithi133.stdout: osd default data pool replay window = 5 2024-03-30T01:50:20.863 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.863 INFO:teuthology.orchestra.run.smithi133.stdout: mon allow pool delete = true 2024-03-30T01:50:20.863 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.863 INFO:teuthology.orchestra.run.smithi133.stdout: mon cluster log file level = debug 2024-03-30T01:50:20.863 INFO:teuthology.orchestra.run.smithi133.stdout: debug asserts on shutdown = true 2024-03-30T01:50:20.863 INFO:teuthology.orchestra.run.smithi133.stdout: mon health detail to clog = false 2024-03-30T01:50:20.863 INFO:teuthology.orchestra.run.smithi133.stdout: mon host = "172.21.15.133,172.21.15.137,[v2:172.21.15.137:3301,v1:172.21.15.137:6790]" 2024-03-30T01:50:20.863 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on skipped message = False 2024-03-30T01:50:20.864 INFO:teuthology.orchestra.run.smithi133.stdout: fsid = 10e5f47a-7547-42f1-8bb3-a8ac3aae8cad 2024-03-30T01:50:20.864 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.864 INFO:teuthology.orchestra.run.smithi133.stdout:[osd] 2024-03-30T01:50:20.864 INFO:teuthology.orchestra.run.smithi133.stdout: osd journal size = 100 2024-03-30T01:50:20.864 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.864 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub load threshold = 5.0 2024-03-30T01:50:20.864 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub max interval = 600 2024-03-30T01:50:20.864 INFO:teuthology.orchestra.run.smithi133.stdout: osd mclock profile = high_recovery_ops 2024-03-30T01:50:20.864 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.864 INFO:teuthology.orchestra.run.smithi133.stdout: osd recover clone overlap = true 2024-03-30T01:50:20.864 INFO:teuthology.orchestra.run.smithi133.stdout: osd recovery max chunk = 1048576 2024-03-30T01:50:20.864 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.864 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug shutdown = true 2024-03-30T01:50:20.864 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug op order = true 2024-03-30T01:50:20.864 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug verify stray on activate = true 2024-03-30T01:50:20.864 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.865 INFO:teuthology.orchestra.run.smithi133.stdout: osd open classes on start = true 2024-03-30T01:50:20.865 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug pg log writeout = true 2024-03-30T01:50:20.865 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.865 INFO:teuthology.orchestra.run.smithi133.stdout: osd deep scrub update digest min age = 30 2024-03-30T01:50:20.865 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.865 INFO:teuthology.orchestra.run.smithi133.stdout: osd map max advance = 10 2024-03-30T01:50:20.865 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.865 INFO:teuthology.orchestra.run.smithi133.stdout: journal zero on create = true 2024-03-30T01:50:20.865 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.865 INFO:teuthology.orchestra.run.smithi133.stdout: filestore ondisk finisher threads = 3 2024-03-30T01:50:20.865 INFO:teuthology.orchestra.run.smithi133.stdout: filestore apply finisher threads = 3 2024-03-30T01:50:20.865 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.865 INFO:teuthology.orchestra.run.smithi133.stdout: bdev debug aio = true 2024-03-30T01:50:20.865 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug misdirected ops = true 2024-03-30T01:50:20.865 INFO:teuthology.orchestra.run.smithi133.stdout: bdev async discard = True 2024-03-30T01:50:20.866 INFO:teuthology.orchestra.run.smithi133.stdout: bdev enable discard = True 2024-03-30T01:50:20.866 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore allocator = bitmap 2024-03-30T01:50:20.866 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore block size = 96636764160 2024-03-30T01:50:20.866 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore fsck on mount = True 2024-03-30T01:50:20.866 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluefs = 1/20 2024-03-30T01:50:20.866 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluestore = 1/20 2024-03-30T01:50:20.866 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-03-30T01:50:20.866 INFO:teuthology.orchestra.run.smithi133.stdout: debug osd = 20 2024-03-30T01:50:20.866 INFO:teuthology.orchestra.run.smithi133.stdout: debug rocksdb = 4/10 2024-03-30T01:50:20.866 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd backfillfull_ratio = 0.85 2024-03-30T01:50:20.866 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd full ratio = 0.9 2024-03-30T01:50:20.866 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd nearfull ratio = 0.8 2024-03-30T01:50:20.866 INFO:teuthology.orchestra.run.smithi133.stdout: osd failsafe full ratio = 0.95 2024-03-30T01:50:20.866 INFO:teuthology.orchestra.run.smithi133.stdout: osd objectstore = bluestore 2024-03-30T01:50:20.866 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2024-03-30T01:50:20.867 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.867 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr] 2024-03-30T01:50:20.867 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-03-30T01:50:20.867 INFO:teuthology.orchestra.run.smithi133.stdout: debug mgr = 20 2024-03-30T01:50:20.867 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2024-03-30T01:50:20.867 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2024-03-30T01:50:20.867 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2024-03-30T01:50:20.867 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2024-03-30T01:50:20.867 INFO:teuthology.orchestra.run.smithi133.stdout: mgr/telemetry/nag = false 2024-03-30T01:50:20.867 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.867 INFO:teuthology.orchestra.run.smithi133.stdout:[mon] 2024-03-30T01:50:20.867 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-03-30T01:50:20.867 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2024-03-30T01:50:20.867 INFO:teuthology.orchestra.run.smithi133.stdout: debug paxos = 20 2024-03-30T01:50:20.867 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2024-03-30T01:50:20.867 INFO:teuthology.orchestra.run.smithi133.stdout: mon data avail warn = 5 2024-03-30T01:50:20.868 INFO:teuthology.orchestra.run.smithi133.stdout: mon mgr mkfs grace = 240 2024-03-30T01:50:20.868 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2024-03-30T01:50:20.868 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd reporter subtree level = osd 2024-03-30T01:50:20.868 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd prime pg temp = true 2024-03-30T01:50:20.868 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2024-03-30T01:50:20.868 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.868 INFO:teuthology.orchestra.run.smithi133.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-30T01:50:20.868 INFO:teuthology.orchestra.run.smithi133.stdout: auth mon ticket ttl = 660 # 11m 2024-03-30T01:50:20.868 INFO:teuthology.orchestra.run.smithi133.stdout: auth service ticket ttl = 240 # 4m 2024-03-30T01:50:20.868 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.868 INFO:teuthology.orchestra.run.smithi133.stdout: # don't complain about insecure global_id in the test suite 2024-03-30T01:50:20.868 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-30T01:50:20.868 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-30T01:50:20.868 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.868 INFO:teuthology.orchestra.run.smithi133.stdout: # 1m isn't quite enough 2024-03-30T01:50:20.869 INFO:teuthology.orchestra.run.smithi133.stdout: mon_down_mkfs_grace = 2m 2024-03-30T01:50:20.869 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.869 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_filestore_osds = false 2024-03-30T01:50:20.869 INFO:teuthology.orchestra.run.smithi133.stdout: mon op complaint time = 120 2024-03-30T01:50:20.869 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:50:20.869 INFO:teuthology.orchestra.run.smithi133.stdout:[client] 2024-03-30T01:50:20.869 INFO:teuthology.orchestra.run.smithi133.stdout: rgw cache enabled = true 2024-03-30T01:50:20.869 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable ops log = true 2024-03-30T01:50:20.869 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable usage log = true 2024-03-30T01:50:20.869 INFO:teuthology.orchestra.run.smithi133.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-30T01:50:20.869 INFO:teuthology.orchestra.run.smithi133.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-30T01:50:20.869 INFO:teuthology.orchestra.run.smithi133.stdout: client mount timeout = 600 2024-03-30T01:50:20.869 INFO:teuthology.orchestra.run.smithi133.stdout: debug client = 20 2024-03-30T01:50:20.869 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-03-30T01:50:20.869 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = "" 2024-03-30T01:50:20.869 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 900 2024-03-30T01:50:20.869 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 900 2024-03-30T01:50:20.870 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.a] 2024-03-30T01:50:20.870 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.b] 2024-03-30T01:50:20.870 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.c] 2024-03-30T01:50:20.870 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2024-03-30T01:50:20.870 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2024-03-30T01:50:20.870 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2024-03-30T01:50:20.870 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.d] 2024-03-30T01:50:20.870 INFO:teuthology.orchestra.run.smithi133.stdout:[mds] 2024-03-30T01:50:20.870 INFO:teuthology.orchestra.run.smithi133.stdout: debug mds = 20 2024-03-30T01:50:20.870 INFO:teuthology.orchestra.run.smithi133.stdout: debug mds balancer = 20 2024-03-30T01:50:20.870 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-03-30T01:50:20.870 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug frag = True 2024-03-30T01:50:20.870 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug scatterstat = True 2024-03-30T01:50:20.870 INFO:teuthology.orchestra.run.smithi133.stdout: mds op complaint time = 180 2024-03-30T01:50:20.870 INFO:teuthology.orchestra.run.smithi133.stdout: mds verify scatter = True 2024-03-30T01:50:20.871 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2024-03-30T01:50:20.871 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 900 2024-03-30T01:50:20.871 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 900 2024-03-30T01:50:20.871 INFO:teuthology.orchestra.run.smithi137.stdout:[global] 2024-03-30T01:50:20.871 INFO:teuthology.orchestra.run.smithi137.stdout: chdir = "" 2024-03-30T01:50:20.871 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-30T01:50:20.871 INFO:teuthology.orchestra.run.smithi137.stdout: auth supported = cephx 2024-03-30T01:50:20.871 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.871 INFO:teuthology.orchestra.run.smithi137.stdout: filestore xattr use omap = true 2024-03-30T01:50:20.872 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.872 INFO:teuthology.orchestra.run.smithi137.stdout: mon clock drift allowed = 1.000 2024-03-30T01:50:20.872 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.872 INFO:teuthology.orchestra.run.smithi137.stdout: osd crush chooseleaf type = 0 2024-03-30T01:50:20.872 INFO:teuthology.orchestra.run.smithi137.stdout: auth debug = true 2024-03-30T01:50:20.872 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.872 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on old message = true 2024-03-30T01:50:20.872 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on bug = true 2024-03-30T01:50:20.872 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.872 INFO:teuthology.orchestra.run.smithi137.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-30T01:50:20.872 INFO:teuthology.orchestra.run.smithi137.stdout: mon pg warn max object skew = 0 2024-03-30T01:50:20.872 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.872 INFO:teuthology.orchestra.run.smithi137.stdout: # disable pg_autoscaler by default for new pools 2024-03-30T01:50:20.872 INFO:teuthology.orchestra.run.smithi137.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-30T01:50:20.872 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.872 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default size = 2 2024-03-30T01:50:20.873 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.873 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow primary affinity = true 2024-03-30T01:50:20.873 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow pg remap = true 2024-03-30T01:50:20.873 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on legacy crush tunables = false 2024-03-30T01:50:20.873 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on crush straw calc version zero = false 2024-03-30T01:50:20.873 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on no sortbitwise = false 2024-03-30T01:50:20.873 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on osd down out interval zero = false 2024-03-30T01:50:20.873 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on too few osds = false 2024-03-30T01:50:20.873 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-30T01:50:20.873 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-30T01:50:20.873 INFO:teuthology.orchestra.run.smithi137.stdout: mon_allow_pool_size_one = true 2024-03-30T01:50:20.873 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.873 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-30T01:50:20.873 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.873 INFO:teuthology.orchestra.run.smithi137.stdout: osd default data pool replay window = 5 2024-03-30T01:50:20.874 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.874 INFO:teuthology.orchestra.run.smithi137.stdout: mon allow pool delete = true 2024-03-30T01:50:20.874 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.874 INFO:teuthology.orchestra.run.smithi137.stdout: mon cluster log file level = debug 2024-03-30T01:50:20.874 INFO:teuthology.orchestra.run.smithi137.stdout: debug asserts on shutdown = true 2024-03-30T01:50:20.874 INFO:teuthology.orchestra.run.smithi137.stdout: mon health detail to clog = false 2024-03-30T01:50:20.874 INFO:teuthology.orchestra.run.smithi137.stdout: mon host = "172.21.15.133,172.21.15.137,[v2:172.21.15.137:3301,v1:172.21.15.137:6790]" 2024-03-30T01:50:20.874 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on skipped message = False 2024-03-30T01:50:20.874 INFO:teuthology.orchestra.run.smithi137.stdout: fsid = 10e5f47a-7547-42f1-8bb3-a8ac3aae8cad 2024-03-30T01:50:20.874 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.874 INFO:teuthology.orchestra.run.smithi137.stdout:[osd] 2024-03-30T01:50:20.874 INFO:teuthology.orchestra.run.smithi137.stdout: osd journal size = 100 2024-03-30T01:50:20.874 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.874 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub load threshold = 5.0 2024-03-30T01:50:20.874 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub max interval = 600 2024-03-30T01:50:20.875 INFO:teuthology.orchestra.run.smithi137.stdout: osd mclock profile = high_recovery_ops 2024-03-30T01:50:20.875 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.875 INFO:teuthology.orchestra.run.smithi137.stdout: osd recover clone overlap = true 2024-03-30T01:50:20.875 INFO:teuthology.orchestra.run.smithi137.stdout: osd recovery max chunk = 1048576 2024-03-30T01:50:20.875 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.875 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug shutdown = true 2024-03-30T01:50:20.875 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug op order = true 2024-03-30T01:50:20.875 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug verify stray on activate = true 2024-03-30T01:50:20.875 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.875 INFO:teuthology.orchestra.run.smithi137.stdout: osd open classes on start = true 2024-03-30T01:50:20.875 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug pg log writeout = true 2024-03-30T01:50:20.875 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.875 INFO:teuthology.orchestra.run.smithi137.stdout: osd deep scrub update digest min age = 30 2024-03-30T01:50:20.875 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.875 INFO:teuthology.orchestra.run.smithi137.stdout: osd map max advance = 10 2024-03-30T01:50:20.875 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.876 INFO:teuthology.orchestra.run.smithi137.stdout: journal zero on create = true 2024-03-30T01:50:20.876 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.876 INFO:teuthology.orchestra.run.smithi137.stdout: filestore ondisk finisher threads = 3 2024-03-30T01:50:20.876 INFO:teuthology.orchestra.run.smithi137.stdout: filestore apply finisher threads = 3 2024-03-30T01:50:20.876 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.876 INFO:teuthology.orchestra.run.smithi137.stdout: bdev debug aio = true 2024-03-30T01:50:20.876 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug misdirected ops = true 2024-03-30T01:50:20.876 INFO:teuthology.orchestra.run.smithi137.stdout: bdev async discard = True 2024-03-30T01:50:20.876 INFO:teuthology.orchestra.run.smithi137.stdout: bdev enable discard = True 2024-03-30T01:50:20.876 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore allocator = bitmap 2024-03-30T01:50:20.876 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore block size = 96636764160 2024-03-30T01:50:20.876 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore fsck on mount = True 2024-03-30T01:50:20.876 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluefs = 1/20 2024-03-30T01:50:20.876 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluestore = 1/20 2024-03-30T01:50:20.876 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-03-30T01:50:20.877 INFO:teuthology.orchestra.run.smithi137.stdout: debug osd = 20 2024-03-30T01:50:20.877 INFO:teuthology.orchestra.run.smithi137.stdout: debug rocksdb = 4/10 2024-03-30T01:50:20.877 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd backfillfull_ratio = 0.85 2024-03-30T01:50:20.877 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd full ratio = 0.9 2024-03-30T01:50:20.877 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd nearfull ratio = 0.8 2024-03-30T01:50:20.877 INFO:teuthology.orchestra.run.smithi137.stdout: osd failsafe full ratio = 0.95 2024-03-30T01:50:20.877 INFO:teuthology.orchestra.run.smithi137.stdout: osd objectstore = bluestore 2024-03-30T01:50:20.877 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-03-30T01:50:20.877 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.877 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr] 2024-03-30T01:50:20.877 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-03-30T01:50:20.877 INFO:teuthology.orchestra.run.smithi137.stdout: debug mgr = 20 2024-03-30T01:50:20.877 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-03-30T01:50:20.877 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-03-30T01:50:20.877 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-03-30T01:50:20.878 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-03-30T01:50:20.878 INFO:teuthology.orchestra.run.smithi137.stdout: mgr/telemetry/nag = false 2024-03-30T01:50:20.878 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.878 INFO:teuthology.orchestra.run.smithi137.stdout:[mon] 2024-03-30T01:50:20.878 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-03-30T01:50:20.878 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-03-30T01:50:20.878 INFO:teuthology.orchestra.run.smithi137.stdout: debug paxos = 20 2024-03-30T01:50:20.878 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-03-30T01:50:20.878 INFO:teuthology.orchestra.run.smithi137.stdout: mon data avail warn = 5 2024-03-30T01:50:20.878 INFO:teuthology.orchestra.run.smithi137.stdout: mon mgr mkfs grace = 240 2024-03-30T01:50:20.878 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-03-30T01:50:20.878 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd reporter subtree level = osd 2024-03-30T01:50:20.878 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd prime pg temp = true 2024-03-30T01:50:20.878 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-03-30T01:50:20.879 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.879 INFO:teuthology.orchestra.run.smithi137.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-30T01:50:20.879 INFO:teuthology.orchestra.run.smithi137.stdout: auth mon ticket ttl = 660 # 11m 2024-03-30T01:50:20.879 INFO:teuthology.orchestra.run.smithi137.stdout: auth service ticket ttl = 240 # 4m 2024-03-30T01:50:20.879 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.879 INFO:teuthology.orchestra.run.smithi137.stdout: # don't complain about insecure global_id in the test suite 2024-03-30T01:50:20.879 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-30T01:50:20.879 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-30T01:50:20.879 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.879 INFO:teuthology.orchestra.run.smithi137.stdout: # 1m isn't quite enough 2024-03-30T01:50:20.879 INFO:teuthology.orchestra.run.smithi137.stdout: mon_down_mkfs_grace = 2m 2024-03-30T01:50:20.879 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.879 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_filestore_osds = false 2024-03-30T01:50:20.879 INFO:teuthology.orchestra.run.smithi137.stdout: mon op complaint time = 120 2024-03-30T01:50:20.879 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-30T01:50:20.880 INFO:teuthology.orchestra.run.smithi137.stdout:[client] 2024-03-30T01:50:20.880 INFO:teuthology.orchestra.run.smithi137.stdout: rgw cache enabled = true 2024-03-30T01:50:20.880 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable ops log = true 2024-03-30T01:50:20.880 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable usage log = true 2024-03-30T01:50:20.880 INFO:teuthology.orchestra.run.smithi137.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-30T01:50:20.880 INFO:teuthology.orchestra.run.smithi137.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-30T01:50:20.880 INFO:teuthology.orchestra.run.smithi137.stdout: client mount timeout = 600 2024-03-30T01:50:20.880 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-03-30T01:50:20.880 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-03-30T01:50:20.880 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = "" 2024-03-30T01:50:20.880 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-03-30T01:50:20.880 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-03-30T01:50:20.880 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.a] 2024-03-30T01:50:20.880 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.b] 2024-03-30T01:50:20.880 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.c] 2024-03-30T01:50:20.880 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a] 2024-03-30T01:50:20.881 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c] 2024-03-30T01:50:20.881 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b] 2024-03-30T01:50:20.881 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.d] 2024-03-30T01:50:20.881 INFO:teuthology.orchestra.run.smithi137.stdout:[mds] 2024-03-30T01:50:20.881 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds = 20 2024-03-30T01:50:20.881 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds balancer = 20 2024-03-30T01:50:20.881 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-03-30T01:50:20.881 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug frag = True 2024-03-30T01:50:20.881 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug scatterstat = True 2024-03-30T01:50:20.881 INFO:teuthology.orchestra.run.smithi137.stdout: mds op complaint time = 180 2024-03-30T01:50:20.881 INFO:teuthology.orchestra.run.smithi137.stdout: mds verify scatter = True 2024-03-30T01:50:20.881 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-03-30T01:50:20.881 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-03-30T01:50:20.882 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-03-30T01:50:20.915 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-30T01:50:20.916 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-30T01:50:21.062 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-30T01:50:21.062 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:50:21.062 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-30T01:50:21.113 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:50:21.113 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-30T01:50:21.160 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi133.front.sepia.ceph.com 2024-03-30T01:50:21.160 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:50:21.160 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-30T01:50:21.160 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-30T01:50:21.355 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:50:21.355 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-30T01:50:21.450 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi137.front.sepia.ceph.com 2024-03-30T01:50:21.450 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:50:21.450 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-30T01:50:21.450 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-30T01:50:21.596 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:50:21.596 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-30T01:50:21.683 INFO:tasks.ceph:Setting up mon nodes... 2024-03-30T01:50:21.683 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-30T01:50:21.683 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-30T01:50:21.866 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-30T01:50:21.876 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-30T01:50:22.058 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-30T01:50:22.066 INFO:tasks.ceph:Setting up mds nodes... 2024-03-30T01:50:22.066 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-30T01:50:22.252 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-30T01:50:22.261 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-30T01:50:22.348 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-30T01:50:22.522 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-30T01:50:22.531 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-30T01:50:22.626 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-30T01:50:22.773 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-30T01:50:22.782 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-30T01:50:22.872 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-30T01:50:23.052 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-30T01:50:23.061 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-30T01:50:23.153 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-30T01:50:23.153 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-30T01:50:23.284 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-30T01:50:23.337 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-03-30T01:50:23.459 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-03-30T01:50:23.514 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-30T01:50:23.641 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-30T01:50:23.697 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-03-30T01:50:23.821 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-03-30T01:50:23.876 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-30T01:50:23.876 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-30T01:50:23.876 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-30T01:50:23.976 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-30T01:50:23.976 INFO:tasks.ceph:role: osd.0 2024-03-30T01:50:23.976 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com 2024-03-30T01:50:23.976 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-30T01:50:24.074 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T01:50:24.074 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T01:50:24.074 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T01:50:24.074 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T01:50:24.074 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T01:50:24.074 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-03-30T01:50:24.074 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T01:50:24.075 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T01:50:24.075 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T01:50:24.075 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T01:50:24.585 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-03-30T01:50:24.591 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-03-30T01:50:24.591 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-30T01:50:24.745 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-30T01:50:24.844 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-30T01:50:24.938 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-30T01:50:24.938 INFO:tasks.ceph:role: osd.1 2024-03-30T01:50:24.938 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com 2024-03-30T01:50:24.938 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-30T01:50:25.031 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T01:50:25.031 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T01:50:25.031 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T01:50:25.031 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T01:50:25.031 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T01:50:25.032 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-03-30T01:50:25.032 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T01:50:25.032 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T01:50:25.032 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T01:50:25.032 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T01:50:25.497 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-03-30T01:50:25.503 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-03-30T01:50:25.503 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-30T01:50:25.637 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-30T01:50:25.726 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-30T01:50:25.816 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-30T01:50:25.816 INFO:tasks.ceph:role: osd.2 2024-03-30T01:50:25.816 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com 2024-03-30T01:50:25.816 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-30T01:50:25.912 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T01:50:25.912 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T01:50:25.912 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T01:50:25.912 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T01:50:25.912 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T01:50:25.912 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-03-30T01:50:25.913 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T01:50:25.913 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T01:50:25.913 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T01:50:25.913 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T01:50:26.434 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-03-30T01:50:26.440 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-03-30T01:50:26.440 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-30T01:50:26.586 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-30T01:50:26.677 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-30T01:50:26.768 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-30T01:50:26.769 INFO:tasks.ceph:role: osd.3 2024-03-30T01:50:26.769 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com 2024-03-30T01:50:26.769 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-30T01:50:26.861 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T01:50:26.861 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T01:50:26.861 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T01:50:26.861 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T01:50:26.861 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T01:50:26.861 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-03-30T01:50:26.861 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T01:50:26.861 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T01:50:26.861 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T01:50:26.861 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T01:50:27.343 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-03-30T01:50:27.350 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-03-30T01:50:27.350 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-30T01:50:27.496 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-30T01:50:27.591 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T01:50:27.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:27.726+0000 7f5a3aa144c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-30T01:50:27.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:27.727+0000 7f5a3aa144c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-30T01:50:27.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:27.727+0000 7f5a3aa144c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-30T01:50:27.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:27.727+0000 7f5a3aa144c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-30T01:50:27.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:27.727+0000 7f5a3aa144c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-30T01:50:27.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:27.730+0000 7f5a3aa144c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-30T01:50:30.909 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-30T01:50:31.000 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T01:50:31.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:31.135+0000 7f690a81a4c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-30T01:50:31.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:31.136+0000 7f690a81a4c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-30T01:50:31.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:31.136+0000 7f690a81a4c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-30T01:50:31.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:31.136+0000 7f690a81a4c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-30T01:50:31.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:31.136+0000 7f690a81a4c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-30T01:50:31.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:31.138+0000 7f690a81a4c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-30T01:50:34.075 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-30T01:50:34.172 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T01:50:34.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:34.305+0000 7f3af74c34c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-30T01:50:34.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:34.305+0000 7f3af74c34c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-30T01:50:34.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:34.305+0000 7f3af74c34c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-30T01:50:34.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:34.305+0000 7f3af74c34c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-30T01:50:34.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:34.305+0000 7f3af74c34c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-30T01:50:34.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:34.307+0000 7f3af74c34c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-30T01:50:37.486 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-30T01:50:37.572 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T01:50:37.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:37.696+0000 7f534e8214c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-30T01:50:37.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:37.697+0000 7f534e8214c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-30T01:50:37.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:37.697+0000 7f534e8214c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-30T01:50:37.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:37.697+0000 7f534e8214c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-30T01:50:37.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:37.697+0000 7f534e8214c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-30T01:50:37.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:50:37.699+0000 7f534e8214c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-30T01:50:40.873 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-30T01:50:40.968 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-30T01:50:41.070 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-30T01:50:41.070 INFO:tasks.ceph:role: osd.4 2024-03-30T01:50:41.070 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com 2024-03-30T01:50:41.070 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-30T01:50:41.173 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T01:50:41.173 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T01:50:41.173 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T01:50:41.173 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T01:50:41.173 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T01:50:41.173 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-03-30T01:50:41.173 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T01:50:41.173 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T01:50:41.173 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T01:50:41.173 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T01:50:41.683 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-03-30T01:50:41.690 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-03-30T01:50:41.690 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-30T01:50:41.862 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-30T01:50:41.972 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-30T01:50:42.058 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-30T01:50:42.058 INFO:tasks.ceph:role: osd.5 2024-03-30T01:50:42.058 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com 2024-03-30T01:50:42.058 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-30T01:50:42.145 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T01:50:42.146 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T01:50:42.146 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T01:50:42.146 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T01:50:42.146 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T01:50:42.146 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-03-30T01:50:42.146 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T01:50:42.146 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T01:50:42.146 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T01:50:42.146 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T01:50:42.606 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-03-30T01:50:42.611 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-03-30T01:50:42.611 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-30T01:50:42.724 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-30T01:50:42.817 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-30T01:50:42.899 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-30T01:50:42.899 INFO:tasks.ceph:role: osd.6 2024-03-30T01:50:42.899 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com 2024-03-30T01:50:42.900 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-30T01:50:42.985 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T01:50:42.985 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T01:50:42.986 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T01:50:42.986 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T01:50:42.986 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T01:50:42.986 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-03-30T01:50:42.986 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T01:50:42.986 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T01:50:42.986 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T01:50:42.986 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T01:50:43.516 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-03-30T01:50:43.520 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-03-30T01:50:43.521 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-30T01:50:43.671 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-30T01:50:43.769 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-30T01:50:43.864 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-30T01:50:43.864 INFO:tasks.ceph:role: osd.7 2024-03-30T01:50:43.864 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi137.front.sepia.ceph.com 2024-03-30T01:50:43.864 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-30T01:50:43.963 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T01:50:43.964 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T01:50:43.964 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T01:50:43.964 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T01:50:43.964 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T01:50:43.964 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-03-30T01:50:43.964 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T01:50:43.964 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T01:50:43.964 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T01:50:43.964 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T01:50:44.418 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-03-30T01:50:44.423 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-03-30T01:50:44.423 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-30T01:50:44.533 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-30T01:50:44.621 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T01:50:44.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:44.768+0000 7f30e9a1f4c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-30T01:50:44.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:44.768+0000 7f30e9a1f4c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-30T01:50:44.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:44.768+0000 7f30e9a1f4c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-30T01:50:44.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:44.768+0000 7f30e9a1f4c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-30T01:50:44.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:44.768+0000 7f30e9a1f4c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-30T01:50:44.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:44.772+0000 7f30e9a1f4c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-30T01:50:47.722 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-30T01:50:47.817 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T01:50:47.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:47.951+0000 7fe306b2b4c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-30T01:50:47.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:47.952+0000 7fe306b2b4c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-30T01:50:47.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:47.952+0000 7fe306b2b4c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-30T01:50:47.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:47.952+0000 7fe306b2b4c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-30T01:50:47.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:47.952+0000 7fe306b2b4c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-30T01:50:47.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:47.954+0000 7fe306b2b4c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-30T01:50:48.038 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T01:50:48.046 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T01:50:51.137 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-30T01:50:51.233 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T01:50:51.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:51.362+0000 7f2176c024c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-30T01:50:51.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:51.363+0000 7f2176c024c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-30T01:50:51.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:51.363+0000 7f2176c024c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-30T01:50:51.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:51.363+0000 7f2176c024c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-30T01:50:51.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:51.363+0000 7f2176c024c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-30T01:50:51.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:51.365+0000 7f2176c024c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-30T01:50:54.285 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-30T01:50:54.382 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T01:50:54.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:54.512+0000 7f15219074c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-30T01:50:54.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:54.513+0000 7f15219074c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-30T01:50:54.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:54.513+0000 7f15219074c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-30T01:50:54.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:54.513+0000 7f15219074c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-30T01:50:54.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:54.513+0000 7f15219074c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-30T01:50:54.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:50:54.515+0000 7f15219074c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-30T01:50:57.695 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-30T01:50:57.788 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-30T01:50:57.789 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:50:57.789 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-30T01:50:57.886 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:50:57.886 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-30T01:50:57.978 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:50:57.978 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-30T01:50:58.070 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:50:58.071 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-30T01:50:58.210 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:50:58.210 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-30T01:50:58.304 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:50:58.304 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-30T01:50:58.397 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:50:58.397 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-30T01:50:58.485 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:50:58.485 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-30T01:50:58.587 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:50:58.587 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-30T01:50:58.678 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:50:58.678 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-30T01:50:58.772 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:50:58.772 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-30T01:50:58.858 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:50:58.858 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-30T01:50:58.995 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:50:58.995 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-30T01:50:59.086 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:50:59.086 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-30T01:50:59.180 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:50:59.180 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-30T01:50:59.235 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:50:59.235 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-03-30T01:50:59.286 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:50:59.286 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-30T01:50:59.343 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:50:59.343 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-03-30T01:50:59.396 INFO:tasks.ceph:Adding keys to all mons... 2024-03-30T01:50:59.397 DEBUG:teuthology.orchestra.run.smithi133:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-30T01:50:59.404 DEBUG:teuthology.orchestra.run.smithi137:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-30T01:50:59.490 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.y] 2024-03-30T01:50:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDdbwdmw45WMxAALzfXrivcnGUnQc0D1sakMw== 2024-03-30T01:50:59.490 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2024-03-30T01:50:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDebwdmkr7ADhAAu0uXAIk2g0kgg2MP39R30Q== 2024-03-30T01:50:59.490 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2024-03-30T01:50:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDebwdmI9nWHhAAP1ONl6CfaVy2ONKW3grPrA== 2024-03-30T01:50:59.490 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.0] 2024-03-30T01:50:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDjbwdm5HpcKxAAqnQUfq7TU4AdOFpM9FmFuw== 2024-03-30T01:50:59.490 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.1] 2024-03-30T01:50:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDnbwdmUTwlCBAApfKESGLGMopFNFoTSxGkbw== 2024-03-30T01:50:59.491 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.2] 2024-03-30T01:50:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDqbwdmnvhCEhAAA79NXAhmqRkjb9w3tzSl1g== 2024-03-30T01:50:59.491 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.3] 2024-03-30T01:50:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDtbwdm0DOXKRAA9xrH6BPDmMPloR0pgI+TkA== 2024-03-30T01:50:59.491 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.x] 2024-03-30T01:50:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDebwdmKZMrAxAA1/8WSPvB1uNyVWcmoPgBUQ== 2024-03-30T01:50:59.491 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2024-03-30T01:50:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDebwdmcGjULRAAZQgxNwjrIIgCij4d0I7HZQ== 2024-03-30T01:50:59.491 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.d] 2024-03-30T01:50:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDfbwdmWc/TAhAABf+PMlPYzuYGMeUGA2fDPg== 2024-03-30T01:50:59.491 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.4] 2024-03-30T01:50:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQD0bwdmOHPaLRAAZ8+uVX5TMx7ykq2W7N9dDg== 2024-03-30T01:50:59.491 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.5] 2024-03-30T01:50:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQD3bwdmN/3JOBAAMTS2oLC2JpdaNlrrfRDafw== 2024-03-30T01:50:59.491 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.6] 2024-03-30T01:50:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQD7bwdmzTqvFRAAYEgyn6vfgzK5diDQSP38nA== 2024-03-30T01:50:59.492 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.7] 2024-03-30T01:50:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQD+bwdmQZ2fHhAA/ZFaICZn5fGIe8rZeDn3Fg== 2024-03-30T01:50:59.492 INFO:teuthology.orchestra.run.smithi133.stdout:[client.0] 2024-03-30T01:50:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDfbwdmkcCwEBAALBXqz3Ig6wLpBxm0qvzHHA== 2024-03-30T01:50:59.492 INFO:teuthology.orchestra.run.smithi133.stdout:[client.2] 2024-03-30T01:50:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDfbwdmSawSGxAA6SdbVP0UoK0NoZdvIuxblQ== 2024-03-30T01:50:59.492 INFO:teuthology.orchestra.run.smithi133.stdout:[client.1] 2024-03-30T01:50:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDfbwdm5A32JRAAUfU1vpjO00nIx+mAsxzCng== 2024-03-30T01:50:59.492 INFO:teuthology.orchestra.run.smithi133.stdout:[client.3] 2024-03-30T01:50:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDfbwdmoSG0MBAAQD5nPtEEOolsbC2CoUfbPQ== 2024-03-30T01:50:59.496 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr.y] 2024-03-30T01:50:59.496 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDdbwdmw45WMxAALzfXrivcnGUnQc0D1sakMw== 2024-03-30T01:50:59.496 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a] 2024-03-30T01:50:59.496 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDebwdmkr7ADhAAu0uXAIk2g0kgg2MP39R30Q== 2024-03-30T01:50:59.496 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c] 2024-03-30T01:50:59.496 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDebwdmI9nWHhAAP1ONl6CfaVy2ONKW3grPrA== 2024-03-30T01:50:59.497 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.0] 2024-03-30T01:50:59.497 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDjbwdm5HpcKxAAqnQUfq7TU4AdOFpM9FmFuw== 2024-03-30T01:50:59.497 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.1] 2024-03-30T01:50:59.497 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDnbwdmUTwlCBAApfKESGLGMopFNFoTSxGkbw== 2024-03-30T01:50:59.497 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.2] 2024-03-30T01:50:59.497 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDqbwdmnvhCEhAAA79NXAhmqRkjb9w3tzSl1g== 2024-03-30T01:50:59.497 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.3] 2024-03-30T01:50:59.497 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDtbwdm0DOXKRAA9xrH6BPDmMPloR0pgI+TkA== 2024-03-30T01:50:59.497 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr.x] 2024-03-30T01:50:59.497 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDebwdmKZMrAxAA1/8WSPvB1uNyVWcmoPgBUQ== 2024-03-30T01:50:59.497 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b] 2024-03-30T01:50:59.497 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDebwdmcGjULRAAZQgxNwjrIIgCij4d0I7HZQ== 2024-03-30T01:50:59.497 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.d] 2024-03-30T01:50:59.497 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDfbwdmWc/TAhAABf+PMlPYzuYGMeUGA2fDPg== 2024-03-30T01:50:59.497 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.4] 2024-03-30T01:50:59.497 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQD0bwdmOHPaLRAAZ8+uVX5TMx7ykq2W7N9dDg== 2024-03-30T01:50:59.498 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.5] 2024-03-30T01:50:59.498 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQD3bwdmN/3JOBAAMTS2oLC2JpdaNlrrfRDafw== 2024-03-30T01:50:59.498 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.6] 2024-03-30T01:50:59.498 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQD7bwdmzTqvFRAAYEgyn6vfgzK5diDQSP38nA== 2024-03-30T01:50:59.498 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.7] 2024-03-30T01:50:59.498 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQD+bwdmQZ2fHhAA/ZFaICZn5fGIe8rZeDn3Fg== 2024-03-30T01:50:59.498 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-03-30T01:50:59.498 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDfbwdmkcCwEBAALBXqz3Ig6wLpBxm0qvzHHA== 2024-03-30T01:50:59.498 INFO:teuthology.orchestra.run.smithi137.stdout:[client.2] 2024-03-30T01:50:59.498 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDfbwdmSawSGxAA6SdbVP0UoK0NoZdvIuxblQ== 2024-03-30T01:50:59.498 INFO:teuthology.orchestra.run.smithi137.stdout:[client.1] 2024-03-30T01:50:59.498 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDfbwdm5A32JRAAUfU1vpjO00nIx+mAsxzCng== 2024-03-30T01:50:59.498 INFO:teuthology.orchestra.run.smithi137.stdout:[client.3] 2024-03-30T01:50:59.498 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDfbwdmoSG0MBAAQD5nPtEEOolsbC2CoUfbPQ== 2024-03-30T01:50:59.501 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-30T01:50:59.540 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-30T01:50:59.682 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T01:50:59.689 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T01:50:59.831 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T01:50:59.836 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T01:50:59.984 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T01:50:59.990 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T01:51:00.132 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T01:51:00.136 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T01:51:00.274 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T01:51:00.279 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T01:51:00.407 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T01:51:00.412 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T01:51:00.551 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-30T01:51:00.557 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-30T01:51:00.695 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T01:51:00.699 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T01:51:00.842 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T01:51:00.849 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T01:51:00.985 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T01:51:00.990 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T01:51:01.132 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T01:51:01.139 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T01:51:01.287 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T01:51:01.292 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T01:51:01.434 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T01:51:01.441 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T01:51:01.583 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T01:51:01.591 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T01:51:01.734 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T01:51:01.741 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T01:51:01.884 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T01:51:01.889 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T01:51:02.037 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T01:51:02.041 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T01:51:02.186 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-30T01:51:02.187 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-30T01:51:02.279 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-30T01:51:02.433 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-30T01:51:02.504 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-30T01:51:02.606 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-30T01:51:02.762 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-30T01:51:02.847 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-30T01:51:02.939 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-30T01:51:03.091 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-30T01:51:03.166 DEBUG:teuthology.orchestra.run.smithi133:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-30T01:51:03.174 DEBUG:teuthology.orchestra.run.smithi137:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-30T01:51:03.222 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-30T01:51:03.222 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-30T01:51:03.222 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-30T01:51:03.227 INFO:tasks.ceph.mon.a:Started 2024-03-30T01:51:03.227 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-30T01:51:03.227 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-30T01:51:03.265 INFO:tasks.ceph.mon.b:Started 2024-03-30T01:51:03.265 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-30T01:51:03.265 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-30T01:51:03.272 INFO:tasks.ceph.mon.c:Started 2024-03-30T01:51:03.272 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-30T01:51:03.273 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-30T01:51:03.273 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-30T01:51:03.277 INFO:tasks.ceph.mgr.y:Started 2024-03-30T01:51:03.278 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-30T01:51:03.278 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-30T01:51:03.281 INFO:tasks.ceph.mgr.x:Started 2024-03-30T01:51:03.282 INFO:tasks.ceph:Setting crush tunables to default 2024-03-30T01:51:03.282 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd crush tunables default 2024-03-30T01:51:03.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.454+0000 7fc38e600640 1 Processor -- start 2024-03-30T01:51:03.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.454+0000 7fc38e600640 1 -- start start 2024-03-30T01:51:03.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.455+0000 7fc38e600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc38815cac0 0x7fc388160670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:03.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.455+0000 7fc38e600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 0x7fc3880cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:03.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.455+0000 7fc38e600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3880b5b50 con 0x7fc3880cdbe0 2024-03-30T01:51:03.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.455+0000 7fc38e600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3880d1020 con 0x7fc388160bb0 2024-03-30T01:51:03.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.455+0000 7fc38e600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3880ce010 con 0x7fc38815cac0 2024-03-30T01:51:03.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.455+0000 7fc37fe00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 0x7fc3880cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:03.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.455+0000 7fc37fe00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 0x7fc3880cd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48292/0 (socket says 172.21.15.133:48292) 2024-03-30T01:51:03.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.455+0000 7fc37fe00640 1 -- 172.21.15.133:0/1930900679 learned_addr learned my addr 172.21.15.133:0/1930900679 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:03.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.455+0000 7fc37fe00640 1 -- 172.21.15.133:0/1930900679 >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 msgr2=0x7fc3880cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-30T01:51:03.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.455+0000 7fc37fe00640 1 -- 172.21.15.133:0/1930900679 >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 msgr2=0x7fc3880cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T01:51:03.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.455+0000 7fc37fe00640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 0x7fc3880cd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T01:51:03.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.456+0000 7fc37fe00640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 0x7fc3880cd6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-30T01:51:03.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.456+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.137:3300/0 conn(0x7fc38815cac0 0x7fc388160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:03.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.456+0000 7fc38d200640 1 -- 172.21.15.133:0/1930900679 >> v2:172.21.15.137:3300/0 conn(0x7fc38815cac0 msgr2=0x7fc388160670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-30T01:51:03.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.456+0000 7fc38d200640 1 -- 172.21.15.133:0/1930900679 >> v2:172.21.15.137:3300/0 conn(0x7fc38815cac0 msgr2=0x7fc388160670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T01:51:03.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.456+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.137:3300/0 conn(0x7fc38815cac0 0x7fc388160670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T01:51:03.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.456+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.137:3300/0 conn(0x7fc38815cac0 0x7fc388160670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-30T01:51:03.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.657+0000 7fc37fe00640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 0x7fc3880cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:03.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.657+0000 7fc37fe00640 1 -- 172.21.15.133:0/1930900679 >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 msgr2=0x7fc3880cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-30T01:51:03.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.657+0000 7fc37fe00640 1 -- 172.21.15.133:0/1930900679 >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 msgr2=0x7fc3880cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T01:51:03.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.657+0000 7fc37fe00640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 0x7fc3880cd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T01:51:03.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.657+0000 7fc37fe00640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 0x7fc3880cd6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-30T01:51:03.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.657+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.137:3300/0 conn(0x7fc38815cac0 0x7fc388160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:03.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.657+0000 7fc38d200640 1 -- 172.21.15.133:0/1930900679 >> v2:172.21.15.137:3300/0 conn(0x7fc38815cac0 msgr2=0x7fc388160670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-30T01:51:03.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.657+0000 7fc38d200640 1 -- 172.21.15.133:0/1930900679 >> v2:172.21.15.137:3300/0 conn(0x7fc38815cac0 msgr2=0x7fc388160670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T01:51:03.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.657+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.137:3300/0 conn(0x7fc38815cac0 0x7fc388160670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T01:51:03.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:03.657+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.137:3300/0 conn(0x7fc38815cac0 0x7fc388160670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-30T01:51:04.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:04.059+0000 7fc37fe00640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 0x7fc3880cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:04.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:04.059+0000 7fc37fe00640 1 -- 172.21.15.133:0/1930900679 >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 msgr2=0x7fc3880cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-30T01:51:04.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:04.059+0000 7fc37fe00640 1 -- 172.21.15.133:0/1930900679 >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 msgr2=0x7fc3880cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T01:51:04.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:04.059+0000 7fc37fe00640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 0x7fc3880cd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T01:51:04.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:04.060+0000 7fc37fe00640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 0x7fc3880cd6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-30T01:51:04.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:04.060+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.137:3300/0 conn(0x7fc38815cac0 0x7fc388160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:04.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:04.060+0000 7fc38d200640 1 -- 172.21.15.133:0/1930900679 >> v2:172.21.15.137:3300/0 conn(0x7fc38815cac0 msgr2=0x7fc388160670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-30T01:51:04.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:04.060+0000 7fc38d200640 1 -- 172.21.15.133:0/1930900679 >> v2:172.21.15.137:3300/0 conn(0x7fc38815cac0 msgr2=0x7fc388160670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T01:51:04.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:04.060+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.137:3300/0 conn(0x7fc38815cac0 0x7fc388160670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T01:51:04.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:04.060+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.137:3300/0 conn(0x7fc38815cac0 0x7fc388160670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-30T01:51:04.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:04.861+0000 7fc37fe00640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 0x7fc3880cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:04.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:04.862+0000 7fc37fe00640 1 -- 172.21.15.133:0/1930900679 >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 msgr2=0x7fc3880cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-30T01:51:04.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:04.862+0000 7fc37fe00640 1 -- 172.21.15.133:0/1930900679 >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 msgr2=0x7fc3880cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T01:51:04.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:04.862+0000 7fc37fe00640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 0x7fc3880cd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T01:51:04.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:04.862+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.137:3300/0 conn(0x7fc38815cac0 0x7fc388160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:04.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:04.862+0000 7fc37fe00640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 0x7fc3880cd6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-30T01:51:04.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:04.862+0000 7fc38d200640 1 -- 172.21.15.133:0/1930900679 >> v2:172.21.15.137:3300/0 conn(0x7fc38815cac0 msgr2=0x7fc388160670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-30T01:51:04.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:04.862+0000 7fc38d200640 1 -- 172.21.15.133:0/1930900679 >> v2:172.21.15.137:3300/0 conn(0x7fc38815cac0 msgr2=0x7fc388160670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T01:51:04.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:04.862+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.137:3300/0 conn(0x7fc38815cac0 0x7fc388160670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T01:51:04.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:04.862+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.137:3300/0 conn(0x7fc38815cac0 0x7fc388160670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-30T01:51:06.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:06.456+0000 7fc386a00640 1 -- 172.21.15.133:0/1930900679 >> v2:172.21.15.137:3300/0 conn(0x7fc38815cac0 msgr2=0x7fc388160670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-30T01:51:06.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:06.456+0000 7fc386a00640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.137:3300/0 conn(0x7fc38815cac0 0x7fc388160670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:06.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:06.456+0000 7fc386a00640 1 -- 172.21.15.133:0/1930900679 >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 msgr2=0x7fc3880cd6a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-30T01:51:06.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:06.456+0000 7fc386a00640 1 --2- 172.21.15.133:0/1930900679 >> v2:172.21.15.133:3300/0 conn(0x7fc388160bb0 0x7fc3880cd6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:06.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:06.456+0000 7fc386a00640 1 -- 172.21.15.133:0/1930900679 >> v1:172.21.15.137:6789/0 conn(0x7fc3880cdbe0 legacy=0x7fc38806b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:06.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:06.456+0000 7fc386a00640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3640036b0 0x7fc364005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:06.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:06.456+0000 7fc386a00640 1 -- 172.21.15.133:0/1930900679 --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc388161100 con 0x7fc364006150 2024-03-30T01:51:06.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:06.456+0000 7fc386a00640 1 -- 172.21.15.133:0/1930900679 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3880d1020 con 0x7fc3640036b0 2024-03-30T01:51:06.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:06.457+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3640036b0 0x7fc364005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:06.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:06.458+0000 7fc38d200640 1 -- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3640036b0 msgr2=0x7fc364005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-30T01:51:06.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:06.458+0000 7fc38d200640 1 -- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3640036b0 msgr2=0x7fc364005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T01:51:06.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:06.458+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3640036b0 0x7fc364005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T01:51:06.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:06.458+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3640036b0 0x7fc364005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-30T01:51:06.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:06.659+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3640036b0 0x7fc364005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:06.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:06.660+0000 7fc38d200640 1 -- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3640036b0 msgr2=0x7fc364005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-30T01:51:06.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:06.660+0000 7fc38d200640 1 -- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3640036b0 msgr2=0x7fc364005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T01:51:06.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:06.660+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3640036b0 0x7fc364005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T01:51:06.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:06.660+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3640036b0 0x7fc364005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-30T01:51:07.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:07.061+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3640036b0 0x7fc364005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:07.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:07.062+0000 7fc38d200640 1 -- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3640036b0 msgr2=0x7fc364005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-30T01:51:07.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:07.062+0000 7fc38d200640 1 -- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3640036b0 msgr2=0x7fc364005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T01:51:07.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:07.062+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3640036b0 0x7fc364005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T01:51:07.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:07.062+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3640036b0 0x7fc364005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-30T01:51:07.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:07.863+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3640036b0 0x7fc364005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:07.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:07.864+0000 7fc38d200640 1 -- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3640036b0 msgr2=0x7fc364005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-30T01:51:07.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:07.864+0000 7fc38d200640 1 -- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3640036b0 msgr2=0x7fc364005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T01:51:07.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:07.864+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3640036b0 0x7fc364005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T01:51:07.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:07.864+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3640036b0 0x7fc364005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-30T01:51:08.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.677+0000 7fc387e00640 1 -- 172.21.15.133:0/1930900679 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559883698 0 0) 0x7fc388161100 con 0x7fc364006150 2024-03-30T01:51:08.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.677+0000 7fc387e00640 1 -- 172.21.15.133:0/1930900679 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc36c003520 con 0x7fc364006150 2024-03-30T01:51:08.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.679+0000 7fc387e00640 1 -- 172.21.15.133:0/1930900679 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3985760042 0 0) 0x7fc36c003520 con 0x7fc364006150 2024-03-30T01:51:08.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.679+0000 7fc387e00640 1 -- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3640036b0 msgr2=0x7fc364005ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-30T01:51:08.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.679+0000 7fc387e00640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3640036b0 0x7fc364005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:08.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.679+0000 7fc387e00640 1 -- 172.21.15.133:0/1930900679 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36400af40 con 0x7fc364006150 2024-03-30T01:51:08.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.679+0000 7fc387e00640 1 -- 172.21.15.133:0/1930900679 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fc37000c570 con 0x7fc364006150 2024-03-30T01:51:08.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.679+0000 7fc387e00640 1 -- 172.21.15.133:0/1930900679 >> v1:172.21.15.133:6789/0 conn(0x7fc364006150 legacy=0x7fc364008610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:08.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.680+0000 7fc38dc00640 1 -- 172.21.15.133:0/1930900679 reap_dead start 2024-03-30T01:51:08.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.680+0000 7fc387e00640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc36c003970 0x7fc36c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:08.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.680+0000 7fc387e00640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc36c0047c0 0x7fc36c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:08.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.680+0000 7fc387e00640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc36c0052a0 0x7fc36c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:08.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.680+0000 7fc387e00640 1 -- 172.21.15.133:0/1930900679 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3880d1020 con 0x7fc36c0047c0 2024-03-30T01:51:08.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.680+0000 7fc387e00640 1 -- 172.21.15.133:0/1930900679 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c00c1f0 con 0x7fc36c003970 2024-03-30T01:51:08.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.680+0000 7fc387e00640 1 -- 172.21.15.133:0/1930900679 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c00c3b0 con 0x7fc36c0052a0 2024-03-30T01:51:08.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.680+0000 7fc38d200640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc36c003970 0x7fc36c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:08.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.680+0000 7fc37fe00640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc36c0047c0 0x7fc36c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:08.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.681+0000 7fc38dc00640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc36c0052a0 0x7fc36c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:08.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.681+0000 7fc37fe00640 1 -- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc36c0052a0 msgr2=0x7fc36c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:08.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.681+0000 7fc37fe00640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc36c0052a0 0x7fc36c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:08.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.681+0000 7fc37fe00640 1 -- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc36c003970 msgr2=0x7fc36c003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:08.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.681+0000 7fc37fe00640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc36c003970 0x7fc36c003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:08.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.681+0000 7fc37fe00640 1 -- 172.21.15.133:0/1930900679 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36c003520 con 0x7fc36c0047c0 2024-03-30T01:51:08.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.685+0000 7fc37fe00640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc36c0047c0 0x7fc36c004c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc370009100 tx=0x7fc36c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe433327e2d5bf server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:08.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.687+0000 7fc387e00640 1 -- 172.21.15.133:0/1930900679 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37002d830 con 0x7fc36c0047c0 2024-03-30T01:51:08.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.687+0000 7fc387e00640 1 -- 172.21.15.133:0/1930900679 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc370031070 con 0x7fc36c0047c0 2024-03-30T01:51:08.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.687+0000 7fc387e00640 1 -- 172.21.15.133:0/1930900679 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37002dbf0 con 0x7fc36c0047c0 2024-03-30T01:51:08.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.688+0000 7fc38e600640 1 -- 172.21.15.133:0/1930900679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc36c0047c0 msgr2=0x7fc36c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:08.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.688+0000 7fc38e600640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc36c0047c0 0x7fc36c004c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc370009100 tx=0x7fc36c0057f0 comp rx=0 tx=0).stop 2024-03-30T01:51:08.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.688+0000 7fc38e600640 1 -- 172.21.15.133:0/1930900679 shutdown_connections 2024-03-30T01:51:08.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.688+0000 7fc38e600640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc36c0052a0 0x7fc36c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:08.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.688+0000 7fc38e600640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc36c0047c0 0x7fc36c004c40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:08.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.688+0000 7fc38e600640 1 --2- 172.21.15.133:0/1930900679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc36c003970 0x7fc36c003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:08.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.688+0000 7fc38e600640 1 -- 172.21.15.133:0/1930900679 >> 172.21.15.133:0/1930900679 conn(0x7fc3880cf770 msgr2=0x7fc3880cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:08.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.689+0000 7fc38e600640 1 -- 172.21.15.133:0/1930900679 shutdown_connections 2024-03-30T01:51:08.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.689+0000 7fc38e600640 1 -- 172.21.15.133:0/1930900679 wait complete. 2024-03-30T01:51:08.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.692+0000 7fc38e600640 1 Processor -- start 2024-03-30T01:51:08.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.693+0000 7fc38e600640 1 -- start start 2024-03-30T01:51:08.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.694+0000 7fc38e600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc36c003970 0x7fc3881f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:08.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.694+0000 7fc38e600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc36c0047c0 0x7fc38814ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:08.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.694+0000 7fc38e600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc36c0052a0 0x7fc3880b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:08.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.694+0000 7fc38e600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3880b3800 con 0x7fc36c0047c0 2024-03-30T01:51:08.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.694+0000 7fc38e600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38815d250 con 0x7fc36c003970 2024-03-30T01:51:08.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.694+0000 7fc38e600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3880b3530 con 0x7fc36c0052a0 2024-03-30T01:51:08.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.695+0000 7fc37fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc36c0047c0 0x7fc38814ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:08.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.695+0000 7fc37fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc36c0047c0 0x7fc38814ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48164/0 (socket says 172.21.15.133:48164) 2024-03-30T01:51:08.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.695+0000 7fc37fe00640 1 -- 172.21.15.133:0/1023497571 learned_addr learned my addr 172.21.15.133:0/1023497571 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:08.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.695+0000 7fc38d200640 1 --2- 172.21.15.133:0/1023497571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc36c003970 0x7fc3881f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:08.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.695+0000 7fc38dc00640 1 --2- 172.21.15.133:0/1023497571 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc36c0052a0 0x7fc3880b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:08.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.695+0000 7fc37fe00640 1 -- 172.21.15.133:0/1023497571 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc36c0052a0 msgr2=0x7fc3880b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:08.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.695+0000 7fc37fe00640 1 --2- 172.21.15.133:0/1023497571 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc36c0052a0 0x7fc3880b2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:08.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.695+0000 7fc37fe00640 1 -- 172.21.15.133:0/1023497571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc36c003970 msgr2=0x7fc3881f2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:08.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.695+0000 7fc37fe00640 1 --2- 172.21.15.133:0/1023497571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc36c003970 0x7fc3881f2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:08.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.695+0000 7fc37fe00640 1 -- 172.21.15.133:0/1023497571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38815d020 con 0x7fc36c0047c0 2024-03-30T01:51:08.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.695+0000 7fc38d200640 1 --2- 172.21.15.133:0/1023497571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc36c003970 0x7fc3881f2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T01:51:08.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.696+0000 7fc37fe00640 1 --2- 172.21.15.133:0/1023497571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc36c0047c0 0x7fc38814ff60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc370009100 tx=0x7fc3700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:08.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.696+0000 7fc385600640 1 -- 172.21.15.133:0/1023497571 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37000c7a0 con 0x7fc36c0047c0 2024-03-30T01:51:08.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.696+0000 7fc385600640 1 -- 172.21.15.133:0/1023497571 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37000c040 con 0x7fc36c0047c0 2024-03-30T01:51:08.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.696+0000 7fc38e600640 1 -- 172.21.15.133:0/1023497571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3880a93f0 con 0x7fc36c0047c0 2024-03-30T01:51:08.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.696+0000 7fc385600640 1 -- 172.21.15.133:0/1023497571 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc370042660 con 0x7fc36c0047c0 2024-03-30T01:51:08.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.697+0000 7fc38e600640 1 -- 172.21.15.133:0/1023497571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3880a99b0 con 0x7fc36c0047c0 2024-03-30T01:51:08.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.697+0000 7fc385600640 1 -- 172.21.15.133:0/1023497571 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc370042ac0 con 0x7fc36c0047c0 2024-03-30T01:51:08.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.697+0000 7fc385600640 1 -- 172.21.15.133:0/1023497571 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc37004ba40 con 0x7fc36c0047c0 2024-03-30T01:51:08.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.698+0000 7fc38e600640 1 -- 172.21.15.133:0/1023497571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc388073750 con 0x7fc36c0047c0 2024-03-30T01:51:08.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.702+0000 7fc385600640 1 -- 172.21.15.133:0/1023497571 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fc370050060 con 0x7fc36c0047c0 2024-03-30T01:51:08.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.775+0000 7fc38e600640 1 -- 172.21.15.133:0/1023497571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc3880d0570 con 0x7fc36c0047c0 2024-03-30T01:51:08.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.779+0000 7fc385600640 1 -- 172.21.15.133:0/1023497571 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc370046070 con 0x7fc36c0047c0 2024-03-30T01:51:08.785 INFO:teuthology.orchestra.run.smithi133.stderr:adjusted tunables profile to default 2024-03-30T01:51:08.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.781+0000 7fc38e600640 1 -- 172.21.15.133:0/1023497571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc36c0047c0 msgr2=0x7fc38814ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:08.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.781+0000 7fc38e600640 1 --2- 172.21.15.133:0/1023497571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc36c0047c0 0x7fc38814ff60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc370009100 tx=0x7fc3700046c0 comp rx=0 tx=0).stop 2024-03-30T01:51:08.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.781+0000 7fc38e600640 1 -- 172.21.15.133:0/1023497571 shutdown_connections 2024-03-30T01:51:08.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.781+0000 7fc38e600640 1 --2- 172.21.15.133:0/1023497571 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc36c0052a0 0x7fc3880b2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:08.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.781+0000 7fc38e600640 1 --2- 172.21.15.133:0/1023497571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc36c0047c0 0x7fc38814ff60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:08.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.781+0000 7fc38e600640 1 --2- 172.21.15.133:0/1023497571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc36c003970 0x7fc3881f2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:08.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.781+0000 7fc38e600640 1 -- 172.21.15.133:0/1023497571 >> 172.21.15.133:0/1023497571 conn(0x7fc3880cf770 msgr2=0x7fc3880d1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:08.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.781+0000 7fc38e600640 1 -- 172.21.15.133:0/1023497571 shutdown_connections 2024-03-30T01:51:08.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:08.781+0000 7fc38e600640 1 -- 172.21.15.133:0/1023497571 wait complete. 2024-03-30T01:51:08.803 INFO:tasks.ceph:check_enable_crimson: False 2024-03-30T01:51:08.803 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-30T01:51:08.803 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:51:08.803 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-30T01:51:08.875 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:51:08.876 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-30T01:51:09.007 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:51:09.007 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-30T01:51:09.086 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:51:09.086 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-30T01:51:09.197 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:51:09.198 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-30T01:51:09.264 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:09.258+0000 7faae0841040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T01:51:09.286 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:51:09.286 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-30T01:51:09.290 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:09.283+0000 7f3769e11040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T01:51:09.328 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:09.323+0000 7faae0841040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T01:51:09.357 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:09.352+0000 7f3769e11040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T01:51:09.380 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:51:09.380 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-30T01:51:09.506 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:51:09.506 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-30T01:51:09.588 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new e78f3a78-50d1-4116-bc15-f2e32e628206 0 2024-03-30T01:51:09.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.819+0000 7f8e7a800640 1 Processor -- start 2024-03-30T01:51:09.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.820+0000 7f8e7a800640 1 -- start start 2024-03-30T01:51:09.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.821+0000 7f8e7a800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8e7415cc50 0x7f8e740d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:09.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.821+0000 7f8e7a800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e7415d030 con 0x7f8e740d2240 2024-03-30T01:51:09.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.821+0000 7f8e7a800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e740b5af0 con 0x7f8e740cfb80 2024-03-30T01:51:09.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.821+0000 7f8e7a800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e740d1c50 con 0x7f8e7415cc50 2024-03-30T01:51:09.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.821+0000 7f8e73e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f8e740cfb80 0x7f8e740b14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50712/0 (socket says 172.21.15.137:50712) 2024-03-30T01:51:09.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.821+0000 7f8e73e00640 1 -- 172.21.15.137:0/2986416678 learned_addr learned my addr 172.21.15.137:0/2986416678 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-03-30T01:51:09.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.822+0000 7f8e73400640 1 --2- 172.21.15.137:0/2986416678 >> v2:172.21.15.133:3300/0 conn(0x7f8e7415cc50 0x7f8e740d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:09.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.822+0000 7f8e72a00640 1 -- 172.21.15.137:0/2986416678 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262041483 0 0) 0x7f8e740b5af0 con 0x7f8e740cfb80 2024-03-30T01:51:09.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.822+0000 7f8e72a00640 1 -- 172.21.15.137:0/2986416678 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e54003520 con 0x7f8e740cfb80 2024-03-30T01:51:09.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.822+0000 7f8e72a00640 1 -- 172.21.15.137:0/2986416678 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 502737974 0 0) 0x7f8e54003520 con 0x7f8e740cfb80 2024-03-30T01:51:09.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.822+0000 7f8e72a00640 1 -- 172.21.15.137:0/2986416678 >> v2:172.21.15.133:3300/0 conn(0x7f8e7415cc50 msgr2=0x7f8e740d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:09.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.822+0000 7f8e72a00640 1 --2- 172.21.15.137:0/2986416678 >> v2:172.21.15.133:3300/0 conn(0x7f8e7415cc50 0x7f8e740d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:09.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.822+0000 7f8e72a00640 1 -- 172.21.15.137:0/2986416678 >> v1:172.21.15.133:6789/0 conn(0x7f8e740d2240 legacy=0x7f8e740cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:09.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.822+0000 7f8e72a00640 1 -- 172.21.15.137:0/2986416678 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e740d10d0 con 0x7f8e740cfb80 2024-03-30T01:51:09.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.822+0000 7f8e72a00640 1 -- 172.21.15.137:0/2986416678 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f8e6c0019f0 con 0x7f8e740cfb80 2024-03-30T01:51:09.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.822+0000 7f8e73400640 1 --2- 172.21.15.137:0/2986416678 >> v2:172.21.15.133:3300/0 conn(0x7f8e7415cc50 0x7f8e740d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T01:51:09.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.822+0000 7f8e72a00640 1 -- 172.21.15.137:0/2986416678 >> v1:172.21.15.137:6789/0 conn(0x7f8e740cfb80 legacy=0x7f8e740b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:09.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.822+0000 7f8e72a00640 1 --2- 172.21.15.137:0/2986416678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e540039c0 0x7f8e54003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:09.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.822+0000 7f8e72a00640 1 --2- 172.21.15.137:0/2986416678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e540047c0 0x7f8e54004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:09.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.822+0000 7f8e72a00640 1 --2- 172.21.15.137:0/2986416678 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8e54005180 0x7f8e5400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:09.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.822+0000 7f8e72a00640 1 -- 172.21.15.137:0/2986416678 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e740d1c50 con 0x7f8e540039c0 2024-03-30T01:51:09.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.822+0000 7f8e72a00640 1 -- 172.21.15.137:0/2986416678 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5400c080 con 0x7f8e540047c0 2024-03-30T01:51:09.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.822+0000 7f8e72a00640 1 -- 172.21.15.137:0/2986416678 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5400c240 con 0x7f8e54005180 2024-03-30T01:51:09.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.823+0000 7f8e73e00640 1 --2- 172.21.15.137:0/2986416678 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8e54005180 0x7f8e5400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.823+0000 7f8e6be00640 1 --2- 172.21.15.137:0/2986416678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e540047c0 0x7f8e54004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.823+0000 7f8e73400640 1 --2- 172.21.15.137:0/2986416678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e540039c0 0x7f8e54003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.823+0000 7f8e73e00640 1 -- 172.21.15.137:0/2986416678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e540047c0 msgr2=0x7f8e54004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.823+0000 7f8e73e00640 1 --2- 172.21.15.137:0/2986416678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e540047c0 0x7f8e54004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.823+0000 7f8e73e00640 1 -- 172.21.15.137:0/2986416678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e540039c0 msgr2=0x7f8e54003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.823+0000 7f8e73e00640 1 --2- 172.21.15.137:0/2986416678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e540039c0 0x7f8e54003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.823+0000 7f8e73e00640 1 -- 172.21.15.137:0/2986416678 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e54003520 con 0x7f8e54005180 2024-03-30T01:51:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.823+0000 7f8e6be00640 1 --2- 172.21.15.137:0/2986416678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e540047c0 0x7f8e54004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T01:51:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.824+0000 7f8e73e00640 1 -- 172.21.15.137:0/2986416678 reap_dead start 2024-03-30T01:51:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.824+0000 7f8e73e00640 1 --2- 172.21.15.137:0/2986416678 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8e54005180 0x7f8e5400b980 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00a760 tx=0x7f8e540057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbc45e7d8320fab1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.824+0000 7f8e72a00640 1 -- 172.21.15.137:0/2986416678 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c034630 con 0x7f8e54005180 2024-03-30T01:51:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.824+0000 7f8e72a00640 1 -- 172.21.15.137:0/2986416678 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c02f070 con 0x7f8e54005180 2024-03-30T01:51:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.824+0000 7f8e72a00640 1 -- 172.21.15.137:0/2986416678 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c034a10 con 0x7f8e54005180 2024-03-30T01:51:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.825+0000 7f8e7a800640 1 -- 172.21.15.137:0/2986416678 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8e54005180 msgr2=0x7f8e5400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.825+0000 7f8e7a800640 1 --2- 172.21.15.137:0/2986416678 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8e54005180 0x7f8e5400b980 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00a760 tx=0x7f8e540057f0 comp rx=0 tx=0).stop 2024-03-30T01:51:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.825+0000 7f8e7a800640 1 -- 172.21.15.137:0/2986416678 shutdown_connections 2024-03-30T01:51:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.825+0000 7f8e7a800640 1 --2- 172.21.15.137:0/2986416678 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8e54005180 0x7f8e5400b980 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.825+0000 7f8e7a800640 1 -- 172.21.15.137:0/2986416678 >> 172.21.15.137:0/2986416678 conn(0x7f8e74071a40 msgr2=0x7f8e7406b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.825+0000 7f8e7a800640 1 -- 172.21.15.137:0/2986416678 shutdown_connections 2024-03-30T01:51:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.825+0000 7f8e7a800640 1 -- 172.21.15.137:0/2986416678 wait complete. 2024-03-30T01:51:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.827+0000 7f8e7a800640 1 Processor -- start 2024-03-30T01:51:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.827+0000 7f8e7a800640 1 -- start start 2024-03-30T01:51:09.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.828+0000 7f8e7a800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e54005180 0x7f8e74151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:09.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.828+0000 7f8e7a800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8e740c9ff0 0x7f8e740b6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:09.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.828+0000 7f8e7a800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e740ca470 0x7f8e740b7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:09.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.828+0000 7f8e7a800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e74152510 con 0x7f8e54005180 2024-03-30T01:51:09.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.828+0000 7f8e7a800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e741538d0 con 0x7f8e740ca470 2024-03-30T01:51:09.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.828+0000 7f8e7a800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e74153bb0 con 0x7f8e740c9ff0 2024-03-30T01:51:09.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.828+0000 7f8e73e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e740ca470 0x7f8e740b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:09.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.828+0000 7f8e6be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8e740c9ff0 0x7f8e740b6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:09.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.828+0000 7f8e73e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e740ca470 0x7f8e740b7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48616/0 (socket says 172.21.15.137:48616) 2024-03-30T01:51:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.828+0000 7f8e73e00640 1 -- 172.21.15.137:0/1883670124 learned_addr learned my addr 172.21.15.137:0/1883670124 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-03-30T01:51:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.828+0000 7f8e73400640 1 --2- 172.21.15.137:0/1883670124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e54005180 0x7f8e74151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.829+0000 7f8e73e00640 1 -- 172.21.15.137:0/1883670124 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8e740c9ff0 msgr2=0x7f8e740b6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.829+0000 7f8e73e00640 1 --2- 172.21.15.137:0/1883670124 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8e740c9ff0 0x7f8e740b6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.829+0000 7f8e73e00640 1 -- 172.21.15.137:0/1883670124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e54005180 msgr2=0x7f8e74151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.829+0000 7f8e73e00640 1 --2- 172.21.15.137:0/1883670124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e54005180 0x7f8e74151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.829+0000 7f8e73e00640 1 -- 172.21.15.137:0/1883670124 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e740ca9b0 con 0x7f8e740ca470 2024-03-30T01:51:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.829+0000 7f8e73e00640 1 --2- 172.21.15.137:0/1883670124 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e740ca470 0x7f8e740b7460 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00a760 tx=0x7f8e6c001cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.829+0000 7f8e6b400640 1 -- 172.21.15.137:0/1883670124 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c001930 con 0x7f8e740ca470 2024-03-30T01:51:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.829+0000 7f8e6b400640 1 -- 172.21.15.137:0/1883670124 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c004b60 con 0x7f8e740ca470 2024-03-30T01:51:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.829+0000 7f8e6b400640 1 -- 172.21.15.137:0/1883670124 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c0347b0 con 0x7f8e740ca470 2024-03-30T01:51:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.829+0000 7f8e7a800640 1 -- 172.21.15.137:0/1883670124 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e740cac90 con 0x7f8e740ca470 2024-03-30T01:51:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.829+0000 7f8e7a800640 1 -- 172.21.15.137:0/1883670124 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e741f3920 con 0x7f8e740ca470 2024-03-30T01:51:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.830+0000 7f8e6b400640 1 -- 172.21.15.137:0/1883670124 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8e6c031030 con 0x7f8e740ca470 2024-03-30T01:51:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.830+0000 7f8e6b400640 1 -- 172.21.15.137:0/1883670124 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8e6c03f7f0 con 0x7f8e740ca470 2024-03-30T01:51:09.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.830+0000 7f8e7a800640 1 -- 172.21.15.137:0/1883670124 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e74066d80 con 0x7f8e740ca470 2024-03-30T01:51:09.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.833+0000 7f8e6b400640 1 -- 172.21.15.137:0/1883670124 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f8e6c039040 con 0x7f8e740ca470 2024-03-30T01:51:09.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.911+0000 7f8e7a800640 1 -- 172.21.15.137:0/1883670124 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e78f3a78-50d1-4116-bc15-f2e32e628206", "id": 0} v 0) v1 -- 0x7f8e74066d80 con 0x7f8e740ca470 2024-03-30T01:51:09.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.922+0000 7f8e6b400640 1 -- 172.21.15.137:0/1883670124 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e78f3a78-50d1-4116-bc15-f2e32e628206", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8e5c001370 con 0x7f8e740ca470 2024-03-30T01:51:09.927 INFO:teuthology.orchestra.run.smithi137.stdout:0 2024-03-30T01:51:09.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.923+0000 7f8e7a800640 1 -- 172.21.15.137:0/1883670124 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e740ca470 msgr2=0x7f8e740b7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:09.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.923+0000 7f8e7a800640 1 --2- 172.21.15.137:0/1883670124 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e740ca470 0x7f8e740b7460 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00a760 tx=0x7f8e6c001cb0 comp rx=0 tx=0).stop 2024-03-30T01:51:09.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.924+0000 7f8e7a800640 1 -- 172.21.15.137:0/1883670124 shutdown_connections 2024-03-30T01:51:09.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.924+0000 7f8e7a800640 1 --2- 172.21.15.137:0/1883670124 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e740ca470 0x7f8e740b7460 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:09.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.924+0000 7f8e7a800640 1 --2- 172.21.15.137:0/1883670124 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8e740c9ff0 0x7f8e740b6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:09.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.924+0000 7f8e7a800640 1 --2- 172.21.15.137:0/1883670124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e54005180 0x7f8e74151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:09.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.924+0000 7f8e7a800640 1 -- 172.21.15.137:0/1883670124 >> 172.21.15.137:0/1883670124 conn(0x7f8e74071a40 msgr2=0x7f8e7415e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:09.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.924+0000 7f8e7a800640 1 -- 172.21.15.137:0/1883670124 shutdown_connections 2024-03-30T01:51:09.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:09.924+0000 7f8e7a800640 1 -- 172.21.15.137:0/1883670124 wait complete. 2024-03-30T01:51:09.945 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new e3e02062-ba40-442a-b2e4-21f26017ff2c 1 2024-03-30T01:51:09.947 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:09.942+0000 7faae0841040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T01:51:09.985 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:09.980+0000 7f3769e11040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T01:51:10.015 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:10.010+0000 7faae0841040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T01:51:10.050 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:10.045+0000 7f3769e11040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T01:51:10.070 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:10.065+0000 7faae0841040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T01:51:10.104 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:10.099+0000 7f3769e11040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T01:51:10.135 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:10.129+0000 7faae0841040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T01:51:10.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.131+0000 7f7807200640 1 Processor -- start 2024-03-30T01:51:10.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.131+0000 7f7807200640 1 -- start start 2024-03-30T01:51:10.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.132+0000 7f7807200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f78080ccbb0 0x7f7808098a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:10.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.132+0000 7f7807200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78080b1be0 0x7f7808098f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:10.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.133+0000 7f7807200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78080ccf90 con 0x7f780815e650 2024-03-30T01:51:10.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.133+0000 7f7807200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78080b02b0 con 0x7f78080ccbb0 2024-03-30T01:51:10.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.133+0000 7f7807200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78080b0590 con 0x7f78080b1be0 2024-03-30T01:51:10.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.133+0000 7f7805e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f78080ccbb0 0x7f7808098a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:10.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.133+0000 7f7806800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78080b1be0 0x7f7808098f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:10.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.133+0000 7f7805e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f78080ccbb0 0x7f7808098a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48624/0 (socket says 172.21.15.137:48624) 2024-03-30T01:51:10.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.133+0000 7f7805e00640 1 -- 172.21.15.137:0/1661004734 learned_addr learned my addr 172.21.15.137:0/1661004734 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-03-30T01:51:10.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.133+0000 7f7805e00640 1 -- 172.21.15.137:0/1661004734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78080b1be0 msgr2=0x7f7808098f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:10.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.133+0000 7f7805e00640 1 --2- 172.21.15.137:0/1661004734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78080b1be0 0x7f7808098f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:10.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.133+0000 7f7805e00640 1 -- 172.21.15.137:0/1661004734 >> v1:172.21.15.133:6789/0 conn(0x7f780815e650 legacy=0x7f78080ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:10.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.133+0000 7f7805e00640 1 -- 172.21.15.137:0/1661004734 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78080b0870 con 0x7f78080ccbb0 2024-03-30T01:51:10.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.133+0000 7f7806800640 1 --2- 172.21.15.137:0/1661004734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78080b1be0 0x7f7808098f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T01:51:10.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.135+0000 7f7805e00640 1 --2- 172.21.15.137:0/1661004734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78080ccbb0 0x7f7808098a30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f77f8009870 tx=0x7f77f802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1c2802ee9d4e4b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:10.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.135+0000 7f7804a00640 1 -- 172.21.15.137:0/1661004734 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f8030840 con 0x7f78080ccbb0 2024-03-30T01:51:10.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.135+0000 7f7804a00640 1 -- 172.21.15.137:0/1661004734 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f80309a0 con 0x7f78080ccbb0 2024-03-30T01:51:10.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.135+0000 7f7804a00640 1 -- 172.21.15.137:0/1661004734 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f8030d30 con 0x7f78080ccbb0 2024-03-30T01:51:10.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.135+0000 7f7807200640 1 -- 172.21.15.137:0/1661004734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78080ccbb0 msgr2=0x7f7808098a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:10.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.135+0000 7f7807200640 1 --2- 172.21.15.137:0/1661004734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78080ccbb0 0x7f7808098a30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f77f8009870 tx=0x7f77f802b980 comp rx=0 tx=0).stop 2024-03-30T01:51:10.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.136+0000 7f7807200640 1 -- 172.21.15.137:0/1661004734 shutdown_connections 2024-03-30T01:51:10.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.136+0000 7f7807200640 1 --2- 172.21.15.137:0/1661004734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78080b1be0 0x7f7808098f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:10.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.136+0000 7f7807200640 1 --2- 172.21.15.137:0/1661004734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78080ccbb0 0x7f7808098a30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:10.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.136+0000 7f7807200640 1 -- 172.21.15.137:0/1661004734 >> 172.21.15.137:0/1661004734 conn(0x7f78080b21c0 msgr2=0x7f78080b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:10.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.136+0000 7f7807200640 1 -- 172.21.15.137:0/1661004734 shutdown_connections 2024-03-30T01:51:10.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.136+0000 7f7807200640 1 -- 172.21.15.137:0/1661004734 wait complete. 2024-03-30T01:51:10.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.137+0000 7f7807200640 1 Processor -- start 2024-03-30T01:51:10.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.137+0000 7f7807200640 1 -- start start 2024-03-30T01:51:10.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.138+0000 7f7807200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78080b1be0 0x7f780806bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:10.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.138+0000 7f7807200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78080ccbb0 0x7f780815b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.138+0000 7f7807200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f780815e650 0x7f78080b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.138+0000 7f7807200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780815b610 con 0x7f780815e650 2024-03-30T01:51:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.138+0000 7f7807200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780806cba0 con 0x7f78080ccbb0 2024-03-30T01:51:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.138+0000 7f7807200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780806c300 con 0x7f78080b1be0 2024-03-30T01:51:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.139+0000 7f7805e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78080b1be0 0x7f780806bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.139+0000 7f7805400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78080ccbb0 0x7f780815b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.139+0000 7f7805e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78080b1be0 0x7f780806bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:41058/0 (socket says 172.21.15.137:41058) 2024-03-30T01:51:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.139+0000 7f7805e00640 1 -- 172.21.15.137:0/1434333386 learned_addr learned my addr 172.21.15.137:0/1434333386 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-03-30T01:51:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.139+0000 7f7806800640 1 --2- 172.21.15.137:0/1434333386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f780815e650 0x7f78080b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.139+0000 7f7805e00640 1 -- 172.21.15.137:0/1434333386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78080ccbb0 msgr2=0x7f780815b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.139+0000 7f7805e00640 1 --2- 172.21.15.137:0/1434333386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78080ccbb0 0x7f780815b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.139+0000 7f7805e00640 1 -- 172.21.15.137:0/1434333386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f780815e650 msgr2=0x7f78080b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.139+0000 7f7805e00640 1 --2- 172.21.15.137:0/1434333386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f780815e650 0x7f78080b60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.139+0000 7f7805e00640 1 -- 172.21.15.137:0/1434333386 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7800009a70 con 0x7f78080b1be0 2024-03-30T01:51:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.139+0000 7f7805400640 1 --2- 172.21.15.137:0/1434333386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78080ccbb0 0x7f780815b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T01:51:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.139+0000 7f7805e00640 1 --2- 172.21.15.137:0/1434333386 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78080b1be0 0x7f780806bcf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f77f80097c0 tx=0x7f77f8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.140+0000 7f77fe000640 1 -- 172.21.15.137:0/1434333386 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f8039a90 con 0x7f78080b1be0 2024-03-30T01:51:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.140+0000 7f77fe000640 1 -- 172.21.15.137:0/1434333386 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f8039bf0 con 0x7f78080b1be0 2024-03-30T01:51:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.140+0000 7f77fe000640 1 -- 172.21.15.137:0/1434333386 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f8043410 con 0x7f78080b1be0 2024-03-30T01:51:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.140+0000 7f7807200640 1 -- 172.21.15.137:0/1434333386 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f80094d0 con 0x7f78080b1be0 2024-03-30T01:51:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.140+0000 7f7807200640 1 -- 172.21.15.137:0/1434333386 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780806c8c0 con 0x7f78080b1be0 2024-03-30T01:51:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.140+0000 7f77fe000640 1 -- 172.21.15.137:0/1434333386 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f77f8043870 con 0x7f78080b1be0 2024-03-30T01:51:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.140+0000 7f77fe000640 1 -- 172.21.15.137:0/1434333386 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f77f804cc00 con 0x7f78080b1be0 2024-03-30T01:51:10.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.141+0000 7f7807200640 1 -- 172.21.15.137:0/1434333386 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7808066940 con 0x7f78080b1be0 2024-03-30T01:51:10.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.144+0000 7f77fe000640 1 -- 172.21.15.137:0/1434333386 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f77f8048070 con 0x7f78080b1be0 2024-03-30T01:51:10.171 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:10.166+0000 7f3769e11040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T01:51:10.186 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:10.181+0000 7faae0841040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T01:51:10.223 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:10.218+0000 7f3769e11040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T01:51:10.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.222+0000 7f7807200640 1 -- 172.21.15.137:0/1434333386 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e3e02062-ba40-442a-b2e4-21f26017ff2c", "id": 1} v 0) v1 -- 0x7f78080b1350 con 0x7f78080b1be0 2024-03-30T01:51:10.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.232+0000 7f77fe000640 1 -- 172.21.15.137:0/1434333386 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e3e02062-ba40-442a-b2e4-21f26017ff2c", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f77f8034070 con 0x7f78080b1be0 2024-03-30T01:51:10.237 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-03-30T01:51:10.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.233+0000 7f7807200640 1 -- 172.21.15.137:0/1434333386 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78080b1be0 msgr2=0x7f780806bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:10.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.233+0000 7f7807200640 1 --2- 172.21.15.137:0/1434333386 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78080b1be0 0x7f780806bcf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f77f80097c0 tx=0x7f77f8004730 comp rx=0 tx=0).stop 2024-03-30T01:51:10.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.233+0000 7f7807200640 1 -- 172.21.15.137:0/1434333386 shutdown_connections 2024-03-30T01:51:10.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.233+0000 7f7807200640 1 --2- 172.21.15.137:0/1434333386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f780815e650 0x7f78080b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:10.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.233+0000 7f7807200640 1 --2- 172.21.15.137:0/1434333386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78080ccbb0 0x7f780815b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:10.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.233+0000 7f7807200640 1 --2- 172.21.15.137:0/1434333386 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78080b1be0 0x7f780806bcf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:10.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.233+0000 7f7807200640 1 -- 172.21.15.137:0/1434333386 >> 172.21.15.137:0/1434333386 conn(0x7f78080b21c0 msgr2=0x7f7808098a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:10.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.233+0000 7f7807200640 1 -- 172.21.15.137:0/1434333386 shutdown_connections 2024-03-30T01:51:10.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.233+0000 7f7807200640 1 -- 172.21.15.137:0/1434333386 wait complete. 2024-03-30T01:51:10.255 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 5a7cd297-9e6b-4677-afa4-193f4b3d736f 2 2024-03-30T01:51:10.320 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:10.315+0000 7faae0841040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T01:51:10.360 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:10.355+0000 7f3769e11040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T01:51:10.402 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:10.397+0000 7faae0841040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T01:51:10.444 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:10.439+0000 7f3769e11040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T01:51:10.457 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:10.452+0000 7faae0841040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T01:51:10.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.480+0000 7f6481800640 1 Processor -- start 2024-03-30T01:51:10.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.480+0000 7f6481800640 1 -- start start 2024-03-30T01:51:10.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.482+0000 7f6481800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f647c1444a0 0x7f647c15c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:10.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.482+0000 7f6481800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647c0cd040 con 0x7f647c15b890 2024-03-30T01:51:10.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.482+0000 7f6481800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647c0cfbd0 con 0x7f647c070450 2024-03-30T01:51:10.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.482+0000 7f6481800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f647c0cfeb0 con 0x7f647c1444a0 2024-03-30T01:51:10.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.482+0000 7f647be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f647c1444a0 0x7f647c15c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:10.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.482+0000 7f647be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f647c1444a0 0x7f647c15c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48644/0 (socket says 172.21.15.137:48644) 2024-03-30T01:51:10.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.482+0000 7f647be00640 1 -- 172.21.15.137:0/1112185429 learned_addr learned my addr 172.21.15.137:0/1112185429 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-03-30T01:51:10.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.483+0000 7f647be00640 1 -- 172.21.15.137:0/1112185429 >> v1:172.21.15.137:6789/0 conn(0x7f647c070450 legacy=0x7f647c0cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:10.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.483+0000 7f647be00640 1 -- 172.21.15.137:0/1112185429 >> v1:172.21.15.133:6789/0 conn(0x7f647c15b890 legacy=0x7f647c06fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:10.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.483+0000 7f647be00640 1 -- 172.21.15.137:0/1112185429 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647c0d0190 con 0x7f647c1444a0 2024-03-30T01:51:10.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.484+0000 7f647be00640 1 --2- 172.21.15.137:0/1112185429 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f647c1444a0 0x7f647c15c210 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f646c0098a0 tx=0x7f646c02b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=947131b3d529ddd7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:10.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.484+0000 7f647aa00640 1 -- 172.21.15.137:0/1112185429 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c0317c0 con 0x7f647c1444a0 2024-03-30T01:51:10.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.484+0000 7f647aa00640 1 -- 172.21.15.137:0/1112185429 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c031920 con 0x7f647c1444a0 2024-03-30T01:51:10.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.484+0000 7f647aa00640 1 -- 172.21.15.137:0/1112185429 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c031cb0 con 0x7f647c1444a0 2024-03-30T01:51:10.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.484+0000 7f6481800640 1 -- 172.21.15.137:0/1112185429 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f647c1444a0 msgr2=0x7f647c15c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:10.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.484+0000 7f6481800640 1 --2- 172.21.15.137:0/1112185429 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f647c1444a0 0x7f647c15c210 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f646c0098a0 tx=0x7f646c02b860 comp rx=0 tx=0).stop 2024-03-30T01:51:10.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.485+0000 7f6481800640 1 -- 172.21.15.137:0/1112185429 shutdown_connections 2024-03-30T01:51:10.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.485+0000 7f6481800640 1 --2- 172.21.15.137:0/1112185429 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f647c1444a0 0x7f647c15c210 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:10.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.485+0000 7f6481800640 1 -- 172.21.15.137:0/1112185429 >> 172.21.15.137:0/1112185429 conn(0x7f647c0b2440 msgr2=0x7f647c0b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:10.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.485+0000 7f6481800640 1 -- 172.21.15.137:0/1112185429 shutdown_connections 2024-03-30T01:51:10.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.485+0000 7f6481800640 1 -- 172.21.15.137:0/1112185429 wait complete. 2024-03-30T01:51:10.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.487+0000 7f6481800640 1 Processor -- start 2024-03-30T01:51:10.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.487+0000 7f6481800640 1 -- start start 2024-03-30T01:51:10.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.488+0000 7f6481800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f647c070450 0x7f647c1efc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:10.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.488+0000 7f6481800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f647c1444a0 0x7f647c1413b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:10.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.488+0000 7f6481800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c15b890 0x7f647c0c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:10.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.488+0000 7f6481800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c141eb0 con 0x7f647c15b890 2024-03-30T01:51:10.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.488+0000 7f6481800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c142190 con 0x7f647c1444a0 2024-03-30T01:51:10.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.488+0000 7f6481800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c142470 con 0x7f647c070450 2024-03-30T01:51:10.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.489+0000 7f647be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f647c070450 0x7f647c1efc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:10.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.489+0000 7f647b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f647c1444a0 0x7f647c1413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:10.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.489+0000 7f647be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f647c070450 0x7f647c1efc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:41070/0 (socket says 172.21.15.137:41070) 2024-03-30T01:51:10.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.489+0000 7f647b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f647c1444a0 0x7f647c1413b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48648/0 (socket says 172.21.15.137:48648) 2024-03-30T01:51:10.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.489+0000 7f647be00640 1 -- 172.21.15.137:0/2073676871 learned_addr learned my addr 172.21.15.137:0/2073676871 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-03-30T01:51:10.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.489+0000 7f6480e00640 1 --2- 172.21.15.137:0/2073676871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c15b890 0x7f647c0c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:10.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.489+0000 7f647b400640 1 -- 172.21.15.137:0/2073676871 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f647c070450 msgr2=0x7f647c1efc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:10.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.489+0000 7f647b400640 1 --2- 172.21.15.137:0/2073676871 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f647c070450 0x7f647c1efc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:10.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.489+0000 7f647b400640 1 -- 172.21.15.137:0/2073676871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c15b890 msgr2=0x7f647c0c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:10.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.489+0000 7f647b400640 1 --2- 172.21.15.137:0/2073676871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c15b890 0x7f647c0c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:10.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.489+0000 7f647b400640 1 -- 172.21.15.137:0/2073676871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c0094d0 con 0x7f647c1444a0 2024-03-30T01:51:10.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.489+0000 7f647be00640 1 --2- 172.21.15.137:0/2073676871 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f647c070450 0x7f647c1efc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T01:51:10.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.489+0000 7f6480e00640 1 --2- 172.21.15.137:0/2073676871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c15b890 0x7f647c0c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:51:10.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.489+0000 7f647b400640 1 --2- 172.21.15.137:0/2073676871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f647c1444a0 0x7f647c1413b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f646800b3e0 tx=0x7f646800b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:10.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.490+0000 7f6473e00640 1 -- 172.21.15.137:0/2073676871 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6468004020 con 0x7f647c1444a0 2024-03-30T01:51:10.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.490+0000 7f6473e00640 1 -- 172.21.15.137:0/2073676871 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6468004180 con 0x7f647c1444a0 2024-03-30T01:51:10.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.490+0000 7f6473e00640 1 -- 172.21.15.137:0/2073676871 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6468011630 con 0x7f647c1444a0 2024-03-30T01:51:10.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.490+0000 7f6481800640 1 -- 172.21.15.137:0/2073676871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647c142750 con 0x7f647c1444a0 2024-03-30T01:51:10.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.490+0000 7f6481800640 1 -- 172.21.15.137:0/2073676871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647c152f00 con 0x7f647c1444a0 2024-03-30T01:51:10.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.490+0000 7f6473e00640 1 -- 172.21.15.137:0/2073676871 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6468011a90 con 0x7f647c1444a0 2024-03-30T01:51:10.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.490+0000 7f6473e00640 1 -- 172.21.15.137:0/2073676871 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f6468011d40 con 0x7f647c1444a0 2024-03-30T01:51:10.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.491+0000 7f6481800640 1 -- 172.21.15.137:0/2073676871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647c073750 con 0x7f647c1444a0 2024-03-30T01:51:10.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.493+0000 7f6473e00640 1 -- 172.21.15.137:0/2073676871 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f6468015030 con 0x7f647c1444a0 2024-03-30T01:51:10.501 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:10.497+0000 7f3769e11040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T01:51:10.520 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:10.514+0000 7faae0841040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T01:51:10.564 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:10.559+0000 7f3769e11040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T01:51:10.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.570+0000 7f6481800640 1 -- 172.21.15.137:0/2073676871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5a7cd297-9e6b-4677-afa4-193f4b3d736f", "id": 2} v 0) v1 -- 0x7f647c070870 con 0x7f647c1444a0 2024-03-30T01:51:10.577 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:10.572+0000 7faae0841040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T01:51:10.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.579+0000 7f6473e00640 1 -- 172.21.15.137:0/2073676871 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5a7cd297-9e6b-4677-afa4-193f4b3d736f", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6468003d20 con 0x7f647c1444a0 2024-03-30T01:51:10.585 INFO:teuthology.orchestra.run.smithi137.stdout:2 2024-03-30T01:51:10.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.580+0000 7f6481800640 1 -- 172.21.15.137:0/2073676871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f647c1444a0 msgr2=0x7f647c1413b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:10.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.580+0000 7f6481800640 1 --2- 172.21.15.137:0/2073676871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f647c1444a0 0x7f647c1413b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f646800b3e0 tx=0x7f646800b8a0 comp rx=0 tx=0).stop 2024-03-30T01:51:10.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.580+0000 7f6481800640 1 -- 172.21.15.137:0/2073676871 shutdown_connections 2024-03-30T01:51:10.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.580+0000 7f6481800640 1 --2- 172.21.15.137:0/2073676871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c15b890 0x7f647c0c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:10.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.580+0000 7f6481800640 1 --2- 172.21.15.137:0/2073676871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f647c1444a0 0x7f647c1413b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:10.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.580+0000 7f6481800640 1 --2- 172.21.15.137:0/2073676871 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f647c070450 0x7f647c1efc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:10.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.580+0000 7f6481800640 1 -- 172.21.15.137:0/2073676871 >> 172.21.15.137:0/2073676871 conn(0x7f647c0b2440 msgr2=0x7f647c0b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:10.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.580+0000 7f6481800640 1 -- 172.21.15.137:0/2073676871 shutdown_connections 2024-03-30T01:51:10.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.580+0000 7f6481800640 1 -- 172.21.15.137:0/2073676871 wait complete. 2024-03-30T01:51:10.602 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new a0f82433-f2da-46c6-a3a9-4f85d761cb2c 3 2024-03-30T01:51:10.623 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:10.618+0000 7f3769e11040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T01:51:10.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.778+0000 7faea1000640 1 Processor -- start 2024-03-30T01:51:10.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.778+0000 7faea1000640 1 -- start start 2024-03-30T01:51:10.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.779+0000 7faea1000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae9c15abd0 0x7fae9c0cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:10.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.779+0000 7faea1000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fae9c0ceae0 0x7fae9c0cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:10.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.780+0000 7faea1000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae9c0d1630 con 0x7fae9c099b70 2024-03-30T01:51:10.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.780+0000 7faea1000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae9c0cf4b0 con 0x7fae9c0ceae0 2024-03-30T01:51:10.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.780+0000 7faea1000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c0cb600 con 0x7fae9c15abd0 2024-03-30T01:51:10.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.780+0000 7fae9be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fae9c0ceae0 0x7fae9c0cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:10.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.780+0000 7fae9be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fae9c0ceae0 0x7fae9c0cef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48654/0 (socket says 172.21.15.137:48654) 2024-03-30T01:51:10.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.780+0000 7fae9be00640 1 -- 172.21.15.137:0/3568091015 learned_addr learned my addr 172.21.15.137:0/3568091015 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-03-30T01:51:10.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.780+0000 7fae9b400640 1 --2- 172.21.15.137:0/3568091015 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae9c15abd0 0x7fae9c0cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:10.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.780+0000 7fae9be00640 1 -- 172.21.15.137:0/3568091015 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae9c15abd0 msgr2=0x7fae9c0cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:10.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.780+0000 7fae9be00640 1 --2- 172.21.15.137:0/3568091015 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae9c15abd0 0x7fae9c0cb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:10.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.780+0000 7fae9be00640 1 -- 172.21.15.137:0/3568091015 >> v1:172.21.15.133:6789/0 conn(0x7fae9c099b70 legacy=0x7fae9c0cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:10.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.780+0000 7fae9be00640 1 -- 172.21.15.137:0/3568091015 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9c0cb8a0 con 0x7fae9c0ceae0 2024-03-30T01:51:10.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.781+0000 7fae9be00640 1 --2- 172.21.15.137:0/3568091015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae9c0ceae0 0x7fae9c0cef70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fae94009e50 tx=0x7fae9402bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91b0559a58c92f25 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:10.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.782+0000 7fae9a000640 1 -- 172.21.15.137:0/3568091015 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9402cb00 con 0x7fae9c0ceae0 2024-03-30T01:51:10.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.782+0000 7fae9a000640 1 -- 172.21.15.137:0/3568091015 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9402cc60 con 0x7fae9c0ceae0 2024-03-30T01:51:10.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.782+0000 7fae9a000640 1 -- 172.21.15.137:0/3568091015 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae940343f0 con 0x7fae9c0ceae0 2024-03-30T01:51:10.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.782+0000 7faea1000640 1 -- 172.21.15.137:0/3568091015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae9c0ceae0 msgr2=0x7fae9c0cef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:10.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.782+0000 7faea1000640 1 --2- 172.21.15.137:0/3568091015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae9c0ceae0 0x7fae9c0cef70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fae94009e50 tx=0x7fae9402bf60 comp rx=0 tx=0).stop 2024-03-30T01:51:10.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.782+0000 7faea1000640 1 -- 172.21.15.137:0/3568091015 shutdown_connections 2024-03-30T01:51:10.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.782+0000 7faea1000640 1 --2- 172.21.15.137:0/3568091015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae9c0ceae0 0x7fae9c0cef70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:10.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.782+0000 7faea1000640 1 --2- 172.21.15.137:0/3568091015 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae9c15abd0 0x7fae9c0cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:10.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.782+0000 7faea1000640 1 -- 172.21.15.137:0/3568091015 >> 172.21.15.137:0/3568091015 conn(0x7fae9c0d0690 msgr2=0x7fae9c0d0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:10.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.783+0000 7faea1000640 1 -- 172.21.15.137:0/3568091015 shutdown_connections 2024-03-30T01:51:10.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.783+0000 7faea1000640 1 -- 172.21.15.137:0/3568091015 wait complete. 2024-03-30T01:51:10.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.784+0000 7faea1000640 1 Processor -- start 2024-03-30T01:51:10.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.784+0000 7faea1000640 1 -- start start 2024-03-30T01:51:10.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.785+0000 7faea1000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae9c099b70 0x7fae9c1f1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:10.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.785+0000 7faea1000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae9c0ceae0 0x7fae9c0c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:10.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.785+0000 7faea1000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae9c15abd0 0x7fae9c0b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:10.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.785+0000 7faea1000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c06b800 con 0x7fae9c0ceae0 2024-03-30T01:51:10.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.785+0000 7faea1000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c1555e0 con 0x7fae9c099b70 2024-03-30T01:51:10.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.785+0000 7faea1000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c06ba50 con 0x7fae9c15abd0 2024-03-30T01:51:10.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.785+0000 7fae9b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae9c099b70 0x7fae9c1f1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:10.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.786+0000 7fae9b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae9c099b70 0x7fae9c1f1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48668/0 (socket says 172.21.15.137:48668) 2024-03-30T01:51:10.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.786+0000 7fae9b400640 1 -- 172.21.15.137:0/3599608456 learned_addr learned my addr 172.21.15.137:0/3599608456 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-03-30T01:51:10.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.786+0000 7fae9be00640 1 --2- 172.21.15.137:0/3599608456 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae9c15abd0 0x7fae9c0b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:10.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.786+0000 7fae9aa00640 1 --2- 172.21.15.137:0/3599608456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae9c0ceae0 0x7fae9c0c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:10.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.786+0000 7fae9b400640 1 -- 172.21.15.137:0/3599608456 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae9c15abd0 msgr2=0x7fae9c0b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:10.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.786+0000 7fae9b400640 1 --2- 172.21.15.137:0/3599608456 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae9c15abd0 0x7fae9c0b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:10.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.786+0000 7fae9b400640 1 -- 172.21.15.137:0/3599608456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae9c0ceae0 msgr2=0x7fae9c0c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:10.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.786+0000 7fae9b400640 1 --2- 172.21.15.137:0/3599608456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae9c0ceae0 0x7fae9c0c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:10.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.786+0000 7fae9b400640 1 -- 172.21.15.137:0/3599608456 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae94009b30 con 0x7fae9c099b70 2024-03-30T01:51:10.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.786+0000 7fae9b400640 1 --2- 172.21.15.137:0/3599608456 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae9c099b70 0x7fae9c1f1e90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fae8c00e870 tx=0x7fae8c00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:10.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.787+0000 7fae93400640 1 -- 172.21.15.137:0/3599608456 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c0094f0 con 0x7fae9c099b70 2024-03-30T01:51:10.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.787+0000 7fae93400640 1 -- 172.21.15.137:0/3599608456 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8c00c940 con 0x7fae9c099b70 2024-03-30T01:51:10.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.787+0000 7fae93400640 1 -- 172.21.15.137:0/3599608456 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c00ccf0 con 0x7fae9c099b70 2024-03-30T01:51:10.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.787+0000 7faea1000640 1 -- 172.21.15.137:0/3599608456 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae9c06bd30 con 0x7fae9c099b70 2024-03-30T01:51:10.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.787+0000 7faea1000640 1 -- 172.21.15.137:0/3599608456 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae9c06c2f0 con 0x7fae9c099b70 2024-03-30T01:51:10.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.787+0000 7fae93400640 1 -- 172.21.15.137:0/3599608456 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fae8c005c90 con 0x7fae9c099b70 2024-03-30T01:51:10.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.787+0000 7fae93400640 1 -- 172.21.15.137:0/3599608456 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fae8c0067f0 con 0x7fae9c099b70 2024-03-30T01:51:10.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.788+0000 7faea1000640 1 -- 172.21.15.137:0/3599608456 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae9c15e200 con 0x7fae9c099b70 2024-03-30T01:51:10.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.790+0000 7fae93400640 1 -- 172.21.15.137:0/3599608456 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fae8c021060 con 0x7fae9c099b70 2024-03-30T01:51:10.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.868+0000 7faea1000640 1 -- 172.21.15.137:0/3599608456 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a0f82433-f2da-46c6-a3a9-4f85d761cb2c", "id": 3} v 0) v1 -- 0x7fae9c0705e0 con 0x7fae9c099b70 2024-03-30T01:51:10.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.878+0000 7fae93400640 1 -- 172.21.15.137:0/3599608456 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a0f82433-f2da-46c6-a3a9-4f85d761cb2c", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fae8c017070 con 0x7fae9c099b70 2024-03-30T01:51:10.884 INFO:teuthology.orchestra.run.smithi137.stdout:3 2024-03-30T01:51:10.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.880+0000 7faea1000640 1 -- 172.21.15.137:0/3599608456 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae9c099b70 msgr2=0x7fae9c1f1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:10.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.880+0000 7faea1000640 1 --2- 172.21.15.137:0/3599608456 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae9c099b70 0x7fae9c1f1e90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fae8c00e870 tx=0x7fae8c00ed30 comp rx=0 tx=0).stop 2024-03-30T01:51:10.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.880+0000 7faea1000640 1 -- 172.21.15.137:0/3599608456 shutdown_connections 2024-03-30T01:51:10.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.880+0000 7faea1000640 1 --2- 172.21.15.137:0/3599608456 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae9c15abd0 0x7fae9c0b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:10.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.880+0000 7faea1000640 1 --2- 172.21.15.137:0/3599608456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae9c0ceae0 0x7fae9c0c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:10.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.880+0000 7faea1000640 1 --2- 172.21.15.137:0/3599608456 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae9c099b70 0x7fae9c1f1e90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:10.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.880+0000 7faea1000640 1 -- 172.21.15.137:0/3599608456 >> 172.21.15.137:0/3599608456 conn(0x7fae9c0d0690 msgr2=0x7fae9c06f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:10.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.880+0000 7faea1000640 1 -- 172.21.15.137:0/3599608456 shutdown_connections 2024-03-30T01:51:10.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:10.880+0000 7faea1000640 1 -- 172.21.15.137:0/3599608456 wait complete. 2024-03-30T01:51:10.902 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87 4 2024-03-30T01:51:11.027 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:11.021+0000 7faae0841040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T01:51:11.099 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:11.094+0000 7f3769e11040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T01:51:11.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.128+0000 7f4de8a00640 1 Processor -- start 2024-03-30T01:51:11.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.128+0000 7f4de8a00640 1 -- start start 2024-03-30T01:51:11.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.130+0000 7f4de8a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4de415c9f0 0x7f4de40b83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:11.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.130+0000 7f4de8a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4de40b4a00 0x7f4de40b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:11.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.130+0000 7f4de8a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de40d1340 con 0x7f4de40d0bd0 2024-03-30T01:51:11.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.130+0000 7f4de8a00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de40d1620 con 0x7f4de40b4a00 2024-03-30T01:51:11.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.130+0000 7f4de8a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de40d1900 con 0x7f4de415c9f0 2024-03-30T01:51:11.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.130+0000 7f4ddbe00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4de40d0bd0 0x7f4de40b42f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58610/0 (socket says 172.21.15.137:58610) 2024-03-30T01:51:11.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.130+0000 7f4ddbe00640 1 -- 172.21.15.137:0/1269348417 learned_addr learned my addr 172.21.15.137:0/1269348417 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-03-30T01:51:11.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.130+0000 7f4de3400640 1 --2- 172.21.15.137:0/1269348417 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4de415c9f0 0x7f4de40b83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:11.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.130+0000 7f4de3e00640 1 --2- 172.21.15.137:0/1269348417 >> v2:172.21.15.133:3300/0 conn(0x7f4de40b4a00 0x7f4de40b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:11.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.131+0000 7f4de2a00640 1 -- 172.21.15.137:0/1269348417 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960424240 0 0) 0x7f4de40d1340 con 0x7f4de40d0bd0 2024-03-30T01:51:11.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.131+0000 7f4de2a00640 1 -- 172.21.15.137:0/1269348417 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dc8003520 con 0x7f4de40d0bd0 2024-03-30T01:51:11.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.131+0000 7f4de3400640 1 -- 172.21.15.137:0/1269348417 >> v2:172.21.15.133:3300/0 conn(0x7f4de40b4a00 msgr2=0x7f4de40b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:11.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.131+0000 7f4de3400640 1 --2- 172.21.15.137:0/1269348417 >> v2:172.21.15.133:3300/0 conn(0x7f4de40b4a00 0x7f4de40b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.131+0000 7f4de3400640 1 -- 172.21.15.137:0/1269348417 >> v1:172.21.15.137:6789/0 conn(0x7f4de40d0bd0 legacy=0x7f4de40b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:11.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.131+0000 7f4de3400640 1 -- 172.21.15.137:0/1269348417 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de40d1be0 con 0x7f4de415c9f0 2024-03-30T01:51:11.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.132+0000 7f4de3400640 1 --2- 172.21.15.137:0/1269348417 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4de415c9f0 0x7f4de40b83c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40097a0 tx=0x7f4dd402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9935fa7068c45eb8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:11.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.132+0000 7f4de2a00640 1 -- 172.21.15.137:0/1269348417 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4031830 con 0x7f4de415c9f0 2024-03-30T01:51:11.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.132+0000 7f4de2a00640 1 -- 172.21.15.137:0/1269348417 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd4031990 con 0x7f4de415c9f0 2024-03-30T01:51:11.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.132+0000 7f4de2a00640 1 -- 172.21.15.137:0/1269348417 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4031d20 con 0x7f4de415c9f0 2024-03-30T01:51:11.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.133+0000 7f4de8a00640 1 -- 172.21.15.137:0/1269348417 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4de415c9f0 msgr2=0x7f4de40b83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:11.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.133+0000 7f4de8a00640 1 --2- 172.21.15.137:0/1269348417 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4de415c9f0 0x7f4de40b83c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40097a0 tx=0x7f4dd402b8d0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.133+0000 7f4de8a00640 1 -- 172.21.15.137:0/1269348417 shutdown_connections 2024-03-30T01:51:11.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.133+0000 7f4de8a00640 1 --2- 172.21.15.137:0/1269348417 >> v2:172.21.15.133:3300/0 conn(0x7f4de40b4a00 0x7f4de40b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.133+0000 7f4de8a00640 1 --2- 172.21.15.137:0/1269348417 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4de415c9f0 0x7f4de40b83c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.133+0000 7f4de8a00640 1 -- 172.21.15.137:0/1269348417 >> 172.21.15.137:0/1269348417 conn(0x7f4de4071a40 msgr2=0x7f4de40cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:11.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.133+0000 7f4de8a00640 1 -- 172.21.15.137:0/1269348417 shutdown_connections 2024-03-30T01:51:11.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.133+0000 7f4de8a00640 1 -- 172.21.15.137:0/1269348417 wait complete. 2024-03-30T01:51:11.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.135+0000 7f4de8a00640 1 Processor -- start 2024-03-30T01:51:11.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.135+0000 7f4de8a00640 1 -- start start 2024-03-30T01:51:11.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.136+0000 7f4de8a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4de40b4a00 0x7f4de41473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:11.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.136+0000 7f4de8a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4de40d0bd0 0x7f4de4155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:11.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.136+0000 7f4de8a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4de415c9f0 0x7f4de415f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:11.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.136+0000 7f4de8a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de415e8b0 con 0x7f4de40d0bd0 2024-03-30T01:51:11.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.136+0000 7f4de8a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de4147930 con 0x7f4de415c9f0 2024-03-30T01:51:11.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.136+0000 7f4de8a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de415ee50 con 0x7f4de40b4a00 2024-03-30T01:51:11.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.136+0000 7f4de3400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4de40b4a00 0x7f4de41473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:11.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.136+0000 7f4de3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4de415c9f0 0x7f4de415f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:11.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.136+0000 7f4de3400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4de40b4a00 0x7f4de41473f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:41192/0 (socket says 172.21.15.137:41192) 2024-03-30T01:51:11.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.136+0000 7f4de3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4de415c9f0 0x7f4de415f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52184/0 (socket says 172.21.15.137:52184) 2024-03-30T01:51:11.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.136+0000 7f4de3400640 1 -- 172.21.15.137:0/2252682808 learned_addr learned my addr 172.21.15.137:0/2252682808 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-03-30T01:51:11.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.136+0000 7f4ddbe00640 1 --2- 172.21.15.137:0/2252682808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4de40d0bd0 0x7f4de4155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:11.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.136+0000 7f4de3e00640 1 -- 172.21.15.137:0/2252682808 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4de40b4a00 msgr2=0x7f4de41473f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:11.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.136+0000 7f4de3e00640 1 --2- 172.21.15.137:0/2252682808 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4de40b4a00 0x7f4de41473f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.136+0000 7f4de3e00640 1 -- 172.21.15.137:0/2252682808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4de40d0bd0 msgr2=0x7f4de4155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:11.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.136+0000 7f4de3e00640 1 --2- 172.21.15.137:0/2252682808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4de40d0bd0 0x7f4de4155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.136+0000 7f4de3e00640 1 -- 172.21.15.137:0/2252682808 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd4009400 con 0x7f4de415c9f0 2024-03-30T01:51:11.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.136+0000 7f4de3400640 1 --2- 172.21.15.137:0/2252682808 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4de40b4a00 0x7f4de41473f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T01:51:11.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.137+0000 7f4de3e00640 1 --2- 172.21.15.137:0/2252682808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4de415c9f0 0x7f4de415f2e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc007d90 tx=0x7f4ddc00e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:11.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.137+0000 7f4ddb400640 1 -- 172.21.15.137:0/2252682808 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc018070 con 0x7f4de415c9f0 2024-03-30T01:51:11.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.137+0000 7f4ddb400640 1 -- 172.21.15.137:0/2252682808 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ddc00edd0 con 0x7f4de415c9f0 2024-03-30T01:51:11.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.137+0000 7f4ddb400640 1 -- 172.21.15.137:0/2252682808 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc003bb0 con 0x7f4de415c9f0 2024-03-30T01:51:11.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.137+0000 7f4de8a00640 1 -- 172.21.15.137:0/2252682808 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de4158960 con 0x7f4de415c9f0 2024-03-30T01:51:11.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.137+0000 7f4de8a00640 1 -- 172.21.15.137:0/2252682808 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de4158f20 con 0x7f4de415c9f0 2024-03-30T01:51:11.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.137+0000 7f4ddb400640 1 -- 172.21.15.137:0/2252682808 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4ddc014720 con 0x7f4de415c9f0 2024-03-30T01:51:11.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.137+0000 7f4ddb400640 1 -- 172.21.15.137:0/2252682808 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f4ddc01d410 con 0x7f4de415c9f0 2024-03-30T01:51:11.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.138+0000 7f4de8a00640 1 -- 172.21.15.137:0/2252682808 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de415efc0 con 0x7f4de415c9f0 2024-03-30T01:51:11.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.141+0000 7f4ddb400640 1 -- 172.21.15.137:0/2252682808 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f4ddc0149d0 con 0x7f4de415c9f0 2024-03-30T01:51:11.189 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:11.184+0000 7faae0841040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T01:51:11.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.218+0000 7f4de8a00640 1 -- 172.21.15.137:0/2252682808 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87", "id": 4} v 0) v1 -- 0x7f4de4073750 con 0x7f4de415c9f0 2024-03-30T01:51:11.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.228+0000 7f4ddb400640 1 -- 172.21.15.137:0/2252682808 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4ddc014c10 con 0x7f4de415c9f0 2024-03-30T01:51:11.234 INFO:teuthology.orchestra.run.smithi137.stdout:4 2024-03-30T01:51:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.229+0000 7f4de8a00640 1 -- 172.21.15.137:0/2252682808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4de415c9f0 msgr2=0x7f4de415f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.229+0000 7f4de8a00640 1 --2- 172.21.15.137:0/2252682808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4de415c9f0 0x7f4de415f2e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc007d90 tx=0x7f4ddc00e4b0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.229+0000 7f4de8a00640 1 -- 172.21.15.137:0/2252682808 shutdown_connections 2024-03-30T01:51:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.229+0000 7f4de8a00640 1 --2- 172.21.15.137:0/2252682808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4de415c9f0 0x7f4de415f2e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.229+0000 7f4de8a00640 1 --2- 172.21.15.137:0/2252682808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4de40d0bd0 0x7f4de4155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.229+0000 7f4de8a00640 1 --2- 172.21.15.137:0/2252682808 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4de40b4a00 0x7f4de41473f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.229+0000 7f4de8a00640 1 -- 172.21.15.137:0/2252682808 >> 172.21.15.137:0/2252682808 conn(0x7f4de4071a40 msgr2=0x7f4de40b2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.230+0000 7f4de8a00640 1 -- 172.21.15.137:0/2252682808 shutdown_connections 2024-03-30T01:51:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.230+0000 7f4de8a00640 1 -- 172.21.15.137:0/2252682808 wait complete. 2024-03-30T01:51:11.252 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 3f1644b8-2f85-4eef-a63d-1c601164035d 5 2024-03-30T01:51:11.269 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:11.264+0000 7f3769e11040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T01:51:11.325 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:11.320+0000 7faae0841040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T01:51:11.378 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:11.372+0000 7faae0841040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T01:51:11.411 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:11.405+0000 7f3769e11040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T01:51:11.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.441+0000 7f9ff2000640 1 Processor -- start 2024-03-30T01:51:11.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.441+0000 7f9ff2000640 1 -- start start 2024-03-30T01:51:11.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.442+0000 7f9ff2000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9fec15aa50 0x7f9fec0cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:11.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.442+0000 7f9ff2000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9fec098b80 0x7f9fec0998b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:11.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.442+0000 7f9ff2000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fec09a240 con 0x7f9fec099df0 2024-03-30T01:51:11.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.442+0000 7f9ff2000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fec06ed40 con 0x7f9fec098b80 2024-03-30T01:51:11.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.442+0000 7f9ff2000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fec099010 con 0x7f9fec15aa50 2024-03-30T01:51:11.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.443+0000 7f9feb400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9fec15aa50 0x7f9fec0cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:11.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.443+0000 7f9feb400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9fec15aa50 0x7f9fec0cf270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52196/0 (socket says 172.21.15.137:52196) 2024-03-30T01:51:11.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.443+0000 7f9feb400640 1 -- 172.21.15.137:0/3308700943 learned_addr learned my addr 172.21.15.137:0/3308700943 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-03-30T01:51:11.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.443+0000 7f9febe00640 1 --1- 172.21.15.137:0/3308700943 >> v1:172.21.15.137:6789/0 conn(0x7f9fec099df0 0x7f9fec0cb310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58620/0 (socket says 172.21.15.137:58620) 2024-03-30T01:51:11.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.443+0000 7f9feaa00640 1 --2- 172.21.15.137:0/3308700943 >> v2:172.21.15.133:3300/0 conn(0x7f9fec098b80 0x7f9fec0998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:11.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.443+0000 7f9feb400640 1 -- 172.21.15.137:0/3308700943 >> v2:172.21.15.133:3300/0 conn(0x7f9fec098b80 msgr2=0x7f9fec0998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:11.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.443+0000 7f9feb400640 1 --2- 172.21.15.137:0/3308700943 >> v2:172.21.15.133:3300/0 conn(0x7f9fec098b80 0x7f9fec0998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.443+0000 7f9feb400640 1 -- 172.21.15.137:0/3308700943 >> v1:172.21.15.137:6789/0 conn(0x7f9fec099df0 legacy=0x7f9fec0cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:11.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.443+0000 7f9feb400640 1 -- 172.21.15.137:0/3308700943 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec099280 con 0x7f9fec15aa50 2024-03-30T01:51:11.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.443+0000 7f9fea000640 1 -- 172.21.15.137:0/3308700943 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128163851 0 0) 0x7f9fe4001490 con 0x7f9fec099df0 2024-03-30T01:51:11.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.444+0000 7f9feb400640 1 --2- 172.21.15.137:0/3308700943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fec15aa50 0x7f9fec0cf270 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9fec066aa0 tx=0x7f9fdc02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da522470a467cc19 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:11.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.444+0000 7f9fea000640 1 -- 172.21.15.137:0/3308700943 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc030860 con 0x7f9fec15aa50 2024-03-30T01:51:11.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.445+0000 7f9fea000640 1 -- 172.21.15.137:0/3308700943 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc0309c0 con 0x7f9fec15aa50 2024-03-30T01:51:11.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.445+0000 7f9fea000640 1 -- 172.21.15.137:0/3308700943 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc030d50 con 0x7f9fec15aa50 2024-03-30T01:51:11.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.445+0000 7f9ff2000640 1 -- 172.21.15.137:0/3308700943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fec15aa50 msgr2=0x7f9fec0cf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:11.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.445+0000 7f9ff2000640 1 --2- 172.21.15.137:0/3308700943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fec15aa50 0x7f9fec0cf270 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9fec066aa0 tx=0x7f9fdc02b9a0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.445+0000 7f9ff2000640 1 -- 172.21.15.137:0/3308700943 shutdown_connections 2024-03-30T01:51:11.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.445+0000 7f9ff2000640 1 --2- 172.21.15.137:0/3308700943 >> v2:172.21.15.133:3300/0 conn(0x7f9fec098b80 0x7f9fec0998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.445+0000 7f9ff2000640 1 --2- 172.21.15.137:0/3308700943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fec15aa50 0x7f9fec0cf270 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.445+0000 7f9ff2000640 1 -- 172.21.15.137:0/3308700943 >> 172.21.15.137:0/3308700943 conn(0x7f9fec0b2330 msgr2=0x7f9fec0b2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:11.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.445+0000 7f9ff2000640 1 -- 172.21.15.137:0/3308700943 shutdown_connections 2024-03-30T01:51:11.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.445+0000 7f9ff2000640 1 -- 172.21.15.137:0/3308700943 wait complete. 2024-03-30T01:51:11.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.447+0000 7f9ff2000640 1 Processor -- start 2024-03-30T01:51:11.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.447+0000 7f9ff2000640 1 -- start start 2024-03-30T01:51:11.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.448+0000 7f9ff2000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fec098b80 0x7f9fec0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:11.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.448+0000 7f9ff2000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fec099df0 0x7f9fec0b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:11.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.448+0000 7f9ff2000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fec15aa50 0x7f9fec0b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:11.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.448+0000 7f9ff2000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec0b6370 con 0x7f9fec15aa50 2024-03-30T01:51:11.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.448+0000 7f9ff2000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec15b010 con 0x7f9fec099df0 2024-03-30T01:51:11.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.448+0000 7f9ff2000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec0c85d0 con 0x7f9fec098b80 2024-03-30T01:51:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.448+0000 7f9feb400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fec098b80 0x7f9fec0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.448+0000 7f9feaa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fec099df0 0x7f9fec0b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.448+0000 7f9feaa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fec099df0 0x7f9fec0b58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52204/0 (socket says 172.21.15.137:52204) 2024-03-30T01:51:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.448+0000 7f9feaa00640 1 -- 172.21.15.137:0/3252262112 learned_addr learned my addr 172.21.15.137:0/3252262112 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-03-30T01:51:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.448+0000 7f9feb400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fec098b80 0x7f9fec0b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:41198/0 (socket says 172.21.15.137:41198) 2024-03-30T01:51:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.448+0000 7f9febe00640 1 --2- 172.21.15.137:0/3252262112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fec15aa50 0x7f9fec0b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.449+0000 7f9feaa00640 1 -- 172.21.15.137:0/3252262112 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fec098b80 msgr2=0x7f9fec0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.449+0000 7f9feaa00640 1 --2- 172.21.15.137:0/3252262112 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fec098b80 0x7f9fec0b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.449+0000 7f9feaa00640 1 -- 172.21.15.137:0/3252262112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fec15aa50 msgr2=0x7f9fec0b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.449+0000 7f9feaa00640 1 --2- 172.21.15.137:0/3252262112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fec15aa50 0x7f9fec0b5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.449+0000 7f9feaa00640 1 -- 172.21.15.137:0/3252262112 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fdc0094d0 con 0x7f9fec099df0 2024-03-30T01:51:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.449+0000 7f9feb400640 1 --2- 172.21.15.137:0/3252262112 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fec098b80 0x7f9fec0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T01:51:11.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.449+0000 7f9feaa00640 1 --2- 172.21.15.137:0/3252262112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fec099df0 0x7f9fec0b58f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800d5f0 tx=0x7f9fd800dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:11.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.449+0000 7f9fe3400640 1 -- 172.21.15.137:0/3252262112 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd80125f0 con 0x7f9fec099df0 2024-03-30T01:51:11.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.449+0000 7f9fe3400640 1 -- 172.21.15.137:0/3252262112 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd8012750 con 0x7f9fec099df0 2024-03-30T01:51:11.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.449+0000 7f9fe3400640 1 -- 172.21.15.137:0/3252262112 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8012b00 con 0x7f9fec099df0 2024-03-30T01:51:11.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.449+0000 7f9ff2000640 1 -- 172.21.15.137:0/3252262112 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fec0c88b0 con 0x7f9fec099df0 2024-03-30T01:51:11.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.449+0000 7f9ff2000640 1 -- 172.21.15.137:0/3252262112 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fec0c8e70 con 0x7f9fec099df0 2024-03-30T01:51:11.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.450+0000 7f9fe3400640 1 -- 172.21.15.137:0/3252262112 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9fd801e460 con 0x7f9fec099df0 2024-03-30T01:51:11.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.450+0000 7f9fe3400640 1 -- 172.21.15.137:0/3252262112 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f9fd801ec90 con 0x7f9fec099df0 2024-03-30T01:51:11.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.450+0000 7f9ff2000640 1 -- 172.21.15.137:0/3252262112 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fec066d80 con 0x7f9fec099df0 2024-03-30T01:51:11.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.453+0000 7f9fe3400640 1 -- 172.21.15.137:0/3252262112 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f9fd801e710 con 0x7f9fec099df0 2024-03-30T01:51:11.469 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:11.463+0000 7f3769e11040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T01:51:11.503 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:11.498+0000 7faae0841040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T01:51:11.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.530+0000 7f9ff2000640 1 -- 172.21.15.137:0/3252262112 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3f1644b8-2f85-4eef-a63d-1c601164035d", "id": 5} v 0) v1 -- 0x7f9fec06ff70 con 0x7f9fec099df0 2024-03-30T01:51:11.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.540+0000 7f9fe3400640 1 -- 172.21.15.137:0/3252262112 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3f1644b8-2f85-4eef-a63d-1c601164035d", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9fd801e9e0 con 0x7f9fec099df0 2024-03-30T01:51:11.545 INFO:teuthology.orchestra.run.smithi137.stdout:5 2024-03-30T01:51:11.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.541+0000 7f9ff2000640 1 -- 172.21.15.137:0/3252262112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fec099df0 msgr2=0x7f9fec0b58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:11.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.541+0000 7f9ff2000640 1 --2- 172.21.15.137:0/3252262112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fec099df0 0x7f9fec0b58f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800d5f0 tx=0x7f9fd800dab0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.541+0000 7f9ff2000640 1 -- 172.21.15.137:0/3252262112 shutdown_connections 2024-03-30T01:51:11.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.541+0000 7f9ff2000640 1 --2- 172.21.15.137:0/3252262112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fec15aa50 0x7f9fec0b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.541+0000 7f9ff2000640 1 --2- 172.21.15.137:0/3252262112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fec099df0 0x7f9fec0b58f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.541+0000 7f9ff2000640 1 --2- 172.21.15.137:0/3252262112 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fec098b80 0x7f9fec0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.541+0000 7f9ff2000640 1 -- 172.21.15.137:0/3252262112 >> 172.21.15.137:0/3252262112 conn(0x7f9fec0b2330 msgr2=0x7f9fec072ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:11.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.541+0000 7f9ff2000640 1 -- 172.21.15.137:0/3252262112 shutdown_connections 2024-03-30T01:51:11.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.541+0000 7f9ff2000640 1 -- 172.21.15.137:0/3252262112 wait complete. 2024-03-30T01:51:11.563 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 593d11b1-b9a9-47f8-a924-71c490ed34f5 6 2024-03-30T01:51:11.601 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:11.595+0000 7f3769e11040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T01:51:11.614 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:11.608+0000 7faae0841040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T01:51:11.719 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:11.713+0000 7f3769e11040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T01:51:11.789 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:11.784+0000 7faae0841040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T01:51:11.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.785+0000 7f3355a00640 1 Processor -- start 2024-03-30T01:51:11.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.785+0000 7f3355a00640 1 -- start start 2024-03-30T01:51:11.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.787+0000 7f3355a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f335015cf90 0x7f33500ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:11.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.787+0000 7f3355a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33500cfca0 0x7f33500b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:11.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.787+0000 7f3355a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33500d15d0 con 0x7f33500d1010 2024-03-30T01:51:11.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.787+0000 7f3355a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33500d18b0 con 0x7f335015cf90 2024-03-30T01:51:11.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.787+0000 7f3355a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33500d1b90 con 0x7f33500cfca0 2024-03-30T01:51:11.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.787+0000 7f334ea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f335015cf90 0x7f33500ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:11.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.787+0000 7f334f400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33500cfca0 0x7f33500b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:11.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.787+0000 7f334ea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f335015cf90 0x7f33500ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52218/0 (socket says 172.21.15.137:52218) 2024-03-30T01:51:11.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.787+0000 7f3347e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f33500d1010 0x7f33500cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58626/0 (socket says 172.21.15.137:58626) 2024-03-30T01:51:11.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.787+0000 7f334ea00640 1 -- 172.21.15.137:0/900730035 learned_addr learned my addr 172.21.15.137:0/900730035 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-03-30T01:51:11.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.787+0000 7f334f400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33500cfca0 0x7f33500b63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:41204/0 (socket says 172.21.15.137:41204) 2024-03-30T01:51:11.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.788+0000 7f334ea00640 1 -- 172.21.15.137:0/900730035 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33500cfca0 msgr2=0x7f33500b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:11.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.788+0000 7f334ea00640 1 --2- 172.21.15.137:0/900730035 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33500cfca0 0x7f33500b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.788+0000 7f334ea00640 1 -- 172.21.15.137:0/900730035 >> v1:172.21.15.137:6789/0 conn(0x7f33500d1010 legacy=0x7f33500cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:11.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.788+0000 7f334ea00640 1 -- 172.21.15.137:0/900730035 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33500d1e70 con 0x7f335015cf90 2024-03-30T01:51:11.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.788+0000 7f334e000640 1 -- 172.21.15.137:0/900730035 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 252495076 0 0) 0x7f33500d15d0 con 0x7f33500d1010 2024-03-30T01:51:11.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.789+0000 7f334ea00640 1 --2- 172.21.15.137:0/900730035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f335015cf90 0x7f33500ce160 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3340009870 tx=0x7f334002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e7551e496d3a528 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:11.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.790+0000 7f334e000640 1 -- 172.21.15.137:0/900730035 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3340031640 con 0x7f335015cf90 2024-03-30T01:51:11.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.790+0000 7f334e000640 1 -- 172.21.15.137:0/900730035 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33400317a0 con 0x7f335015cf90 2024-03-30T01:51:11.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.790+0000 7f334e000640 1 -- 172.21.15.137:0/900730035 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3340031b30 con 0x7f335015cf90 2024-03-30T01:51:11.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.790+0000 7f3355a00640 1 -- 172.21.15.137:0/900730035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f335015cf90 msgr2=0x7f33500ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:11.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.790+0000 7f3355a00640 1 --2- 172.21.15.137:0/900730035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f335015cf90 0x7f33500ce160 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3340009870 tx=0x7f334002b8f0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.791+0000 7f3355a00640 1 -- 172.21.15.137:0/900730035 shutdown_connections 2024-03-30T01:51:11.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.791+0000 7f3355a00640 1 --2- 172.21.15.137:0/900730035 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33500cfca0 0x7f33500b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.791+0000 7f3355a00640 1 --2- 172.21.15.137:0/900730035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f335015cf90 0x7f33500ce160 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.791+0000 7f3355a00640 1 -- 172.21.15.137:0/900730035 >> 172.21.15.137:0/900730035 conn(0x7f3350071a40 msgr2=0x7f335006b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:11.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.791+0000 7f3355a00640 1 -- 172.21.15.137:0/900730035 shutdown_connections 2024-03-30T01:51:11.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.791+0000 7f3355a00640 1 -- 172.21.15.137:0/900730035 wait complete. 2024-03-30T01:51:11.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.792+0000 7f3355a00640 1 Processor -- start 2024-03-30T01:51:11.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.792+0000 7f3355a00640 1 -- start start 2024-03-30T01:51:11.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.793+0000 7f3355a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33500cfca0 0x7f3350150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:11.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.793+0000 7f3355a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33500d1010 0x7f33500c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:11.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.793+0000 7f3355a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f335015cf90 0x7f33500c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:11.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.793+0000 7f3355a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3350158da0 con 0x7f33500cfca0 2024-03-30T01:51:11.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.793+0000 7f3355a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33500b2090 con 0x7f335015cf90 2024-03-30T01:51:11.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.793+0000 7f3355a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33500b22e0 con 0x7f33500d1010 2024-03-30T01:51:11.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.793+0000 7f3347e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33500d1010 0x7f33500c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:11.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.794+0000 7f334f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f335015cf90 0x7f33500c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:11.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.794+0000 7f3347e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33500d1010 0x7f33500c78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:41218/0 (socket says 172.21.15.137:41218) 2024-03-30T01:51:11.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.794+0000 7f3347e00640 1 -- 172.21.15.137:0/2089155262 learned_addr learned my addr 172.21.15.137:0/2089155262 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-03-30T01:51:11.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.794+0000 7f334ea00640 1 --2- 172.21.15.137:0/2089155262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33500cfca0 0x7f3350150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:11.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.794+0000 7f3347e00640 1 -- 172.21.15.137:0/2089155262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f335015cf90 msgr2=0x7f33500c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:11.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.794+0000 7f3347e00640 1 --2- 172.21.15.137:0/2089155262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f335015cf90 0x7f33500c7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.794+0000 7f3347e00640 1 -- 172.21.15.137:0/2089155262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33500cfca0 msgr2=0x7f3350150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:11.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.794+0000 7f3347e00640 1 --2- 172.21.15.137:0/2089155262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33500cfca0 0x7f3350150180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.794+0000 7f3347e00640 1 -- 172.21.15.137:0/2089155262 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33400094d0 con 0x7f33500d1010 2024-03-30T01:51:11.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.794+0000 7f334f400640 1 --2- 172.21.15.137:0/2089155262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f335015cf90 0x7f33500c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T01:51:11.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.794+0000 7f334ea00640 1 --2- 172.21.15.137:0/2089155262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33500cfca0 0x7f3350150180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:11.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.794+0000 7f3347e00640 1 --2- 172.21.15.137:0/2089155262 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33500d1010 0x7f33500c78f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f333800c4b0 tx=0x7f333800c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:11.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.794+0000 7f3346a00640 1 -- 172.21.15.137:0/2089155262 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338007480 con 0x7f33500d1010 2024-03-30T01:51:11.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.794+0000 7f3346a00640 1 -- 172.21.15.137:0/2089155262 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33380075e0 con 0x7f33500d1010 2024-03-30T01:51:11.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.794+0000 7f3355a00640 1 -- 172.21.15.137:0/2089155262 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33500b25c0 con 0x7f33500d1010 2024-03-30T01:51:11.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.795+0000 7f3346a00640 1 -- 172.21.15.137:0/2089155262 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338004a20 con 0x7f33500d1010 2024-03-30T01:51:11.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.795+0000 7f3355a00640 1 -- 172.21.15.137:0/2089155262 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33500b2b80 con 0x7f33500d1010 2024-03-30T01:51:11.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.795+0000 7f3346a00640 1 -- 172.21.15.137:0/2089155262 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f333801d440 con 0x7f33500d1010 2024-03-30T01:51:11.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.795+0000 7f3346a00640 1 -- 172.21.15.137:0/2089155262 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f3338012a80 con 0x7f33500d1010 2024-03-30T01:51:11.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.796+0000 7f3355a00640 1 -- 172.21.15.137:0/2089155262 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3350066d80 con 0x7f33500d1010 2024-03-30T01:51:11.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.800+0000 7f3346a00640 1 -- 172.21.15.137:0/2089155262 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f3338018070 con 0x7f33500d1010 2024-03-30T01:51:11.838 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:11.833+0000 7faae0841040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T01:51:11.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.877+0000 7f3355a00640 1 -- 172.21.15.137:0/2089155262 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd new", "uuid": "593d11b1-b9a9-47f8-a924-71c490ed34f5", "id": 6} v 0) v1 -- 0x7f33500b6900 con 0x7f33500d1010 2024-03-30T01:51:11.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.887+0000 7f3346a00640 1 -- 172.21.15.137:0/2089155262 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "593d11b1-b9a9-47f8-a924-71c490ed34f5", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f33380125c0 con 0x7f33500d1010 2024-03-30T01:51:11.893 INFO:teuthology.orchestra.run.smithi137.stdout:6 2024-03-30T01:51:11.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.888+0000 7f3355a00640 1 -- 172.21.15.137:0/2089155262 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33500d1010 msgr2=0x7f33500c78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:11.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.888+0000 7f3355a00640 1 --2- 172.21.15.137:0/2089155262 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33500d1010 0x7f33500c78f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f333800c4b0 tx=0x7f333800c970 comp rx=0 tx=0).stop 2024-03-30T01:51:11.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.889+0000 7f3355a00640 1 -- 172.21.15.137:0/2089155262 shutdown_connections 2024-03-30T01:51:11.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.889+0000 7f3355a00640 1 --2- 172.21.15.137:0/2089155262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f335015cf90 0x7f33500c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.889+0000 7f3355a00640 1 --2- 172.21.15.137:0/2089155262 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33500d1010 0x7f33500c78f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.889+0000 7f3355a00640 1 --2- 172.21.15.137:0/2089155262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33500cfca0 0x7f3350150180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:11.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.889+0000 7f3355a00640 1 -- 172.21.15.137:0/2089155262 >> 172.21.15.137:0/2089155262 conn(0x7f3350071a40 msgr2=0x7f33500c8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:11.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.889+0000 7f3355a00640 1 -- 172.21.15.137:0/2089155262 shutdown_connections 2024-03-30T01:51:11.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:11.889+0000 7f3355a00640 1 -- 172.21.15.137:0/2089155262 wait complete. 2024-03-30T01:51:11.907 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:11.901+0000 7f3769e11040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T01:51:11.911 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new deea6cf8-0323-4aec-b27e-340cada83562 7 2024-03-30T01:51:11.963 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:11.957+0000 7f3769e11040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T01:51:12.011 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:12.005+0000 7faae0841040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T01:51:12.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.099+0000 7fb0bea00640 1 Processor -- start 2024-03-30T01:51:12.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.099+0000 7fb0bea00640 1 -- start start 2024-03-30T01:51:12.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.101+0000 7fb0bea00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb0b8159730 0x7fb0b80adc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:12.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.101+0000 7fb0bea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0b8159b10 0x7fb0b80ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:12.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.101+0000 7fb0bea00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b80ad000 con 0x7fb0b80b32c0 2024-03-30T01:51:12.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.101+0000 7fb0bea00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b80ae7f0 con 0x7fb0b8159730 2024-03-30T01:51:12.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.101+0000 7fb0bea00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b80aead0 con 0x7fb0b8159b10 2024-03-30T01:51:12.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.101+0000 7fb0bcc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0b8159b10 0x7fb0b80ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:12.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.101+0000 7fb0bcc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0b8159b10 0x7fb0b80ae190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:41220/0 (socket says 172.21.15.137:41220) 2024-03-30T01:51:12.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.101+0000 7fb0bcc00640 1 -- 172.21.15.137:0/1151288214 learned_addr learned my addr 172.21.15.137:0/1151288214 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-03-30T01:51:12.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.101+0000 7fb0bd600640 1 --2- 172.21.15.137:0/1151288214 >> v2:172.21.15.133:3300/0 conn(0x7fb0b8159730 0x7fb0b80adc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:12.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.102+0000 7fb0bcc00640 1 -- 172.21.15.137:0/1151288214 >> v2:172.21.15.133:3300/0 conn(0x7fb0b8159730 msgr2=0x7fb0b80adc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:12.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.102+0000 7fb0bcc00640 1 --2- 172.21.15.137:0/1151288214 >> v2:172.21.15.133:3300/0 conn(0x7fb0b8159730 0x7fb0b80adc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:12.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.102+0000 7fb0bcc00640 1 -- 172.21.15.137:0/1151288214 >> v1:172.21.15.137:6789/0 conn(0x7fb0b80b32c0 legacy=0x7fb0b815d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:12.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.102+0000 7fb0bcc00640 1 -- 172.21.15.137:0/1151288214 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b80af070 con 0x7fb0b8159b10 2024-03-30T01:51:12.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.102+0000 7fb0b7e00640 1 -- 172.21.15.137:0/1151288214 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749215494 0 0) 0x7fb0b80ad000 con 0x7fb0b80b32c0 2024-03-30T01:51:12.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.103+0000 7fb0bcc00640 1 --2- 172.21.15.137:0/1151288214 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0b8159b10 0x7fb0b80ae190 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4009870 tx=0x7fb0a402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4d892bc99b3a6ae server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:12.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.103+0000 7fb0b7e00640 1 -- 172.21.15.137:0/1151288214 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4030840 con 0x7fb0b8159b10 2024-03-30T01:51:12.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.103+0000 7fb0b7e00640 1 -- 172.21.15.137:0/1151288214 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a40309a0 con 0x7fb0b8159b10 2024-03-30T01:51:12.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.103+0000 7fb0b7e00640 1 -- 172.21.15.137:0/1151288214 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4030d30 con 0x7fb0b8159b10 2024-03-30T01:51:12.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.104+0000 7fb0bea00640 1 -- 172.21.15.137:0/1151288214 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0b8159b10 msgr2=0x7fb0b80ae190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:12.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.104+0000 7fb0bea00640 1 --2- 172.21.15.137:0/1151288214 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0b8159b10 0x7fb0b80ae190 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4009870 tx=0x7fb0a402b980 comp rx=0 tx=0).stop 2024-03-30T01:51:12.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.104+0000 7fb0bea00640 1 -- 172.21.15.137:0/1151288214 shutdown_connections 2024-03-30T01:51:12.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.104+0000 7fb0bea00640 1 --2- 172.21.15.137:0/1151288214 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0b8159b10 0x7fb0b80ae190 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:12.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.104+0000 7fb0bea00640 1 --2- 172.21.15.137:0/1151288214 >> v2:172.21.15.133:3300/0 conn(0x7fb0b8159730 0x7fb0b80adc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:12.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.104+0000 7fb0bea00640 1 -- 172.21.15.137:0/1151288214 >> 172.21.15.137:0/1151288214 conn(0x7fb0b80719b0 msgr2=0x7fb0b8098a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:12.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.104+0000 7fb0bea00640 1 -- 172.21.15.137:0/1151288214 shutdown_connections 2024-03-30T01:51:12.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.104+0000 7fb0bea00640 1 -- 172.21.15.137:0/1151288214 wait complete. 2024-03-30T01:51:12.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.105+0000 7fb0bea00640 1 Processor -- start 2024-03-30T01:51:12.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.106+0000 7fb0bea00640 1 -- start start 2024-03-30T01:51:12.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.106+0000 7fb0bea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0b80b32c0 0x7fb0b8143420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:12.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.106+0000 7fb0bea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0b8159730 0x7fb0b814a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:12.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.106+0000 7fb0bea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0b8159b10 0x7fb0b814acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:12.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.106+0000 7fb0bea00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b8159f10 con 0x7fb0b80b32c0 2024-03-30T01:51:12.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.106+0000 7fb0bea00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b81459c0 con 0x7fb0b8159730 2024-03-30T01:51:12.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.106+0000 7fb0bea00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b8145ca0 con 0x7fb0b8159b10 2024-03-30T01:51:12.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.107+0000 7fb0be000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0b8159b10 0x7fb0b814acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:12.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.107+0000 7fb0bcc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0b8159730 0x7fb0b814a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:12.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.107+0000 7fb0be000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0b8159b10 0x7fb0b814acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:41224/0 (socket says 172.21.15.137:41224) 2024-03-30T01:51:12.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.107+0000 7fb0be000640 1 -- 172.21.15.137:0/644974930 learned_addr learned my addr 172.21.15.137:0/644974930 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-03-30T01:51:12.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.107+0000 7fb0bcc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0b8159730 0x7fb0b814a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52242/0 (socket says 172.21.15.137:52242) 2024-03-30T01:51:12.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.107+0000 7fb0bd600640 1 --2- 172.21.15.137:0/644974930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0b80b32c0 0x7fb0b8143420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:12.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.107+0000 7fb0be000640 1 -- 172.21.15.137:0/644974930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0b8159730 msgr2=0x7fb0b814a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:12.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.107+0000 7fb0be000640 1 --2- 172.21.15.137:0/644974930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0b8159730 0x7fb0b814a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:12.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.107+0000 7fb0be000640 1 -- 172.21.15.137:0/644974930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0b80b32c0 msgr2=0x7fb0b8143420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:12.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.107+0000 7fb0be000640 1 --2- 172.21.15.137:0/644974930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0b80b32c0 0x7fb0b8143420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:12.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.107+0000 7fb0be000640 1 -- 172.21.15.137:0/644974930 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a40094d0 con 0x7fb0b8159b10 2024-03-30T01:51:12.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.107+0000 7fb0bd600640 1 --2- 172.21.15.137:0/644974930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0b80b32c0 0x7fb0b8143420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:51:12.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.107+0000 7fb0bcc00640 1 --2- 172.21.15.137:0/644974930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0b8159730 0x7fb0b814a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T01:51:12.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.108+0000 7fb0be000640 1 --2- 172.21.15.137:0/644974930 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0b8159b10 0x7fb0b814acc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000c760 tx=0x7fb0b000cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:12.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.108+0000 7fb0b5600640 1 -- 172.21.15.137:0/644974930 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0003da0 con 0x7fb0b8159b10 2024-03-30T01:51:12.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.108+0000 7fb0b5600640 1 -- 172.21.15.137:0/644974930 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b000ce70 con 0x7fb0b8159b10 2024-03-30T01:51:12.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.108+0000 7fb0b5600640 1 -- 172.21.15.137:0/644974930 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0005290 con 0x7fb0b8159b10 2024-03-30T01:51:12.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.108+0000 7fb0bea00640 1 -- 172.21.15.137:0/644974930 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b81473a0 con 0x7fb0b8159b10 2024-03-30T01:51:12.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.108+0000 7fb0bea00640 1 -- 172.21.15.137:0/644974930 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b8143960 con 0x7fb0b8159b10 2024-03-30T01:51:12.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.108+0000 7fb0b5600640 1 -- 172.21.15.137:0/644974930 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb0b00056f0 con 0x7fb0b8159b10 2024-03-30T01:51:12.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.108+0000 7fb0b5600640 1 -- 172.21.15.137:0/644974930 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fb0b001ba60 con 0x7fb0b8159b10 2024-03-30T01:51:12.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.109+0000 7fb0bea00640 1 -- 172.21.15.137:0/644974930 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b8147200 con 0x7fb0b8159b10 2024-03-30T01:51:12.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.111+0000 7fb0b5600640 1 -- 172.21.15.137:0/644974930 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fb0b8147200 con 0x7fb0b8159b10 2024-03-30T01:51:12.150 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:12.141+0000 7f3769e11040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T01:51:12.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.189+0000 7fb0bea00640 1 -- 172.21.15.137:0/644974930 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd new", "uuid": "deea6cf8-0323-4aec-b27e-340cada83562", "id": 7} v 0) v1 -- 0x7fb0b81478c0 con 0x7fb0b8159b10 2024-03-30T01:51:12.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.195+0000 7fb0b5600640 1 -- 172.21.15.137:0/644974930 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "deea6cf8-0323-4aec-b27e-340cada83562", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb0b81478c0 con 0x7fb0b8159b10 2024-03-30T01:51:12.202 INFO:teuthology.orchestra.run.smithi137.stdout:7 2024-03-30T01:51:12.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.196+0000 7fb0bea00640 1 -- 172.21.15.137:0/644974930 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0b8159b10 msgr2=0x7fb0b814acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:12.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.196+0000 7fb0bea00640 1 --2- 172.21.15.137:0/644974930 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0b8159b10 0x7fb0b814acc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000c760 tx=0x7fb0b000cc20 comp rx=0 tx=0).stop 2024-03-30T01:51:12.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.197+0000 7fb0bea00640 1 -- 172.21.15.137:0/644974930 shutdown_connections 2024-03-30T01:51:12.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.197+0000 7fb0bea00640 1 --2- 172.21.15.137:0/644974930 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0b8159b10 0x7fb0b814acc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:12.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.197+0000 7fb0bea00640 1 --2- 172.21.15.137:0/644974930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0b8159730 0x7fb0b814a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:12.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.197+0000 7fb0bea00640 1 --2- 172.21.15.137:0/644974930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0b80b32c0 0x7fb0b8143420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:12.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.197+0000 7fb0bea00640 1 -- 172.21.15.137:0/644974930 >> 172.21.15.137:0/644974930 conn(0x7fb0b80719b0 msgr2=0x7fb0b80b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:12.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.197+0000 7fb0bea00640 1 -- 172.21.15.137:0/644974930 shutdown_connections 2024-03-30T01:51:12.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-30T01:51:12.197+0000 7fb0bea00640 1 -- 172.21.15.137:0/644974930 wait complete. 2024-03-30T01:51:12.218 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-30T01:51:12.219 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-30T01:51:12.226 INFO:tasks.ceph.osd.0:Started 2024-03-30T01:51:12.226 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-30T01:51:12.227 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-30T01:51:12.233 INFO:tasks.ceph.osd.1:Started 2024-03-30T01:51:12.233 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-30T01:51:12.234 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-30T01:51:12.238 INFO:tasks.ceph.osd.2:Started 2024-03-30T01:51:12.238 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-30T01:51:12.238 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-30T01:51:12.243 INFO:tasks.ceph.osd.3:Started 2024-03-30T01:51:12.243 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-30T01:51:12.243 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-30T01:51:12.250 INFO:tasks.ceph.osd.4:Started 2024-03-30T01:51:12.251 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-30T01:51:12.251 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-30T01:51:12.257 INFO:tasks.ceph.osd.5:Started 2024-03-30T01:51:12.257 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-30T01:51:12.257 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-30T01:51:12.264 INFO:tasks.ceph.osd.6:Started 2024-03-30T01:51:12.264 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-30T01:51:12.264 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-30T01:51:12.269 INFO:tasks.ceph.osd.7:Started 2024-03-30T01:51:12.269 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:51:12.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.483+0000 7ff0f5c00640 1 Processor -- start 2024-03-30T01:51:12.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.483+0000 7ff0f5c00640 1 -- start start 2024-03-30T01:51:12.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.484+0000 7ff0f5c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff0f00d0af0 0x7ff0f00cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:12.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.484+0000 7ff0f5c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff0f00cf9b0 0x7ff0f00b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:12.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.484+0000 7ff0f5c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f015d030 con 0x7ff0f015cc50 2024-03-30T01:51:12.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.484+0000 7ff0f5c00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f00d1c50 con 0x7ff0f00d0af0 2024-03-30T01:51:12.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.484+0000 7ff0f5c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f00cfe20 con 0x7ff0f00cf9b0 2024-03-30T01:51:12.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.484+0000 7ff0e6000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff0f00d0af0 0x7ff0f00cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:12.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.484+0000 7ff0e6000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff0f00d0af0 0x7ff0f00cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48202/0 (socket says 172.21.15.133:48202) 2024-03-30T01:51:12.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.484+0000 7ff0ef400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff0f00cf9b0 0x7ff0f00b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:12.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.484+0000 7ff0e6000640 1 -- 172.21.15.133:0/843902274 learned_addr learned my addr 172.21.15.133:0/843902274 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:12.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.485+0000 7ff0e6000640 1 -- 172.21.15.133:0/843902274 >> v2:172.21.15.137:3300/0 conn(0x7ff0f00cf9b0 msgr2=0x7ff0f00b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:12.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.485+0000 7ff0e6000640 1 --2- 172.21.15.133:0/843902274 >> v2:172.21.15.137:3300/0 conn(0x7ff0f00cf9b0 0x7ff0f00b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:12.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.485+0000 7ff0e6000640 1 -- 172.21.15.133:0/843902274 >> v1:172.21.15.137:6789/0 conn(0x7ff0f015cc50 legacy=0x7ff0f00d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:12.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.485+0000 7ff0e6000640 1 -- 172.21.15.133:0/843902274 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f00b5af0 con 0x7ff0f00d0af0 2024-03-30T01:51:12.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.486+0000 7ff0e6000640 1 --2- 172.21.15.133:0/843902274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0f00d0af0 0x7ff0f00cf470 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff0f006bd10 tx=0x7ff0d802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7342e9fb0f14d207 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:12.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.486+0000 7ff0ee000640 1 -- 172.21.15.133:0/843902274 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8030860 con 0x7ff0f00d0af0 2024-03-30T01:51:12.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.486+0000 7ff0ee000640 1 -- 172.21.15.133:0/843902274 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d80309c0 con 0x7ff0f00d0af0 2024-03-30T01:51:12.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.486+0000 7ff0ee000640 1 -- 172.21.15.133:0/843902274 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8030d50 con 0x7ff0f00d0af0 2024-03-30T01:51:12.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.487+0000 7ff0f5c00640 1 -- 172.21.15.133:0/843902274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0f00d0af0 msgr2=0x7ff0f00cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:12.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.487+0000 7ff0f5c00640 1 --2- 172.21.15.133:0/843902274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0f00d0af0 0x7ff0f00cf470 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff0f006bd10 tx=0x7ff0d802b9a0 comp rx=0 tx=0).stop 2024-03-30T01:51:12.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.487+0000 7ff0f5c00640 1 -- 172.21.15.133:0/843902274 shutdown_connections 2024-03-30T01:51:12.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.487+0000 7ff0f5c00640 1 --2- 172.21.15.133:0/843902274 >> v2:172.21.15.137:3300/0 conn(0x7ff0f00cf9b0 0x7ff0f00b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:12.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.487+0000 7ff0f5c00640 1 --2- 172.21.15.133:0/843902274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0f00d0af0 0x7ff0f00cf470 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:12.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.487+0000 7ff0f5c00640 1 -- 172.21.15.133:0/843902274 >> 172.21.15.133:0/843902274 conn(0x7ff0f0071a40 msgr2=0x7ff0f006b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:12.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.487+0000 7ff0f5c00640 1 -- 172.21.15.133:0/843902274 shutdown_connections 2024-03-30T01:51:12.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.487+0000 7ff0f5c00640 1 -- 172.21.15.133:0/843902274 wait complete. 2024-03-30T01:51:12.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.489+0000 7ff0f5c00640 1 Processor -- start 2024-03-30T01:51:12.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.489+0000 7ff0f5c00640 1 -- start start 2024-03-30T01:51:12.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.490+0000 7ff0f5c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0f00cf9b0 0x7ff0f00af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:12.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.490+0000 7ff0f5c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0f00d0af0 0x7ff0f01f1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:12.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.490+0000 7ff0f5c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0f015cc50 0x7ff0f01f1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:12.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.490+0000 7ff0f5c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f00ad2e0 con 0x7ff0f00cf9b0 2024-03-30T01:51:12.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.490+0000 7ff0f5c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f0150a40 con 0x7ff0f015cc50 2024-03-30T01:51:12.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.490+0000 7ff0f5c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f01f1fa0 con 0x7ff0f00d0af0 2024-03-30T01:51:12.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.490+0000 7ff0eea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0f00cf9b0 0x7ff0f00af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:12.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.490+0000 7ff0eea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0f00cf9b0 0x7ff0f00af8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48208/0 (socket says 172.21.15.133:48208) 2024-03-30T01:51:12.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.490+0000 7ff0eea00640 1 -- 172.21.15.133:0/3945260555 learned_addr learned my addr 172.21.15.133:0/3945260555 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:12.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.490+0000 7ff0e6000640 1 --2- 172.21.15.133:0/3945260555 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0f00d0af0 0x7ff0f01f1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:12.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.490+0000 7ff0ef400640 1 --2- 172.21.15.133:0/3945260555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0f015cc50 0x7ff0f01f1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:12.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.490+0000 7ff0eea00640 1 -- 172.21.15.133:0/3945260555 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0f00d0af0 msgr2=0x7ff0f01f1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:12.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.490+0000 7ff0eea00640 1 --2- 172.21.15.133:0/3945260555 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0f00d0af0 0x7ff0f01f1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:12.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.490+0000 7ff0eea00640 1 -- 172.21.15.133:0/3945260555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0f015cc50 msgr2=0x7ff0f01f1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:12.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.490+0000 7ff0eea00640 1 --2- 172.21.15.133:0/3945260555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0f015cc50 0x7ff0f01f1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:12.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.490+0000 7ff0eea00640 1 -- 172.21.15.133:0/3945260555 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d80094d0 con 0x7ff0f00cf9b0 2024-03-30T01:51:12.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.491+0000 7ff0eea00640 1 --2- 172.21.15.133:0/3945260555 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0f00cf9b0 0x7ff0f00af8b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000c710 tx=0x7ff0e000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:12.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.491+0000 7ff0e7400640 1 -- 172.21.15.133:0/3945260555 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0003b90 con 0x7ff0f00cf9b0 2024-03-30T01:51:12.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.491+0000 7ff0e7400640 1 -- 172.21.15.133:0/3945260555 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e0003cf0 con 0x7ff0f00cf9b0 2024-03-30T01:51:12.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.491+0000 7ff0e7400640 1 -- 172.21.15.133:0/3945260555 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e000aa90 con 0x7ff0f00cf9b0 2024-03-30T01:51:12.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.491+0000 7ff0f5c00640 1 -- 172.21.15.133:0/3945260555 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f00abce0 con 0x7ff0f00cf9b0 2024-03-30T01:51:12.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.491+0000 7ff0f5c00640 1 -- 172.21.15.133:0/3945260555 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f00acc20 con 0x7ff0f00cf9b0 2024-03-30T01:51:12.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.491+0000 7ff0e7400640 1 -- 172.21.15.133:0/3945260555 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff0e00050d0 con 0x7ff0f00cf9b0 2024-03-30T01:51:12.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.491+0000 7ff0e7400640 1 -- 172.21.15.133:0/3945260555 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ff0e0012af0 con 0x7ff0f00cf9b0 2024-03-30T01:51:12.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.492+0000 7ff0f5c00640 1 -- 172.21.15.133:0/3945260555 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f0066d80 con 0x7ff0f00cf9b0 2024-03-30T01:51:12.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.494+0000 7ff0e7400640 1 -- 172.21.15.133:0/3945260555 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7ff0e0012d40 con 0x7ff0f00cf9b0 2024-03-30T01:51:12.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.561+0000 7ff0f5c00640 1 -- 172.21.15.133:0/3945260555 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0f00ceaa0 con 0x7ff0f00cf9b0 2024-03-30T01:51:12.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.562+0000 7ff0e7400640 1 -- 172.21.15.133:0/3945260555 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff0e0005380 con 0x7ff0f00cf9b0 2024-03-30T01:51:12.568 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:12.568 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":10,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:51:12.191363+0000","last_up_change":"0.000000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:51:12.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.563+0000 7ff0f5c00640 1 -- 172.21.15.133:0/3945260555 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0f00cf9b0 msgr2=0x7ff0f00af8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:12.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.563+0000 7ff0f5c00640 1 --2- 172.21.15.133:0/3945260555 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0f00cf9b0 0x7ff0f00af8b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000c710 tx=0x7ff0e000cbd0 comp rx=0 tx=0).stop 2024-03-30T01:51:12.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.563+0000 7ff0f5c00640 1 -- 172.21.15.133:0/3945260555 shutdown_connections 2024-03-30T01:51:12.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.563+0000 7ff0f5c00640 1 --2- 172.21.15.133:0/3945260555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0f015cc50 0x7ff0f01f1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:12.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.563+0000 7ff0f5c00640 1 --2- 172.21.15.133:0/3945260555 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0f00d0af0 0x7ff0f01f1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:12.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.563+0000 7ff0f5c00640 1 --2- 172.21.15.133:0/3945260555 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0f00cf9b0 0x7ff0f00af8b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:12.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.563+0000 7ff0f5c00640 1 -- 172.21.15.133:0/3945260555 >> 172.21.15.133:0/3945260555 conn(0x7ff0f0071a40 msgr2=0x7ff0f00d3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:12.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.563+0000 7ff0f5c00640 1 -- 172.21.15.133:0/3945260555 shutdown_connections 2024-03-30T01:51:12.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:12.564+0000 7ff0f5c00640 1 -- 172.21.15.133:0/3945260555 wait complete. 2024-03-30T01:51:12.586 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-30T01:51:12.586 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-30T01:51:12.931 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-03-30T01:51:12.925+0000 7f83d62a54c0 -1 Falling back to public interface 2024-03-30T01:51:12.936 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-03-30T01:51:12.930+0000 7fa2ae0a94c0 -1 Falling back to public interface 2024-03-30T01:51:12.948 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-03-30T01:51:12.942+0000 7f9fb1a1f4c0 -1 Falling back to public interface 2024-03-30T01:51:12.948 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-03-30T01:51:12.942+0000 7fd072a0e4c0 -1 Falling back to public interface 2024-03-30T01:51:12.955 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-03-30T01:51:12.949+0000 7f1a2f8124c0 -1 Falling back to public interface 2024-03-30T01:51:12.960 INFO:tasks.ceph.osd.0.smithi133.stderr:2024-03-30T01:51:12.954+0000 7fa21ff174c0 -1 Falling back to public interface 2024-03-30T01:51:12.960 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-03-30T01:51:12.954+0000 7f85186104c0 -1 Falling back to public interface 2024-03-30T01:51:12.973 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-03-30T01:51:12.967+0000 7f8393e144c0 -1 Falling back to public interface 2024-03-30T01:51:13.166 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:13.160+0000 7faae0841040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T01:51:13.279 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:13.272+0000 7f3769e11040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T01:51:13.392 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-30T01:51:13.474 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:13.468+0000 7faae0841040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T01:51:13.537 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:13.530+0000 7faae0841040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T01:51:13.558 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.552+0000 7fbba5200640 1 Processor -- start 2024-03-30T01:51:13.559 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.552+0000 7fbba5200640 1 -- start start 2024-03-30T01:51:13.561 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.554+0000 7fbba5200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbba015ce30 0x7fbba01608b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:13.561 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.554+0000 7fbba5200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbba0160df0 0x7fbba00cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:13.561 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.554+0000 7fbba5200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba015d210 con 0x7fbba00b8860 2024-03-30T01:51:13.561 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.554+0000 7fbba5200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba0161850 con 0x7fbba0160df0 2024-03-30T01:51:13.561 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.554+0000 7fbba5200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba00d1400 con 0x7fbba015ce30 2024-03-30T01:51:13.561 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.554+0000 7fbb97e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbba0160df0 0x7fbba00cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:13.561 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.554+0000 7fbb97e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbba0160df0 0x7fbba00cf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48220/0 (socket says 172.21.15.133:48220) 2024-03-30T01:51:13.561 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.554+0000 7fbb97e00640 1 -- 172.21.15.133:0/1158308686 learned_addr learned my addr 172.21.15.133:0/1158308686 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:13.561 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.554+0000 7fbb9e800640 1 --1- 172.21.15.133:0/1158308686 >> v1:172.21.15.133:6789/0 conn(0x7fbba00b8860 0x7fbba00b4550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55344/0 (socket says 172.21.15.133:55344) 2024-03-30T01:51:13.561 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.554+0000 7fbb9de00640 1 --2- 172.21.15.133:0/1158308686 >> v2:172.21.15.137:3300/0 conn(0x7fbba015ce30 0x7fbba01608b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:13.561 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.554+0000 7fbb97e00640 1 -- 172.21.15.133:0/1158308686 >> v2:172.21.15.137:3300/0 conn(0x7fbba015ce30 msgr2=0x7fbba01608b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:13.561 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.554+0000 7fbb97e00640 1 --2- 172.21.15.133:0/1158308686 >> v2:172.21.15.137:3300/0 conn(0x7fbba015ce30 0x7fbba01608b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:13.562 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.554+0000 7fbb97e00640 1 -- 172.21.15.133:0/1158308686 >> v1:172.21.15.133:6789/0 conn(0x7fbba00b8860 legacy=0x7fbba00b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:13.562 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.554+0000 7fbb97e00640 1 -- 172.21.15.133:0/1158308686 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba00d28a0 con 0x7fbba0160df0 2024-03-30T01:51:13.562 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.554+0000 7fbb9d400640 1 -- 172.21.15.133:0/1158308686 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54277080 0 0) 0x7fbb98001490 con 0x7fbba00b8860 2024-03-30T01:51:13.563 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.556+0000 7fbb97e00640 1 --2- 172.21.15.133:0/1158308686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbba0160df0 0x7fbba00cf8c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbba00d3b40 tx=0x7fbb8802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1d3f9b4c01a80d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:13.563 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.556+0000 7fbb9d400640 1 -- 172.21.15.133:0/1158308686 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8802f850 con 0x7fbba0160df0 2024-03-30T01:51:13.563 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.556+0000 7fbb9d400640 1 -- 172.21.15.133:0/1158308686 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8802f9b0 con 0x7fbba0160df0 2024-03-30T01:51:13.563 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.556+0000 7fbb9d400640 1 -- 172.21.15.133:0/1158308686 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8802fd40 con 0x7fbba0160df0 2024-03-30T01:51:13.563 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.556+0000 7fbba5200640 1 -- 172.21.15.133:0/1158308686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbba0160df0 msgr2=0x7fbba00cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:13.563 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.556+0000 7fbba5200640 1 --2- 172.21.15.133:0/1158308686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbba0160df0 0x7fbba00cf8c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbba00d3b40 tx=0x7fbb8802ba30 comp rx=0 tx=0).stop 2024-03-30T01:51:13.563 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.557+0000 7fbba5200640 1 -- 172.21.15.133:0/1158308686 shutdown_connections 2024-03-30T01:51:13.564 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.557+0000 7fbba5200640 1 --2- 172.21.15.133:0/1158308686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbba0160df0 0x7fbba00cf8c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:13.564 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.557+0000 7fbba5200640 1 --2- 172.21.15.133:0/1158308686 >> v2:172.21.15.137:3300/0 conn(0x7fbba015ce30 0x7fbba01608b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:13.564 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.557+0000 7fbba5200640 1 -- 172.21.15.133:0/1158308686 >> 172.21.15.133:0/1158308686 conn(0x7fbba006b5b0 msgr2=0x7fbba006b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:13.564 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.557+0000 7fbba5200640 1 -- 172.21.15.133:0/1158308686 shutdown_connections 2024-03-30T01:51:13.564 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.557+0000 7fbba5200640 1 -- 172.21.15.133:0/1158308686 wait complete. 2024-03-30T01:51:13.564 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.558+0000 7fbba5200640 1 Processor -- start 2024-03-30T01:51:13.564 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.558+0000 7fbba5200640 1 -- start start 2024-03-30T01:51:13.566 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.559+0000 7fbba5200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbba00b8860 0x7fbba01f2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:13.566 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.559+0000 7fbba5200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbba015ce30 0x7fbba00c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:13.566 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.559+0000 7fbba5200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbba0160df0 0x7fbba015d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:13.566 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.559+0000 7fbba5200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba00b3580 con 0x7fbba015ce30 2024-03-30T01:51:13.567 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.559+0000 7fbba5200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba00b43a0 con 0x7fbba0160df0 2024-03-30T01:51:13.567 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.559+0000 7fbba5200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba00b3790 con 0x7fbba00b8860 2024-03-30T01:51:13.567 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.560+0000 7fbb97e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbba015ce30 0x7fbba00c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:13.567 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.560+0000 7fbb97e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbba015ce30 0x7fbba00c8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48222/0 (socket says 172.21.15.133:48222) 2024-03-30T01:51:13.567 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.560+0000 7fbb97e00640 1 -- 172.21.15.133:0/2808610255 learned_addr learned my addr 172.21.15.133:0/2808610255 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:13.567 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.560+0000 7fbb9de00640 1 --2- 172.21.15.133:0/2808610255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbba00b8860 0x7fbba01f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:13.567 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.560+0000 7fbb9e800640 1 --2- 172.21.15.133:0/2808610255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbba0160df0 0x7fbba015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:13.567 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.560+0000 7fbb97e00640 1 -- 172.21.15.133:0/2808610255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbba00b8860 msgr2=0x7fbba01f2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:13.567 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.560+0000 7fbb97e00640 1 --2- 172.21.15.133:0/2808610255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbba00b8860 0x7fbba01f2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:13.567 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.560+0000 7fbb97e00640 1 -- 172.21.15.133:0/2808610255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbba0160df0 msgr2=0x7fbba015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:13.567 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.560+0000 7fbb97e00640 1 --2- 172.21.15.133:0/2808610255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbba0160df0 0x7fbba015d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:13.567 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.560+0000 7fbb97e00640 1 -- 172.21.15.133:0/2808610255 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb880094d0 con 0x7fbba015ce30 2024-03-30T01:51:13.567 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.560+0000 7fbb9e800640 1 --2- 172.21.15.133:0/2808610255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbba0160df0 0x7fbba015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:51:13.567 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.560+0000 7fbb97e00640 1 --2- 172.21.15.133:0/2808610255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbba015ce30 0x7fbba00c8d70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbb88000c00 tx=0x7fbb88004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:13.569 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.561+0000 7fbb96000640 1 -- 172.21.15.133:0/2808610255 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88037c40 con 0x7fbba015ce30 2024-03-30T01:51:13.569 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.561+0000 7fbb96000640 1 -- 172.21.15.133:0/2808610255 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb88037da0 con 0x7fbba015ce30 2024-03-30T01:51:13.569 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.561+0000 7fbba5200640 1 -- 172.21.15.133:0/2808610255 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba00b3a70 con 0x7fbba015ce30 2024-03-30T01:51:13.569 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.561+0000 7fbb96000640 1 -- 172.21.15.133:0/2808610255 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88041620 con 0x7fbba015ce30 2024-03-30T01:51:13.569 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.561+0000 7fbba5200640 1 -- 172.21.15.133:0/2808610255 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba00b4030 con 0x7fbba015ce30 2024-03-30T01:51:13.569 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.561+0000 7fbb96000640 1 -- 172.21.15.133:0/2808610255 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbb88041a80 con 0x7fbba015ce30 2024-03-30T01:51:13.569 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.561+0000 7fbb96000640 1 -- 172.21.15.133:0/2808610255 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fbb8803c070 con 0x7fbba015ce30 2024-03-30T01:51:13.569 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.562+0000 7fbba5200640 1 -- 172.21.15.133:0/2808610255 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba0073790 con 0x7fbba015ce30 2024-03-30T01:51:13.570 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.565+0000 7fbb96000640 1 -- 172.21.15.133:0/2808610255 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fbb88041d30 con 0x7fbba015ce30 2024-03-30T01:51:13.612 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:13.606+0000 7f3769e11040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T01:51:13.636 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.630+0000 7fbba5200640 1 -- 172.21.15.133:0/2808610255 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbba00d07c0 con 0x7fbba015ce30 2024-03-30T01:51:13.638 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.632+0000 7fbb96000640 1 -- 172.21.15.133:0/2808610255 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fbb8804b460 con 0x7fbba015ce30 2024-03-30T01:51:13.638 INFO:teuthology.misc.health.smithi133.stdout: 2024-03-30T01:51:13.638 INFO:teuthology.misc.health.smithi133.stdout:{"epoch":10,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:51:12.191363+0000","last_up_change":"0.000000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:51:13.639 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.633+0000 7fbba5200640 1 -- 172.21.15.133:0/2808610255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbba015ce30 msgr2=0x7fbba00c8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:13.639 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.633+0000 7fbba5200640 1 --2- 172.21.15.133:0/2808610255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbba015ce30 0x7fbba00c8d70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbb88000c00 tx=0x7fbb88004730 comp rx=0 tx=0).stop 2024-03-30T01:51:13.639 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.633+0000 7fbba5200640 1 -- 172.21.15.133:0/2808610255 shutdown_connections 2024-03-30T01:51:13.640 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.633+0000 7fbba5200640 1 --2- 172.21.15.133:0/2808610255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbba0160df0 0x7fbba015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:13.640 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.633+0000 7fbba5200640 1 --2- 172.21.15.133:0/2808610255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbba015ce30 0x7fbba00c8d70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:13.640 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.633+0000 7fbba5200640 1 --2- 172.21.15.133:0/2808610255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbba00b8860 0x7fbba01f2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:13.640 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.633+0000 7fbba5200640 1 -- 172.21.15.133:0/2808610255 >> 172.21.15.133:0/2808610255 conn(0x7fbba006b5b0 msgr2=0x7fbba00cd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:13.640 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.633+0000 7fbba5200640 1 -- 172.21.15.133:0/2808610255 shutdown_connections 2024-03-30T01:51:13.640 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:13.633+0000 7fbba5200640 1 -- 172.21.15.133:0/2808610255 wait complete. 2024-03-30T01:51:13.652 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-30T01:51:13.672 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:13.665+0000 7f3769e11040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T01:51:13.672 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:13.666+0000 7faae0841040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T01:51:13.812 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-03-30T01:51:13.806+0000 7f3769e11040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T01:51:14.719 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:14.712+0000 7faa81200640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-30T01:51:14.720 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-03-30T01:51:14.714+0000 7faa81200640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-30T01:51:16.489 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-03-30T01:51:16.482+0000 7f83d62a54c0 -1 osd.3 0 log_to_monitors true 2024-03-30T01:51:16.502 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-03-30T01:51:16.496+0000 7f9fb1a1f4c0 -1 osd.5 0 log_to_monitors true 2024-03-30T01:51:16.510 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-03-30T01:51:16.504+0000 7fa2ae0a94c0 -1 osd.2 0 log_to_monitors true 2024-03-30T01:51:16.541 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-03-30T01:51:16.535+0000 7f1a2f8124c0 -1 osd.7 0 log_to_monitors true 2024-03-30T01:51:16.544 INFO:tasks.ceph.osd.0.smithi133.stderr:2024-03-30T01:51:16.538+0000 7fa21ff174c0 -1 osd.0 0 log_to_monitors true 2024-03-30T01:51:16.549 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-03-30T01:51:16.543+0000 7fd072a0e4c0 -1 osd.4 0 log_to_monitors true 2024-03-30T01:51:16.550 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-03-30T01:51:16.544+0000 7f85186104c0 -1 osd.1 0 log_to_monitors true 2024-03-30T01:51:16.558 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-03-30T01:51:16.553+0000 7f8393e144c0 -1 osd.6 0 log_to_monitors true 2024-03-30T01:51:18.202 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T01:51:18.207 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T01:51:19.914 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-03-30T01:51:19.908+0000 7fa2a8600640 -1 osd.2 0 waiting for initial osdmap 2024-03-30T01:51:19.926 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-03-30T01:51:19.920+0000 7fa29f000640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T01:51:20.003 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-03-30T01:51:19.997+0000 7f83d0800640 -1 osd.3 0 waiting for initial osdmap 2024-03-30T01:51:20.003 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-03-30T01:51:19.998+0000 7f838dc00640 -1 osd.6 0 waiting for initial osdmap 2024-03-30T01:51:20.006 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-03-30T01:51:20.001+0000 7f1a29600640 -1 osd.7 0 waiting for initial osdmap 2024-03-30T01:51:20.008 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-03-30T01:51:20.002+0000 7f83c7200640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T01:51:20.010 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-03-30T01:51:20.003+0000 7f8384600640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T01:51:20.014 INFO:tasks.ceph.osd.0.smithi133.stderr:2024-03-30T01:51:20.008+0000 7fa21a400640 -1 osd.0 0 waiting for initial osdmap 2024-03-30T01:51:20.016 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-03-30T01:51:20.010+0000 7f1a20000640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T01:51:20.021 INFO:tasks.ceph.osd.0.smithi133.stderr:2024-03-30T01:51:20.015+0000 7fa210e00640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T01:51:20.036 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-03-30T01:51:20.030+0000 7f8512400640 -1 osd.1 0 waiting for initial osdmap 2024-03-30T01:51:20.036 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-03-30T01:51:20.030+0000 7fd06c800640 -1 osd.4 0 waiting for initial osdmap 2024-03-30T01:51:20.044 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-03-30T01:51:20.038+0000 7f8508e00640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T01:51:20.048 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-03-30T01:51:20.042+0000 7fd063200640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T01:51:20.091 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-03-30T01:51:20.085+0000 7f9fab800640 -1 osd.5 0 waiting for initial osdmap 2024-03-30T01:51:20.101 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-03-30T01:51:20.096+0000 7f9fa2200640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T01:51:20.458 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-30T01:51:20.630 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.624+0000 7fd5fd000640 1 Processor -- start 2024-03-30T01:51:20.630 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.624+0000 7fd5fd000640 1 -- start start 2024-03-30T01:51:20.632 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.626+0000 7fd5fd000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd5f81441b0 0x7fd5f806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:20.632 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.626+0000 7fd5fd000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f8144590 con 0x7fd5f80cc0c0 2024-03-30T01:51:20.632 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.626+0000 7fd5fd000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f806ce70 con 0x7fd5f80ce890 2024-03-30T01:51:20.632 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.626+0000 7fd5fd000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f806d150 con 0x7fd5f81441b0 2024-03-30T01:51:20.632 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.626+0000 7fd5f6800640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd5f80cc0c0 0x7fd5f815aef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35402/0 (socket says 172.21.15.133:35402) 2024-03-30T01:51:20.632 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.626+0000 7fd5f6800640 1 -- 172.21.15.133:0/2542088299 learned_addr learned my addr 172.21.15.133:0/2542088299 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:20.634 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.626+0000 7fd5f5e00640 1 --2- 172.21.15.133:0/2542088299 >> v2:172.21.15.137:3300/0 conn(0x7fd5f81441b0 0x7fd5f806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:20.634 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.627+0000 7fd5f4a00640 1 -- 172.21.15.133:0/2542088299 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799106275 0 0) 0x7fd5f8144590 con 0x7fd5f80cc0c0 2024-03-30T01:51:20.634 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.627+0000 7fd5f4a00640 1 -- 172.21.15.133:0/2542088299 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5dc003520 con 0x7fd5f80cc0c0 2024-03-30T01:51:20.634 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.627+0000 7fd5f4a00640 1 -- 172.21.15.133:0/2542088299 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 7379534 0 0) 0x7fd5dc003520 con 0x7fd5f80cc0c0 2024-03-30T01:51:20.634 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.627+0000 7fd5f4a00640 1 -- 172.21.15.133:0/2542088299 >> v2:172.21.15.137:3300/0 conn(0x7fd5f81441b0 msgr2=0x7fd5f806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:20.634 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.627+0000 7fd5f4a00640 1 --2- 172.21.15.133:0/2542088299 >> v2:172.21.15.137:3300/0 conn(0x7fd5f81441b0 0x7fd5f806df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:20.634 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.627+0000 7fd5f4a00640 1 -- 172.21.15.133:0/2542088299 >> v1:172.21.15.137:6789/0 conn(0x7fd5f80ce890 legacy=0x7fd5f80cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:20.634 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.627+0000 7fd5f4a00640 1 -- 172.21.15.133:0/2542088299 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f806d430 con 0x7fd5f80cc0c0 2024-03-30T01:51:20.634 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.627+0000 7fd5f4a00640 1 -- 172.21.15.133:0/2542088299 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fd5f00019f0 con 0x7fd5f80cc0c0 2024-03-30T01:51:20.634 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.627+0000 7fd5f4a00640 1 -- 172.21.15.133:0/2542088299 >> v1:172.21.15.133:6789/0 conn(0x7fd5f80cc0c0 legacy=0x7fd5f815aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:20.634 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.627+0000 7fd5f4a00640 1 --2- 172.21.15.133:0/2542088299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5dc0039c0 0x7fd5dc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:20.634 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.627+0000 7fd5f4a00640 1 --2- 172.21.15.133:0/2542088299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5dc0047c0 0x7fd5dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:20.634 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.627+0000 7fd5f4a00640 1 --2- 172.21.15.133:0/2542088299 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd5dc005180 0x7fd5dc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:20.635 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.627+0000 7fd5f4a00640 1 -- 172.21.15.133:0/2542088299 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f806d150 con 0x7fd5dc0047c0 2024-03-30T01:51:20.635 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.627+0000 7fd5f4a00640 1 -- 172.21.15.133:0/2542088299 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc00c080 con 0x7fd5dc0039c0 2024-03-30T01:51:20.635 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.627+0000 7fd5f4a00640 1 -- 172.21.15.133:0/2542088299 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc00c240 con 0x7fd5dc005180 2024-03-30T01:51:20.635 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.628+0000 7fd5f5400640 1 --2- 172.21.15.133:0/2542088299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5dc0047c0 0x7fd5dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:20.636 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.628+0000 7fd5f6800640 1 --2- 172.21.15.133:0/2542088299 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd5dc005180 0x7fd5dc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:20.636 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.628+0000 7fd5f5400640 1 -- 172.21.15.133:0/2542088299 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd5dc005180 msgr2=0x7fd5dc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:20.636 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.628+0000 7fd5f5400640 1 --2- 172.21.15.133:0/2542088299 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd5dc005180 0x7fd5dc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:20.636 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.628+0000 7fd5f5400640 1 -- 172.21.15.133:0/2542088299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5dc0039c0 msgr2=0x7fd5dc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:20.636 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.628+0000 7fd5f5400640 1 --2- 172.21.15.133:0/2542088299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5dc0039c0 0x7fd5dc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:20.636 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.628+0000 7fd5f5400640 1 -- 172.21.15.133:0/2542088299 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc003520 con 0x7fd5dc0047c0 2024-03-30T01:51:20.636 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.628+0000 7fd5f6800640 1 --2- 172.21.15.133:0/2542088299 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd5dc005180 0x7fd5dc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:20.636 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.628+0000 7fd5f6800640 1 -- 172.21.15.133:0/2542088299 reap_dead start 2024-03-30T01:51:20.636 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.629+0000 7fd5f5400640 1 --2- 172.21.15.133:0/2542088299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5dc0047c0 0x7fd5dc004c40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4001750 tx=0x7fd5dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614161d991fa4160 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:20.637 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.630+0000 7fd5f4a00640 1 -- 172.21.15.133:0/2542088299 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e40052d0 con 0x7fd5dc0047c0 2024-03-30T01:51:20.637 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.630+0000 7fd5f4a00640 1 -- 172.21.15.133:0/2542088299 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e402e050 con 0x7fd5dc0047c0 2024-03-30T01:51:20.637 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.630+0000 7fd5f4a00640 1 -- 172.21.15.133:0/2542088299 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4003830 con 0x7fd5dc0047c0 2024-03-30T01:51:20.637 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.630+0000 7fd5fd000640 1 -- 172.21.15.133:0/2542088299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5dc0047c0 msgr2=0x7fd5dc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:20.637 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.630+0000 7fd5fd000640 1 --2- 172.21.15.133:0/2542088299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5dc0047c0 0x7fd5dc004c40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4001750 tx=0x7fd5dc0057f0 comp rx=0 tx=0).stop 2024-03-30T01:51:20.638 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.631+0000 7fd5fd000640 1 -- 172.21.15.133:0/2542088299 shutdown_connections 2024-03-30T01:51:20.638 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.631+0000 7fd5fd000640 1 --2- 172.21.15.133:0/2542088299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5dc0047c0 0x7fd5dc004c40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:20.638 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.631+0000 7fd5fd000640 1 -- 172.21.15.133:0/2542088299 >> 172.21.15.133:0/2542088299 conn(0x7fd5f80b0450 msgr2=0x7fd5f80b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:20.638 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.631+0000 7fd5fd000640 1 -- 172.21.15.133:0/2542088299 shutdown_connections 2024-03-30T01:51:20.638 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.631+0000 7fd5fd000640 1 -- 172.21.15.133:0/2542088299 wait complete. 2024-03-30T01:51:20.639 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.633+0000 7fd5fd000640 1 Processor -- start 2024-03-30T01:51:20.639 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.633+0000 7fd5fd000640 1 -- start start 2024-03-30T01:51:20.641 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.634+0000 7fd5fd000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd5dc0047c0 0x7fd5f8142250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:20.641 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.634+0000 7fd5fd000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5f8156380 0x7fd5f81f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:20.641 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.634+0000 7fd5fd000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5f8142790 0x7fd5f81f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:20.641 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.634+0000 7fd5fd000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f8140ab0 con 0x7fd5f8142790 2024-03-30T01:51:20.641 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.634+0000 7fd5fd000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f81407d0 con 0x7fd5f8156380 2024-03-30T01:51:20.641 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.634+0000 7fd5fd000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f8141770 con 0x7fd5dc0047c0 2024-03-30T01:51:20.641 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.635+0000 7fd5f6800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5f8142790 0x7fd5f81f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:20.642 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.635+0000 7fd5f6800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5f8142790 0x7fd5f81f2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34234/0 (socket says 172.21.15.133:34234) 2024-03-30T01:51:20.642 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.635+0000 7fd5f6800640 1 -- 172.21.15.133:0/1461334773 learned_addr learned my addr 172.21.15.133:0/1461334773 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:20.642 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.635+0000 7fd5f5e00640 1 --2- 172.21.15.133:0/1461334773 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd5dc0047c0 0x7fd5f8142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:20.642 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.635+0000 7fd5f5400640 1 --2- 172.21.15.133:0/1461334773 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5f8156380 0x7fd5f81f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:20.642 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.635+0000 7fd5f6800640 1 -- 172.21.15.133:0/1461334773 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd5dc0047c0 msgr2=0x7fd5f8142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:20.642 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.635+0000 7fd5f6800640 1 --2- 172.21.15.133:0/1461334773 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd5dc0047c0 0x7fd5f8142250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:20.642 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.635+0000 7fd5f6800640 1 -- 172.21.15.133:0/1461334773 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5f8156380 msgr2=0x7fd5f81f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:20.642 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.635+0000 7fd5f6800640 1 --2- 172.21.15.133:0/1461334773 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5f8156380 0x7fd5f81f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:20.642 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.635+0000 7fd5f6800640 1 -- 172.21.15.133:0/1461334773 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f8141a50 con 0x7fd5f8142790 2024-03-30T01:51:20.642 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.635+0000 7fd5f6800640 1 --2- 172.21.15.133:0/1461334773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5f8142790 0x7fd5f81f2510 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd5f80cf370 tx=0x7fd5f000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:20.643 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.636+0000 7fd5ee000640 1 -- 172.21.15.133:0/1461334773 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0004d60 con 0x7fd5f8142790 2024-03-30T01:51:20.643 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.636+0000 7fd5ee000640 1 -- 172.21.15.133:0/1461334773 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f000bb80 con 0x7fd5f8142790 2024-03-30T01:51:20.643 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.636+0000 7fd5fd000640 1 -- 172.21.15.133:0/1461334773 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f8141d30 con 0x7fd5f8142790 2024-03-30T01:51:20.643 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.636+0000 7fd5ee000640 1 -- 172.21.15.133:0/1461334773 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0007070 con 0x7fd5f8142790 2024-03-30T01:51:20.643 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.636+0000 7fd5fd000640 1 -- 172.21.15.133:0/1461334773 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f80acf10 con 0x7fd5f8142790 2024-03-30T01:51:20.643 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.637+0000 7fd5fd000640 1 -- 172.21.15.133:0/1461334773 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f81415d0 con 0x7fd5f8142790 2024-03-30T01:51:20.644 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.638+0000 7fd5ee000640 1 -- 172.21.15.133:0/1461334773 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 89081+0+0 (secure 0 0 0) 0x7fd5f00071d0 con 0x7fd5f8142790 2024-03-30T01:51:20.645 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.639+0000 7fd5ee000640 1 --2- 172.21.15.133:0/1461334773 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd5d806ab70 0x7fd5d806d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:20.645 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.639+0000 7fd5ee000640 1 -- 172.21.15.133:0/1461334773 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fd5f0088880 con 0x7fd5f8142790 2024-03-30T01:51:20.645 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.639+0000 7fd5f5e00640 1 --2- 172.21.15.133:0/1461334773 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd5d806ab70 0x7fd5d806d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:20.646 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.640+0000 7fd5f5e00640 1 --2- 172.21.15.133:0/1461334773 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd5d806ab70 0x7fd5d806d030 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd5e80047b0 tx=0x7fd5e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:20.650 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.644+0000 7fd5ee000640 1 -- 172.21.15.133:0/1461334773 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fd5f81415d0 con 0x7fd5f8142790 2024-03-30T01:51:20.834 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.828+0000 7fd5fd000640 1 -- 172.21.15.133:0/1461334773 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5f81415d0 con 0x7fd5f8142790 2024-03-30T01:51:20.835 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.829+0000 7fd5ee000640 1 -- 172.21.15.133:0/1461334773 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fd5f81415d0 con 0x7fd5f8142790 2024-03-30T01:51:20.835 INFO:teuthology.misc.health.smithi133.stdout: 2024-03-30T01:51:20.836 INFO:teuthology.misc.health.smithi133.stdout:{"epoch":12,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:51:17.715770+0000","last_up_change":"0.000000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:51:20.838 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.831+0000 7fd5fd000640 1 -- 172.21.15.133:0/1461334773 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd5d806ab70 msgr2=0x7fd5d806d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:20.838 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.831+0000 7fd5fd000640 1 --2- 172.21.15.133:0/1461334773 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd5d806ab70 0x7fd5d806d030 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd5e80047b0 tx=0x7fd5e8008040 comp rx=0 tx=0).stop 2024-03-30T01:51:20.838 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.831+0000 7fd5fd000640 1 -- 172.21.15.133:0/1461334773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5f8142790 msgr2=0x7fd5f81f2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:20.838 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.831+0000 7fd5fd000640 1 --2- 172.21.15.133:0/1461334773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5f8142790 0x7fd5f81f2510 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd5f80cf370 tx=0x7fd5f000b4a0 comp rx=0 tx=0).stop 2024-03-30T01:51:20.838 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.832+0000 7fd5fd000640 1 -- 172.21.15.133:0/1461334773 shutdown_connections 2024-03-30T01:51:20.838 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.832+0000 7fd5fd000640 1 --2- 172.21.15.133:0/1461334773 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd5d806ab70 0x7fd5d806d030 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:20.839 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.832+0000 7fd5fd000640 1 --2- 172.21.15.133:0/1461334773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5f8142790 0x7fd5f81f2510 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:20.839 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.832+0000 7fd5fd000640 1 --2- 172.21.15.133:0/1461334773 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5f8156380 0x7fd5f81f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:20.839 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.832+0000 7fd5fd000640 1 --2- 172.21.15.133:0/1461334773 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd5dc0047c0 0x7fd5f8142250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:20.839 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.832+0000 7fd5fd000640 1 -- 172.21.15.133:0/1461334773 >> 172.21.15.133:0/1461334773 conn(0x7fd5f80b0450 msgr2=0x7fd5f80cb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:20.839 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.832+0000 7fd5fd000640 1 -- 172.21.15.133:0/1461334773 shutdown_connections 2024-03-30T01:51:20.839 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:20.832+0000 7fd5fd000640 1 -- 172.21.15.133:0/1461334773 wait complete. 2024-03-30T01:51:20.852 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-30T01:51:27.659 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-30T01:51:27.844 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.837+0000 7fa206200640 1 Processor -- start 2024-03-30T01:51:27.844 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.837+0000 7fa206200640 1 -- start start 2024-03-30T01:51:27.845 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.839+0000 7fa206200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa2001441b0 0x7fa20006df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:27.845 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.839+0000 7fa206200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa2000ce890 0x7fa2000ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:27.845 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.839+0000 7fa206200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa200144590 con 0x7fa2000cb9b0 2024-03-30T01:51:27.845 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.839+0000 7fa206200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20006ce70 con 0x7fa2000ce890 2024-03-30T01:51:27.845 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.839+0000 7fa206200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20006d150 con 0x7fa2001441b0 2024-03-30T01:51:27.846 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.839+0000 7fa1fea00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa2000ce890 0x7fa2000ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:27.846 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.839+0000 7fa1fea00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa2000ce890 0x7fa2000ced20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40152/0 (socket says 172.21.15.133:40152) 2024-03-30T01:51:27.846 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.839+0000 7fa1fea00640 1 -- 172.21.15.133:0/1365732268 learned_addr learned my addr 172.21.15.133:0/1365732268 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:27.847 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.840+0000 7fa1ff400640 1 --2- 172.21.15.133:0/1365732268 >> v2:172.21.15.137:3300/0 conn(0x7fa2001441b0 0x7fa20006df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:27.847 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.840+0000 7fa1fea00640 1 -- 172.21.15.133:0/1365732268 >> v2:172.21.15.137:3300/0 conn(0x7fa2001441b0 msgr2=0x7fa20006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:27.847 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.840+0000 7fa1fea00640 1 --2- 172.21.15.133:0/1365732268 >> v2:172.21.15.137:3300/0 conn(0x7fa2001441b0 0x7fa20006df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:27.847 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.840+0000 7fa1fea00640 1 -- 172.21.15.133:0/1365732268 >> v1:172.21.15.133:6789/0 conn(0x7fa2000cb9b0 legacy=0x7fa20015aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:27.847 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.840+0000 7fa1fea00640 1 -- 172.21.15.133:0/1365732268 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20006d430 con 0x7fa2000ce890 2024-03-30T01:51:27.847 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.840+0000 7fa1ff400640 1 --2- 172.21.15.133:0/1365732268 >> v2:172.21.15.137:3300/0 conn(0x7fa2001441b0 0x7fa20006df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:27.847 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.841+0000 7fa1fea00640 1 --2- 172.21.15.133:0/1365732268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2000ce890 0x7fa2000ced20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa2000b3ad0 tx=0x7fa1ec02b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a370885bd6d24d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:27.847 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.841+0000 7fa1fe000640 1 -- 172.21.15.133:0/1365732268 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec030880 con 0x7fa2000ce890 2024-03-30T01:51:27.847 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.841+0000 7fa1fe000640 1 -- 172.21.15.133:0/1365732268 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec0309e0 con 0x7fa2000ce890 2024-03-30T01:51:27.847 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.841+0000 7fa1fe000640 1 -- 172.21.15.133:0/1365732268 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec030d70 con 0x7fa2000ce890 2024-03-30T01:51:27.849 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.842+0000 7fa206200640 1 -- 172.21.15.133:0/1365732268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2000ce890 msgr2=0x7fa2000ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:27.849 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.842+0000 7fa206200640 1 --2- 172.21.15.133:0/1365732268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2000ce890 0x7fa2000ced20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa2000b3ad0 tx=0x7fa1ec02b9c0 comp rx=0 tx=0).stop 2024-03-30T01:51:27.849 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.842+0000 7fa206200640 1 -- 172.21.15.133:0/1365732268 shutdown_connections 2024-03-30T01:51:27.849 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.842+0000 7fa206200640 1 --2- 172.21.15.133:0/1365732268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2000ce890 0x7fa2000ced20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:27.849 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.842+0000 7fa206200640 1 --2- 172.21.15.133:0/1365732268 >> v2:172.21.15.137:3300/0 conn(0x7fa2001441b0 0x7fa20006df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:27.849 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.842+0000 7fa206200640 1 -- 172.21.15.133:0/1365732268 >> 172.21.15.133:0/1365732268 conn(0x7fa2000b0450 msgr2=0x7fa2000b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:27.849 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.842+0000 7fa206200640 1 -- 172.21.15.133:0/1365732268 shutdown_connections 2024-03-30T01:51:27.849 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.842+0000 7fa206200640 1 -- 172.21.15.133:0/1365732268 wait complete. 2024-03-30T01:51:27.853 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.843+0000 7fa206200640 1 Processor -- start 2024-03-30T01:51:27.854 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.844+0000 7fa206200640 1 -- start start 2024-03-30T01:51:27.854 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.844+0000 7fa206200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2000cb9b0 0x7fa20015a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:27.854 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.844+0000 7fa206200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2000ce890 0x7fa2000c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:27.854 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.844+0000 7fa206200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2001441b0 0x7fa2000c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:27.854 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.844+0000 7fa206200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20012dab0 con 0x7fa2001441b0 2024-03-30T01:51:27.854 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.844+0000 7fa206200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20012dd90 con 0x7fa2000ce890 2024-03-30T01:51:27.854 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.845+0000 7fa206200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2000c4b20 con 0x7fa2000cb9b0 2024-03-30T01:51:27.855 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.845+0000 7fa1ffe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2001441b0 0x7fa2000c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:27.855 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.845+0000 7fa1ffe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2001441b0 0x7fa2000c87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40156/0 (socket says 172.21.15.133:40156) 2024-03-30T01:51:27.855 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.845+0000 7fa1ffe00640 1 -- 172.21.15.133:0/1751957872 learned_addr learned my addr 172.21.15.133:0/1751957872 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:27.855 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.845+0000 7fa1ff400640 1 --2- 172.21.15.133:0/1751957872 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2000cb9b0 0x7fa20015a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:27.855 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.845+0000 7fa1fea00640 1 --2- 172.21.15.133:0/1751957872 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2000ce890 0x7fa2000c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:27.855 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.845+0000 7fa1ffe00640 1 -- 172.21.15.133:0/1751957872 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2000cb9b0 msgr2=0x7fa20015a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:27.855 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.845+0000 7fa1ffe00640 1 --2- 172.21.15.133:0/1751957872 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2000cb9b0 0x7fa20015a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:27.855 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.845+0000 7fa1ffe00640 1 -- 172.21.15.133:0/1751957872 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2000ce890 msgr2=0x7fa2000c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:27.855 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.845+0000 7fa1ffe00640 1 --2- 172.21.15.133:0/1751957872 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2000ce890 0x7fa2000c40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:27.855 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.845+0000 7fa1ffe00640 1 -- 172.21.15.133:0/1751957872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ec0094d0 con 0x7fa2001441b0 2024-03-30T01:51:27.855 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.846+0000 7fa1ffe00640 1 --2- 172.21.15.133:0/1751957872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2001441b0 0x7fa2000c87a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8001eb0 tx=0x7fa1f800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:27.855 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.846+0000 7fa1f7400640 1 -- 172.21.15.133:0/1751957872 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f80052d0 con 0x7fa2001441b0 2024-03-30T01:51:27.856 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.846+0000 7fa1f7400640 1 -- 172.21.15.133:0/1751957872 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f8005430 con 0x7fa2001441b0 2024-03-30T01:51:27.856 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.846+0000 7fa1f7400640 1 -- 172.21.15.133:0/1751957872 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8003810 con 0x7fa2001441b0 2024-03-30T01:51:27.856 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.846+0000 7fa206200640 1 -- 172.21.15.133:0/1751957872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2000c4e00 con 0x7fa2001441b0 2024-03-30T01:51:27.856 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.846+0000 7fa206200640 1 -- 172.21.15.133:0/1751957872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa200140d70 con 0x7fa2001441b0 2024-03-30T01:51:27.856 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.847+0000 7fa206200640 1 -- 172.21.15.133:0/1751957872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa20012df00 con 0x7fa2001441b0 2024-03-30T01:51:27.857 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.848+0000 7fa1f7400640 1 -- 172.21.15.133:0/1751957872 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fa1f8003970 con 0x7fa2001441b0 2024-03-30T01:51:27.857 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.849+0000 7fa1f7400640 1 --2- 172.21.15.133:0/1751957872 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa1e006ac00 0x7fa1e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:27.857 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.849+0000 7fa1f7400640 1 -- 172.21.15.133:0/1751957872 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa1f80886c0 con 0x7fa2001441b0 2024-03-30T01:51:27.857 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.849+0000 7fa1ff400640 1 --2- 172.21.15.133:0/1751957872 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa1e006ac00 0x7fa1e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:27.857 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.850+0000 7fa1ff400640 1 --2- 172.21.15.133:0/1751957872 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa1e006ac00 0x7fa1e006d0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0007510 tx=0x7fa1f00074a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:27.860 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:27.854+0000 7fa1f7400640 1 -- 172.21.15.133:0/1751957872 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fa1f8053ac0 con 0x7fa2001441b0 2024-03-30T01:51:28.056 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:28.050+0000 7fa206200640 1 -- 172.21.15.133:0/1751957872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa200140f00 con 0x7fa2001441b0 2024-03-30T01:51:28.058 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:28.052+0000 7fa1f7400640 1 -- 172.21.15.133:0/1751957872 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7fa1f8017090 con 0x7fa2001441b0 2024-03-30T01:51:28.058 INFO:teuthology.misc.health.smithi133.stdout: 2024-03-30T01:51:28.059 INFO:teuthology.misc.health.smithi133.stdout:{"epoch":16,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:51:24.012485+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:51:28.061 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:28.055+0000 7fa206200640 1 -- 172.21.15.133:0/1751957872 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa1e006ac00 msgr2=0x7fa1e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:28.061 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:28.055+0000 7fa206200640 1 --2- 172.21.15.133:0/1751957872 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa1e006ac00 0x7fa1e006d0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0007510 tx=0x7fa1f00074a0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.062 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:28.055+0000 7fa206200640 1 -- 172.21.15.133:0/1751957872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2001441b0 msgr2=0x7fa2000c87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:28.062 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:28.055+0000 7fa206200640 1 --2- 172.21.15.133:0/1751957872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2001441b0 0x7fa2000c87a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8001eb0 tx=0x7fa1f800c890 comp rx=0 tx=0).stop 2024-03-30T01:51:28.062 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:28.055+0000 7fa206200640 1 -- 172.21.15.133:0/1751957872 shutdown_connections 2024-03-30T01:51:28.062 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:28.055+0000 7fa206200640 1 --2- 172.21.15.133:0/1751957872 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa1e006ac00 0x7fa1e006d0c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.062 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:28.055+0000 7fa206200640 1 --2- 172.21.15.133:0/1751957872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2001441b0 0x7fa2000c87a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.062 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:28.055+0000 7fa206200640 1 --2- 172.21.15.133:0/1751957872 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2000ce890 0x7fa2000c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.062 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:28.055+0000 7fa206200640 1 --2- 172.21.15.133:0/1751957872 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2000cb9b0 0x7fa20015a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.062 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:28.055+0000 7fa206200640 1 -- 172.21.15.133:0/1751957872 >> 172.21.15.133:0/1751957872 conn(0x7fa2000b0450 msgr2=0x7fa2000adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:28.062 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:28.055+0000 7fa206200640 1 -- 172.21.15.133:0/1751957872 shutdown_connections 2024-03-30T01:51:28.062 INFO:teuthology.misc.health.smithi133.stderr:2024-03-30T01:51:28.055+0000 7fa206200640 1 -- 172.21.15.133:0/1751957872 wait complete. 2024-03-30T01:51:28.076 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-30T01:51:28.076 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-30T01:51:28.077 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-30T01:51:28.077 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-30T01:51:28.084 INFO:tasks.ceph.mds.a:Started 2024-03-30T01:51:28.084 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-30T01:51:28.084 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-30T01:51:28.091 INFO:tasks.ceph.mds.c:Started 2024-03-30T01:51:28.091 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-30T01:51:28.091 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-30T01:51:28.098 INFO:tasks.ceph.mds.b:Started 2024-03-30T01:51:28.099 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-30T01:51:28.099 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-30T01:51:28.106 INFO:tasks.ceph.mds.d:Started 2024-03-30T01:51:28.106 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-30T01:51:28.109 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:51:28.240 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2024-03-30T01:51:28.240 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2024-03-30T01:51:28.264 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2024-03-30T01:51:28.264 INFO:tasks.ceph.mds.d.smithi137.stdout:starting mds.d at 2024-03-30T01:51:28.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.292+0000 7f6007400640 1 Processor -- start 2024-03-30T01:51:28.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.292+0000 7f6007400640 1 -- start start 2024-03-30T01:51:28.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.293+0000 7f6007400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f600015cc50 0x7f60000d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:28.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.293+0000 7f6007400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f60000d2240 0x7f60000cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:28.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.293+0000 7f6007400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f600015d030 con 0x7f60000cf9b0 2024-03-30T01:51:28.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.293+0000 7f6007400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60000d1c50 con 0x7f60000d2240 2024-03-30T01:51:28.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.293+0000 7f6007400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60000cfe20 con 0x7f600015cc50 2024-03-30T01:51:28.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.294+0000 7f5ff7e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f60000d2240 0x7f60000cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:28.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.294+0000 7f5ff7e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f60000d2240 0x7f60000cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40190/0 (socket says 172.21.15.133:40190) 2024-03-30T01:51:28.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.294+0000 7f5ff7e00640 1 -- 172.21.15.133:0/2966106212 learned_addr learned my addr 172.21.15.133:0/2966106212 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:28.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.294+0000 7f6004a00640 1 --2- 172.21.15.133:0/2966106212 >> v2:172.21.15.137:3300/0 conn(0x7f600015cc50 0x7f60000d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:28.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.294+0000 7f5ff7e00640 1 -- 172.21.15.133:0/2966106212 >> v2:172.21.15.137:3300/0 conn(0x7f600015cc50 msgr2=0x7f60000d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:28.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.294+0000 7f5ff7e00640 1 --2- 172.21.15.133:0/2966106212 >> v2:172.21.15.137:3300/0 conn(0x7f600015cc50 0x7f60000d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.294+0000 7f5ff7e00640 1 -- 172.21.15.133:0/2966106212 >> v1:172.21.15.137:6789/0 conn(0x7f60000cf9b0 legacy=0x7f60000b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:28.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.294+0000 7f5ff7e00640 1 -- 172.21.15.133:0/2966106212 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60000b5af0 con 0x7f60000d2240 2024-03-30T01:51:28.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.295+0000 7f5ff7e00640 1 --2- 172.21.15.133:0/2966106212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60000d2240 0x7f60000cf470 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f60000b5620 tx=0x7f5fe802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142aa94aa8f6655f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:28.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.295+0000 7f5fffe00640 1 -- 172.21.15.133:0/2966106212 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8030860 con 0x7f60000d2240 2024-03-30T01:51:28.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.295+0000 7f5fffe00640 1 -- 172.21.15.133:0/2966106212 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe80309c0 con 0x7f60000d2240 2024-03-30T01:51:28.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.295+0000 7f5fffe00640 1 -- 172.21.15.133:0/2966106212 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8030d50 con 0x7f60000d2240 2024-03-30T01:51:28.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.296+0000 7f6007400640 1 -- 172.21.15.133:0/2966106212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60000d2240 msgr2=0x7f60000cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:28.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.296+0000 7f6007400640 1 --2- 172.21.15.133:0/2966106212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60000d2240 0x7f60000cf470 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f60000b5620 tx=0x7f5fe802b9a0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.296+0000 7f6007400640 1 -- 172.21.15.133:0/2966106212 shutdown_connections 2024-03-30T01:51:28.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.296+0000 7f6007400640 1 --2- 172.21.15.133:0/2966106212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60000d2240 0x7f60000cf470 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.296+0000 7f6007400640 1 --2- 172.21.15.133:0/2966106212 >> v2:172.21.15.137:3300/0 conn(0x7f600015cc50 0x7f60000d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.296+0000 7f6007400640 1 -- 172.21.15.133:0/2966106212 >> 172.21.15.133:0/2966106212 conn(0x7f6000071a40 msgr2=0x7f600006b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:28.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.296+0000 7f6007400640 1 -- 172.21.15.133:0/2966106212 shutdown_connections 2024-03-30T01:51:28.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.296+0000 7f6007400640 1 -- 172.21.15.133:0/2966106212 wait complete. 2024-03-30T01:51:28.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.298+0000 7f6007400640 1 Processor -- start 2024-03-30T01:51:28.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.298+0000 7f6007400640 1 -- start start 2024-03-30T01:51:28.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.299+0000 7f6007400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f60000cf9b0 0x7f600015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:28.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.299+0000 7f6007400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60000d2240 0x7f600015e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:28.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.299+0000 7f6007400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f600015cc50 0x7f600015e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:28.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.299+0000 7f6007400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60000ac830 con 0x7f600015cc50 2024-03-30T01:51:28.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.299+0000 7f6007400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60001f34a0 con 0x7f60000d2240 2024-03-30T01:51:28.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.299+0000 7f6007400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60000ac550 con 0x7f60000cf9b0 2024-03-30T01:51:28.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.299+0000 7f6005400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f600015cc50 0x7f600015e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:28.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.299+0000 7f5ff7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60000d2240 0x7f600015e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:28.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.299+0000 7f6005400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f600015cc50 0x7f600015e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40198/0 (socket says 172.21.15.133:40198) 2024-03-30T01:51:28.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.299+0000 7f6005400640 1 -- 172.21.15.133:0/1489735772 learned_addr learned my addr 172.21.15.133:0/1489735772 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:28.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.299+0000 7f6004a00640 1 --2- 172.21.15.133:0/1489735772 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f60000cf9b0 0x7f600015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:28.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.300+0000 7f6005400640 1 -- 172.21.15.133:0/1489735772 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f60000cf9b0 msgr2=0x7f600015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:28.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.300+0000 7f6005400640 1 --2- 172.21.15.133:0/1489735772 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f60000cf9b0 0x7f600015a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.300+0000 7f6005400640 1 -- 172.21.15.133:0/1489735772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60000d2240 msgr2=0x7f600015e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:28.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.300+0000 7f6005400640 1 --2- 172.21.15.133:0/1489735772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60000d2240 0x7f600015e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.300+0000 7f6005400640 1 -- 172.21.15.133:0/1489735772 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe80094d0 con 0x7f600015cc50 2024-03-30T01:51:28.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.300+0000 7f6005400640 1 --2- 172.21.15.133:0/1489735772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f600015cc50 0x7f600015e5e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800c730 tx=0x7f5ff800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:28.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.300+0000 7f5ffd600640 1 -- 172.21.15.133:0/1489735772 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8003b90 con 0x7f600015cc50 2024-03-30T01:51:28.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.300+0000 7f5ffd600640 1 -- 172.21.15.133:0/1489735772 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff8003cf0 con 0x7f600015cc50 2024-03-30T01:51:28.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.300+0000 7f6007400640 1 -- 172.21.15.133:0/1489735772 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60001f3740 con 0x7f600015cc50 2024-03-30T01:51:28.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.300+0000 7f5ffd600640 1 -- 172.21.15.133:0/1489735772 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8003ea0 con 0x7f600015cc50 2024-03-30T01:51:28.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.300+0000 7f6007400640 1 -- 172.21.15.133:0/1489735772 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600015a9e0 con 0x7f600015cc50 2024-03-30T01:51:28.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.301+0000 7f6007400640 1 -- 172.21.15.133:0/1489735772 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60001f3300 con 0x7f600015cc50 2024-03-30T01:51:28.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.302+0000 7f5ffd600640 1 -- 172.21.15.133:0/1489735772 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f5ff800aa90 con 0x7f600015cc50 2024-03-30T01:51:28.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.303+0000 7f5ffd600640 1 --2- 172.21.15.133:0/1489735772 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f5fdc06ac00 0x7f5fdc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:28.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.303+0000 7f5ffd600640 1 -- 172.21.15.133:0/1489735772 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5ff8088d90 con 0x7f600015cc50 2024-03-30T01:51:28.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.304+0000 7f6004a00640 1 --2- 172.21.15.133:0/1489735772 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f5fdc06ac00 0x7f5fdc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:28.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.304+0000 7f6004a00640 1 --2- 172.21.15.133:0/1489735772 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f5fdc06ac00 0x7f5fdc06d0c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0009aa0 tx=0x7f5ff0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:28.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.308+0000 7f5ffd600640 1 -- 172.21.15.133:0/1489735772 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f60001f3300 con 0x7f600015cc50 2024-03-30T01:51:28.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.506+0000 7f6007400640 1 -- 172.21.15.133:0/1489735772 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60001f3300 con 0x7f600015cc50 2024-03-30T01:51:28.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.507+0000 7f5ffd600640 1 -- 172.21.15.133:0/1489735772 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f60001f3300 con 0x7f600015cc50 2024-03-30T01:51:28.513 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:28.514 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":16,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:51:24.012485+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:51:28.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.510+0000 7f6007400640 1 -- 172.21.15.133:0/1489735772 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f5fdc06ac00 msgr2=0x7f5fdc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:28.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.510+0000 7f6007400640 1 --2- 172.21.15.133:0/1489735772 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f5fdc06ac00 0x7f5fdc06d0c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0009aa0 tx=0x7f5ff0009190 comp rx=0 tx=0).stop 2024-03-30T01:51:28.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.510+0000 7f6007400640 1 -- 172.21.15.133:0/1489735772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f600015cc50 msgr2=0x7f600015e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:28.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.510+0000 7f6007400640 1 --2- 172.21.15.133:0/1489735772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f600015cc50 0x7f600015e5e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800c730 tx=0x7f5ff800cbf0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.510+0000 7f6007400640 1 -- 172.21.15.133:0/1489735772 shutdown_connections 2024-03-30T01:51:28.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.510+0000 7f6007400640 1 --2- 172.21.15.133:0/1489735772 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f5fdc06ac00 0x7f5fdc06d0c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.510+0000 7f6007400640 1 --2- 172.21.15.133:0/1489735772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f600015cc50 0x7f600015e5e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.510+0000 7f6007400640 1 --2- 172.21.15.133:0/1489735772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60000d2240 0x7f600015e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.510+0000 7f6007400640 1 --2- 172.21.15.133:0/1489735772 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f60000cf9b0 0x7f600015a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.510+0000 7f6007400640 1 -- 172.21.15.133:0/1489735772 >> 172.21.15.133:0/1489735772 conn(0x7f6000071a40 msgr2=0x7f60000b7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:28.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.510+0000 7f6007400640 1 -- 172.21.15.133:0/1489735772 shutdown_connections 2024-03-30T01:51:28.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.510+0000 7f6007400640 1 -- 172.21.15.133:0/1489735772 wait complete. 2024-03-30T01:51:28.535 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T01:51:21.771393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T01:51:28.535 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T01:51:28.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.732+0000 7f2879400640 1 Processor -- start 2024-03-30T01:51:28.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.733+0000 7f2879400640 1 -- start start 2024-03-30T01:51:28.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.734+0000 7f2879400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f287415cec0 0x7f28740b8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:28.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.734+0000 7f2879400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28740cf860 0x7f28740cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:28.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.734+0000 7f2879400640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28740b5ba0 con 0x7f28740b4530 2024-03-30T01:51:28.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.734+0000 7f2879400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2874161810 con 0x7f287415cec0 2024-03-30T01:51:28.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.734+0000 7f2879400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28740d0230 con 0x7f28740cf860 2024-03-30T01:51:28.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.735+0000 7f2872800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f287415cec0 0x7f28740b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:28.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.735+0000 7f2873200640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f28740b4530 0x7f28740b49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41902/0 (socket says 172.21.15.133:41902) 2024-03-30T01:51:28.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.735+0000 7f2873200640 1 -- 172.21.15.133:0/3318077662 learned_addr learned my addr 172.21.15.133:0/3318077662 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:28.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.735+0000 7f2871e00640 1 --2- 172.21.15.133:0/3318077662 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28740cf860 0x7f28740cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:28.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.735+0000 7f2871400640 1 -- 172.21.15.133:0/3318077662 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474396796 0 0) 0x7f28740b5ba0 con 0x7f28740b4530 2024-03-30T01:51:28.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.735+0000 7f2871400640 1 -- 172.21.15.133:0/3318077662 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2858003520 con 0x7f28740b4530 2024-03-30T01:51:28.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.735+0000 7f2872800640 1 -- 172.21.15.133:0/3318077662 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28740cf860 msgr2=0x7f28740cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:28.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.735+0000 7f2872800640 1 --2- 172.21.15.133:0/3318077662 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28740cf860 0x7f28740cfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.735+0000 7f2872800640 1 -- 172.21.15.133:0/3318077662 >> v1:172.21.15.133:6789/0 conn(0x7f28740b4530 legacy=0x7f28740b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:28.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.735+0000 7f2872800640 1 -- 172.21.15.133:0/3318077662 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2874160b90 con 0x7f287415cec0 2024-03-30T01:51:28.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.736+0000 7f2872800640 1 --2- 172.21.15.133:0/3318077662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f287415cec0 0x7f28740b8420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2864009d90 tx=0x7f286402bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7fe6db741b31568 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:28.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.737+0000 7f2871400640 1 -- 172.21.15.133:0/3318077662 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286402cce0 con 0x7f287415cec0 2024-03-30T01:51:28.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.737+0000 7f2871400640 1 -- 172.21.15.133:0/3318077662 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286402ce40 con 0x7f287415cec0 2024-03-30T01:51:28.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.737+0000 7f2871400640 1 -- 172.21.15.133:0/3318077662 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2864034660 con 0x7f287415cec0 2024-03-30T01:51:28.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.737+0000 7f2879400640 1 -- 172.21.15.133:0/3318077662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f287415cec0 msgr2=0x7f28740b8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:28.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.737+0000 7f2879400640 1 --2- 172.21.15.133:0/3318077662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f287415cec0 0x7f28740b8420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2864009d90 tx=0x7f286402bf30 comp rx=0 tx=0).stop 2024-03-30T01:51:28.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.738+0000 7f2879400640 1 -- 172.21.15.133:0/3318077662 shutdown_connections 2024-03-30T01:51:28.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.738+0000 7f2879400640 1 --2- 172.21.15.133:0/3318077662 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28740cf860 0x7f28740cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.738+0000 7f2879400640 1 --2- 172.21.15.133:0/3318077662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f287415cec0 0x7f28740b8420 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.738+0000 7f2879400640 1 -- 172.21.15.133:0/3318077662 >> 172.21.15.133:0/3318077662 conn(0x7f287406b5e0 msgr2=0x7f287406b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:28.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.738+0000 7f2879400640 1 -- 172.21.15.133:0/3318077662 shutdown_connections 2024-03-30T01:51:28.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.738+0000 7f2879400640 1 -- 172.21.15.133:0/3318077662 wait complete. 2024-03-30T01:51:28.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.739+0000 7f2879400640 1 Processor -- start 2024-03-30T01:51:28.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.740+0000 7f2879400640 1 -- start start 2024-03-30T01:51:28.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.740+0000 7f2879400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28740b4530 0x7f28740c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:28.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.740+0000 7f2879400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28740cf860 0x7f287415d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:28.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.740+0000 7f2879400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28740cbd70 0x7f287414bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:28.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.740+0000 7f2879400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287415d8d0 con 0x7f28740cbd70 2024-03-30T01:51:28.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.741+0000 7f2879400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28740c7460 con 0x7f28740cf860 2024-03-30T01:51:28.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.741+0000 7f2879400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28740c6bc0 con 0x7f28740b4530 2024-03-30T01:51:28.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.741+0000 7f2873200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28740cbd70 0x7f287414bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:28.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.741+0000 7f2873200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28740cbd70 0x7f287414bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40220/0 (socket says 172.21.15.133:40220) 2024-03-30T01:51:28.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.741+0000 7f2873200640 1 -- 172.21.15.133:0/3857715347 learned_addr learned my addr 172.21.15.133:0/3857715347 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:28.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.741+0000 7f2872800640 1 --2- 172.21.15.133:0/3857715347 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28740b4530 0x7f28740c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:28.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.741+0000 7f2871e00640 1 --2- 172.21.15.133:0/3857715347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28740cf860 0x7f287415d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:28.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.741+0000 7f2873200640 1 -- 172.21.15.133:0/3857715347 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28740b4530 msgr2=0x7f28740c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:28.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.741+0000 7f2873200640 1 --2- 172.21.15.133:0/3857715347 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28740b4530 0x7f28740c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.741+0000 7f2873200640 1 -- 172.21.15.133:0/3857715347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28740cf860 msgr2=0x7f287415d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:28.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.741+0000 7f2873200640 1 --2- 172.21.15.133:0/3857715347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28740cf860 0x7f287415d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.741+0000 7f2873200640 1 -- 172.21.15.133:0/3857715347 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2864009a70 con 0x7f28740cbd70 2024-03-30T01:51:28.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.741+0000 7f2871e00640 1 --2- 172.21.15.133:0/3857715347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28740cf860 0x7f287415d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:28.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.742+0000 7f2873200640 1 --2- 172.21.15.133:0/3857715347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28740cbd70 0x7f287414bb40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f286c00c430 tx=0x7f286c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:28.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.742+0000 7f286aa00640 1 -- 172.21.15.133:0/3857715347 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c005ce0 con 0x7f28740cbd70 2024-03-30T01:51:28.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.742+0000 7f286aa00640 1 -- 172.21.15.133:0/3857715347 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c005e40 con 0x7f28740cbd70 2024-03-30T01:51:28.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.742+0000 7f286aa00640 1 -- 172.21.15.133:0/3857715347 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c007310 con 0x7f28740cbd70 2024-03-30T01:51:28.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.742+0000 7f2879400640 1 -- 172.21.15.133:0/3857715347 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28740c6ea0 con 0x7f28740cbd70 2024-03-30T01:51:28.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.742+0000 7f2879400640 1 -- 172.21.15.133:0/3857715347 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28740c77d0 con 0x7f28740cbd70 2024-03-30T01:51:28.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.743+0000 7f2879400640 1 -- 172.21.15.133:0/3857715347 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2874066d80 con 0x7f28740cbd70 2024-03-30T01:51:28.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.744+0000 7f286aa00640 1 -- 172.21.15.133:0/3857715347 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f286c007470 con 0x7f28740cbd70 2024-03-30T01:51:28.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.745+0000 7f286aa00640 1 --2- 172.21.15.133:0/3857715347 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f285006ac00 0x7f285006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:28.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.745+0000 7f286aa00640 1 -- 172.21.15.133:0/3857715347 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f286c088620 con 0x7f28740cbd70 2024-03-30T01:51:28.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.745+0000 7f2872800640 1 --2- 172.21.15.133:0/3857715347 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f285006ac00 0x7f285006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:28.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.746+0000 7f2872800640 1 --2- 172.21.15.133:0/3857715347 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f285006ac00 0x7f285006d0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2864036000 tx=0x7f2864030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:28.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.750+0000 7f286aa00640 1 -- 172.21.15.133:0/3857715347 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f286c053b40 con 0x7f28740cbd70 2024-03-30T01:51:28.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.942+0000 7f2879400640 1 -- 172.21.15.133:0/3857715347 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28740c6310 con 0x7f28740cbd70 2024-03-30T01:51:28.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.943+0000 7f286aa00640 1 -- 172.21.15.133:0/3857715347 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f286c017020 con 0x7f28740cbd70 2024-03-30T01:51:28.949 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-03-30T01:51:28.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.946+0000 7f2879400640 1 -- 172.21.15.133:0/3857715347 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f285006ac00 msgr2=0x7f285006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:28.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.946+0000 7f2879400640 1 --2- 172.21.15.133:0/3857715347 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f285006ac00 0x7f285006d0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2864036000 tx=0x7f2864030000 comp rx=0 tx=0).stop 2024-03-30T01:51:28.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.946+0000 7f2879400640 1 -- 172.21.15.133:0/3857715347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28740cbd70 msgr2=0x7f287414bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:28.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.946+0000 7f2879400640 1 --2- 172.21.15.133:0/3857715347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28740cbd70 0x7f287414bb40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f286c00c430 tx=0x7f286c00c8f0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.946+0000 7f2879400640 1 -- 172.21.15.133:0/3857715347 shutdown_connections 2024-03-30T01:51:28.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.946+0000 7f2879400640 1 --2- 172.21.15.133:0/3857715347 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f285006ac00 0x7f285006d0c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.946+0000 7f2879400640 1 --2- 172.21.15.133:0/3857715347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28740cbd70 0x7f287414bb40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.946+0000 7f2879400640 1 --2- 172.21.15.133:0/3857715347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28740cf860 0x7f287415d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.946+0000 7f2879400640 1 --2- 172.21.15.133:0/3857715347 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28740b4530 0x7f28740c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:28.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.946+0000 7f2879400640 1 -- 172.21.15.133:0/3857715347 >> 172.21.15.133:0/3857715347 conn(0x7f287406b5e0 msgr2=0x7f28740b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:28.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.946+0000 7f2879400640 1 -- 172.21.15.133:0/3857715347 shutdown_connections 2024-03-30T01:51:28.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:28.946+0000 7f2879400640 1 -- 172.21.15.133:0/3857715347 wait complete. 2024-03-30T01:51:28.970 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T01:51:29.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.172+0000 7f4b98a00640 1 Processor -- start 2024-03-30T01:51:29.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.172+0000 7f4b98a00640 1 -- start start 2024-03-30T01:51:29.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.174+0000 7f4b98a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4b941457b0 0x7f4b940b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:29.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.174+0000 7f4b98a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4b94070c10 0x7f4b940b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:29.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.174+0000 7f4b98a00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9406c320 con 0x7f4b94145d30 2024-03-30T01:51:29.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.174+0000 7f4b98a00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b94145b90 con 0x7f4b94070c10 2024-03-30T01:51:29.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.174+0000 7f4b98a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b9406c600 con 0x7f4b941457b0 2024-03-30T01:51:29.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.174+0000 7f4b92800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4b94070c10 0x7f4b940b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:29.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.174+0000 7f4b92800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4b94070c10 0x7f4b940b18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40222/0 (socket says 172.21.15.133:40222) 2024-03-30T01:51:29.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.174+0000 7f4b92800640 1 -- 172.21.15.133:0/797199454 learned_addr learned my addr 172.21.15.133:0/797199454 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:29.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.174+0000 7f4b91400640 1 --1- 172.21.15.133:0/797199454 >> v1:172.21.15.133:6789/0 conn(0x7f4b94145d30 0x7f4b94070500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41914/0 (socket says 172.21.15.133:41914) 2024-03-30T01:51:29.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.174+0000 7f4b91e00640 1 --2- 172.21.15.133:0/797199454 >> v2:172.21.15.137:3300/0 conn(0x7f4b941457b0 0x7f4b940b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:29.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.175+0000 7f4b92800640 1 -- 172.21.15.133:0/797199454 >> v2:172.21.15.137:3300/0 conn(0x7f4b941457b0 msgr2=0x7f4b940b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:29.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.175+0000 7f4b92800640 1 --2- 172.21.15.133:0/797199454 >> v2:172.21.15.137:3300/0 conn(0x7f4b941457b0 0x7f4b940b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:29.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.175+0000 7f4b92800640 1 -- 172.21.15.133:0/797199454 >> v1:172.21.15.133:6789/0 conn(0x7f4b94145d30 legacy=0x7f4b94070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:29.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.175+0000 7f4b92800640 1 -- 172.21.15.133:0/797199454 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9406c8e0 con 0x7f4b94070c10 2024-03-30T01:51:29.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.175+0000 7f4b90a00640 1 -- 172.21.15.133:0/797199454 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537941960 0 0) 0x7f4b9406c320 con 0x7f4b94145d30 2024-03-30T01:51:29.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.176+0000 7f4b92800640 1 --2- 172.21.15.133:0/797199454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b94070c10 0x7f4b940b18c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4b94071240 tx=0x7f4b8c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb4a18738e18771 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:29.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.176+0000 7f4b90a00640 1 -- 172.21.15.133:0/797199454 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c02cb20 con 0x7f4b94070c10 2024-03-30T01:51:29.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.176+0000 7f4b90a00640 1 -- 172.21.15.133:0/797199454 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8c02cc80 con 0x7f4b94070c10 2024-03-30T01:51:29.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.176+0000 7f4b90a00640 1 -- 172.21.15.133:0/797199454 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c0343f0 con 0x7f4b94070c10 2024-03-30T01:51:29.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.177+0000 7f4b98a00640 1 -- 172.21.15.133:0/797199454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b94070c10 msgr2=0x7f4b940b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:29.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.177+0000 7f4b98a00640 1 --2- 172.21.15.133:0/797199454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b94070c10 0x7f4b940b18c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4b94071240 tx=0x7f4b8c02bf80 comp rx=0 tx=0).stop 2024-03-30T01:51:29.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.177+0000 7f4b98a00640 1 -- 172.21.15.133:0/797199454 shutdown_connections 2024-03-30T01:51:29.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.177+0000 7f4b98a00640 1 --2- 172.21.15.133:0/797199454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b94070c10 0x7f4b940b18c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:29.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.177+0000 7f4b98a00640 1 --2- 172.21.15.133:0/797199454 >> v2:172.21.15.137:3300/0 conn(0x7f4b941457b0 0x7f4b940b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:29.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.177+0000 7f4b98a00640 1 -- 172.21.15.133:0/797199454 >> 172.21.15.133:0/797199454 conn(0x7f4b940b07a0 msgr2=0x7f4b940b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:29.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.177+0000 7f4b98a00640 1 -- 172.21.15.133:0/797199454 shutdown_connections 2024-03-30T01:51:29.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.177+0000 7f4b98a00640 1 -- 172.21.15.133:0/797199454 wait complete. 2024-03-30T01:51:29.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.178+0000 7f4b98a00640 1 Processor -- start 2024-03-30T01:51:29.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.179+0000 7f4b98a00640 1 -- start start 2024-03-30T01:51:29.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.180+0000 7f4b98a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b94070c10 0x7f4b9415c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:29.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.180+0000 7f4b98a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b941457b0 0x7f4b94131590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:29.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.180+0000 7f4b98a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b94145d30 0x7f4b941f5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:29.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.180+0000 7f4b98a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b941f6b50 con 0x7f4b941457b0 2024-03-30T01:51:29.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.180+0000 7f4b98a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9415c9c0 con 0x7f4b94070c10 2024-03-30T01:51:29.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.180+0000 7f4b98a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b941f6590 con 0x7f4b94145d30 2024-03-30T01:51:29.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.180+0000 7f4b91400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b941457b0 0x7f4b94131590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:29.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.180+0000 7f4b91400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b941457b0 0x7f4b94131590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40228/0 (socket says 172.21.15.133:40228) 2024-03-30T01:51:29.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.180+0000 7f4b91400640 1 -- 172.21.15.133:0/2665676702 learned_addr learned my addr 172.21.15.133:0/2665676702 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:29.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.180+0000 7f4b91e00640 1 --2- 172.21.15.133:0/2665676702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b94070c10 0x7f4b9415c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:29.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.180+0000 7f4b91400640 1 -- 172.21.15.133:0/2665676702 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b94145d30 msgr2=0x7f4b941f5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:29.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.180+0000 7f4b91400640 1 --2- 172.21.15.133:0/2665676702 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b94145d30 0x7f4b941f5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:29.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.180+0000 7f4b91400640 1 -- 172.21.15.133:0/2665676702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b94070c10 msgr2=0x7f4b9415c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:29.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.180+0000 7f4b91400640 1 --2- 172.21.15.133:0/2665676702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b94070c10 0x7f4b9415c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:29.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.180+0000 7f4b91400640 1 -- 172.21.15.133:0/2665676702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8c009b30 con 0x7f4b941457b0 2024-03-30T01:51:29.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.181+0000 7f4b91400640 1 --2- 172.21.15.133:0/2665676702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b941457b0 0x7f4b94131590 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000c430 tx=0x7f4b8000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:29.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.181+0000 7f4b8a000640 1 -- 172.21.15.133:0/2665676702 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b800074e0 con 0x7f4b941457b0 2024-03-30T01:51:29.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.181+0000 7f4b8a000640 1 -- 172.21.15.133:0/2665676702 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b80007660 con 0x7f4b941457b0 2024-03-30T01:51:29.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.181+0000 7f4b98a00640 1 -- 172.21.15.133:0/2665676702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b941f6870 con 0x7f4b941457b0 2024-03-30T01:51:29.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.181+0000 7f4b8a000640 1 -- 172.21.15.133:0/2665676702 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b80004a20 con 0x7f4b941457b0 2024-03-30T01:51:29.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.181+0000 7f4b98a00640 1 -- 172.21.15.133:0/2665676702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b94131070 con 0x7f4b941457b0 2024-03-30T01:51:29.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.182+0000 7f4b98a00640 1 -- 172.21.15.133:0/2665676702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b94130bf0 con 0x7f4b941457b0 2024-03-30T01:51:29.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.183+0000 7f4b8a000640 1 -- 172.21.15.133:0/2665676702 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f4b80004b80 con 0x7f4b941457b0 2024-03-30T01:51:29.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.184+0000 7f4b8a000640 1 --2- 172.21.15.133:0/2665676702 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4b7406ac30 0x7f4b7406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:29.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.184+0000 7f4b8a000640 1 -- 172.21.15.133:0/2665676702 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4b80088ed0 con 0x7f4b941457b0 2024-03-30T01:51:29.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.184+0000 7f4b91e00640 1 --2- 172.21.15.133:0/2665676702 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4b7406ac30 0x7f4b7406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:29.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.185+0000 7f4b91e00640 1 --2- 172.21.15.133:0/2665676702 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4b7406ac30 0x7f4b7406d0f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4b84006fd0 tx=0x7f4b84008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:29.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.189+0000 7f4b8a000640 1 -- 172.21.15.133:0/2665676702 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f4b94130bf0 con 0x7f4b941457b0 2024-03-30T01:51:29.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.422+0000 7f4b98a00640 1 -- 172.21.15.133:0/2665676702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b94130bf0 con 0x7f4b941457b0 2024-03-30T01:51:29.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.423+0000 7f4b8a000640 1 -- 172.21.15.133:0/2665676702 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3533 (secure 0 0 0) 0x7f4b94130bf0 con 0x7f4b941457b0 2024-03-30T01:51:29.429 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:29.429 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2218506023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2218506023},{"type":"v1","addr":"172.21.15.137:6835","nonce":2218506023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2935514153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2935514153},{"type":"v1","addr":"172.21.15.133:6836","nonce":2935514153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2942187095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2942187095},{"type":"v1","addr":"172.21.15.133:6837","nonce":2942187095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/225370013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":225370013},{"type":"v1","addr":"172.21.15.137:6834","nonce":225370013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-03-30T01:51:29.429 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 3 2024-03-30T01:51:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.425+0000 7f4b98a00640 1 -- 172.21.15.133:0/2665676702 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4b7406ac30 msgr2=0x7f4b7406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.425+0000 7f4b98a00640 1 --2- 172.21.15.133:0/2665676702 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4b7406ac30 0x7f4b7406d0f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4b84006fd0 tx=0x7f4b84008040 comp rx=0 tx=0).stop 2024-03-30T01:51:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.425+0000 7f4b98a00640 1 -- 172.21.15.133:0/2665676702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b941457b0 msgr2=0x7f4b94131590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.425+0000 7f4b98a00640 1 --2- 172.21.15.133:0/2665676702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b941457b0 0x7f4b94131590 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000c430 tx=0x7f4b8000c8f0 comp rx=0 tx=0).stop 2024-03-30T01:51:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.426+0000 7f4b98a00640 1 -- 172.21.15.133:0/2665676702 shutdown_connections 2024-03-30T01:51:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.426+0000 7f4b98a00640 1 --2- 172.21.15.133:0/2665676702 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4b7406ac30 0x7f4b7406d0f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.426+0000 7f4b98a00640 1 --2- 172.21.15.133:0/2665676702 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b94145d30 0x7f4b941f5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.426+0000 7f4b98a00640 1 --2- 172.21.15.133:0/2665676702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b941457b0 0x7f4b94131590 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.426+0000 7f4b98a00640 1 --2- 172.21.15.133:0/2665676702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b94070c10 0x7f4b9415c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:29.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.426+0000 7f4b98a00640 1 -- 172.21.15.133:0/2665676702 >> 172.21.15.133:0/2665676702 conn(0x7f4b940b07a0 msgr2=0x7f4b940afc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:29.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.426+0000 7f4b98a00640 1 -- 172.21.15.133:0/2665676702 shutdown_connections 2024-03-30T01:51:29.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.426+0000 7f4b98a00640 1 -- 172.21.15.133:0/2665676702 wait complete. 2024-03-30T01:51:29.450 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:51:29.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.652+0000 7fe751000640 1 Processor -- start 2024-03-30T01:51:29.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.652+0000 7fe751000640 1 -- start start 2024-03-30T01:51:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.653+0000 7fe751000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe74c0ccc40 0x7fe74c070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.653+0000 7fe751000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74c0a76a0 con 0x7fe74c070500 2024-03-30T01:51:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.653+0000 7fe751000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74c0b38e0 con 0x7fe74c143790 2024-03-30T01:51:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.653+0000 7fe751000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe74c070ed0 con 0x7fe74c0ccc40 2024-03-30T01:51:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.654+0000 7fe741400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe74c070500 0x7fe74c0cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41916/0 (socket says 172.21.15.133:41916) 2024-03-30T01:51:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.654+0000 7fe741400640 1 -- 172.21.15.133:0/3136931285 learned_addr learned my addr 172.21.15.133:0/3136931285 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.654+0000 7fe74a800640 1 --2- 172.21.15.133:0/3136931285 >> v2:172.21.15.133:3300/0 conn(0x7fe74c0ccc40 0x7fe74c070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.654+0000 7fe74a800640 1 -- 172.21.15.133:0/3136931285 >> v1:172.21.15.137:6789/0 conn(0x7fe74c143790 legacy=0x7fe74c0cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.654+0000 7fe74a800640 1 -- 172.21.15.133:0/3136931285 >> v1:172.21.15.133:6789/0 conn(0x7fe74c070500 legacy=0x7fe74c0cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.654+0000 7fe74a800640 1 -- 172.21.15.133:0/3136931285 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c0cd180 con 0x7fe74c0ccc40 2024-03-30T01:51:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.654+0000 7fe749400640 1 -- 172.21.15.133:0/3136931285 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261002371 0 0) 0x7fe74c0a76a0 con 0x7fe74c070500 2024-03-30T01:51:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.655+0000 7fe74a800640 1 --2- 172.21.15.133:0/3136931285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe74c0ccc40 0x7fe74c070990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe744009d90 tx=0x7fe74402bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916cabb1254794e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.655+0000 7fe749400640 1 -- 172.21.15.133:0/3136931285 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74402cd80 con 0x7fe74c0ccc40 2024-03-30T01:51:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.655+0000 7fe749400640 1 -- 172.21.15.133:0/3136931285 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe744034440 con 0x7fe74c0ccc40 2024-03-30T01:51:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.655+0000 7fe749400640 1 -- 172.21.15.133:0/3136931285 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7440347d0 con 0x7fe74c0ccc40 2024-03-30T01:51:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.656+0000 7fe751000640 1 -- 172.21.15.133:0/3136931285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe74c0ccc40 msgr2=0x7fe74c070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.656+0000 7fe751000640 1 --2- 172.21.15.133:0/3136931285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe74c0ccc40 0x7fe74c070990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe744009d90 tx=0x7fe74402bfd0 comp rx=0 tx=0).stop 2024-03-30T01:51:29.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.656+0000 7fe751000640 1 -- 172.21.15.133:0/3136931285 shutdown_connections 2024-03-30T01:51:29.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.656+0000 7fe751000640 1 --2- 172.21.15.133:0/3136931285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe74c0ccc40 0x7fe74c070990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:29.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.656+0000 7fe751000640 1 -- 172.21.15.133:0/3136931285 >> 172.21.15.133:0/3136931285 conn(0x7fe74c0b07a0 msgr2=0x7fe74c0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:29.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.656+0000 7fe751000640 1 -- 172.21.15.133:0/3136931285 shutdown_connections 2024-03-30T01:51:29.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.656+0000 7fe751000640 1 -- 172.21.15.133:0/3136931285 wait complete. 2024-03-30T01:51:29.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.658+0000 7fe751000640 1 Processor -- start 2024-03-30T01:51:29.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.658+0000 7fe751000640 1 -- start start 2024-03-30T01:51:29.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.659+0000 7fe751000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe74c070500 0x7fe74c0c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:29.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.659+0000 7fe751000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe74c0ccc40 0x7fe74c0c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:29.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.659+0000 7fe751000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe74c143790 0x7fe74c142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:29.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.659+0000 7fe751000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c0c4b10 con 0x7fe74c0ccc40 2024-03-30T01:51:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.659+0000 7fe751000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c0c3830 con 0x7fe74c143790 2024-03-30T01:51:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.659+0000 7fe751000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c13ec60 con 0x7fe74c070500 2024-03-30T01:51:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.659+0000 7fe741400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe74c0ccc40 0x7fe74c0c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.659+0000 7fe741400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe74c0ccc40 0x7fe74c0c45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40234/0 (socket says 172.21.15.133:40234) 2024-03-30T01:51:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.659+0000 7fe741400640 1 -- 172.21.15.133:0/1658872438 learned_addr learned my addr 172.21.15.133:0/1658872438 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.660+0000 7fe749e00640 1 --2- 172.21.15.133:0/1658872438 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe74c070500 0x7fe74c0c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.660+0000 7fe74a800640 1 --2- 172.21.15.133:0/1658872438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe74c143790 0x7fe74c142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.660+0000 7fe741400640 1 -- 172.21.15.133:0/1658872438 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe74c070500 msgr2=0x7fe74c0c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.660+0000 7fe741400640 1 --2- 172.21.15.133:0/1658872438 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe74c070500 0x7fe74c0c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:29.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.660+0000 7fe741400640 1 -- 172.21.15.133:0/1658872438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe74c143790 msgr2=0x7fe74c142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:29.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.660+0000 7fe741400640 1 --2- 172.21.15.133:0/1658872438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe74c143790 0x7fe74c142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:29.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.660+0000 7fe741400640 1 -- 172.21.15.133:0/1658872438 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe744009a70 con 0x7fe74c0ccc40 2024-03-30T01:51:29.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.660+0000 7fe74a800640 1 --2- 172.21.15.133:0/1658872438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe74c143790 0x7fe74c142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:29.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.660+0000 7fe741400640 1 --2- 172.21.15.133:0/1658872438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe74c0ccc40 0x7fe74c0c45d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe73400c4a0 tx=0x7fe73400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:29.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.660+0000 7fe742a00640 1 -- 172.21.15.133:0/1658872438 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7340074e0 con 0x7fe74c0ccc40 2024-03-30T01:51:29.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.660+0000 7fe742a00640 1 -- 172.21.15.133:0/1658872438 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe734007640 con 0x7fe74c0ccc40 2024-03-30T01:51:29.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.660+0000 7fe742a00640 1 -- 172.21.15.133:0/1658872438 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe734004a00 con 0x7fe74c0ccc40 2024-03-30T01:51:29.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.660+0000 7fe751000640 1 -- 172.21.15.133:0/1658872438 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe74c0c3af0 con 0x7fe74c0ccc40 2024-03-30T01:51:29.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.660+0000 7fe751000640 1 -- 172.21.15.133:0/1658872438 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74c0c40b0 con 0x7fe74c0ccc40 2024-03-30T01:51:29.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.661+0000 7fe751000640 1 -- 172.21.15.133:0/1658872438 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe74c0c42a0 con 0x7fe74c0ccc40 2024-03-30T01:51:29.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.662+0000 7fe742a00640 1 -- 172.21.15.133:0/1658872438 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe734004b60 con 0x7fe74c0ccc40 2024-03-30T01:51:29.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.663+0000 7fe742a00640 1 --2- 172.21.15.133:0/1658872438 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe72806ac00 0x7fe72806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:29.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.663+0000 7fe742a00640 1 -- 172.21.15.133:0/1658872438 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe7340882a0 con 0x7fe74c0ccc40 2024-03-30T01:51:29.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.663+0000 7fe749e00640 1 --2- 172.21.15.133:0/1658872438 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe72806ac00 0x7fe72806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:29.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.664+0000 7fe749e00640 1 --2- 172.21.15.133:0/1658872438 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe72806ac00 0x7fe72806d0c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe73c000f60 tx=0x7fe73c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:29.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.668+0000 7fe742a00640 1 -- 172.21.15.133:0/1658872438 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fe734053730 con 0x7fe74c0ccc40 2024-03-30T01:51:29.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.863+0000 7fe751000640 1 -- 172.21.15.133:0/1658872438 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe74c066d80 con 0x7fe74c0ccc40 2024-03-30T01:51:29.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.864+0000 7fe742a00640 1 -- 172.21.15.133:0/1658872438 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7fe734056d50 con 0x7fe74c0ccc40 2024-03-30T01:51:29.871 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:29.871 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":16,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:51:24.012485+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:51:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.867+0000 7fe751000640 1 -- 172.21.15.133:0/1658872438 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe72806ac00 msgr2=0x7fe72806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.867+0000 7fe751000640 1 --2- 172.21.15.133:0/1658872438 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe72806ac00 0x7fe72806d0c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe73c000f60 tx=0x7fe73c009040 comp rx=0 tx=0).stop 2024-03-30T01:51:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.867+0000 7fe751000640 1 -- 172.21.15.133:0/1658872438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe74c0ccc40 msgr2=0x7fe74c0c45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.867+0000 7fe751000640 1 --2- 172.21.15.133:0/1658872438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe74c0ccc40 0x7fe74c0c45d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe73400c4a0 tx=0x7fe73400c960 comp rx=0 tx=0).stop 2024-03-30T01:51:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.867+0000 7fe751000640 1 -- 172.21.15.133:0/1658872438 shutdown_connections 2024-03-30T01:51:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.867+0000 7fe751000640 1 --2- 172.21.15.133:0/1658872438 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe72806ac00 0x7fe72806d0c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.867+0000 7fe751000640 1 --2- 172.21.15.133:0/1658872438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe74c143790 0x7fe74c142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.867+0000 7fe751000640 1 --2- 172.21.15.133:0/1658872438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe74c0ccc40 0x7fe74c0c45d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.867+0000 7fe751000640 1 --2- 172.21.15.133:0/1658872438 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe74c070500 0x7fe74c0c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.867+0000 7fe751000640 1 -- 172.21.15.133:0/1658872438 >> 172.21.15.133:0/1658872438 conn(0x7fe74c0b07a0 msgr2=0x7fe74c0b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.867+0000 7fe751000640 1 -- 172.21.15.133:0/1658872438 shutdown_connections 2024-03-30T01:51:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:29.867+0000 7fe751000640 1 -- 172.21.15.133:0/1658872438 wait complete. 2024-03-30T01:51:29.892 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T01:51:21.771393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T01:51:29.892 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T01:51:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.091+0000 7f4028e00640 1 Processor -- start 2024-03-30T01:51:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.091+0000 7f4028e00640 1 -- start start 2024-03-30T01:51:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.093+0000 7f4028e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f402406b3d0 0x7f402415d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.093+0000 7f4028e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f40240b47a0 0x7f40240b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.093+0000 7f4028e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f402406b990 con 0x7f402415a5a0 2024-03-30T01:51:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.093+0000 7f4028e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40240b5170 con 0x7f40240b47a0 2024-03-30T01:51:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.093+0000 7f4028e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402406bc70 con 0x7f402406b3d0 2024-03-30T01:51:30.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.093+0000 7f4022a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f402406b3d0 0x7f402415d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:30.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.094+0000 7f4023400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f402415a5a0 0x7f40240d0f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.133:34188/0 (socket says 172.21.15.133:34188) 2024-03-30T01:51:30.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.094+0000 7f4022a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f402406b3d0 0x7f402415d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.133:46210/0 (socket says 172.21.15.133:46210) 2024-03-30T01:51:30.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.094+0000 7f4023400640 1 -- 172.21.15.133:0/2722075254 learned_addr learned my addr 172.21.15.133:0/2722075254 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:30.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.094+0000 7f4023e00640 1 --2- 172.21.15.133:0/2722075254 >> v2:172.21.15.137:3300/0 conn(0x7f40240b47a0 0x7f40240b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:30.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.094+0000 7f4022000640 1 -- 172.21.15.133:0/2722075254 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682233565 0 0) 0x7f402406b990 con 0x7f402415a5a0 2024-03-30T01:51:30.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.094+0000 7f4022a00640 1 -- 172.21.15.133:0/2722075254 >> v2:172.21.15.137:3300/0 conn(0x7f40240b47a0 msgr2=0x7f40240b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:30.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.094+0000 7f4022a00640 1 --2- 172.21.15.133:0/2722075254 >> v2:172.21.15.137:3300/0 conn(0x7f40240b47a0 0x7f40240b4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.094+0000 7f4022a00640 1 -- 172.21.15.133:0/2722075254 >> v1:172.21.15.137:6789/0 conn(0x7f402415a5a0 legacy=0x7f40240d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:30.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.094+0000 7f4022a00640 1 -- 172.21.15.133:0/2722075254 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402406bf50 con 0x7f402406b3d0 2024-03-30T01:51:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.096+0000 7f4022a00640 1 --2- 172.21.15.133:0/2722075254 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f402406b3d0 0x7f402415d0a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f40100097a0 tx=0x7f401002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3be9b6aa6a08cd8a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.096+0000 7f4022000640 1 -- 172.21.15.133:0/2722075254 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401002e070 con 0x7f402406b3d0 2024-03-30T01:51:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.096+0000 7f4022000640 1 -- 172.21.15.133:0/2722075254 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40100315a0 con 0x7f402406b3d0 2024-03-30T01:51:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.096+0000 7f4022000640 1 -- 172.21.15.133:0/2722075254 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4010031930 con 0x7f402406b3d0 2024-03-30T01:51:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.097+0000 7f4028e00640 1 -- 172.21.15.133:0/2722075254 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f402406b3d0 msgr2=0x7f402415d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.097+0000 7f4028e00640 1 --2- 172.21.15.133:0/2722075254 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f402406b3d0 0x7f402415d0a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f40100097a0 tx=0x7f401002b840 comp rx=0 tx=0).stop 2024-03-30T01:51:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.097+0000 7f4028e00640 1 -- 172.21.15.133:0/2722075254 shutdown_connections 2024-03-30T01:51:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.097+0000 7f4028e00640 1 --2- 172.21.15.133:0/2722075254 >> v2:172.21.15.137:3300/0 conn(0x7f40240b47a0 0x7f40240b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.097+0000 7f4028e00640 1 --2- 172.21.15.133:0/2722075254 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f402406b3d0 0x7f402415d0a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.097+0000 7f4028e00640 1 -- 172.21.15.133:0/2722075254 >> 172.21.15.133:0/2722075254 conn(0x7f40240cf810 msgr2=0x7f40240cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:30.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.097+0000 7f4028e00640 1 -- 172.21.15.133:0/2722075254 shutdown_connections 2024-03-30T01:51:30.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.097+0000 7f4028e00640 1 -- 172.21.15.133:0/2722075254 wait complete. 2024-03-30T01:51:30.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.099+0000 7f4028e00640 1 Processor -- start 2024-03-30T01:51:30.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.099+0000 7f4028e00640 1 -- start start 2024-03-30T01:51:30.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.100+0000 7f4028e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f402406b3d0 0x7f40240cc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:30.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.100+0000 7f4028e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40240b47a0 0x7f40240ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:30.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.100+0000 7f4028e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f402415a5a0 0x7f40241529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:30.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.100+0000 7f4028e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40241533f0 con 0x7f402415a5a0 2024-03-30T01:51:30.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.100+0000 7f4028e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40240cb3d0 con 0x7f40240b47a0 2024-03-30T01:51:30.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.100+0000 7f4028e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40240cab30 con 0x7f402406b3d0 2024-03-30T01:51:30.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.100+0000 7f4023e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f402415a5a0 0x7f40241529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:30.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.100+0000 7f4023e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f402415a5a0 0x7f40241529a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40246/0 (socket says 172.21.15.133:40246) 2024-03-30T01:51:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.100+0000 7f4023e00640 1 -- 172.21.15.133:0/2946859041 learned_addr learned my addr 172.21.15.133:0/2946859041 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.100+0000 7f4023400640 1 --2- 172.21.15.133:0/2946859041 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f402406b3d0 0x7f40240cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.100+0000 7f4022a00640 1 --2- 172.21.15.133:0/2946859041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40240b47a0 0x7f40240ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.101+0000 7f4023e00640 1 -- 172.21.15.133:0/2946859041 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f402406b3d0 msgr2=0x7f40240cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.101+0000 7f4023e00640 1 --2- 172.21.15.133:0/2946859041 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f402406b3d0 0x7f40240cc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.101+0000 7f4023e00640 1 -- 172.21.15.133:0/2946859041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40240b47a0 msgr2=0x7f40240ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.101+0000 7f4023e00640 1 --2- 172.21.15.133:0/2946859041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40240b47a0 0x7f40240ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.101+0000 7f4023e00640 1 -- 172.21.15.133:0/2946859041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4010009400 con 0x7f402415a5a0 2024-03-30T01:51:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.101+0000 7f4023e00640 1 --2- 172.21.15.133:0/2946859041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f402415a5a0 0x7f40241529a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f401c00efc0 tx=0x7f401c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:30.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.101+0000 7f401b400640 1 -- 172.21.15.133:0/2946859041 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c014480 con 0x7f402415a5a0 2024-03-30T01:51:30.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.101+0000 7f401b400640 1 -- 172.21.15.133:0/2946859041 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401c00f040 con 0x7f402415a5a0 2024-03-30T01:51:30.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.101+0000 7f401b400640 1 -- 172.21.15.133:0/2946859041 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c014820 con 0x7f402415a5a0 2024-03-30T01:51:30.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.101+0000 7f4028e00640 1 -- 172.21.15.133:0/2946859041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40240cae10 con 0x7f402415a5a0 2024-03-30T01:51:30.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.101+0000 7f4028e00640 1 -- 172.21.15.133:0/2946859041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4024152ee0 con 0x7f402415a5a0 2024-03-30T01:51:30.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.103+0000 7f4028e00640 1 -- 172.21.15.133:0/2946859041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4024073750 con 0x7f402415a5a0 2024-03-30T01:51:30.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.103+0000 7f401b400640 1 -- 172.21.15.133:0/2946859041 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f401c014980 con 0x7f402415a5a0 2024-03-30T01:51:30.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.104+0000 7f401b400640 1 --2- 172.21.15.133:0/2946859041 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f400406ac30 0x7f400406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:30.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.104+0000 7f401b400640 1 -- 172.21.15.133:0/2946859041 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f401c089b50 con 0x7f402415a5a0 2024-03-30T01:51:30.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.105+0000 7f4023400640 1 --2- 172.21.15.133:0/2946859041 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f400406ac30 0x7f400406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:30.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.105+0000 7f4023400640 1 --2- 172.21.15.133:0/2946859041 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f400406ac30 0x7f400406d0f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4014000f60 tx=0x7f4014007b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:30.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.109+0000 7f401b400640 1 -- 172.21.15.133:0/2946859041 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f401c055110 con 0x7f402415a5a0 2024-03-30T01:51:30.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.306+0000 7f4028e00640 1 -- 172.21.15.133:0/2946859041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f40240d07a0 con 0x7f402415a5a0 2024-03-30T01:51:30.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.307+0000 7f401b400640 1 -- 172.21.15.133:0/2946859041 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f401c0180a0 con 0x7f402415a5a0 2024-03-30T01:51:30.313 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-03-30T01:51:30.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.309+0000 7f4028e00640 1 -- 172.21.15.133:0/2946859041 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f400406ac30 msgr2=0x7f400406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:30.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.309+0000 7f4028e00640 1 --2- 172.21.15.133:0/2946859041 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f400406ac30 0x7f400406d0f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4014000f60 tx=0x7f4014007b50 comp rx=0 tx=0).stop 2024-03-30T01:51:30.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.309+0000 7f4028e00640 1 -- 172.21.15.133:0/2946859041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f402415a5a0 msgr2=0x7f40241529a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:30.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.309+0000 7f4028e00640 1 --2- 172.21.15.133:0/2946859041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f402415a5a0 0x7f40241529a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f401c00efc0 tx=0x7f401c00c490 comp rx=0 tx=0).stop 2024-03-30T01:51:30.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.310+0000 7f4028e00640 1 -- 172.21.15.133:0/2946859041 shutdown_connections 2024-03-30T01:51:30.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.310+0000 7f4028e00640 1 --2- 172.21.15.133:0/2946859041 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f400406ac30 0x7f400406d0f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.310+0000 7f4028e00640 1 --2- 172.21.15.133:0/2946859041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f402415a5a0 0x7f40241529a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.310+0000 7f4028e00640 1 --2- 172.21.15.133:0/2946859041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40240b47a0 0x7f40240ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.310+0000 7f4028e00640 1 --2- 172.21.15.133:0/2946859041 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f402406b3d0 0x7f40240cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.310+0000 7f4028e00640 1 -- 172.21.15.133:0/2946859041 >> 172.21.15.133:0/2946859041 conn(0x7f40240cf810 msgr2=0x7f40240cddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:30.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.310+0000 7f4028e00640 1 -- 172.21.15.133:0/2946859041 shutdown_connections 2024-03-30T01:51:30.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.310+0000 7f4028e00640 1 -- 172.21.15.133:0/2946859041 wait complete. 2024-03-30T01:51:30.335 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-30T01:51:30.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.535+0000 7fa573a00640 1 Processor -- start 2024-03-30T01:51:30.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.536+0000 7fa573a00640 1 -- start start 2024-03-30T01:51:30.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.537+0000 7fa573a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa56c15cc50 0x7fa56c0d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:30.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.537+0000 7fa573a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa56c0d2240 0x7fa56c0cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:30.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.537+0000 7fa573a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa56c0cf9b0 0x7fa56c0b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:30.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.537+0000 7fa573a00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56c0d1c50 con 0x7fa56c15cc50 2024-03-30T01:51:30.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.537+0000 7fa573a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56c15d030 con 0x7fa56c0cf9b0 2024-03-30T01:51:30.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.537+0000 7fa573a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c0cfe40 con 0x7fa56c0d2240 2024-03-30T01:51:30.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.537+0000 7fa571000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa56c15cc50 0x7fa56c0d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:30.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.537+0000 7fa571000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa56c15cc50 0x7fa56c0d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40260/0 (socket says 172.21.15.133:40260) 2024-03-30T01:51:30.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.537+0000 7fa571000640 1 -- 172.21.15.133:0/2705274747 learned_addr learned my addr 172.21.15.133:0/2705274747 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:30.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.538+0000 7fa571000640 1 -- 172.21.15.133:0/2705274747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa56c0d2240 msgr2=0x7fa56c0cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:30.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.538+0000 7fa571000640 1 --2- 172.21.15.133:0/2705274747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa56c0d2240 0x7fa56c0cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.538+0000 7fa571000640 1 -- 172.21.15.133:0/2705274747 >> v2:172.21.15.137:3300/0 conn(0x7fa56c0cf9b0 msgr2=0x7fa56c0b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:30.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.538+0000 7fa571000640 1 --2- 172.21.15.133:0/2705274747 >> v2:172.21.15.137:3300/0 conn(0x7fa56c0cf9b0 0x7fa56c0b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.538+0000 7fa571000640 1 -- 172.21.15.133:0/2705274747 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c0b5af0 con 0x7fa56c15cc50 2024-03-30T01:51:30.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.539+0000 7fa571000640 1 --2- 172.21.15.133:0/2705274747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c15cc50 0x7fa56c0d0af0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0d3aa0 tx=0x7fa55402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3d3ee5a0e65cb4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:30.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.539+0000 7fa56b400640 1 -- 172.21.15.133:0/2705274747 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa554031870 con 0x7fa56c15cc50 2024-03-30T01:51:30.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.539+0000 7fa56b400640 1 -- 172.21.15.133:0/2705274747 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5540319d0 con 0x7fa56c15cc50 2024-03-30T01:51:30.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.539+0000 7fa56b400640 1 -- 172.21.15.133:0/2705274747 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa554031d60 con 0x7fa56c15cc50 2024-03-30T01:51:30.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.540+0000 7fa573a00640 1 -- 172.21.15.133:0/2705274747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c15cc50 msgr2=0x7fa56c0d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:30.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.540+0000 7fa573a00640 1 --2- 172.21.15.133:0/2705274747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c15cc50 0x7fa56c0d0af0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0d3aa0 tx=0x7fa55402b910 comp rx=0 tx=0).stop 2024-03-30T01:51:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.540+0000 7fa573a00640 1 -- 172.21.15.133:0/2705274747 shutdown_connections 2024-03-30T01:51:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.540+0000 7fa573a00640 1 --2- 172.21.15.133:0/2705274747 >> v2:172.21.15.137:3300/0 conn(0x7fa56c0cf9b0 0x7fa56c0b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.540+0000 7fa573a00640 1 --2- 172.21.15.133:0/2705274747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa56c0d2240 0x7fa56c0cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.540+0000 7fa573a00640 1 --2- 172.21.15.133:0/2705274747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c15cc50 0x7fa56c0d0af0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.540+0000 7fa573a00640 1 -- 172.21.15.133:0/2705274747 >> 172.21.15.133:0/2705274747 conn(0x7fa56c071a40 msgr2=0x7fa56c06b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.540+0000 7fa573a00640 1 -- 172.21.15.133:0/2705274747 shutdown_connections 2024-03-30T01:51:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.540+0000 7fa573a00640 1 -- 172.21.15.133:0/2705274747 wait complete. 2024-03-30T01:51:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.541+0000 7fa573a00640 1 Processor -- start 2024-03-30T01:51:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.542+0000 7fa573a00640 1 -- start start 2024-03-30T01:51:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.543+0000 7fa573a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c0cf9b0 0x7fa56c0b8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.543+0000 7fa573a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa56c0d2240 0x7fa56c152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.543+0000 7fa573a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa56c15cc50 0x7fa56c1f1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.543+0000 7fa573a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c1f5780 con 0x7fa56c0cf9b0 2024-03-30T01:51:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.543+0000 7fa573a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c1f5a60 con 0x7fa56c15cc50 2024-03-30T01:51:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.543+0000 7fa573a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c1f5d40 con 0x7fa56c0d2240 2024-03-30T01:51:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.543+0000 7fa571000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c0cf9b0 0x7fa56c0b8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.543+0000 7fa571000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c0cf9b0 0x7fa56c0b8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40268/0 (socket says 172.21.15.133:40268) 2024-03-30T01:51:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.543+0000 7fa571000640 1 -- 172.21.15.133:0/546636577 learned_addr learned my addr 172.21.15.133:0/546636577 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.543+0000 7fa56be00640 1 --2- 172.21.15.133:0/546636577 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa56c0d2240 0x7fa56c152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.543+0000 7fa571a00640 1 --2- 172.21.15.133:0/546636577 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa56c15cc50 0x7fa56c1f1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.543+0000 7fa571000640 1 -- 172.21.15.133:0/546636577 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa56c0d2240 msgr2=0x7fa56c152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.543+0000 7fa571000640 1 --2- 172.21.15.133:0/546636577 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa56c0d2240 0x7fa56c152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.543+0000 7fa571000640 1 -- 172.21.15.133:0/546636577 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa56c15cc50 msgr2=0x7fa56c1f1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.543+0000 7fa571000640 1 --2- 172.21.15.133:0/546636577 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa56c15cc50 0x7fa56c1f1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.543+0000 7fa571000640 1 -- 172.21.15.133:0/546636577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5540094d0 con 0x7fa56c0cf9b0 2024-03-30T01:51:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.543+0000 7fa571a00640 1 --2- 172.21.15.133:0/546636577 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa56c15cc50 0x7fa56c1f1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.544+0000 7fa571000640 1 --2- 172.21.15.133:0/546636577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c0cf9b0 0x7fa56c0b8230 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa554000c00 tx=0x7fa5540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.544+0000 7fa568c00640 1 -- 172.21.15.133:0/546636577 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa554031840 con 0x7fa56c0cf9b0 2024-03-30T01:51:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.544+0000 7fa568c00640 1 -- 172.21.15.133:0/546636577 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5540443f0 con 0x7fa56c0cf9b0 2024-03-30T01:51:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.544+0000 7fa573a00640 1 -- 172.21.15.133:0/546636577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56c1f6020 con 0x7fa56c0cf9b0 2024-03-30T01:51:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.544+0000 7fa568c00640 1 -- 172.21.15.133:0/546636577 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5540447a0 con 0x7fa56c0cf9b0 2024-03-30T01:51:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.544+0000 7fa573a00640 1 -- 172.21.15.133:0/546636577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56c1f65e0 con 0x7fa56c0cf9b0 2024-03-30T01:51:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.546+0000 7fa573a00640 1 -- 172.21.15.133:0/546636577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56c1583a0 con 0x7fa56c0cf9b0 2024-03-30T01:51:30.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.546+0000 7fa568c00640 1 -- 172.21.15.133:0/546636577 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fa55404d450 con 0x7fa56c0cf9b0 2024-03-30T01:51:30.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.547+0000 7fa568c00640 1 --2- 172.21.15.133:0/546636577 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa54806ac00 0x7fa54806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:30.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.547+0000 7fa568c00640 1 -- 172.21.15.133:0/546636577 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa55402d040 con 0x7fa56c0cf9b0 2024-03-30T01:51:30.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.547+0000 7fa56be00640 1 --2- 172.21.15.133:0/546636577 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa54806ac00 0x7fa54806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:30.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.548+0000 7fa56be00640 1 --2- 172.21.15.133:0/546636577 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa54806ac00 0x7fa54806d0c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa56c153cf0 tx=0x7fa55c0094f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.551+0000 7fa568c00640 1 -- 172.21.15.133:0/546636577 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fa56c1583a0 con 0x7fa56c0cf9b0 2024-03-30T01:51:30.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.748+0000 7fa573a00640 1 -- 172.21.15.133:0/546636577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa56c1583a0 con 0x7fa56c0cf9b0 2024-03-30T01:51:30.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.749+0000 7fa568c00640 1 -- 172.21.15.133:0/546636577 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa56c1583a0 con 0x7fa56c0cf9b0 2024-03-30T01:51:30.755 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:30.755 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-03-30T01:51:30.755 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:51:30.755 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2024-03-30T01:51:30.755 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": ".mgr" 2024-03-30T01:51:30.755 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:51:30.755 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-03-30T01:51:30.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.752+0000 7fa573a00640 1 -- 172.21.15.133:0/546636577 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa54806ac00 msgr2=0x7fa54806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:30.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.752+0000 7fa573a00640 1 --2- 172.21.15.133:0/546636577 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa54806ac00 0x7fa54806d0c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa56c153cf0 tx=0x7fa55c0094f0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.752+0000 7fa573a00640 1 -- 172.21.15.133:0/546636577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c0cf9b0 msgr2=0x7fa56c0b8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:30.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.752+0000 7fa573a00640 1 --2- 172.21.15.133:0/546636577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c0cf9b0 0x7fa56c0b8230 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa554000c00 tx=0x7fa5540046c0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.752+0000 7fa573a00640 1 -- 172.21.15.133:0/546636577 shutdown_connections 2024-03-30T01:51:30.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.752+0000 7fa573a00640 1 --2- 172.21.15.133:0/546636577 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa54806ac00 0x7fa54806d0c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.752+0000 7fa573a00640 1 --2- 172.21.15.133:0/546636577 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa56c15cc50 0x7fa56c1f1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.752+0000 7fa573a00640 1 --2- 172.21.15.133:0/546636577 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa56c0d2240 0x7fa56c152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.752+0000 7fa573a00640 1 --2- 172.21.15.133:0/546636577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c0cf9b0 0x7fa56c0b8230 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.752+0000 7fa573a00640 1 -- 172.21.15.133:0/546636577 >> 172.21.15.133:0/546636577 conn(0x7fa56c071a40 msgr2=0x7fa56c15d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:30.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.752+0000 7fa573a00640 1 -- 172.21.15.133:0/546636577 shutdown_connections 2024-03-30T01:51:30.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.752+0000 7fa573a00640 1 -- 172.21.15.133:0/546636577 wait complete. 2024-03-30T01:51:30.776 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-30T01:51:30.776 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-30T01:51:30.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.985+0000 7fa161600640 1 Processor -- start 2024-03-30T01:51:30.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.986+0000 7fa161600640 1 -- start start 2024-03-30T01:51:30.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.987+0000 7fa161600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa15c15cb70 0x7fa15c0d2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:30.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.987+0000 7fa161600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa15c0b8640 0x7fa15c0d0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:30.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.987+0000 7fa161600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa15c0cd5e0 0x7fa15c0cda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:30.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.987+0000 7fa161600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15c0cdfb0 con 0x7fa15c0b8640 2024-03-30T01:51:30.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.987+0000 7fa161600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15c0d12a0 con 0x7fa15c15cb70 2024-03-30T01:51:30.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.987+0000 7fa161600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c0d1580 con 0x7fa15c0cd5e0 2024-03-30T01:51:30.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.987+0000 7fa15b400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa15c0b8640 0x7fa15c0d0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:30.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.987+0000 7fa15b400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa15c0b8640 0x7fa15c0d0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40282/0 (socket says 172.21.15.133:40282) 2024-03-30T01:51:30.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.987+0000 7fa15b400640 1 -- 172.21.15.133:0/1096240632 learned_addr learned my addr 172.21.15.133:0/1096240632 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:30.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.988+0000 7fa160c00640 1 --2- 172.21.15.133:0/1096240632 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa15c0cd5e0 0x7fa15c0cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:30.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.988+0000 7fa15be00640 1 --2- 172.21.15.133:0/1096240632 >> v2:172.21.15.137:3300/0 conn(0x7fa15c15cb70 0x7fa15c0d2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:30.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.988+0000 7fa15b400640 1 -- 172.21.15.133:0/1096240632 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa15c0cd5e0 msgr2=0x7fa15c0cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:30.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.988+0000 7fa15b400640 1 --2- 172.21.15.133:0/1096240632 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa15c0cd5e0 0x7fa15c0cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.988+0000 7fa15b400640 1 -- 172.21.15.133:0/1096240632 >> v2:172.21.15.137:3300/0 conn(0x7fa15c15cb70 msgr2=0x7fa15c0d2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:30.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.988+0000 7fa15b400640 1 --2- 172.21.15.133:0/1096240632 >> v2:172.21.15.137:3300/0 conn(0x7fa15c15cb70 0x7fa15c0d2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.988+0000 7fa15b400640 1 -- 172.21.15.133:0/1096240632 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15c0d1860 con 0x7fa15c0b8640 2024-03-30T01:51:30.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.988+0000 7fa15be00640 1 --2- 172.21.15.133:0/1096240632 >> v2:172.21.15.137:3300/0 conn(0x7fa15c15cb70 0x7fa15c0d2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:30.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.989+0000 7fa15b400640 1 --2- 172.21.15.133:0/1096240632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa15c0b8640 0x7fa15c0d0950 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa15c06c3c0 tx=0x7fa14402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3196a1e7ea653b3a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:30.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.989+0000 7fa15aa00640 1 -- 172.21.15.133:0/1096240632 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14402c9e0 con 0x7fa15c0b8640 2024-03-30T01:51:30.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.989+0000 7fa15aa00640 1 -- 172.21.15.133:0/1096240632 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14402cb40 con 0x7fa15c0b8640 2024-03-30T01:51:30.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.989+0000 7fa15aa00640 1 -- 172.21.15.133:0/1096240632 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1440343f0 con 0x7fa15c0b8640 2024-03-30T01:51:30.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.990+0000 7fa161600640 1 -- 172.21.15.133:0/1096240632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa15c0b8640 msgr2=0x7fa15c0d0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:30.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.990+0000 7fa161600640 1 --2- 172.21.15.133:0/1096240632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa15c0b8640 0x7fa15c0d0950 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa15c06c3c0 tx=0x7fa14402be40 comp rx=0 tx=0).stop 2024-03-30T01:51:30.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.990+0000 7fa161600640 1 -- 172.21.15.133:0/1096240632 shutdown_connections 2024-03-30T01:51:30.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.990+0000 7fa161600640 1 --2- 172.21.15.133:0/1096240632 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa15c0cd5e0 0x7fa15c0cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.990+0000 7fa161600640 1 --2- 172.21.15.133:0/1096240632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa15c0b8640 0x7fa15c0d0950 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.990+0000 7fa161600640 1 --2- 172.21.15.133:0/1096240632 >> v2:172.21.15.137:3300/0 conn(0x7fa15c15cb70 0x7fa15c0d2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:30.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.990+0000 7fa161600640 1 -- 172.21.15.133:0/1096240632 >> 172.21.15.133:0/1096240632 conn(0x7fa15c071a40 msgr2=0x7fa15c0cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:30.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.990+0000 7fa161600640 1 -- 172.21.15.133:0/1096240632 shutdown_connections 2024-03-30T01:51:30.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.990+0000 7fa161600640 1 -- 172.21.15.133:0/1096240632 wait complete. 2024-03-30T01:51:30.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.992+0000 7fa161600640 1 Processor -- start 2024-03-30T01:51:30.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.992+0000 7fa161600640 1 -- start start 2024-03-30T01:51:30.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.992+0000 7fa161600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa15c0b8640 0x7fa15c155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:30.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.993+0000 7fa161600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa15c0cd5e0 0x7fa15c155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:30.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.993+0000 7fa161600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa15c15cb70 0x7fa15c159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:30.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.993+0000 7fa161600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c0c7c40 con 0x7fa15c0cd5e0 2024-03-30T01:51:30.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.993+0000 7fa161600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c155550 con 0x7fa15c15cb70 2024-03-30T01:51:30.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.993+0000 7fa161600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c155ed0 con 0x7fa15c0b8640 2024-03-30T01:51:30.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.993+0000 7fa15b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa15c0cd5e0 0x7fa15c155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:30.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.993+0000 7fa15b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa15c0cd5e0 0x7fa15c155990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40294/0 (socket says 172.21.15.133:40294) 2024-03-30T01:51:30.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.993+0000 7fa15b400640 1 -- 172.21.15.133:0/788496608 learned_addr learned my addr 172.21.15.133:0/788496608 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:30.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.993+0000 7fa15be00640 1 --2- 172.21.15.133:0/788496608 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa15c0b8640 0x7fa15c155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:31.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.993+0000 7fa15b400640 1 -- 172.21.15.133:0/788496608 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa15c0b8640 msgr2=0x7fa15c155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:31.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.993+0000 7fa15b400640 1 --2- 172.21.15.133:0/788496608 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa15c0b8640 0x7fa15c155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:31.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.993+0000 7fa15b400640 1 -- 172.21.15.133:0/788496608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa15c15cb70 msgr2=0x7fa15c159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:31.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.993+0000 7fa160c00640 1 --2- 172.21.15.133:0/788496608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa15c15cb70 0x7fa15c159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:31.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.993+0000 7fa15b400640 1 --2- 172.21.15.133:0/788496608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa15c15cb70 0x7fa15c159a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:31.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.993+0000 7fa15b400640 1 -- 172.21.15.133:0/788496608 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa144009b30 con 0x7fa15c0cd5e0 2024-03-30T01:51:31.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.993+0000 7fa15be00640 1 --2- 172.21.15.133:0/788496608 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa15c0b8640 0x7fa15c155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:51:31.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.994+0000 7fa15b400640 1 --2- 172.21.15.133:0/788496608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa15c0cd5e0 0x7fa15c155990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa144000f80 tx=0x7fa144004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:31.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.994+0000 7fa153e00640 1 -- 172.21.15.133:0/788496608 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa144009510 con 0x7fa15c0cd5e0 2024-03-30T01:51:31.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.994+0000 7fa153e00640 1 -- 172.21.15.133:0/788496608 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14403e450 con 0x7fa15c0cd5e0 2024-03-30T01:51:31.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.994+0000 7fa153e00640 1 -- 172.21.15.133:0/788496608 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14403e800 con 0x7fa15c0cd5e0 2024-03-30T01:51:31.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.994+0000 7fa161600640 1 -- 172.21.15.133:0/788496608 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15c0c7680 con 0x7fa15c0cd5e0 2024-03-30T01:51:31.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.994+0000 7fa161600640 1 -- 172.21.15.133:0/788496608 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15c154810 con 0x7fa15c0cd5e0 2024-03-30T01:51:31.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.995+0000 7fa161600640 1 -- 172.21.15.133:0/788496608 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa15c154670 con 0x7fa15c0cd5e0 2024-03-30T01:51:31.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.996+0000 7fa153e00640 1 -- 172.21.15.133:0/788496608 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fa14403e960 con 0x7fa15c0cd5e0 2024-03-30T01:51:31.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.997+0000 7fa153e00640 1 --2- 172.21.15.133:0/788496608 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa13806ac30 0x7fa13806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:31.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.997+0000 7fa153e00640 1 -- 172.21.15.133:0/788496608 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa1440abe40 con 0x7fa15c0cd5e0 2024-03-30T01:51:31.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.997+0000 7fa15be00640 1 --2- 172.21.15.133:0/788496608 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa13806ac30 0x7fa13806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:31.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:30.998+0000 7fa15be00640 1 --2- 172.21.15.133:0/788496608 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa13806ac30 0x7fa13806d0f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa14c00a910 tx=0x7fa14c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:31.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.002+0000 7fa153e00640 1 -- 172.21.15.133:0/788496608 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fa15c154670 con 0x7fa15c0cd5e0 2024-03-30T01:51:31.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.196+0000 7fa161600640 1 -- 172.21.15.133:0/788496608 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa15c154670 con 0x7fa15c0cd5e0 2024-03-30T01:51:31.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.285+0000 7fa153e00640 1 -- 172.21.15.133:0/788496608 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa15c154670 con 0x7fa15c0cd5e0 2024-03-30T01:51:31.292 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2024-03-30T01:51:31.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.289+0000 7fa161600640 1 -- 172.21.15.133:0/788496608 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa13806ac30 msgr2=0x7fa13806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:31.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.289+0000 7fa161600640 1 --2- 172.21.15.133:0/788496608 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa13806ac30 0x7fa13806d0f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa14c00a910 tx=0x7fa14c008040 comp rx=0 tx=0).stop 2024-03-30T01:51:31.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.289+0000 7fa161600640 1 -- 172.21.15.133:0/788496608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa15c0cd5e0 msgr2=0x7fa15c155990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:31.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.289+0000 7fa161600640 1 --2- 172.21.15.133:0/788496608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa15c0cd5e0 0x7fa15c155990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa144000f80 tx=0x7fa144004a40 comp rx=0 tx=0).stop 2024-03-30T01:51:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.290+0000 7fa161600640 1 -- 172.21.15.133:0/788496608 shutdown_connections 2024-03-30T01:51:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.290+0000 7fa161600640 1 --2- 172.21.15.133:0/788496608 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa13806ac30 0x7fa13806d0f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.290+0000 7fa161600640 1 --2- 172.21.15.133:0/788496608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa15c15cb70 0x7fa15c159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.290+0000 7fa161600640 1 --2- 172.21.15.133:0/788496608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa15c0cd5e0 0x7fa15c155990 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.290+0000 7fa161600640 1 --2- 172.21.15.133:0/788496608 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa15c0b8640 0x7fa15c155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.290+0000 7fa161600640 1 -- 172.21.15.133:0/788496608 >> 172.21.15.133:0/788496608 conn(0x7fa15c071a40 msgr2=0x7fa15c0b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.290+0000 7fa161600640 1 -- 172.21.15.133:0/788496608 shutdown_connections 2024-03-30T01:51:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.290+0000 7fa161600640 1 -- 172.21.15.133:0/788496608 wait complete. 2024-03-30T01:51:31.322 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-30T01:51:31.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.509+0000 7f8422c00640 1 Processor -- start 2024-03-30T01:51:31.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.509+0000 7f8422c00640 1 -- start start 2024-03-30T01:51:31.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.510+0000 7f8422c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f841c0acd10 0x7f841c0abd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:31.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.510+0000 7f8422c00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f841c15d470 con 0x7f841c0cef00 2024-03-30T01:51:31.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.511+0000 7f8422c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f841c15d750 con 0x7f841c0ad0f0 2024-03-30T01:51:31.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.511+0000 7f8422c00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841c15da30 con 0x7f841c0acd10 2024-03-30T01:51:31.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.511+0000 7f841be00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f841c0acd10 0x7f841c0abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:31.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.511+0000 7f8420c00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f841c0cef00 0x7f841c0ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41932/0 (socket says 172.21.15.133:41932) 2024-03-30T01:51:31.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.511+0000 7f8420c00640 1 -- 172.21.15.133:0/925355226 learned_addr learned my addr 172.21.15.133:0/925355226 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:31.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.511+0000 7f841be00640 1 -- 172.21.15.133:0/925355226 >> v1:172.21.15.137:6789/0 conn(0x7f841c0ad0f0 legacy=0x7f841c0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:31.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.511+0000 7f841be00640 1 -- 172.21.15.133:0/925355226 >> v1:172.21.15.133:6789/0 conn(0x7f841c0cef00 legacy=0x7f841c0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:31.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.511+0000 7f841be00640 1 -- 172.21.15.133:0/925355226 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841c15dd10 con 0x7f841c0acd10 2024-03-30T01:51:31.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.511+0000 7f841b400640 1 -- 172.21.15.133:0/925355226 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768854275 0 0) 0x7f841c15d470 con 0x7f841c0cef00 2024-03-30T01:51:31.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.513+0000 7f841be00640 1 --2- 172.21.15.133:0/925355226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f841c0acd10 0x7f841c0abd60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f840c0097a0 tx=0x7f840c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922b48af66b732b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:31.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.513+0000 7f841b400640 1 -- 172.21.15.133:0/925355226 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c030610 con 0x7f841c0acd10 2024-03-30T01:51:31.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.513+0000 7f841b400640 1 -- 172.21.15.133:0/925355226 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840c030770 con 0x7f841c0acd10 2024-03-30T01:51:31.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.513+0000 7f841b400640 1 -- 172.21.15.133:0/925355226 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c030b00 con 0x7f841c0acd10 2024-03-30T01:51:31.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.514+0000 7f8422c00640 1 -- 172.21.15.133:0/925355226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f841c0acd10 msgr2=0x7f841c0abd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:31.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.514+0000 7f8422c00640 1 --2- 172.21.15.133:0/925355226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f841c0acd10 0x7f841c0abd60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f840c0097a0 tx=0x7f840c02b960 comp rx=0 tx=0).stop 2024-03-30T01:51:31.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.514+0000 7f8422c00640 1 -- 172.21.15.133:0/925355226 shutdown_connections 2024-03-30T01:51:31.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.514+0000 7f8422c00640 1 --2- 172.21.15.133:0/925355226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f841c0acd10 0x7f841c0abd60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:31.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.514+0000 7f8422c00640 1 -- 172.21.15.133:0/925355226 >> 172.21.15.133:0/925355226 conn(0x7f841c069ce0 msgr2=0x7f841c06a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:31.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.514+0000 7f8422c00640 1 -- 172.21.15.133:0/925355226 shutdown_connections 2024-03-30T01:51:31.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.514+0000 7f8422c00640 1 -- 172.21.15.133:0/925355226 wait complete. 2024-03-30T01:51:31.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.515+0000 7f8422c00640 1 Processor -- start 2024-03-30T01:51:31.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.516+0000 7f8422c00640 1 -- start start 2024-03-30T01:51:31.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.516+0000 7f8422c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f841c0acd10 0x7f841c14f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:31.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.516+0000 7f8422c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f841c0cef00 0x7f841c14fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:31.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.517+0000 7f8422c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f841c150070 0x7f841c151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:31.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.517+0000 7f8422c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c150510 con 0x7f841c0cef00 2024-03-30T01:51:31.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.517+0000 7f8422c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c1507f0 con 0x7f841c150070 2024-03-30T01:51:31.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.517+0000 7f8422c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841c150ad0 con 0x7f841c0acd10 2024-03-30T01:51:31.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.517+0000 7f8413e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f841c0cef00 0x7f841c14fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:31.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.517+0000 7f8413e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f841c0cef00 0x7f841c14fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40318/0 (socket says 172.21.15.133:40318) 2024-03-30T01:51:31.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.517+0000 7f8413e00640 1 -- 172.21.15.133:0/328470198 learned_addr learned my addr 172.21.15.133:0/328470198 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:31.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.517+0000 7f841be00640 1 --2- 172.21.15.133:0/328470198 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f841c0acd10 0x7f841c14f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:31.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.517+0000 7f8420c00640 1 --2- 172.21.15.133:0/328470198 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f841c150070 0x7f841c151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:31.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.517+0000 7f8413e00640 1 -- 172.21.15.133:0/328470198 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f841c0acd10 msgr2=0x7f841c14f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:31.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.517+0000 7f8413e00640 1 --2- 172.21.15.133:0/328470198 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f841c0acd10 0x7f841c14f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:31.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.517+0000 7f8413e00640 1 -- 172.21.15.133:0/328470198 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f841c150070 msgr2=0x7f841c151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:31.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.517+0000 7f8413e00640 1 --2- 172.21.15.133:0/328470198 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f841c150070 0x7f841c151570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:31.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.517+0000 7f8413e00640 1 -- 172.21.15.133:0/328470198 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840c009400 con 0x7f841c0cef00 2024-03-30T01:51:31.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.517+0000 7f8413e00640 1 --2- 172.21.15.133:0/328470198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f841c0cef00 0x7f841c14fb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f840400c450 tx=0x7f840400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:31.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.518+0000 7f8418c00640 1 -- 172.21.15.133:0/328470198 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84040052d0 con 0x7f841c0cef00 2024-03-30T01:51:31.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.518+0000 7f8418c00640 1 -- 172.21.15.133:0/328470198 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8404005430 con 0x7f841c0cef00 2024-03-30T01:51:31.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.518+0000 7f8418c00640 1 -- 172.21.15.133:0/328470198 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8404012870 con 0x7f841c0cef00 2024-03-30T01:51:31.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.518+0000 7f8422c00640 1 -- 172.21.15.133:0/328470198 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f841c150db0 con 0x7f841c0cef00 2024-03-30T01:51:31.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.518+0000 7f8422c00640 1 -- 172.21.15.133:0/328470198 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841c14f6f0 con 0x7f841c0cef00 2024-03-30T01:51:31.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.519+0000 7f8422c00640 1 -- 172.21.15.133:0/328470198 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f841c0ac910 con 0x7f841c0cef00 2024-03-30T01:51:31.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.520+0000 7f8418c00640 1 -- 172.21.15.133:0/328470198 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f84040129d0 con 0x7f841c0cef00 2024-03-30T01:51:31.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.521+0000 7f8418c00640 1 --2- 172.21.15.133:0/328470198 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f83f806ac00 0x7f83f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:31.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.521+0000 7f8418c00640 1 -- 172.21.15.133:0/328470198 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f8404088c50 con 0x7f841c0cef00 2024-03-30T01:51:31.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.521+0000 7f841be00640 1 --2- 172.21.15.133:0/328470198 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f83f806ac00 0x7f83f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:31.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.522+0000 7f841be00640 1 --2- 172.21.15.133:0/328470198 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f83f806ac00 0x7f83f806d0c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f840c036000 tx=0x7f840c03b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:31.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.527+0000 7f8418c00640 1 -- 172.21.15.133:0/328470198 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f840408e020 con 0x7f841c0cef00 2024-03-30T01:51:31.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:31.720+0000 7f8422c00640 1 -- 172.21.15.133:0/328470198 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f841c1512d0 con 0x7f841c0cef00 2024-03-30T01:51:32.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.304+0000 7f8418c00640 1 -- 172.21.15.133:0/328470198 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f841c1512d0 con 0x7f841c0cef00 2024-03-30T01:51:32.312 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2024-03-30T01:51:32.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.313+0000 7f8422c00640 1 -- 172.21.15.133:0/328470198 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f83f806ac00 msgr2=0x7f83f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:32.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.313+0000 7f8422c00640 1 --2- 172.21.15.133:0/328470198 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f83f806ac00 0x7f83f806d0c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f840c036000 tx=0x7f840c03b040 comp rx=0 tx=0).stop 2024-03-30T01:51:32.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.313+0000 7f8422c00640 1 -- 172.21.15.133:0/328470198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f841c0cef00 msgr2=0x7f841c14fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:32.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.313+0000 7f8422c00640 1 --2- 172.21.15.133:0/328470198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f841c0cef00 0x7f841c14fb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f840400c450 tx=0x7f840400c910 comp rx=0 tx=0).stop 2024-03-30T01:51:32.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.315+0000 7f8422c00640 1 -- 172.21.15.133:0/328470198 shutdown_connections 2024-03-30T01:51:32.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.315+0000 7f8422c00640 1 --2- 172.21.15.133:0/328470198 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f83f806ac00 0x7f83f806d0c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:32.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.315+0000 7f8422c00640 1 --2- 172.21.15.133:0/328470198 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f841c150070 0x7f841c151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:32.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.315+0000 7f8422c00640 1 --2- 172.21.15.133:0/328470198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f841c0cef00 0x7f841c14fb30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:32.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.315+0000 7f8422c00640 1 --2- 172.21.15.133:0/328470198 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f841c0acd10 0x7f841c14f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:32.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.315+0000 7f8422c00640 1 -- 172.21.15.133:0/328470198 >> 172.21.15.133:0/328470198 conn(0x7f841c069ce0 msgr2=0x7f841c15ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:32.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.317+0000 7f8422c00640 1 -- 172.21.15.133:0/328470198 shutdown_connections 2024-03-30T01:51:32.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.317+0000 7f8422c00640 1 -- 172.21.15.133:0/328470198 wait complete. 2024-03-30T01:51:32.352 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-30T01:51:32.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.528+0000 7febf3600640 1 Processor -- start 2024-03-30T01:51:32.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.528+0000 7febf3600640 1 -- start start 2024-03-30T01:51:32.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.530+0000 7febf3600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7febec070c10 0x7febec167780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:32.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.530+0000 7febf3600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febec0b28d0 con 0x7febec145d30 2024-03-30T01:51:32.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.530+0000 7febf3600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febec06c320 con 0x7febec1457b0 2024-03-30T01:51:32.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.530+0000 7febf3600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febec145b90 con 0x7febec070c10 2024-03-30T01:51:32.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.530+0000 7febf1600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7febec070c10 0x7febec167780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:32.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.530+0000 7febebe00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7febec145d30 0x7febec070500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41946/0 (socket says 172.21.15.133:41946) 2024-03-30T01:51:32.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.530+0000 7febf1600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7febec070c10 0x7febec167780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40326/0 (socket says 172.21.15.133:40326) 2024-03-30T01:51:32.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.530+0000 7febebe00640 1 -- 172.21.15.133:0/3919548460 learned_addr learned my addr 172.21.15.133:0/3919548460 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:32.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.530+0000 7febeb400640 1 -- 172.21.15.133:0/3919548460 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234834668 0 0) 0x7febec0b28d0 con 0x7febec145d30 2024-03-30T01:51:32.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.530+0000 7febeb400640 1 -- 172.21.15.133:0/3919548460 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febd4003520 con 0x7febec145d30 2024-03-30T01:51:32.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.530+0000 7febf1600640 1 -- 172.21.15.133:0/3919548460 >> v1:172.21.15.137:6789/0 conn(0x7febec1457b0 legacy=0x7febec0b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:32.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.530+0000 7febf1600640 1 -- 172.21.15.133:0/3919548460 >> v1:172.21.15.133:6789/0 conn(0x7febec145d30 legacy=0x7febec070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:32.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.531+0000 7febf1600640 1 -- 172.21.15.133:0/3919548460 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec06c600 con 0x7febec070c10 2024-03-30T01:51:32.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.532+0000 7febf1600640 1 --2- 172.21.15.133:0/3919548460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febec070c10 0x7febec167780 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7febe4009d90 tx=0x7febe402bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a11de7c0e2bcf6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:32.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.532+0000 7febeb400640 1 -- 172.21.15.133:0/3919548460 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe402ccf0 con 0x7febec070c10 2024-03-30T01:51:32.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.532+0000 7febeb400640 1 -- 172.21.15.133:0/3919548460 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe402ce50 con 0x7febec070c10 2024-03-30T01:51:32.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.532+0000 7febeb400640 1 -- 172.21.15.133:0/3919548460 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4034660 con 0x7febec070c10 2024-03-30T01:51:32.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.533+0000 7febf3600640 1 -- 172.21.15.133:0/3919548460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febec070c10 msgr2=0x7febec167780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:32.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.533+0000 7febf3600640 1 --2- 172.21.15.133:0/3919548460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febec070c10 0x7febec167780 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7febe4009d90 tx=0x7febe402bf40 comp rx=0 tx=0).stop 2024-03-30T01:51:32.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.533+0000 7febf3600640 1 -- 172.21.15.133:0/3919548460 shutdown_connections 2024-03-30T01:51:32.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.533+0000 7febf3600640 1 --2- 172.21.15.133:0/3919548460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febec070c10 0x7febec167780 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:32.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.533+0000 7febf3600640 1 -- 172.21.15.133:0/3919548460 >> 172.21.15.133:0/3919548460 conn(0x7febec0b07a0 msgr2=0x7febec0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:32.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.533+0000 7febf3600640 1 -- 172.21.15.133:0/3919548460 shutdown_connections 2024-03-30T01:51:32.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.533+0000 7febf3600640 1 -- 172.21.15.133:0/3919548460 wait complete. 2024-03-30T01:51:32.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.534+0000 7febf3600640 1 Processor -- start 2024-03-30T01:51:32.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.535+0000 7febf3600640 1 -- start start 2024-03-30T01:51:32.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.536+0000 7febf3600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7febec070c10 0x7febec0cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.536+0000 7febf3600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7febec1457b0 0x7febec15c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.536+0000 7febf3600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febec145d30 0x7febec0ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.536+0000 7febf3600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec0cd1a0 con 0x7febec145d30 2024-03-30T01:51:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.536+0000 7febf3600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec0ce110 con 0x7febec070c10 2024-03-30T01:51:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.536+0000 7febf3600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec0cc590 con 0x7febec1457b0 2024-03-30T01:51:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.536+0000 7febf1600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febec145d30 0x7febec0ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.536+0000 7febf1600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febec145d30 0x7febec0ae4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40334/0 (socket says 172.21.15.133:40334) 2024-03-30T01:51:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.536+0000 7febf1600640 1 -- 172.21.15.133:0/3052203670 learned_addr learned my addr 172.21.15.133:0/3052203670 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.536+0000 7febf0c00640 1 --2- 172.21.15.133:0/3052203670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7febec070c10 0x7febec0cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.536+0000 7febebe00640 1 --2- 172.21.15.133:0/3052203670 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7febec1457b0 0x7febec15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.536+0000 7febf1600640 1 -- 172.21.15.133:0/3052203670 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7febec1457b0 msgr2=0x7febec15c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.536+0000 7febf1600640 1 --2- 172.21.15.133:0/3052203670 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7febec1457b0 0x7febec15c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.536+0000 7febf1600640 1 -- 172.21.15.133:0/3052203670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7febec070c10 msgr2=0x7febec0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.536+0000 7febf1600640 1 --2- 172.21.15.133:0/3052203670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7febec070c10 0x7febec0cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:32.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.536+0000 7febf1600640 1 -- 172.21.15.133:0/3052203670 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe4009a70 con 0x7febec145d30 2024-03-30T01:51:32.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.537+0000 7febf1600640 1 --2- 172.21.15.133:0/3052203670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febec145d30 0x7febec0ae4c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7febe4037040 tx=0x7febe4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:32.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.537+0000 7febe8c00640 1 -- 172.21.15.133:0/3052203670 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe403d600 con 0x7febec145d30 2024-03-30T01:51:32.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.537+0000 7febe8c00640 1 -- 172.21.15.133:0/3052203670 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe403d760 con 0x7febec145d30 2024-03-30T01:51:32.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.537+0000 7febf3600640 1 -- 172.21.15.133:0/3052203670 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febec0cc870 con 0x7febec145d30 2024-03-30T01:51:32.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.537+0000 7febe8c00640 1 -- 172.21.15.133:0/3052203670 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe403db10 con 0x7febec145d30 2024-03-30T01:51:32.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.537+0000 7febf3600640 1 -- 172.21.15.133:0/3052203670 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febec0cce30 con 0x7febec145d30 2024-03-30T01:51:32.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.538+0000 7febf3600640 1 -- 172.21.15.133:0/3052203670 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febec0cd310 con 0x7febec145d30 2024-03-30T01:51:32.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.539+0000 7febe8c00640 1 -- 172.21.15.133:0/3052203670 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7febe403b040 con 0x7febec145d30 2024-03-30T01:51:32.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.540+0000 7febe8c00640 1 --2- 172.21.15.133:0/3052203670 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7febcc06ac00 0x7febcc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:32.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.540+0000 7febe8c00640 1 -- 172.21.15.133:0/3052203670 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7febe40abd00 con 0x7febec145d30 2024-03-30T01:51:32.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.540+0000 7febf0c00640 1 --2- 172.21.15.133:0/3052203670 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7febcc06ac00 0x7febcc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:32.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.541+0000 7febf0c00640 1 --2- 172.21.15.133:0/3052203670 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7febcc06ac00 0x7febcc06d0c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7febe0000f60 tx=0x7febe0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:32.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.544+0000 7febe8c00640 1 -- 172.21.15.133:0/3052203670 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7febe4076f20 con 0x7febec145d30 2024-03-30T01:51:32.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.773+0000 7febf3600640 1 -- 172.21.15.133:0/3052203670 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7febec066d80 con 0x7febec145d30 2024-03-30T01:51:32.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.787+0000 7febe8c00640 1 -- 172.21.15.133:0/3052203670 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7febe404e0c0 con 0x7febec145d30 2024-03-30T01:51:32.794 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 2 and data pool 3 2024-03-30T01:51:32.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.790+0000 7febf3600640 1 -- 172.21.15.133:0/3052203670 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7febcc06ac00 msgr2=0x7febcc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:32.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.790+0000 7febf3600640 1 --2- 172.21.15.133:0/3052203670 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7febcc06ac00 0x7febcc06d0c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7febe0000f60 tx=0x7febe0009040 comp rx=0 tx=0).stop 2024-03-30T01:51:32.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.790+0000 7febf3600640 1 -- 172.21.15.133:0/3052203670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febec145d30 msgr2=0x7febec0ae4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:32.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.790+0000 7febf3600640 1 --2- 172.21.15.133:0/3052203670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febec145d30 0x7febec0ae4c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7febe4037040 tx=0x7febe4004a40 comp rx=0 tx=0).stop 2024-03-30T01:51:32.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.792+0000 7febf3600640 1 -- 172.21.15.133:0/3052203670 shutdown_connections 2024-03-30T01:51:32.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.792+0000 7febf3600640 1 --2- 172.21.15.133:0/3052203670 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7febcc06ac00 0x7febcc06d0c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:32.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.792+0000 7febf3600640 1 --2- 172.21.15.133:0/3052203670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febec145d30 0x7febec0ae4c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:32.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.792+0000 7febf3600640 1 --2- 172.21.15.133:0/3052203670 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7febec1457b0 0x7febec15c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:32.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.792+0000 7febf3600640 1 --2- 172.21.15.133:0/3052203670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7febec070c10 0x7febec0cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:32.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.792+0000 7febf3600640 1 -- 172.21.15.133:0/3052203670 >> 172.21.15.133:0/3052203670 conn(0x7febec0b07a0 msgr2=0x7febec0adbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:32.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.794+0000 7febf3600640 1 -- 172.21.15.133:0/3052203670 shutdown_connections 2024-03-30T01:51:32.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.794+0000 7febf3600640 1 -- 172.21.15.133:0/3052203670 wait complete. 2024-03-30T01:51:32.831 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:51:32.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.990+0000 7f7ec4a00640 1 Processor -- start 2024-03-30T01:51:32.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.990+0000 7f7ec4a00640 1 -- start start 2024-03-30T01:51:32.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.991+0000 7f7ec4a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7ec0145d30 0x7f7ec0070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:32.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.991+0000 7f7ec4a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ec0070a40 0x7f7ec00b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:32.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.991+0000 7f7ec4a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec006c320 con 0x7f7ec01457b0 2024-03-30T01:51:32.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.991+0000 7f7ec4a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec0070ed0 con 0x7f7ec0145d30 2024-03-30T01:51:32.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.991+0000 7f7ec4a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec0145b90 con 0x7f7ec0070a40 2024-03-30T01:51:32.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.992+0000 7f7ebe800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ec0070a40 0x7f7ec00b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:32.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.992+0000 7f7ebe800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ec0070a40 0x7f7ec00b18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.133:46286/0 (socket says 172.21.15.133:46286) 2024-03-30T01:51:32.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.992+0000 7f7ebe800640 1 -- 172.21.15.133:0/3897840275 learned_addr learned my addr 172.21.15.133:0/3897840275 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:32.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.992+0000 7f7ebd400640 1 --2- 172.21.15.133:0/3897840275 >> v2:172.21.15.137:3300/0 conn(0x7f7ec0145d30 0x7f7ec0070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:32.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.993+0000 7f7ebe800640 1 -- 172.21.15.133:0/3897840275 >> v2:172.21.15.137:3300/0 conn(0x7f7ec0145d30 msgr2=0x7f7ec0070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:32.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.993+0000 7f7ebe800640 1 --2- 172.21.15.133:0/3897840275 >> v2:172.21.15.137:3300/0 conn(0x7f7ec0145d30 0x7f7ec0070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:32.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.993+0000 7f7ebe800640 1 -- 172.21.15.133:0/3897840275 >> v1:172.21.15.137:6789/0 conn(0x7f7ec01457b0 legacy=0x7f7ec00b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:32.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.993+0000 7f7ebe800640 1 -- 172.21.15.133:0/3897840275 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec006c600 con 0x7f7ec0070a40 2024-03-30T01:51:33.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.994+0000 7f7ebe800640 1 --2- 172.21.15.133:0/3897840275 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ec0070a40 0x7f7ec00b18c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009e50 tx=0x7f7eb802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=575c14e05f4e4a9a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:33.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.995+0000 7f7ebca00640 1 -- 172.21.15.133:0/3897840275 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb802cb00 con 0x7f7ec0070a40 2024-03-30T01:51:33.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.995+0000 7f7ebca00640 1 -- 172.21.15.133:0/3897840275 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb802cc60 con 0x7f7ec0070a40 2024-03-30T01:51:33.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.995+0000 7f7ebca00640 1 -- 172.21.15.133:0/3897840275 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb80343f0 con 0x7f7ec0070a40 2024-03-30T01:51:33.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.995+0000 7f7ec4a00640 1 -- 172.21.15.133:0/3897840275 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ec0070a40 msgr2=0x7f7ec00b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:33.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.995+0000 7f7ec4a00640 1 --2- 172.21.15.133:0/3897840275 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ec0070a40 0x7f7ec00b18c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009e50 tx=0x7f7eb802bf60 comp rx=0 tx=0).stop 2024-03-30T01:51:33.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.995+0000 7f7ec4a00640 1 -- 172.21.15.133:0/3897840275 shutdown_connections 2024-03-30T01:51:33.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.995+0000 7f7ec4a00640 1 --2- 172.21.15.133:0/3897840275 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ec0070a40 0x7f7ec00b18c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.995+0000 7f7ec4a00640 1 --2- 172.21.15.133:0/3897840275 >> v2:172.21.15.137:3300/0 conn(0x7f7ec0145d30 0x7f7ec0070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.995+0000 7f7ec4a00640 1 -- 172.21.15.133:0/3897840275 >> 172.21.15.133:0/3897840275 conn(0x7f7ec00b07a0 msgr2=0x7f7ec00b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:33.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.995+0000 7f7ec4a00640 1 -- 172.21.15.133:0/3897840275 shutdown_connections 2024-03-30T01:51:33.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.996+0000 7f7ec4a00640 1 -- 172.21.15.133:0/3897840275 wait complete. 2024-03-30T01:51:33.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.997+0000 7f7ec4a00640 1 Processor -- start 2024-03-30T01:51:33.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.997+0000 7f7ec4a00640 1 -- start start 2024-03-30T01:51:33.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.998+0000 7f7ec4a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ec0070a40 0x7f7ec015cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:33.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.998+0000 7f7ec4a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ec01457b0 0x7f7ec013f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:33.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.998+0000 7f7ec4a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ec0145d30 0x7f7ec013ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:33.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.998+0000 7f7ec4a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec015f3c0 con 0x7f7ec01457b0 2024-03-30T01:51:33.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.998+0000 7f7ec4a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec015d810 con 0x7f7ec0145d30 2024-03-30T01:51:33.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.998+0000 7f7ec4a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec015daf0 con 0x7f7ec0070a40 2024-03-30T01:51:33.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.999+0000 7f7ebd400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ec01457b0 0x7f7ec013f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:33.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.999+0000 7f7ebd400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ec01457b0 0x7f7ec013f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40346/0 (socket says 172.21.15.133:40346) 2024-03-30T01:51:33.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.999+0000 7f7ebd400640 1 -- 172.21.15.133:0/2840090055 learned_addr learned my addr 172.21.15.133:0/2840090055 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:33.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.999+0000 7f7ebde00640 1 --2- 172.21.15.133:0/2840090055 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ec0070a40 0x7f7ec015cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:33.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.999+0000 7f7ebe800640 1 --2- 172.21.15.133:0/2840090055 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ec0145d30 0x7f7ec013ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:33.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.999+0000 7f7ebd400640 1 -- 172.21.15.133:0/2840090055 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ec0070a40 msgr2=0x7f7ec015cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:33.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.999+0000 7f7ebd400640 1 --2- 172.21.15.133:0/2840090055 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ec0070a40 0x7f7ec015cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.999+0000 7f7ebd400640 1 -- 172.21.15.133:0/2840090055 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ec0145d30 msgr2=0x7f7ec013ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:33.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.999+0000 7f7ebd400640 1 --2- 172.21.15.133:0/2840090055 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ec0145d30 0x7f7ec013ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.999+0000 7f7ebd400640 1 -- 172.21.15.133:0/2840090055 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb8009b30 con 0x7f7ec01457b0 2024-03-30T01:51:33.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.999+0000 7f7ebe800640 1 --2- 172.21.15.133:0/2840090055 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ec0145d30 0x7f7ec013ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:51:33.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:32.999+0000 7f7ebd400640 1 --2- 172.21.15.133:0/2840090055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ec01457b0 0x7f7ec013f9f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00e9b0 tx=0x7f7eac00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:33.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.000+0000 7f7eb6000640 1 -- 172.21.15.133:0/2840090055 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac009670 con 0x7f7ec01457b0 2024-03-30T01:51:33.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.000+0000 7f7eb6000640 1 -- 172.21.15.133:0/2840090055 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac00c9a0 con 0x7f7ec01457b0 2024-03-30T01:51:33.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.000+0000 7f7eb6000640 1 -- 172.21.15.133:0/2840090055 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac00cd50 con 0x7f7ec01457b0 2024-03-30T01:51:33.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.000+0000 7f7ec4a00640 1 -- 172.21.15.133:0/2840090055 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec015ddd0 con 0x7f7ec01457b0 2024-03-30T01:51:33.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.000+0000 7f7ec4a00640 1 -- 172.21.15.133:0/2840090055 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec015e390 con 0x7f7ec01457b0 2024-03-30T01:51:33.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.001+0000 7f7ec4a00640 1 -- 172.21.15.133:0/2840090055 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec0066d80 con 0x7f7ec01457b0 2024-03-30T01:51:33.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.002+0000 7f7eb6000640 1 -- 172.21.15.133:0/2840090055 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f7eac013470 con 0x7f7ec01457b0 2024-03-30T01:51:33.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.003+0000 7f7eb6000640 1 --2- 172.21.15.133:0/2840090055 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7ea006ac00 0x7f7ea006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:33.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.003+0000 7f7eb6000640 1 -- 172.21.15.133:0/2840090055 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7eac0896f0 con 0x7f7ec01457b0 2024-03-30T01:51:33.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.003+0000 7f7ebde00640 1 --2- 172.21.15.133:0/2840090055 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7ea006ac00 0x7f7ea006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:33.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.003+0000 7f7ebde00640 1 --2- 172.21.15.133:0/2840090055 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7ea006ac00 0x7f7ea006d0c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0000f60 tx=0x7f7eb0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:33.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.007+0000 7f7eb6000640 1 -- 172.21.15.133:0/2840090055 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f7eac054830 con 0x7f7ec01457b0 2024-03-30T01:51:33.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.185+0000 7f7ec4a00640 1 -- 172.21.15.133:0/2840090055 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ec00cafb0 con 0x7f7ec01457b0 2024-03-30T01:51:33.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.187+0000 7f7eb6000640 1 -- 172.21.15.133:0/2840090055 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16098 (secure 0 0 0) 0x7f7eac057e50 con 0x7f7ec01457b0 2024-03-30T01:51:33.193 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:33.193 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":19,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:51:32.775735+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:51:31.245378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T01:51:31.774247+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:51:33.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.189+0000 7f7ec4a00640 1 -- 172.21.15.133:0/2840090055 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7ea006ac00 msgr2=0x7f7ea006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:33.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.189+0000 7f7ec4a00640 1 --2- 172.21.15.133:0/2840090055 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7ea006ac00 0x7f7ea006d0c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0000f60 tx=0x7f7eb0009040 comp rx=0 tx=0).stop 2024-03-30T01:51:33.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.189+0000 7f7ec4a00640 1 -- 172.21.15.133:0/2840090055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ec01457b0 msgr2=0x7f7ec013f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:33.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.189+0000 7f7ec4a00640 1 --2- 172.21.15.133:0/2840090055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ec01457b0 0x7f7ec013f9f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00e9b0 tx=0x7f7eac00ee70 comp rx=0 tx=0).stop 2024-03-30T01:51:33.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.189+0000 7f7ec4a00640 1 -- 172.21.15.133:0/2840090055 shutdown_connections 2024-03-30T01:51:33.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.189+0000 7f7ec4a00640 1 --2- 172.21.15.133:0/2840090055 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7ea006ac00 0x7f7ea006d0c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.189+0000 7f7ec4a00640 1 --2- 172.21.15.133:0/2840090055 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ec0145d30 0x7f7ec013ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.189+0000 7f7ec4a00640 1 --2- 172.21.15.133:0/2840090055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ec01457b0 0x7f7ec013f9f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.189+0000 7f7ec4a00640 1 --2- 172.21.15.133:0/2840090055 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ec0070a40 0x7f7ec015cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.189+0000 7f7ec4a00640 1 -- 172.21.15.133:0/2840090055 >> 172.21.15.133:0/2840090055 conn(0x7f7ec00b07a0 msgr2=0x7f7ec01418d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:33.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.189+0000 7f7ec4a00640 1 -- 172.21.15.133:0/2840090055 shutdown_connections 2024-03-30T01:51:33.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.190+0000 7f7ec4a00640 1 -- 172.21.15.133:0/2840090055 wait complete. 2024-03-30T01:51:33.213 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:51:33.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.412+0000 7fce9de00640 1 Processor -- start 2024-03-30T01:51:33.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.413+0000 7fce9de00640 1 -- start start 2024-03-30T01:51:33.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.414+0000 7fce9de00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fce9815c9f0 0x7fce980b83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:33.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.414+0000 7fce9de00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fce980d0bd0 0x7fce980b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:33.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.414+0000 7fce9de00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce980b4c80 con 0x7fce980b4830 2024-03-30T01:51:33.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.414+0000 7fce9de00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce980d1340 con 0x7fce980d0bd0 2024-03-30T01:51:33.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.414+0000 7fce9de00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce980d1620 con 0x7fce9815c9f0 2024-03-30T01:51:33.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.414+0000 7fce97e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fce980d0bd0 0x7fce980b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:33.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.414+0000 7fce97e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fce980d0bd0 0x7fce980b42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40362/0 (socket says 172.21.15.133:40362) 2024-03-30T01:51:33.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.414+0000 7fce97e00640 1 -- 172.21.15.133:0/3876263275 learned_addr learned my addr 172.21.15.133:0/3876263275 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:33.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.414+0000 7fce9d400640 1 --1- 172.21.15.133:0/3876263275 >> v1:172.21.15.133:6789/0 conn(0x7fce980b4830 0x7fce9806b220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41950/0 (socket says 172.21.15.133:41950) 2024-03-30T01:51:33.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.414+0000 7fce9ca00640 1 --2- 172.21.15.133:0/3876263275 >> v2:172.21.15.137:3300/0 conn(0x7fce9815c9f0 0x7fce980b83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:33.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.414+0000 7fce97e00640 1 -- 172.21.15.133:0/3876263275 >> v2:172.21.15.137:3300/0 conn(0x7fce9815c9f0 msgr2=0x7fce980b83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:33.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.414+0000 7fce97e00640 1 --2- 172.21.15.133:0/3876263275 >> v2:172.21.15.137:3300/0 conn(0x7fce9815c9f0 0x7fce980b83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.414+0000 7fce97e00640 1 -- 172.21.15.133:0/3876263275 >> v1:172.21.15.133:6789/0 conn(0x7fce980b4830 legacy=0x7fce9806b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:33.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.414+0000 7fce97e00640 1 -- 172.21.15.133:0/3876263275 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce980d1900 con 0x7fce980d0bd0 2024-03-30T01:51:33.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.415+0000 7fce97e00640 1 --2- 172.21.15.133:0/3876263275 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce980d0bd0 0x7fce980b42f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fce98074e20 tx=0x7fce8402b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52616ddb2b622d67 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:33.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.416+0000 7fce97400640 1 -- 172.21.15.133:0/3876263275 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce84030880 con 0x7fce980d0bd0 2024-03-30T01:51:33.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.416+0000 7fce97400640 1 -- 172.21.15.133:0/3876263275 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce840309e0 con 0x7fce980d0bd0 2024-03-30T01:51:33.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.416+0000 7fce97400640 1 -- 172.21.15.133:0/3876263275 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce84030d70 con 0x7fce980d0bd0 2024-03-30T01:51:33.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.416+0000 7fce9de00640 1 -- 172.21.15.133:0/3876263275 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce980d0bd0 msgr2=0x7fce980b42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:33.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.416+0000 7fce9de00640 1 --2- 172.21.15.133:0/3876263275 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce980d0bd0 0x7fce980b42f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fce98074e20 tx=0x7fce8402b9c0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.416+0000 7fce9de00640 1 -- 172.21.15.133:0/3876263275 shutdown_connections 2024-03-30T01:51:33.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.416+0000 7fce9de00640 1 --2- 172.21.15.133:0/3876263275 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce980d0bd0 0x7fce980b42f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.416+0000 7fce9de00640 1 --2- 172.21.15.133:0/3876263275 >> v2:172.21.15.137:3300/0 conn(0x7fce9815c9f0 0x7fce980b83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.416+0000 7fce9de00640 1 -- 172.21.15.133:0/3876263275 >> 172.21.15.133:0/3876263275 conn(0x7fce98071a40 msgr2=0x7fce980cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:33.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.416+0000 7fce9de00640 1 -- 172.21.15.133:0/3876263275 shutdown_connections 2024-03-30T01:51:33.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.416+0000 7fce9de00640 1 -- 172.21.15.133:0/3876263275 wait complete. 2024-03-30T01:51:33.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.418+0000 7fce9de00640 1 Processor -- start 2024-03-30T01:51:33.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.418+0000 7fce9de00640 1 -- start start 2024-03-30T01:51:33.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.419+0000 7fce9de00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce980b4830 0x7fce981401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:33.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.419+0000 7fce9de00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce980d0bd0 0x7fce9815f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:33.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.419+0000 7fce9de00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce9815c9f0 0x7fce98150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:33.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.419+0000 7fce9de00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9813d720 con 0x7fce980d0bd0 2024-03-30T01:51:33.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.419+0000 7fce9de00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9813dfc0 con 0x7fce9815c9f0 2024-03-30T01:51:33.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.419+0000 7fce9de00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce98143590 con 0x7fce980b4830 2024-03-30T01:51:33.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.419+0000 7fce97e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce980d0bd0 0x7fce9815f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:33.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.419+0000 7fce97e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce980d0bd0 0x7fce9815f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40376/0 (socket says 172.21.15.133:40376) 2024-03-30T01:51:33.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.419+0000 7fce97e00640 1 -- 172.21.15.133:0/941592371 learned_addr learned my addr 172.21.15.133:0/941592371 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:33.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.420+0000 7fce9ca00640 1 --2- 172.21.15.133:0/941592371 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce980b4830 0x7fce981401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:33.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.420+0000 7fce97e00640 1 -- 172.21.15.133:0/941592371 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce980b4830 msgr2=0x7fce981401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:33.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.420+0000 7fce97e00640 1 --2- 172.21.15.133:0/941592371 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce980b4830 0x7fce981401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.420+0000 7fce97e00640 1 -- 172.21.15.133:0/941592371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce9815c9f0 msgr2=0x7fce98150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:33.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.420+0000 7fce97e00640 1 --2- 172.21.15.133:0/941592371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce9815c9f0 0x7fce98150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.420+0000 7fce97e00640 1 -- 172.21.15.133:0/941592371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce840094d0 con 0x7fce980d0bd0 2024-03-30T01:51:33.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.420+0000 7fce9ca00640 1 --2- 172.21.15.133:0/941592371 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce980b4830 0x7fce981401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:33.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.420+0000 7fce97e00640 1 --2- 172.21.15.133:0/941592371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce980d0bd0 0x7fce9815f720 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fce8402ba00 tx=0x7fce84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:33.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.420+0000 7fce94c00640 1 -- 172.21.15.133:0/941592371 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce84039d60 con 0x7fce980d0bd0 2024-03-30T01:51:33.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.420+0000 7fce94c00640 1 -- 172.21.15.133:0/941592371 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce84043400 con 0x7fce980d0bd0 2024-03-30T01:51:33.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.420+0000 7fce94c00640 1 -- 172.21.15.133:0/941592371 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce840437b0 con 0x7fce980d0bd0 2024-03-30T01:51:33.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.420+0000 7fce9de00640 1 -- 172.21.15.133:0/941592371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce98140c10 con 0x7fce980d0bd0 2024-03-30T01:51:33.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.421+0000 7fce9de00640 1 -- 172.21.15.133:0/941592371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce980cc610 con 0x7fce980d0bd0 2024-03-30T01:51:33.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.422+0000 7fce9de00640 1 -- 172.21.15.133:0/941592371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce9813e130 con 0x7fce980d0bd0 2024-03-30T01:51:33.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.423+0000 7fce94c00640 1 -- 172.21.15.133:0/941592371 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fce84043910 con 0x7fce980d0bd0 2024-03-30T01:51:33.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.423+0000 7fce94c00640 1 --2- 172.21.15.133:0/941592371 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fce7806ac50 0x7fce7806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:33.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.423+0000 7fce94c00640 1 -- 172.21.15.133:0/941592371 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce8403e070 con 0x7fce980d0bd0 2024-03-30T01:51:33.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.424+0000 7fce9ca00640 1 --2- 172.21.15.133:0/941592371 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fce7806ac50 0x7fce7806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:33.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.424+0000 7fce9ca00640 1 --2- 172.21.15.133:0/941592371 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fce7806ac50 0x7fce7806d110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fce8c006fd0 tx=0x7fce8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:33.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.428+0000 7fce94c00640 1 -- 172.21.15.133:0/941592371 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fce84077720 con 0x7fce980d0bd0 2024-03-30T01:51:33.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.623+0000 7fce9de00640 1 -- 172.21.15.133:0/941592371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce98073750 con 0x7fce980d0bd0 2024-03-30T01:51:33.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.626+0000 7fce94c00640 1 -- 172.21.15.133:0/941592371 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16098 (secure 0 0 0) 0x7fce8407ad40 con 0x7fce980d0bd0 2024-03-30T01:51:33.633 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:33.633 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":19,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:51:32.775735+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:51:31.245378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T01:51:31.774247+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:51:33.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.629+0000 7fce9de00640 1 -- 172.21.15.133:0/941592371 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fce7806ac50 msgr2=0x7fce7806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:33.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.629+0000 7fce9de00640 1 --2- 172.21.15.133:0/941592371 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fce7806ac50 0x7fce7806d110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fce8c006fd0 tx=0x7fce8c008040 comp rx=0 tx=0).stop 2024-03-30T01:51:33.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.629+0000 7fce9de00640 1 -- 172.21.15.133:0/941592371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce980d0bd0 msgr2=0x7fce9815f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:33.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.629+0000 7fce9de00640 1 --2- 172.21.15.133:0/941592371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce980d0bd0 0x7fce9815f720 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fce8402ba00 tx=0x7fce84004730 comp rx=0 tx=0).stop 2024-03-30T01:51:33.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.629+0000 7fce9de00640 1 -- 172.21.15.133:0/941592371 shutdown_connections 2024-03-30T01:51:33.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.629+0000 7fce9de00640 1 --2- 172.21.15.133:0/941592371 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fce7806ac50 0x7fce7806d110 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.629+0000 7fce9de00640 1 --2- 172.21.15.133:0/941592371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce9815c9f0 0x7fce98150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.629+0000 7fce9de00640 1 --2- 172.21.15.133:0/941592371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce980d0bd0 0x7fce9815f720 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.629+0000 7fce9de00640 1 --2- 172.21.15.133:0/941592371 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce980b4830 0x7fce981401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.629+0000 7fce9de00640 1 -- 172.21.15.133:0/941592371 >> 172.21.15.133:0/941592371 conn(0x7fce98071a40 msgr2=0x7fce980b70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:33.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.629+0000 7fce9de00640 1 -- 172.21.15.133:0/941592371 shutdown_connections 2024-03-30T01:51:33.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.629+0000 7fce9de00640 1 -- 172.21.15.133:0/941592371 wait complete. 2024-03-30T01:51:33.655 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-30T01:51:33.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.854+0000 7f6d68a00640 1 Processor -- start 2024-03-30T01:51:33.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.854+0000 7f6d68a00640 1 -- start start 2024-03-30T01:51:33.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.855+0000 7f6d68a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6d6415cc50 0x7f6d640d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:33.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.855+0000 7f6d68a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6d640d2240 0x7f6d640cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:33.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.855+0000 7f6d68a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d640cf9b0 0x7f6d640b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:33.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.855+0000 7f6d68a00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d640d1c50 con 0x7f6d6415cc50 2024-03-30T01:51:33.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.855+0000 7f6d68a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6415d030 con 0x7f6d640d2240 2024-03-30T01:51:33.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.855+0000 7f6d68a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d640cfe40 con 0x7f6d640cf9b0 2024-03-30T01:51:33.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.856+0000 7f6d61e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6d6415cc50 0x7f6d640d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:33.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.856+0000 7f6d61e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6d6415cc50 0x7f6d640d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40386/0 (socket says 172.21.15.133:40386) 2024-03-30T01:51:33.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.856+0000 7f6d61e00640 1 -- 172.21.15.133:0/888659271 learned_addr learned my addr 172.21.15.133:0/888659271 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:33.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.856+0000 7f6d62800640 1 --2- 172.21.15.133:0/888659271 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d640cf9b0 0x7f6d640b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:33.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.856+0000 7f6d61e00640 1 -- 172.21.15.133:0/888659271 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d640cf9b0 msgr2=0x7f6d640b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:33.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.856+0000 7f6d61e00640 1 --2- 172.21.15.133:0/888659271 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d640cf9b0 0x7f6d640b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.856+0000 7f6d61e00640 1 -- 172.21.15.133:0/888659271 >> v2:172.21.15.137:3300/0 conn(0x7f6d640d2240 msgr2=0x7f6d640cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:33.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.856+0000 7f6d59400640 1 --2- 172.21.15.133:0/888659271 >> v2:172.21.15.137:3300/0 conn(0x7f6d640d2240 0x7f6d640cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:33.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.856+0000 7f6d61e00640 1 --2- 172.21.15.133:0/888659271 >> v2:172.21.15.137:3300/0 conn(0x7f6d640d2240 0x7f6d640cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.856+0000 7f6d61e00640 1 -- 172.21.15.133:0/888659271 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d640b5af0 con 0x7f6d6415cc50 2024-03-30T01:51:33.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.856+0000 7f6d59400640 1 --2- 172.21.15.133:0/888659271 >> v2:172.21.15.137:3300/0 conn(0x7f6d640d2240 0x7f6d640cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:33.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.857+0000 7f6d61e00640 1 --2- 172.21.15.133:0/888659271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d6415cc50 0x7f6d640d0af0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6d6406c150 tx=0x7f6d5402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afec0bfc24602c7c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:33.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.857+0000 7f6d61400640 1 -- 172.21.15.133:0/888659271 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54031870 con 0x7f6d6415cc50 2024-03-30T01:51:33.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.857+0000 7f6d61400640 1 -- 172.21.15.133:0/888659271 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d540319d0 con 0x7f6d6415cc50 2024-03-30T01:51:33.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.857+0000 7f6d61400640 1 -- 172.21.15.133:0/888659271 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54031d60 con 0x7f6d6415cc50 2024-03-30T01:51:33.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.858+0000 7f6d68a00640 1 -- 172.21.15.133:0/888659271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d6415cc50 msgr2=0x7f6d640d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:33.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.858+0000 7f6d68a00640 1 --2- 172.21.15.133:0/888659271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d6415cc50 0x7f6d640d0af0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6d6406c150 tx=0x7f6d5402b910 comp rx=0 tx=0).stop 2024-03-30T01:51:33.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.858+0000 7f6d68a00640 1 -- 172.21.15.133:0/888659271 shutdown_connections 2024-03-30T01:51:33.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.858+0000 7f6d68a00640 1 --2- 172.21.15.133:0/888659271 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d640cf9b0 0x7f6d640b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.858+0000 7f6d68a00640 1 --2- 172.21.15.133:0/888659271 >> v2:172.21.15.137:3300/0 conn(0x7f6d640d2240 0x7f6d640cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.858+0000 7f6d68a00640 1 --2- 172.21.15.133:0/888659271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d6415cc50 0x7f6d640d0af0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.858+0000 7f6d68a00640 1 -- 172.21.15.133:0/888659271 >> 172.21.15.133:0/888659271 conn(0x7f6d64071a40 msgr2=0x7f6d6406b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:33.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.858+0000 7f6d68a00640 1 -- 172.21.15.133:0/888659271 shutdown_connections 2024-03-30T01:51:33.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.858+0000 7f6d68a00640 1 -- 172.21.15.133:0/888659271 wait complete. 2024-03-30T01:51:33.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.860+0000 7f6d68a00640 1 Processor -- start 2024-03-30T01:51:33.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.860+0000 7f6d68a00640 1 -- start start 2024-03-30T01:51:33.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.861+0000 7f6d68a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d640cf9b0 0x7f6d64151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:33.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.861+0000 7f6d68a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d640d2240 0x7f6d641587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:33.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.861+0000 7f6d68a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d6415cc50 0x7f6d64158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:33.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.861+0000 7f6d68a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d64159370 con 0x7f6d6415cc50 2024-03-30T01:51:33.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.861+0000 7f6d68a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d64156e50 con 0x7f6d640d2240 2024-03-30T01:51:33.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.861+0000 7f6d68a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d641524c0 con 0x7f6d640cf9b0 2024-03-30T01:51:33.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.861+0000 7f6d62800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d6415cc50 0x7f6d64158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:33.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.861+0000 7f6d62800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d6415cc50 0x7f6d64158d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40400/0 (socket says 172.21.15.133:40400) 2024-03-30T01:51:33.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.861+0000 7f6d62800640 1 -- 172.21.15.133:0/969542728 learned_addr learned my addr 172.21.15.133:0/969542728 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:33.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.861+0000 7f6d62800640 1 -- 172.21.15.133:0/969542728 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d640cf9b0 msgr2=0x7f6d64151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:33.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.861+0000 7f6d62800640 1 --2- 172.21.15.133:0/969542728 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d640cf9b0 0x7f6d64151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.861+0000 7f6d62800640 1 -- 172.21.15.133:0/969542728 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d640d2240 msgr2=0x7f6d641587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:33.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.862+0000 7f6d62800640 1 --2- 172.21.15.133:0/969542728 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d640d2240 0x7f6d641587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:33.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.862+0000 7f6d62800640 1 -- 172.21.15.133:0/969542728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d540094d0 con 0x7f6d6415cc50 2024-03-30T01:51:33.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.862+0000 7f6d62800640 1 --2- 172.21.15.133:0/969542728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d6415cc50 0x7f6d64158d10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00cd70 tx=0x7f6d5c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:33.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.862+0000 7f6d5aa00640 1 -- 172.21.15.133:0/969542728 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c003b90 con 0x7f6d6415cc50 2024-03-30T01:51:33.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.862+0000 7f6d5aa00640 1 -- 172.21.15.133:0/969542728 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5c003cf0 con 0x7f6d6415cc50 2024-03-30T01:51:33.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.862+0000 7f6d68a00640 1 -- 172.21.15.133:0/969542728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d64156520 con 0x7f6d6415cc50 2024-03-30T01:51:33.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.862+0000 7f6d5aa00640 1 -- 172.21.15.133:0/969542728 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c004240 con 0x7f6d6415cc50 2024-03-30T01:51:33.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.862+0000 7f6d68a00640 1 -- 172.21.15.133:0/969542728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d64156ae0 con 0x7f6d6415cc50 2024-03-30T01:51:33.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.863+0000 7f6d68a00640 1 -- 172.21.15.133:0/969542728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d64066d80 con 0x7f6d6415cc50 2024-03-30T01:51:33.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.864+0000 7f6d5aa00640 1 -- 172.21.15.133:0/969542728 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f6d5c0043a0 con 0x7f6d6415cc50 2024-03-30T01:51:33.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.865+0000 7f6d5aa00640 1 --2- 172.21.15.133:0/969542728 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6d4006ac00 0x7f6d4006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:33.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.865+0000 7f6d5aa00640 1 -- 172.21.15.133:0/969542728 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d5c012070 con 0x7f6d6415cc50 2024-03-30T01:51:33.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.865+0000 7f6d61e00640 1 --2- 172.21.15.133:0/969542728 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6d4006ac00 0x7f6d4006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:33.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.866+0000 7f6d61e00640 1 --2- 172.21.15.133:0/969542728 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6d4006ac00 0x7f6d4006d0c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6d54036000 tx=0x7f6d54030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:33.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:33.869+0000 7f6d5aa00640 1 -- 172.21.15.133:0/969542728 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f6d5c054f00 con 0x7f6d6415cc50 2024-03-30T01:51:34.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:34.103+0000 7f6d68a00640 1 -- 172.21.15.133:0/969542728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6d64156f90 con 0x7f6d6415cc50 2024-03-30T01:51:34.274 INFO:tasks.ceph.mds.d.smithi137.stderr:2024-03-30T01:51:34.268+0000 7f7306e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-30T01:51:34.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:34.790+0000 7f6d5aa00640 1 -- 172.21.15.133:0/969542728 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6d5c058520 con 0x7f6d6415cc50 2024-03-30T01:51:34.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:34.793+0000 7f6d68a00640 1 -- 172.21.15.133:0/969542728 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6d4006ac00 msgr2=0x7f6d4006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:34.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:34.793+0000 7f6d68a00640 1 --2- 172.21.15.133:0/969542728 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6d4006ac00 0x7f6d4006d0c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6d54036000 tx=0x7f6d54030000 comp rx=0 tx=0).stop 2024-03-30T01:51:34.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:34.793+0000 7f6d68a00640 1 -- 172.21.15.133:0/969542728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d6415cc50 msgr2=0x7f6d64158d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:34.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:34.793+0000 7f6d68a00640 1 --2- 172.21.15.133:0/969542728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d6415cc50 0x7f6d64158d10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00cd70 tx=0x7f6d5c00a660 comp rx=0 tx=0).stop 2024-03-30T01:51:34.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:34.794+0000 7f6d68a00640 1 -- 172.21.15.133:0/969542728 shutdown_connections 2024-03-30T01:51:34.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:34.794+0000 7f6d68a00640 1 --2- 172.21.15.133:0/969542728 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6d4006ac00 0x7f6d4006d0c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:34.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:34.794+0000 7f6d68a00640 1 --2- 172.21.15.133:0/969542728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d6415cc50 0x7f6d64158d10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:34.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:34.794+0000 7f6d68a00640 1 --2- 172.21.15.133:0/969542728 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d640d2240 0x7f6d641587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:34.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:34.794+0000 7f6d68a00640 1 --2- 172.21.15.133:0/969542728 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d640cf9b0 0x7f6d64151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:34.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:34.794+0000 7f6d68a00640 1 -- 172.21.15.133:0/969542728 >> 172.21.15.133:0/969542728 conn(0x7f6d64071a40 msgr2=0x7f6d6415e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:34.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:34.794+0000 7f6d68a00640 1 -- 172.21.15.133:0/969542728 shutdown_connections 2024-03-30T01:51:34.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:34.794+0000 7f6d68a00640 1 -- 172.21.15.133:0/969542728 wait complete. 2024-03-30T01:51:34.937 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-30T01:51:34.937 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-30T01:51:35.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.151+0000 7f0e9aa00640 1 Processor -- start 2024-03-30T01:51:35.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.151+0000 7f0e9aa00640 1 -- start start 2024-03-30T01:51:35.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.152+0000 7f0e9aa00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0e94070c10 0x7f0e94164740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:35.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.152+0000 7f0e9aa00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e940ce400 con 0x7f0e94143220 2024-03-30T01:51:35.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.152+0000 7f0e9aa00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e9406d0e0 con 0x7f0e9406e2e0 2024-03-30T01:51:35.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.152+0000 7f0e9aa00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e940cc5c0 con 0x7f0e94070c10 2024-03-30T01:51:35.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.152+0000 7f0e98a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0e94070c10 0x7f0e94164740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:35.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.152+0000 7f0e98a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0e94070c10 0x7f0e94164740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40414/0 (socket says 172.21.15.133:40414) 2024-03-30T01:51:35.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.152+0000 7f0e98a00640 1 -- 172.21.15.133:0/3261539502 learned_addr learned my addr 172.21.15.133:0/3261539502 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:35.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.152+0000 7f0e93e00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0e94143220 0x7f0e940cd990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41954/0 (socket says 172.21.15.133:41954) 2024-03-30T01:51:35.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.153+0000 7f0e98a00640 1 -- 172.21.15.133:0/3261539502 >> v1:172.21.15.137:6789/0 conn(0x7f0e9406e2e0 legacy=0x7f0e94070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:35.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.153+0000 7f0e98a00640 1 -- 172.21.15.133:0/3261539502 >> v1:172.21.15.133:6789/0 conn(0x7f0e94143220 legacy=0x7f0e940cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:35.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.153+0000 7f0e92a00640 1 -- 172.21.15.133:0/3261539502 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519684726 0 0) 0x7f0e940ce400 con 0x7f0e94143220 2024-03-30T01:51:35.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.153+0000 7f0e98a00640 1 -- 172.21.15.133:0/3261539502 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9406d3c0 con 0x7f0e94070c10 2024-03-30T01:51:35.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.154+0000 7f0e98a00640 1 --2- 172.21.15.133:0/3261539502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e94070c10 0x7f0e94164740 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c009e50 tx=0x7f0e8c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bce4ad699ef0beb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:35.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.154+0000 7f0e92a00640 1 -- 172.21.15.133:0/3261539502 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c02cb00 con 0x7f0e94070c10 2024-03-30T01:51:35.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.154+0000 7f0e92a00640 1 -- 172.21.15.133:0/3261539502 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8c02cc60 con 0x7f0e94070c10 2024-03-30T01:51:35.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.154+0000 7f0e92a00640 1 -- 172.21.15.133:0/3261539502 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c0343f0 con 0x7f0e94070c10 2024-03-30T01:51:35.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.155+0000 7f0e9aa00640 1 -- 172.21.15.133:0/3261539502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e94070c10 msgr2=0x7f0e94164740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:35.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.155+0000 7f0e9aa00640 1 --2- 172.21.15.133:0/3261539502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e94070c10 0x7f0e94164740 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c009e50 tx=0x7f0e8c02bf60 comp rx=0 tx=0).stop 2024-03-30T01:51:35.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.155+0000 7f0e9aa00640 1 -- 172.21.15.133:0/3261539502 shutdown_connections 2024-03-30T01:51:35.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.155+0000 7f0e9aa00640 1 --2- 172.21.15.133:0/3261539502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e94070c10 0x7f0e94164740 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:35.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.155+0000 7f0e9aa00640 1 -- 172.21.15.133:0/3261539502 >> 172.21.15.133:0/3261539502 conn(0x7f0e940b07a0 msgr2=0x7f0e940b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:35.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.155+0000 7f0e9aa00640 1 -- 172.21.15.133:0/3261539502 shutdown_connections 2024-03-30T01:51:35.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.155+0000 7f0e9aa00640 1 -- 172.21.15.133:0/3261539502 wait complete. 2024-03-30T01:51:35.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.157+0000 7f0e9aa00640 1 Processor -- start 2024-03-30T01:51:35.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.157+0000 7f0e9aa00640 1 -- start start 2024-03-30T01:51:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.158+0000 7f0e9aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e9406e2e0 0x7f0e94155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.158+0000 7f0e9aa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e94070c10 0x7f0e9415bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.158+0000 7f0e9aa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e94143220 0x7f0e9415c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.158+0000 7f0e9aa00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9415c740 con 0x7f0e94143220 2024-03-30T01:51:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.158+0000 7f0e9aa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e941f5d10 con 0x7f0e9406e2e0 2024-03-30T01:51:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.158+0000 7f0e9aa00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9415a320 con 0x7f0e94070c10 2024-03-30T01:51:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.158+0000 7f0e98a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e94143220 0x7f0e9415c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.158+0000 7f0e98a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e94143220 0x7f0e9415c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40426/0 (socket says 172.21.15.133:40426) 2024-03-30T01:51:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.158+0000 7f0e98a00640 1 -- 172.21.15.133:0/4233336597 learned_addr learned my addr 172.21.15.133:0/4233336597 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.158+0000 7f0e93e00640 1 --2- 172.21.15.133:0/4233336597 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e9406e2e0 0x7f0e94155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.158+0000 7f0e93400640 1 --2- 172.21.15.133:0/4233336597 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e94070c10 0x7f0e9415bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.158+0000 7f0e98a00640 1 -- 172.21.15.133:0/4233336597 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e94070c10 msgr2=0x7f0e9415bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.158+0000 7f0e98a00640 1 --2- 172.21.15.133:0/4233336597 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e94070c10 0x7f0e9415bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.158+0000 7f0e98a00640 1 -- 172.21.15.133:0/4233336597 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e9406e2e0 msgr2=0x7f0e94155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.158+0000 7f0e98a00640 1 --2- 172.21.15.133:0/4233336597 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e9406e2e0 0x7f0e94155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.158+0000 7f0e98a00640 1 -- 172.21.15.133:0/4233336597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8c009b30 con 0x7f0e94143220 2024-03-30T01:51:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.159+0000 7f0e98a00640 1 --2- 172.21.15.133:0/4233336597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e94143220 0x7f0e9415c200 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c036040 tx=0x7f0e8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.159+0000 7f0e8be00640 1 -- 172.21.15.133:0/4233336597 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c03e450 con 0x7f0e94143220 2024-03-30T01:51:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.159+0000 7f0e8be00640 1 -- 172.21.15.133:0/4233336597 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8c03e5d0 con 0x7f0e94143220 2024-03-30T01:51:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.159+0000 7f0e8be00640 1 -- 172.21.15.133:0/4233336597 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c03e980 con 0x7f0e94143220 2024-03-30T01:51:35.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.159+0000 7f0e9aa00640 1 -- 172.21.15.133:0/4233336597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9415c930 con 0x7f0e94143220 2024-03-30T01:51:35.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.159+0000 7f0e9aa00640 1 -- 172.21.15.133:0/4233336597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e941f6520 con 0x7f0e94143220 2024-03-30T01:51:35.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.160+0000 7f0e9aa00640 1 -- 172.21.15.133:0/4233336597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e94066d80 con 0x7f0e94143220 2024-03-30T01:51:35.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.161+0000 7f0e8be00640 1 -- 172.21.15.133:0/4233336597 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0e8c03eae0 con 0x7f0e94143220 2024-03-30T01:51:35.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.162+0000 7f0e8be00640 1 --2- 172.21.15.133:0/4233336597 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0e7406ac00 0x7f0e7406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:35.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.162+0000 7f0e8be00640 1 -- 172.21.15.133:0/4233336597 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e8c0ac220 con 0x7f0e94143220 2024-03-30T01:51:35.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.162+0000 7f0e93e00640 1 --2- 172.21.15.133:0/4233336597 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0e7406ac00 0x7f0e7406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.163+0000 7f0e93e00640 1 --2- 172.21.15.133:0/4233336597 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0e7406ac00 0x7f0e7406d0c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0e84000f60 tx=0x7f0e84007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:35.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.166+0000 7f0e8be00640 1 -- 172.21.15.133:0/4233336597 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f0e8c077400 con 0x7f0e94143220 2024-03-30T01:51:35.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.400+0000 7f0e9aa00640 1 -- 172.21.15.133:0/4233336597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0e9415d120 con 0x7f0e94143220 2024-03-30T01:51:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.793+0000 7f0e8be00640 1 -- 172.21.15.133:0/4233336597 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0e8c07aa20 con 0x7f0e94143220 2024-03-30T01:51:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.797+0000 7f0e9aa00640 1 -- 172.21.15.133:0/4233336597 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0e7406ac00 msgr2=0x7f0e7406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.797+0000 7f0e9aa00640 1 --2- 172.21.15.133:0/4233336597 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0e7406ac00 0x7f0e7406d0c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0e84000f60 tx=0x7f0e84007c00 comp rx=0 tx=0).stop 2024-03-30T01:51:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.797+0000 7f0e9aa00640 1 -- 172.21.15.133:0/4233336597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e94143220 msgr2=0x7f0e9415c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.797+0000 7f0e9aa00640 1 --2- 172.21.15.133:0/4233336597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e94143220 0x7f0e9415c200 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c036040 tx=0x7f0e8c004a40 comp rx=0 tx=0).stop 2024-03-30T01:51:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.797+0000 7f0e9aa00640 1 -- 172.21.15.133:0/4233336597 shutdown_connections 2024-03-30T01:51:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.797+0000 7f0e9aa00640 1 --2- 172.21.15.133:0/4233336597 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0e7406ac00 0x7f0e7406d0c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.797+0000 7f0e9aa00640 1 --2- 172.21.15.133:0/4233336597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e94143220 0x7f0e9415c200 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.797+0000 7f0e9aa00640 1 --2- 172.21.15.133:0/4233336597 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e94070c10 0x7f0e9415bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.797+0000 7f0e9aa00640 1 --2- 172.21.15.133:0/4233336597 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e9406e2e0 0x7f0e94155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.797+0000 7f0e9aa00640 1 -- 172.21.15.133:0/4233336597 >> 172.21.15.133:0/4233336597 conn(0x7f0e940b07a0 msgr2=0x7f0e9413fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.798+0000 7f0e9aa00640 1 -- 172.21.15.133:0/4233336597 shutdown_connections 2024-03-30T01:51:35.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:35.798+0000 7f0e9aa00640 1 -- 172.21.15.133:0/4233336597 wait complete. 2024-03-30T01:51:35.826 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-30T01:51:35.826 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T01:51:36.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.029+0000 7efc36400640 1 Processor -- start 2024-03-30T01:51:36.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.029+0000 7efc36400640 1 -- start start 2024-03-30T01:51:36.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.031+0000 7efc36400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc30143790 0x7efc300cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:36.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.031+0000 7efc36400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efc30070500 0x7efc30070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:36.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.031+0000 7efc36400640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc300a76a0 con 0x7efc300cc530 2024-03-30T01:51:36.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.031+0000 7efc36400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc300b38e0 con 0x7efc30070500 2024-03-30T01:51:36.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.031+0000 7efc36400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc300cd180 con 0x7efc30143790 2024-03-30T01:51:36.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.031+0000 7efc2fe00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7efc300cc530 0x7efc300cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53880/0 (socket says 172.21.15.133:53880) 2024-03-30T01:51:36.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.031+0000 7efc2fe00640 1 -- 172.21.15.133:0/2180265398 learned_addr learned my addr 172.21.15.133:0/2180265398 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:36.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.031+0000 7efc2f400640 1 --2- 172.21.15.133:0/2180265398 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc30143790 0x7efc300cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:36.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.031+0000 7efc26a00640 1 --2- 172.21.15.133:0/2180265398 >> v2:172.21.15.137:3300/0 conn(0x7efc30070500 0x7efc30070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:36.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.031+0000 7efc2ea00640 1 -- 172.21.15.133:0/2180265398 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2315385111 0 0) 0x7efc300a76a0 con 0x7efc300cc530 2024-03-30T01:51:36.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.031+0000 7efc2ea00640 1 -- 172.21.15.133:0/2180265398 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc14003520 con 0x7efc300cc530 2024-03-30T01:51:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.032+0000 7efc2ea00640 1 -- 172.21.15.133:0/2180265398 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3138961025 0 0) 0x7efc14003520 con 0x7efc300cc530 2024-03-30T01:51:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.032+0000 7efc2ea00640 1 -- 172.21.15.133:0/2180265398 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc30143790 msgr2=0x7efc300cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.032+0000 7efc2ea00640 1 --2- 172.21.15.133:0/2180265398 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc30143790 0x7efc300cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.032+0000 7efc2ea00640 1 -- 172.21.15.133:0/2180265398 >> v2:172.21.15.137:3300/0 conn(0x7efc30070500 msgr2=0x7efc30070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.032+0000 7efc2ea00640 1 --2- 172.21.15.133:0/2180265398 >> v2:172.21.15.137:3300/0 conn(0x7efc30070500 0x7efc30070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.032+0000 7efc2ea00640 1 -- 172.21.15.133:0/2180265398 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc30070ea0 con 0x7efc300cc530 2024-03-30T01:51:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.032+0000 7efc2ea00640 1 -- 172.21.15.133:0/2180265398 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7efc280019f0 con 0x7efc300cc530 2024-03-30T01:51:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.032+0000 7efc2ea00640 1 -- 172.21.15.133:0/2180265398 >> v1:172.21.15.133:6789/0 conn(0x7efc300cc530 legacy=0x7efc300cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.032+0000 7efc2ea00640 1 --2- 172.21.15.133:0/2180265398 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc30143790 0x7efc14003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.032+0000 7efc2ea00640 1 --2- 172.21.15.133:0/2180265398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc14003ef0 0x7efc140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.032+0000 7efc2ea00640 1 --2- 172.21.15.133:0/2180265398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc14004d00 0x7efc14005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.032+0000 7efc2ea00640 1 -- 172.21.15.133:0/2180265398 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc300b38e0 con 0x7efc14004d00 2024-03-30T01:51:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.032+0000 7efc2ea00640 1 -- 172.21.15.133:0/2180265398 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc300cd180 con 0x7efc14003ef0 2024-03-30T01:51:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.032+0000 7efc2ea00640 1 -- 172.21.15.133:0/2180265398 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1400b9b0 con 0x7efc30143790 2024-03-30T01:51:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.032+0000 7efc2fe00640 1 --2- 172.21.15.133:0/2180265398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc14004d00 0x7efc14005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.033+0000 7efc2f400640 1 --2- 172.21.15.133:0/2180265398 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc30143790 0x7efc14003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.033+0000 7efc26a00640 1 --2- 172.21.15.133:0/2180265398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc14003ef0 0x7efc140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.033+0000 7efc2fe00640 1 -- 172.21.15.133:0/2180265398 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc30143790 msgr2=0x7efc14003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.033+0000 7efc2fe00640 1 --2- 172.21.15.133:0/2180265398 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc30143790 0x7efc14003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.033+0000 7efc2fe00640 1 -- 172.21.15.133:0/2180265398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc14003ef0 msgr2=0x7efc140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.033+0000 7efc2fe00640 1 --2- 172.21.15.133:0/2180265398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc14003ef0 0x7efc140047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.033+0000 7efc2fe00640 1 -- 172.21.15.133:0/2180265398 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc14003520 con 0x7efc14004d00 2024-03-30T01:51:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.034+0000 7efc2fe00640 1 --2- 172.21.15.133:0/2180265398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc14004d00 0x7efc14005180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efc2800a860 tx=0x7efc140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf19060c4b8d330 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.034+0000 7efc2ea00640 1 -- 172.21.15.133:0/2180265398 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc28034630 con 0x7efc14004d00 2024-03-30T01:51:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.034+0000 7efc2ea00640 1 -- 172.21.15.133:0/2180265398 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2802f070 con 0x7efc14004d00 2024-03-30T01:51:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.034+0000 7efc2ea00640 1 -- 172.21.15.133:0/2180265398 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc28034a30 con 0x7efc14004d00 2024-03-30T01:51:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.034+0000 7efc36400640 1 -- 172.21.15.133:0/2180265398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc14004d00 msgr2=0x7efc14005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.034+0000 7efc36400640 1 --2- 172.21.15.133:0/2180265398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc14004d00 0x7efc14005180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efc2800a860 tx=0x7efc140057f0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.034+0000 7efc2fe00640 1 -- 172.21.15.133:0/2180265398 reap_dead start 2024-03-30T01:51:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.035+0000 7efc36400640 1 -- 172.21.15.133:0/2180265398 shutdown_connections 2024-03-30T01:51:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.035+0000 7efc36400640 1 -- 172.21.15.133:0/2180265398 >> 172.21.15.133:0/2180265398 conn(0x7efc300b07a0 msgr2=0x7efc300b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.035+0000 7efc36400640 1 -- 172.21.15.133:0/2180265398 shutdown_connections 2024-03-30T01:51:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.035+0000 7efc36400640 1 -- 172.21.15.133:0/2180265398 wait complete. 2024-03-30T01:51:36.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.036+0000 7efc36400640 1 Processor -- start 2024-03-30T01:51:36.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.037+0000 7efc36400640 1 -- start start 2024-03-30T01:51:36.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.037+0000 7efc36400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc14004d00 0x7efc3015a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:36.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.037+0000 7efc36400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc3013dd70 0x7efc3006d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:36.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.037+0000 7efc36400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc3006d6a0 0x7efc3013e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:36.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.037+0000 7efc36400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3013d950 con 0x7efc14004d00 2024-03-30T01:51:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.037+0000 7efc36400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3006db20 con 0x7efc3006d6a0 2024-03-30T01:51:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.037+0000 7efc36400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3015a690 con 0x7efc3013dd70 2024-03-30T01:51:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.038+0000 7efc2f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc14004d00 0x7efc3015a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.038+0000 7efc2f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc14004d00 0x7efc3015a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45806/0 (socket says 172.21.15.133:45806) 2024-03-30T01:51:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.038+0000 7efc2f400640 1 -- 172.21.15.133:0/2035809878 learned_addr learned my addr 172.21.15.133:0/2035809878 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.038+0000 7efc26a00640 1 --2- 172.21.15.133:0/2035809878 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc3013dd70 0x7efc3006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.038+0000 7efc2f400640 1 -- 172.21.15.133:0/2035809878 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc3013dd70 msgr2=0x7efc3006d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.038+0000 7efc2f400640 1 --2- 172.21.15.133:0/2035809878 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc3013dd70 0x7efc3006d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.038+0000 7efc2f400640 1 -- 172.21.15.133:0/2035809878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc3006d6a0 msgr2=0x7efc3013e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.038+0000 7efc2f400640 1 --2- 172.21.15.133:0/2035809878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc3006d6a0 0x7efc3013e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.038+0000 7efc2f400640 1 -- 172.21.15.133:0/2035809878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3013cff0 con 0x7efc14004d00 2024-03-30T01:51:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.038+0000 7efc2f400640 1 --2- 172.21.15.133:0/2035809878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc14004d00 0x7efc3015a150 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efc20010860 tx=0x7efc20010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.039+0000 7efc27e00640 1 -- 172.21.15.133:0/2035809878 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc20009610 con 0x7efc14004d00 2024-03-30T01:51:36.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.039+0000 7efc27e00640 1 -- 172.21.15.133:0/2035809878 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2000ea80 con 0x7efc14004d00 2024-03-30T01:51:36.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.039+0000 7efc36400640 1 -- 172.21.15.133:0/2035809878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc3013f220 con 0x7efc14004d00 2024-03-30T01:51:36.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.039+0000 7efc27e00640 1 -- 172.21.15.133:0/2035809878 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2000ee10 con 0x7efc14004d00 2024-03-30T01:51:36.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.039+0000 7efc36400640 1 -- 172.21.15.133:0/2035809878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3013d570 con 0x7efc14004d00 2024-03-30T01:51:36.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.040+0000 7efc36400640 1 -- 172.21.15.133:0/2035809878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc300adf20 con 0x7efc14004d00 2024-03-30T01:51:36.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.041+0000 7efc27e00640 1 -- 172.21.15.133:0/2035809878 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7efc2001c400 con 0x7efc14004d00 2024-03-30T01:51:36.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.041+0000 7efc27e00640 1 --2- 172.21.15.133:0/2035809878 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efc0c06ac30 0x7efc0c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:36.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.042+0000 7efc27e00640 1 -- 172.21.15.133:0/2035809878 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc200897e0 con 0x7efc14004d00 2024-03-30T01:51:36.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.042+0000 7efc26a00640 1 --2- 172.21.15.133:0/2035809878 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efc0c06ac30 0x7efc0c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:36.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.042+0000 7efc26a00640 1 --2- 172.21.15.133:0/2035809878 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efc0c06ac30 0x7efc0c06d0f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efc3013cf10 tx=0x7efc18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:36.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.046+0000 7efc27e00640 1 -- 172.21.15.133:0/2035809878 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7efc20054a60 con 0x7efc14004d00 2024-03-30T01:51:36.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.276+0000 7efc36400640 1 -- 172.21.15.133:0/2035809878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc30066d80 con 0x7efc14004d00 2024-03-30T01:51:36.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.277+0000 7efc27e00640 1 -- 172.21.15.133:0/2035809878 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4737 (secure 0 0 0) 0x7efc20058080 con 0x7efc14004d00 2024-03-30T01:51:36.284 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:36.284 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2218506023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2218506023},{"type":"v1","addr":"172.21.15.137:6835","nonce":2218506023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2935514153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2935514153},{"type":"v1","addr":"172.21.15.133:6836","nonce":2935514153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2942187095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2942187095},{"type":"v1","addr":"172.21.15.133:6837","nonce":2942187095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T01:51:32.776583+0000","modified":"2024-03-30T01:51:35.787820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/225370013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":225370013},{"type":"v1","addr":"172.21.15.137:6834","nonce":225370013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-30T01:51:36.284 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 7 2024-03-30T01:51:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.280+0000 7efc36400640 1 -- 172.21.15.133:0/2035809878 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efc0c06ac30 msgr2=0x7efc0c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.280+0000 7efc36400640 1 --2- 172.21.15.133:0/2035809878 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efc0c06ac30 0x7efc0c06d0f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efc3013cf10 tx=0x7efc18008040 comp rx=0 tx=0).stop 2024-03-30T01:51:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.280+0000 7efc36400640 1 -- 172.21.15.133:0/2035809878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc14004d00 msgr2=0x7efc3015a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.280+0000 7efc36400640 1 --2- 172.21.15.133:0/2035809878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc14004d00 0x7efc3015a150 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efc20010860 tx=0x7efc20010d20 comp rx=0 tx=0).stop 2024-03-30T01:51:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.280+0000 7efc36400640 1 -- 172.21.15.133:0/2035809878 shutdown_connections 2024-03-30T01:51:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.280+0000 7efc36400640 1 --2- 172.21.15.133:0/2035809878 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efc0c06ac30 0x7efc0c06d0f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.280+0000 7efc36400640 1 --2- 172.21.15.133:0/2035809878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc3006d6a0 0x7efc3013e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.280+0000 7efc36400640 1 --2- 172.21.15.133:0/2035809878 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc3013dd70 0x7efc3006d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.280+0000 7efc36400640 1 --2- 172.21.15.133:0/2035809878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc14004d00 0x7efc3015a150 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.280+0000 7efc36400640 1 -- 172.21.15.133:0/2035809878 >> 172.21.15.133:0/2035809878 conn(0x7efc300b07a0 msgr2=0x7efc300ad200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.281+0000 7efc36400640 1 -- 172.21.15.133:0/2035809878 shutdown_connections 2024-03-30T01:51:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.281+0000 7efc36400640 1 -- 172.21.15.133:0/2035809878 wait complete. 2024-03-30T01:51:36.305 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:51:36.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.489+0000 7fd87fe00640 1 Processor -- start 2024-03-30T01:51:36.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.489+0000 7fd87fe00640 1 -- start start 2024-03-30T01:51:36.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.490+0000 7fd87fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8800b4a00 0x7fd8800b83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:36.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.490+0000 7fd87fe00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8800d1340 con 0x7fd88015c9f0 2024-03-30T01:51:36.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.490+0000 7fd87fe00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8800d1620 con 0x7fd8800d0bd0 2024-03-30T01:51:36.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.490+0000 7fd87fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8800d1900 con 0x7fd8800b4a00 2024-03-30T01:51:36.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.491+0000 7fd87ea00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd88015c9f0 0x7fd8800b42f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53892/0 (socket says 172.21.15.133:53892) 2024-03-30T01:51:36.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.491+0000 7fd87ea00640 1 -- 172.21.15.133:0/336177174 learned_addr learned my addr 172.21.15.133:0/336177174 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:36.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.491+0000 7fd87e000640 1 --2- 172.21.15.133:0/336177174 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8800b4a00 0x7fd8800b83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:36.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.491+0000 7fd87d600640 1 -- 172.21.15.133:0/336177174 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1721503721 0 0) 0x7fd8800d1340 con 0x7fd88015c9f0 2024-03-30T01:51:36.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.491+0000 7fd87d600640 1 -- 172.21.15.133:0/336177174 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd864003520 con 0x7fd88015c9f0 2024-03-30T01:51:36.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.491+0000 7fd87d600640 1 -- 172.21.15.133:0/336177174 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1017403470 0 0) 0x7fd864003520 con 0x7fd88015c9f0 2024-03-30T01:51:36.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.491+0000 7fd87d600640 1 -- 172.21.15.133:0/336177174 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8800b4a00 msgr2=0x7fd8800b83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:36.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.491+0000 7fd87d600640 1 --2- 172.21.15.133:0/336177174 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8800b4a00 0x7fd8800b83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.491+0000 7fd87d600640 1 -- 172.21.15.133:0/336177174 >> v1:172.21.15.137:6789/0 conn(0x7fd8800d0bd0 legacy=0x7fd8800b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:36.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.491+0000 7fd87d600640 1 -- 172.21.15.133:0/336177174 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8800d1be0 con 0x7fd88015c9f0 2024-03-30T01:51:36.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.491+0000 7fd87d600640 1 -- 172.21.15.133:0/336177174 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fd870001670 con 0x7fd88015c9f0 2024-03-30T01:51:36.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.491+0000 7fd87d600640 1 -- 172.21.15.133:0/336177174 >> v1:172.21.15.133:6789/0 conn(0x7fd88015c9f0 legacy=0x7fd8800b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:36.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.491+0000 7fd87d600640 1 --2- 172.21.15.133:0/336177174 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8800b4a00 0x7fd8640039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:36.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.491+0000 7fd87d600640 1 --2- 172.21.15.133:0/336177174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd864003f20 0x7fd8640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:36.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.492+0000 7fd87d600640 1 --2- 172.21.15.133:0/336177174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd864004d00 0x7fd864005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:36.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.492+0000 7fd87d600640 1 -- 172.21.15.133:0/336177174 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8800d1900 con 0x7fd864004d00 2024-03-30T01:51:36.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.492+0000 7fd87d600640 1 -- 172.21.15.133:0/336177174 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86400ba60 con 0x7fd864003f20 2024-03-30T01:51:36.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.492+0000 7fd87d600640 1 -- 172.21.15.133:0/336177174 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86400bc20 con 0x7fd8800b4a00 2024-03-30T01:51:36.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.492+0000 7fd87f400640 1 --2- 172.21.15.133:0/336177174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd864004d00 0x7fd864005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:36.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.492+0000 7fd87f400640 1 -- 172.21.15.133:0/336177174 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8800b4a00 msgr2=0x7fd8640039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:36.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.492+0000 7fd87f400640 1 --2- 172.21.15.133:0/336177174 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8800b4a00 0x7fd8640039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.492+0000 7fd87f400640 1 -- 172.21.15.133:0/336177174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd864003f20 msgr2=0x7fd8640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:36.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.492+0000 7fd87f400640 1 --2- 172.21.15.133:0/336177174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd864003f20 0x7fd8640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.492+0000 7fd87f400640 1 -- 172.21.15.133:0/336177174 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd864003520 con 0x7fd864004d00 2024-03-30T01:51:36.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.493+0000 7fd87f400640 1 --2- 172.21.15.133:0/336177174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd864004d00 0x7fd864005180 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd878001e50 tx=0x7fd8640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970dad7ba9bd0055 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:36.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.493+0000 7fd87d600640 1 -- 172.21.15.133:0/336177174 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878003b70 con 0x7fd864004d00 2024-03-30T01:51:36.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.493+0000 7fd87d600640 1 -- 172.21.15.133:0/336177174 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd878003cd0 con 0x7fd864004d00 2024-03-30T01:51:36.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.493+0000 7fd87d600640 1 -- 172.21.15.133:0/336177174 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878005310 con 0x7fd864004d00 2024-03-30T01:51:36.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.494+0000 7fd87fe00640 1 -- 172.21.15.133:0/336177174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd864004d00 msgr2=0x7fd864005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:36.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.494+0000 7fd87fe00640 1 --2- 172.21.15.133:0/336177174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd864004d00 0x7fd864005180 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd878001e50 tx=0x7fd8640057f0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.494+0000 7fd87f400640 1 -- 172.21.15.133:0/336177174 reap_dead start 2024-03-30T01:51:36.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.494+0000 7fd87fe00640 1 -- 172.21.15.133:0/336177174 shutdown_connections 2024-03-30T01:51:36.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.494+0000 7fd87fe00640 1 -- 172.21.15.133:0/336177174 >> 172.21.15.133:0/336177174 conn(0x7fd880071a40 msgr2=0x7fd8800cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:36.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.494+0000 7fd87fe00640 1 -- 172.21.15.133:0/336177174 shutdown_connections 2024-03-30T01:51:36.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.494+0000 7fd87fe00640 1 -- 172.21.15.133:0/336177174 wait complete. 2024-03-30T01:51:36.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.496+0000 7fd87fe00640 1 Processor -- start 2024-03-30T01:51:36.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.496+0000 7fd87fe00640 1 -- start start 2024-03-30T01:51:36.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.497+0000 7fd87fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd864004d00 0x7fd8801f5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:36.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.497+0000 7fd87fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8801f2690 0x7fd8800b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:36.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.497+0000 7fd87fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8800b2ca0 0x7fd8800ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:36.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.497+0000 7fd87fe00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8800b3120 con 0x7fd8801f2690 2024-03-30T01:51:36.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.497+0000 7fd87fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd880146a00 con 0x7fd864004d00 2024-03-30T01:51:36.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.497+0000 7fd87fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd880146ce0 con 0x7fd8800b2ca0 2024-03-30T01:51:36.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.497+0000 7fd87e000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8801f2690 0x7fd8800b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:36.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.497+0000 7fd87e000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8801f2690 0x7fd8800b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45810/0 (socket says 172.21.15.133:45810) 2024-03-30T01:51:36.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.497+0000 7fd87e000640 1 -- 172.21.15.133:0/208003420 learned_addr learned my addr 172.21.15.133:0/208003420 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:36.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.497+0000 7fd87ea00640 1 --2- 172.21.15.133:0/208003420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd864004d00 0x7fd8801f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:36.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.497+0000 7fd87e000640 1 -- 172.21.15.133:0/208003420 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8800b2ca0 msgr2=0x7fd8800ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:36.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.497+0000 7fd87e000640 1 --2- 172.21.15.133:0/208003420 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8800b2ca0 0x7fd8800ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.497+0000 7fd87e000640 1 -- 172.21.15.133:0/208003420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd864004d00 msgr2=0x7fd8801f5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:36.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.497+0000 7fd87e000640 1 --2- 172.21.15.133:0/208003420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd864004d00 0x7fd8801f5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.497+0000 7fd87e000640 1 -- 172.21.15.133:0/208003420 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd880146fc0 con 0x7fd8801f2690 2024-03-30T01:51:36.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.497+0000 7fd87ea00640 1 --2- 172.21.15.133:0/208003420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd864004d00 0x7fd8801f5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:36.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.498+0000 7fd87e000640 1 --2- 172.21.15.133:0/208003420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8801f2690 0x7fd8800b2760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00e780 tx=0x7fd86c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:36.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.498+0000 7fd876a00640 1 -- 172.21.15.133:0/208003420 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c00ee90 con 0x7fd8801f2690 2024-03-30T01:51:36.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.498+0000 7fd876a00640 1 -- 172.21.15.133:0/208003420 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86c00c940 con 0x7fd8801f2690 2024-03-30T01:51:36.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.498+0000 7fd876a00640 1 -- 172.21.15.133:0/208003420 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c00ccf0 con 0x7fd8801f2690 2024-03-30T01:51:36.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.498+0000 7fd87fe00640 1 -- 172.21.15.133:0/208003420 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8801472a0 con 0x7fd8801f2690 2024-03-30T01:51:36.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.498+0000 7fd87fe00640 1 -- 172.21.15.133:0/208003420 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8800cad70 con 0x7fd8801f2690 2024-03-30T01:51:36.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.499+0000 7fd87fe00640 1 -- 172.21.15.133:0/208003420 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd880073750 con 0x7fd8801f2690 2024-03-30T01:51:36.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.500+0000 7fd876a00640 1 -- 172.21.15.133:0/208003420 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd86c013470 con 0x7fd8801f2690 2024-03-30T01:51:36.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.501+0000 7fd876a00640 1 --2- 172.21.15.133:0/208003420 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd86006ac30 0x7fd86006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:36.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.501+0000 7fd876a00640 1 -- 172.21.15.133:0/208003420 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd86c089410 con 0x7fd8801f2690 2024-03-30T01:51:36.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.501+0000 7fd87ea00640 1 --2- 172.21.15.133:0/208003420 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd86006ac30 0x7fd86006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:36.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.502+0000 7fd87ea00640 1 --2- 172.21.15.133:0/208003420 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd86006ac30 0x7fd86006d0f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd870001eb0 tx=0x7fd870009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:36.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.506+0000 7fd876a00640 1 -- 172.21.15.133:0/208003420 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fd86c0545e0 con 0x7fd8801f2690 2024-03-30T01:51:36.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.699+0000 7fd87fe00640 1 -- 172.21.15.133:0/208003420 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8800b1680 con 0x7fd8801f2690 2024-03-30T01:51:36.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.702+0000 7fd876a00640 1 -- 172.21.15.133:0/208003420 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7fd86c057c00 con 0x7fd8801f2690 2024-03-30T01:51:36.708 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:36.708 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:51:33.780665+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:51:31.245378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T01:51:31.774247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:51:36.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.704+0000 7fd87fe00640 1 -- 172.21.15.133:0/208003420 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd86006ac30 msgr2=0x7fd86006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:36.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.704+0000 7fd87fe00640 1 --2- 172.21.15.133:0/208003420 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd86006ac30 0x7fd86006d0f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd870001eb0 tx=0x7fd870009040 comp rx=0 tx=0).stop 2024-03-30T01:51:36.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.704+0000 7fd87fe00640 1 -- 172.21.15.133:0/208003420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8801f2690 msgr2=0x7fd8800b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:36.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.704+0000 7fd87fe00640 1 --2- 172.21.15.133:0/208003420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8801f2690 0x7fd8800b2760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00e780 tx=0x7fd86c00ec40 comp rx=0 tx=0).stop 2024-03-30T01:51:36.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.705+0000 7fd87fe00640 1 -- 172.21.15.133:0/208003420 shutdown_connections 2024-03-30T01:51:36.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.705+0000 7fd87fe00640 1 --2- 172.21.15.133:0/208003420 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd86006ac30 0x7fd86006d0f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.705+0000 7fd87fe00640 1 --2- 172.21.15.133:0/208003420 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8800b2ca0 0x7fd8800ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.705+0000 7fd87fe00640 1 --2- 172.21.15.133:0/208003420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8801f2690 0x7fd8800b2760 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.705+0000 7fd87fe00640 1 --2- 172.21.15.133:0/208003420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd864004d00 0x7fd8801f5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.705+0000 7fd87fe00640 1 -- 172.21.15.133:0/208003420 >> 172.21.15.133:0/208003420 conn(0x7fd880071a40 msgr2=0x7fd88006b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:36.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.705+0000 7fd87fe00640 1 -- 172.21.15.133:0/208003420 shutdown_connections 2024-03-30T01:51:36.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.705+0000 7fd87fe00640 1 -- 172.21.15.133:0/208003420 wait complete. 2024-03-30T01:51:36.729 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-30T01:51:36.729 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T01:51:36.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.927+0000 7f2d7a200640 1 Processor -- start 2024-03-30T01:51:36.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.927+0000 7f2d7a200640 1 -- start start 2024-03-30T01:51:36.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.928+0000 7f2d7a200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d7415cc50 0x7f2d740d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:36.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.928+0000 7f2d7a200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2d740d2240 0x7f2d740cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:36.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.929+0000 7f2d7a200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d7415d030 con 0x7f2d740cf9b0 2024-03-30T01:51:36.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.929+0000 7f2d7a200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d740d1c50 con 0x7f2d740d2240 2024-03-30T01:51:36.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.929+0000 7f2d7a200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d740cfe40 con 0x7f2d7415cc50 2024-03-30T01:51:36.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.929+0000 7f2d73400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d7415cc50 0x7f2d740d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:36.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.929+0000 7f2d73400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d7415cc50 0x7f2d740d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.133:52524/0 (socket says 172.21.15.133:52524) 2024-03-30T01:51:36.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.929+0000 7f2d73400640 1 -- 172.21.15.133:0/1527745121 learned_addr learned my addr 172.21.15.133:0/1527745121 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:36.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.929+0000 7f2d72a00640 1 --2- 172.21.15.133:0/1527745121 >> v2:172.21.15.137:3300/0 conn(0x7f2d740d2240 0x7f2d740cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:36.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.930+0000 7f2d73400640 1 -- 172.21.15.133:0/1527745121 >> v2:172.21.15.137:3300/0 conn(0x7f2d740d2240 msgr2=0x7f2d740cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:36.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.930+0000 7f2d73400640 1 --2- 172.21.15.133:0/1527745121 >> v2:172.21.15.137:3300/0 conn(0x7f2d740d2240 0x7f2d740cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.930+0000 7f2d73400640 1 -- 172.21.15.133:0/1527745121 >> v1:172.21.15.137:6789/0 conn(0x7f2d740cf9b0 legacy=0x7f2d740b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:36.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.930+0000 7f2d73400640 1 -- 172.21.15.133:0/1527745121 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d740b5af0 con 0x7f2d7415cc50 2024-03-30T01:51:36.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.930+0000 7f2d72000640 1 -- 172.21.15.133:0/1527745121 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903023564 0 0) 0x7f2d7415d030 con 0x7f2d740cf9b0 2024-03-30T01:51:36.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.931+0000 7f2d73400640 1 --2- 172.21.15.133:0/1527745121 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d7415cc50 0x7f2d740d0af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2d64009870 tx=0x7f2d6402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=773779ac594e33e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:36.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.932+0000 7f2d72000640 1 -- 172.21.15.133:0/1527745121 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64030840 con 0x7f2d7415cc50 2024-03-30T01:51:36.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.932+0000 7f2d72000640 1 -- 172.21.15.133:0/1527745121 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d640309a0 con 0x7f2d7415cc50 2024-03-30T01:51:36.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.932+0000 7f2d72000640 1 -- 172.21.15.133:0/1527745121 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64030d30 con 0x7f2d7415cc50 2024-03-30T01:51:36.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.932+0000 7f2d7a200640 1 -- 172.21.15.133:0/1527745121 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d7415cc50 msgr2=0x7f2d740d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:36.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.932+0000 7f2d7a200640 1 --2- 172.21.15.133:0/1527745121 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d7415cc50 0x7f2d740d0af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2d64009870 tx=0x7f2d6402b980 comp rx=0 tx=0).stop 2024-03-30T01:51:36.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.933+0000 7f2d7a200640 1 -- 172.21.15.133:0/1527745121 shutdown_connections 2024-03-30T01:51:36.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.933+0000 7f2d7a200640 1 --2- 172.21.15.133:0/1527745121 >> v2:172.21.15.137:3300/0 conn(0x7f2d740d2240 0x7f2d740cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.933+0000 7f2d7a200640 1 --2- 172.21.15.133:0/1527745121 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d7415cc50 0x7f2d740d0af0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.933+0000 7f2d7a200640 1 -- 172.21.15.133:0/1527745121 >> 172.21.15.133:0/1527745121 conn(0x7f2d74071a40 msgr2=0x7f2d7406b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:36.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.933+0000 7f2d7a200640 1 -- 172.21.15.133:0/1527745121 shutdown_connections 2024-03-30T01:51:36.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.933+0000 7f2d7a200640 1 -- 172.21.15.133:0/1527745121 wait complete. 2024-03-30T01:51:36.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.934+0000 7f2d7a200640 1 Processor -- start 2024-03-30T01:51:36.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.934+0000 7f2d7a200640 1 -- start start 2024-03-30T01:51:36.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.935+0000 7f2d7a200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d740cf9b0 0x7f2d7415aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:36.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.935+0000 7f2d7a200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d740d2240 0x7f2d74156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:36.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.935+0000 7f2d7a200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d7415cc50 0x7f2d7414f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:36.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.935+0000 7f2d7a200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d741f2bc0 con 0x7f2d740d2240 2024-03-30T01:51:36.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.935+0000 7f2d7a200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7415b4d0 con 0x7f2d740cf9b0 2024-03-30T01:51:36.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.935+0000 7f2d7a200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d741f2220 con 0x7f2d7415cc50 2024-03-30T01:51:36.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.936+0000 7f2d72a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d740d2240 0x7f2d74156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:36.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.936+0000 7f2d72a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d740d2240 0x7f2d74156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45826/0 (socket says 172.21.15.133:45826) 2024-03-30T01:51:36.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.936+0000 7f2d72a00640 1 -- 172.21.15.133:0/1780353724 learned_addr learned my addr 172.21.15.133:0/1780353724 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:36.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.936+0000 7f2d73400640 1 --2- 172.21.15.133:0/1780353724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d740cf9b0 0x7f2d7415aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:36.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.936+0000 7f2d73e00640 1 --2- 172.21.15.133:0/1780353724 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d7415cc50 0x7f2d7414f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:36.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.936+0000 7f2d72a00640 1 -- 172.21.15.133:0/1780353724 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d7415cc50 msgr2=0x7f2d7414f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:36.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.936+0000 7f2d72a00640 1 --2- 172.21.15.133:0/1780353724 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d7415cc50 0x7f2d7414f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.936+0000 7f2d72a00640 1 -- 172.21.15.133:0/1780353724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d740cf9b0 msgr2=0x7f2d7415aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:36.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.936+0000 7f2d72a00640 1 --2- 172.21.15.133:0/1780353724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d740cf9b0 0x7f2d7415aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:36.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.936+0000 7f2d72a00640 1 -- 172.21.15.133:0/1780353724 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d640094d0 con 0x7f2d740d2240 2024-03-30T01:51:36.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.936+0000 7f2d72a00640 1 --2- 172.21.15.133:0/1780353724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d740d2240 0x7f2d74156020 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000e9b0 tx=0x7f2d6000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:36.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.937+0000 7f2d6b400640 1 -- 172.21.15.133:0/1780353724 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d60009670 con 0x7f2d740d2240 2024-03-30T01:51:36.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.937+0000 7f2d6b400640 1 -- 172.21.15.133:0/1780353724 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6000c9a0 con 0x7f2d740d2240 2024-03-30T01:51:36.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.937+0000 7f2d6b400640 1 -- 172.21.15.133:0/1780353724 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6000cd50 con 0x7f2d740d2240 2024-03-30T01:51:36.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.937+0000 7f2d7a200640 1 -- 172.21.15.133:0/1780353724 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d741f2500 con 0x7f2d740d2240 2024-03-30T01:51:36.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.937+0000 7f2d7a200640 1 -- 172.21.15.133:0/1780353724 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7415fe70 con 0x7f2d740d2240 2024-03-30T01:51:36.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.938+0000 7f2d7a200640 1 -- 172.21.15.133:0/1780353724 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d74066d80 con 0x7f2d740d2240 2024-03-30T01:51:36.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.939+0000 7f2d6b400640 1 -- 172.21.15.133:0/1780353724 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f2d60013470 con 0x7f2d740d2240 2024-03-30T01:51:36.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.940+0000 7f2d6b400640 1 --2- 172.21.15.133:0/1780353724 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f2d5406ac00 0x7f2d5406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:36.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.940+0000 7f2d6b400640 1 -- 172.21.15.133:0/1780353724 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d600895c0 con 0x7f2d740d2240 2024-03-30T01:51:36.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.940+0000 7f2d73400640 1 --2- 172.21.15.133:0/1780353724 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f2d5406ac00 0x7f2d5406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:36.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.940+0000 7f2d73400640 1 --2- 172.21.15.133:0/1780353724 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f2d5406ac00 0x7f2d5406d0c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2d64036000 tx=0x7f2d6403b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:36.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:36.944+0000 7f2d6b400640 1 -- 172.21.15.133:0/1780353724 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f2d60054830 con 0x7f2d740d2240 2024-03-30T01:51:37.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.132+0000 7f2d7a200640 1 -- 172.21.15.133:0/1780353724 --> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d740d1690 con 0x7f2d5406ac00 2024-03-30T01:51:37.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.154+0000 7f2d6b400640 1 -- 172.21.15.133:0/1780353724 <== mgr.4105 v2:172.21.15.133:6832/37234 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253806 (secure 0 0 0) 0x7f2d64030b90 con 0x7f2d5406ac00 2024-03-30T01:51:37.164 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:37.166 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-03-30T01:51:37.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.160+0000 7f2d7a200640 1 -- 172.21.15.133:0/1780353724 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f2d5406ac00 msgr2=0x7f2d5406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:37.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.160+0000 7f2d7a200640 1 --2- 172.21.15.133:0/1780353724 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f2d5406ac00 0x7f2d5406d0c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2d64036000 tx=0x7f2d6403b040 comp rx=0 tx=0).stop 2024-03-30T01:51:37.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.160+0000 7f2d7a200640 1 -- 172.21.15.133:0/1780353724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d740d2240 msgr2=0x7f2d74156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:37.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.160+0000 7f2d7a200640 1 --2- 172.21.15.133:0/1780353724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d740d2240 0x7f2d74156020 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000e9b0 tx=0x7f2d6000ee70 comp rx=0 tx=0).stop 2024-03-30T01:51:37.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.160+0000 7f2d7a200640 1 -- 172.21.15.133:0/1780353724 shutdown_connections 2024-03-30T01:51:37.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.160+0000 7f2d7a200640 1 --2- 172.21.15.133:0/1780353724 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f2d5406ac00 0x7f2d5406d0c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:37.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.160+0000 7f2d7a200640 1 --2- 172.21.15.133:0/1780353724 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d7415cc50 0x7f2d7414f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:37.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.160+0000 7f2d7a200640 1 --2- 172.21.15.133:0/1780353724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d740d2240 0x7f2d74156020 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:37.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.160+0000 7f2d7a200640 1 --2- 172.21.15.133:0/1780353724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d740cf9b0 0x7f2d7415aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:37.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.160+0000 7f2d7a200640 1 -- 172.21.15.133:0/1780353724 >> 172.21.15.133:0/1780353724 conn(0x7f2d74071a40 msgr2=0x7f2d740b7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:37.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.160+0000 7f2d7a200640 1 -- 172.21.15.133:0/1780353724 shutdown_connections 2024-03-30T01:51:37.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.160+0000 7f2d7a200640 1 -- 172.21.15.133:0/1780353724 wait complete. 2024-03-30T01:51:37.187 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-03-30T01:51:35.697391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218624,"kb_used_data":2464,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756096,"statfs":{"total":773094113280,"available":772870242304,"internally_reserved":0,"allocated":2523136,"data_stored":1591082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.413979"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.289573+0000","last_change":"2024-03-30T01:51:31.289573+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.289573+0000","last_undegraded":"2024-03-30T01:51:31.289573+0000","last_fullsized":"2024-03-30T01:51:31.289573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:16:10.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.306107+0000","last_change":"2024-03-30T01:51:31.306107+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.306107+0000","last_undegraded":"2024-03-30T01:51:31.306107+0000","last_fullsized":"2024-03-30T01:51:31.306107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.290136+0000","last_change":"2024-03-30T01:51:31.290136+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.290136+0000","last_undegraded":"2024-03-30T01:51:31.290136+0000","last_fullsized":"2024-03-30T01:51:31.290136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.292550+0000","last_change":"2024-03-30T01:51:31.292550+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.292550+0000","last_undegraded":"2024-03-30T01:51:31.292550+0000","last_fullsized":"2024-03-30T01:51:31.292550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:16.099108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.308062+0000","last_change":"2024-03-30T01:51:31.308062+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.308062+0000","last_undegraded":"2024-03-30T01:51:31.308062+0000","last_fullsized":"2024-03-30T01:51:31.308062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:49:06.802141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.293682+0000","last_change":"2024-03-30T01:51:31.293682+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.293682+0000","last_undegraded":"2024-03-30T01:51:31.293682+0000","last_fullsized":"2024-03-30T01:51:31.293682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.299522+0000","last_change":"2024-03-30T01:51:31.299522+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.299522+0000","last_undegraded":"2024-03-30T01:51:31.299522+0000","last_fullsized":"2024-03-30T01:51:31.299522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.305195+0000","last_change":"2024-03-30T01:51:31.305195+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.305195+0000","last_undegraded":"2024-03-30T01:51:31.305195+0000","last_fullsized":"2024-03-30T01:51:31.305195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:16:10.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.294760+0000","last_change":"2024-03-30T01:51:31.294760+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.294760+0000","last_undegraded":"2024-03-30T01:51:31.294760+0000","last_fullsized":"2024-03-30T01:51:31.294760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:18.328608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.294880+0000","last_change":"2024-03-30T01:51:31.294880+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.294880+0000","last_undegraded":"2024-03-30T01:51:31.294880+0000","last_fullsized":"2024-03-30T01:51:31.294880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:49:06.802141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.304553+0000","last_change":"2024-03-30T01:51:31.304553+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.304553+0000","last_undegraded":"2024-03-30T01:51:31.304553+0000","last_fullsized":"2024-03-30T01:51:31.304553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.297273+0000","last_change":"2024-03-30T01:51:31.297273+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.297273+0000","last_undegraded":"2024-03-30T01:51:31.297273+0000","last_fullsized":"2024-03-30T01:51:31.297273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:16:10.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.308132+0000","last_change":"2024-03-30T01:51:31.308132+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.308132+0000","last_undegraded":"2024-03-30T01:51:31.308132+0000","last_fullsized":"2024-03-30T01:51:31.308132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:29:54.309497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.297647+0000","last_change":"2024-03-30T01:51:31.297647+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.297647+0000","last_undegraded":"2024-03-30T01:51:31.297647+0000","last_fullsized":"2024-03-30T01:51:31.297647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.297847+0000","last_change":"2024-03-30T01:51:31.297847+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.297847+0000","last_undegraded":"2024-03-30T01:51:31.297847+0000","last_fullsized":"2024-03-30T01:51:31.297847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:43:13.165559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.296841+0000","last_change":"2024-03-30T01:51:31.296841+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.296841+0000","last_undegraded":"2024-03-30T01:51:31.296841+0000","last_fullsized":"2024-03-30T01:51:31.296841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:18.328608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":161,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-30T01:51:26.739183+0000","last_change":"2024-03-30T01:51:23.358245+0000","last_active":"2024-03-30T01:51:26.739183+0000","last_peered":"2024-03-30T01:51:26.739183+0000","last_clean":"2024-03-30T01:51:26.739183+0000","last_became_active":"2024-03-30T01:51:23.355914+0000","last_became_peered":"2024-03-30T01:51:23.355914+0000","last_unstale":"2024-03-30T01:51:26.739183+0000","last_undegraded":"2024-03-30T01:51:26.739183+0000","last_fullsized":"2024-03-30T01:51:26.739183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_clean_scrub_stamp":"2024-03-30T01:51:21.990253+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:21:19.291194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.292613+0000","last_change":"2024-03-30T01:51:31.292613+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.292613+0000","last_undegraded":"2024-03-30T01:51:31.292613+0000","last_fullsized":"2024-03-30T01:51:31.292613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.293017+0000","last_change":"2024-03-30T01:51:31.293017+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.293017+0000","last_undegraded":"2024-03-30T01:51:31.293017+0000","last_fullsized":"2024-03-30T01:51:31.293017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:28.389656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.297730+0000","last_change":"2024-03-30T01:51:31.297730+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.297730+0000","last_undegraded":"2024-03-30T01:51:31.297730+0000","last_fullsized":"2024-03-30T01:51:31.297730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:49:06.802141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.292415+0000","last_change":"2024-03-30T01:51:31.292415+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.292415+0000","last_undegraded":"2024-03-30T01:51:31.292415+0000","last_fullsized":"2024-03-30T01:51:31.292415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.302274+0000","last_change":"2024-03-30T01:51:31.302274+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.302274+0000","last_undegraded":"2024-03-30T01:51:31.302274+0000","last_fullsized":"2024-03-30T01:51:31.302274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:16.099108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.299810+0000","last_change":"2024-03-30T01:51:31.299810+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.299810+0000","last_undegraded":"2024-03-30T01:51:31.299810+0000","last_fullsized":"2024-03-30T01:51:31.299810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:16:47.699775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.298009+0000","last_change":"2024-03-30T01:51:31.298009+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.298009+0000","last_undegraded":"2024-03-30T01:51:31.298009+0000","last_fullsized":"2024-03-30T01:51:31.298009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:28.389656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.307089+0000","last_change":"2024-03-30T01:51:31.307089+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.307089+0000","last_undegraded":"2024-03-30T01:51:31.307089+0000","last_fullsized":"2024-03-30T01:51:31.307089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.295606+0000","last_change":"2024-03-30T01:51:31.295606+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.295606+0000","last_undegraded":"2024-03-30T01:51:31.295606+0000","last_fullsized":"2024-03-30T01:51:31.295606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.300282+0000","last_change":"2024-03-30T01:51:31.300282+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.300282+0000","last_undegraded":"2024-03-30T01:51:31.300282+0000","last_fullsized":"2024-03-30T01:51:31.300282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.297741+0000","last_change":"2024-03-30T01:51:31.297741+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.297741+0000","last_undegraded":"2024-03-30T01:51:31.297741+0000","last_fullsized":"2024-03-30T01:51:31.297741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.293261+0000","last_change":"2024-03-30T01:51:31.293261+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.293261+0000","last_undegraded":"2024-03-30T01:51:31.293261+0000","last_fullsized":"2024-03-30T01:51:31.293261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:30:14.002651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.294594+0000","last_change":"2024-03-30T01:51:31.294594+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.294594+0000","last_undegraded":"2024-03-30T01:51:31.294594+0000","last_fullsized":"2024-03-30T01:51:31.294594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.302124+0000","last_change":"2024-03-30T01:51:31.302124+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.302124+0000","last_undegraded":"2024-03-30T01:51:31.302124+0000","last_fullsized":"2024-03-30T01:51:31.302124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:42:26.214040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.289759+0000","last_change":"2024-03-30T01:51:31.289759+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.289759+0000","last_undegraded":"2024-03-30T01:51:31.289759+0000","last_fullsized":"2024-03-30T01:51:31.289759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:18.328608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.294838+0000","last_change":"2024-03-30T01:51:31.294838+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.294838+0000","last_undegraded":"2024-03-30T01:51:31.294838+0000","last_fullsized":"2024-03-30T01:51:31.294838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T07:39:05.794505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":761856,"data_stored":641916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.605}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.506}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.621}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8280000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9730000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6890000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9359999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2709999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.877}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0910000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.877}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5269999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8460000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":50529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6439999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6870000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.597}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5820000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.518}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4769999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.837}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7969999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0920000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":757760,"data_stored":640897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.476}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T01:51:37.191 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T01:51:37.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.433+0000 7fb3dae00640 1 Processor -- start 2024-03-30T01:51:37.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.433+0000 7fb3dae00640 1 -- start start 2024-03-30T01:51:37.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.434+0000 7fb3dae00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb3d415ab90 0x7fb3d4099900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:37.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.434+0000 7fb3dae00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb3d40cee60 0x7fb3d40cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:37.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.434+0000 7fb3dae00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d40cf7b0 con 0x7fb3d40ce450 2024-03-30T01:51:37.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.434+0000 7fb3dae00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d415af70 con 0x7fb3d40cee60 2024-03-30T01:51:37.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.434+0000 7fb3dae00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d40ce9a0 con 0x7fb3d415ab90 2024-03-30T01:51:37.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.434+0000 7fb3d8e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb3d40cee60 0x7fb3d40cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:37.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.434+0000 7fb3d3400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb3d40ce450 0x7fb3d40cc180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53902/0 (socket says 172.21.15.133:53902) 2024-03-30T01:51:37.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.435+0000 7fb3d3400640 1 -- 172.21.15.133:0/499405895 learned_addr learned my addr 172.21.15.133:0/499405895 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:37.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.435+0000 7fb3d3e00640 1 --2- 172.21.15.133:0/499405895 >> v2:172.21.15.137:3300/0 conn(0x7fb3d415ab90 0x7fb3d4099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:37.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.435+0000 7fb3d2a00640 1 -- 172.21.15.133:0/499405895 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284613401 0 0) 0x7fb3d40cf7b0 con 0x7fb3d40ce450 2024-03-30T01:51:37.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.435+0000 7fb3d2a00640 1 -- 172.21.15.133:0/499405895 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3b8003520 con 0x7fb3d40ce450 2024-03-30T01:51:37.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.435+0000 7fb3d8e00640 1 -- 172.21.15.133:0/499405895 >> v2:172.21.15.137:3300/0 conn(0x7fb3d415ab90 msgr2=0x7fb3d4099900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:37.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.435+0000 7fb3d8e00640 1 --2- 172.21.15.133:0/499405895 >> v2:172.21.15.137:3300/0 conn(0x7fb3d415ab90 0x7fb3d4099900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:37.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.435+0000 7fb3d8e00640 1 -- 172.21.15.133:0/499405895 >> v1:172.21.15.133:6789/0 conn(0x7fb3d40ce450 legacy=0x7fb3d40cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:37.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.435+0000 7fb3d8e00640 1 -- 172.21.15.133:0/499405895 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d40cb6a0 con 0x7fb3d40cee60 2024-03-30T01:51:37.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.435+0000 7fb3d3e00640 1 --2- 172.21.15.133:0/499405895 >> v2:172.21.15.137:3300/0 conn(0x7fb3d415ab90 0x7fb3d4099900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:51:37.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.436+0000 7fb3d8e00640 1 --2- 172.21.15.133:0/499405895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d40cee60 0x7fb3d40cf270 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4071f70 tx=0x7fb3cc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40cbfed91e9cf9f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:37.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.436+0000 7fb3d2a00640 1 -- 172.21.15.133:0/499405895 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc02e070 con 0x7fb3d40cee60 2024-03-30T01:51:37.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.436+0000 7fb3d2a00640 1 -- 172.21.15.133:0/499405895 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc0315a0 con 0x7fb3d40cee60 2024-03-30T01:51:37.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.437+0000 7fb3d2a00640 1 -- 172.21.15.133:0/499405895 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc031930 con 0x7fb3d40cee60 2024-03-30T01:51:37.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.437+0000 7fb3dae00640 1 -- 172.21.15.133:0/499405895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d40cee60 msgr2=0x7fb3d40cf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:37.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.437+0000 7fb3dae00640 1 --2- 172.21.15.133:0/499405895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d40cee60 0x7fb3d40cf270 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4071f70 tx=0x7fb3cc02b840 comp rx=0 tx=0).stop 2024-03-30T01:51:37.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.437+0000 7fb3dae00640 1 -- 172.21.15.133:0/499405895 shutdown_connections 2024-03-30T01:51:37.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.437+0000 7fb3dae00640 1 --2- 172.21.15.133:0/499405895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d40cee60 0x7fb3d40cf270 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:37.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.437+0000 7fb3dae00640 1 --2- 172.21.15.133:0/499405895 >> v2:172.21.15.137:3300/0 conn(0x7fb3d415ab90 0x7fb3d4099900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:37.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.437+0000 7fb3dae00640 1 -- 172.21.15.133:0/499405895 >> 172.21.15.133:0/499405895 conn(0x7fb3d40d0880 msgr2=0x7fb3d40d0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:37.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.437+0000 7fb3dae00640 1 -- 172.21.15.133:0/499405895 shutdown_connections 2024-03-30T01:51:37.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.437+0000 7fb3dae00640 1 -- 172.21.15.133:0/499405895 wait complete. 2024-03-30T01:51:37.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.439+0000 7fb3dae00640 1 Processor -- start 2024-03-30T01:51:37.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.439+0000 7fb3dae00640 1 -- start start 2024-03-30T01:51:37.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.440+0000 7fb3dae00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3d40ce450 0x7fb3d41f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:37.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.440+0000 7fb3dae00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3d40cee60 0x7fb3d40ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:37.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.440+0000 7fb3dae00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d415ab90 0x7fb3d4158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:37.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.440+0000 7fb3dae00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d41f3a60 con 0x7fb3d415ab90 2024-03-30T01:51:37.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.440+0000 7fb3dae00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d41f2e50 con 0x7fb3d40cee60 2024-03-30T01:51:37.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.440+0000 7fb3dae00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d41f3130 con 0x7fb3d40ce450 2024-03-30T01:51:37.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.440+0000 7fb3d8e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d415ab90 0x7fb3d4158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:37.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.440+0000 7fb3d8e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d415ab90 0x7fb3d4158bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45838/0 (socket says 172.21.15.133:45838) 2024-03-30T01:51:37.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.440+0000 7fb3d8e00640 1 -- 172.21.15.133:0/1473953942 learned_addr learned my addr 172.21.15.133:0/1473953942 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:37.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.441+0000 7fb3d3e00640 1 --2- 172.21.15.133:0/1473953942 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3d40ce450 0x7fb3d41f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:37.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.441+0000 7fb3d3400640 1 --2- 172.21.15.133:0/1473953942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3d40cee60 0x7fb3d40ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:37.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.441+0000 7fb3d8e00640 1 -- 172.21.15.133:0/1473953942 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3d40ce450 msgr2=0x7fb3d41f2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:37.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.441+0000 7fb3d8e00640 1 --2- 172.21.15.133:0/1473953942 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3d40ce450 0x7fb3d41f2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:37.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.441+0000 7fb3d8e00640 1 -- 172.21.15.133:0/1473953942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3d40cee60 msgr2=0x7fb3d40ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:37.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.441+0000 7fb3d8e00640 1 --2- 172.21.15.133:0/1473953942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3d40cee60 0x7fb3d40ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:37.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.441+0000 7fb3d8e00640 1 -- 172.21.15.133:0/1473953942 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc009400 con 0x7fb3d415ab90 2024-03-30T01:51:37.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.441+0000 7fb3d3e00640 1 --2- 172.21.15.133:0/1473953942 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3d40ce450 0x7fb3d41f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:37.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.441+0000 7fb3d8e00640 1 --2- 172.21.15.133:0/1473953942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d415ab90 0x7fb3d4158bd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009890 tx=0x7fb3cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:37.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.441+0000 7fb3cbe00640 1 -- 172.21.15.133:0/1473953942 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc032840 con 0x7fb3d415ab90 2024-03-30T01:51:37.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.441+0000 7fb3cbe00640 1 -- 172.21.15.133:0/1473953942 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc0329a0 con 0x7fb3d415ab90 2024-03-30T01:51:37.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.441+0000 7fb3cbe00640 1 -- 172.21.15.133:0/1473953942 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc032d30 con 0x7fb3d415ab90 2024-03-30T01:51:37.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.441+0000 7fb3dae00640 1 -- 172.21.15.133:0/1473953942 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d41f3410 con 0x7fb3d415ab90 2024-03-30T01:51:37.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.441+0000 7fb3dae00640 1 -- 172.21.15.133:0/1473953942 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d40ca7a0 con 0x7fb3d415ab90 2024-03-30T01:51:37.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.443+0000 7fb3dae00640 1 -- 172.21.15.133:0/1473953942 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d41f3c10 con 0x7fb3d415ab90 2024-03-30T01:51:37.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.443+0000 7fb3cbe00640 1 -- 172.21.15.133:0/1473953942 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb3cc04e430 con 0x7fb3d415ab90 2024-03-30T01:51:37.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.444+0000 7fb3cbe00640 1 --2- 172.21.15.133:0/1473953942 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb3b006ac00 0x7fb3b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:37.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.444+0000 7fb3cbe00640 1 -- 172.21.15.133:0/1473953942 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3cc0ab360 con 0x7fb3d415ab90 2024-03-30T01:51:37.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.445+0000 7fb3d3e00640 1 --2- 172.21.15.133:0/1473953942 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb3b006ac00 0x7fb3b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:37.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.445+0000 7fb3d3e00640 1 --2- 172.21.15.133:0/1473953942 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb3b006ac00 0x7fb3b006d0c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009540 tx=0x7fb3c400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:37.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.449+0000 7fb3cbe00640 1 -- 172.21.15.133:0/1473953942 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fb3d41f3c10 con 0x7fb3d415ab90 2024-03-30T01:51:37.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.641+0000 7fb3dae00640 1 -- 172.21.15.133:0/1473953942 --> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3d40cb390 con 0x7fb3b006ac00 2024-03-30T01:51:37.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.658+0000 7fb3cbe00640 1 -- 172.21.15.133:0/1473953942 <== mgr.4105 v2:172.21.15.133:6832/37234 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253806 (secure 0 0 0) 0x7fb3c400f040 con 0x7fb3b006ac00 2024-03-30T01:51:37.667 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:37.669 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-03-30T01:51:37.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.664+0000 7fb3dae00640 1 -- 172.21.15.133:0/1473953942 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb3b006ac00 msgr2=0x7fb3b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:37.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.664+0000 7fb3dae00640 1 --2- 172.21.15.133:0/1473953942 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb3b006ac00 0x7fb3b006d0c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009540 tx=0x7fb3c400b040 comp rx=0 tx=0).stop 2024-03-30T01:51:37.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.664+0000 7fb3dae00640 1 -- 172.21.15.133:0/1473953942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d415ab90 msgr2=0x7fb3d4158bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:37.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.664+0000 7fb3dae00640 1 --2- 172.21.15.133:0/1473953942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d415ab90 0x7fb3d4158bd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009890 tx=0x7fb3cc0046c0 comp rx=0 tx=0).stop 2024-03-30T01:51:37.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.665+0000 7fb3dae00640 1 -- 172.21.15.133:0/1473953942 shutdown_connections 2024-03-30T01:51:37.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.665+0000 7fb3dae00640 1 --2- 172.21.15.133:0/1473953942 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb3b006ac00 0x7fb3b006d0c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:37.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.665+0000 7fb3dae00640 1 --2- 172.21.15.133:0/1473953942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d415ab90 0x7fb3d4158bd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:37.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.665+0000 7fb3dae00640 1 --2- 172.21.15.133:0/1473953942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3d40cee60 0x7fb3d40ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:37.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.665+0000 7fb3dae00640 1 --2- 172.21.15.133:0/1473953942 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3d40ce450 0x7fb3d41f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:37.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.665+0000 7fb3dae00640 1 -- 172.21.15.133:0/1473953942 >> 172.21.15.133:0/1473953942 conn(0x7fb3d40d0880 msgr2=0x7fb3d40b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:37.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.665+0000 7fb3dae00640 1 -- 172.21.15.133:0/1473953942 shutdown_connections 2024-03-30T01:51:37.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.665+0000 7fb3dae00640 1 -- 172.21.15.133:0/1473953942 wait complete. 2024-03-30T01:51:37.691 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-03-30T01:51:35.697391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218624,"kb_used_data":2464,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756096,"statfs":{"total":773094113280,"available":772870242304,"internally_reserved":0,"allocated":2523136,"data_stored":1591082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.413979"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.289573+0000","last_change":"2024-03-30T01:51:31.289573+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.289573+0000","last_undegraded":"2024-03-30T01:51:31.289573+0000","last_fullsized":"2024-03-30T01:51:31.289573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:16:10.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.306107+0000","last_change":"2024-03-30T01:51:31.306107+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.306107+0000","last_undegraded":"2024-03-30T01:51:31.306107+0000","last_fullsized":"2024-03-30T01:51:31.306107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.290136+0000","last_change":"2024-03-30T01:51:31.290136+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.290136+0000","last_undegraded":"2024-03-30T01:51:31.290136+0000","last_fullsized":"2024-03-30T01:51:31.290136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.292550+0000","last_change":"2024-03-30T01:51:31.292550+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.292550+0000","last_undegraded":"2024-03-30T01:51:31.292550+0000","last_fullsized":"2024-03-30T01:51:31.292550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:16.099108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.308062+0000","last_change":"2024-03-30T01:51:31.308062+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.308062+0000","last_undegraded":"2024-03-30T01:51:31.308062+0000","last_fullsized":"2024-03-30T01:51:31.308062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:49:06.802141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.293682+0000","last_change":"2024-03-30T01:51:31.293682+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.293682+0000","last_undegraded":"2024-03-30T01:51:31.293682+0000","last_fullsized":"2024-03-30T01:51:31.293682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.299522+0000","last_change":"2024-03-30T01:51:31.299522+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.299522+0000","last_undegraded":"2024-03-30T01:51:31.299522+0000","last_fullsized":"2024-03-30T01:51:31.299522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.305195+0000","last_change":"2024-03-30T01:51:31.305195+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.305195+0000","last_undegraded":"2024-03-30T01:51:31.305195+0000","last_fullsized":"2024-03-30T01:51:31.305195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:16:10.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.294760+0000","last_change":"2024-03-30T01:51:31.294760+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.294760+0000","last_undegraded":"2024-03-30T01:51:31.294760+0000","last_fullsized":"2024-03-30T01:51:31.294760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:18.328608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.294880+0000","last_change":"2024-03-30T01:51:31.294880+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.294880+0000","last_undegraded":"2024-03-30T01:51:31.294880+0000","last_fullsized":"2024-03-30T01:51:31.294880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:49:06.802141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.304553+0000","last_change":"2024-03-30T01:51:31.304553+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.304553+0000","last_undegraded":"2024-03-30T01:51:31.304553+0000","last_fullsized":"2024-03-30T01:51:31.304553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.297273+0000","last_change":"2024-03-30T01:51:31.297273+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.297273+0000","last_undegraded":"2024-03-30T01:51:31.297273+0000","last_fullsized":"2024-03-30T01:51:31.297273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:16:10.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.308132+0000","last_change":"2024-03-30T01:51:31.308132+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.308132+0000","last_undegraded":"2024-03-30T01:51:31.308132+0000","last_fullsized":"2024-03-30T01:51:31.308132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:29:54.309497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.297647+0000","last_change":"2024-03-30T01:51:31.297647+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.297647+0000","last_undegraded":"2024-03-30T01:51:31.297647+0000","last_fullsized":"2024-03-30T01:51:31.297647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.297847+0000","last_change":"2024-03-30T01:51:31.297847+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.297847+0000","last_undegraded":"2024-03-30T01:51:31.297847+0000","last_fullsized":"2024-03-30T01:51:31.297847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:43:13.165559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.296841+0000","last_change":"2024-03-30T01:51:31.296841+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.296841+0000","last_undegraded":"2024-03-30T01:51:31.296841+0000","last_fullsized":"2024-03-30T01:51:31.296841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:18.328608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":161,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-30T01:51:26.739183+0000","last_change":"2024-03-30T01:51:23.358245+0000","last_active":"2024-03-30T01:51:26.739183+0000","last_peered":"2024-03-30T01:51:26.739183+0000","last_clean":"2024-03-30T01:51:26.739183+0000","last_became_active":"2024-03-30T01:51:23.355914+0000","last_became_peered":"2024-03-30T01:51:23.355914+0000","last_unstale":"2024-03-30T01:51:26.739183+0000","last_undegraded":"2024-03-30T01:51:26.739183+0000","last_fullsized":"2024-03-30T01:51:26.739183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_clean_scrub_stamp":"2024-03-30T01:51:21.990253+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:21:19.291194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.292613+0000","last_change":"2024-03-30T01:51:31.292613+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.292613+0000","last_undegraded":"2024-03-30T01:51:31.292613+0000","last_fullsized":"2024-03-30T01:51:31.292613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.293017+0000","last_change":"2024-03-30T01:51:31.293017+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.293017+0000","last_undegraded":"2024-03-30T01:51:31.293017+0000","last_fullsized":"2024-03-30T01:51:31.293017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:28.389656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.297730+0000","last_change":"2024-03-30T01:51:31.297730+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.297730+0000","last_undegraded":"2024-03-30T01:51:31.297730+0000","last_fullsized":"2024-03-30T01:51:31.297730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:49:06.802141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.292415+0000","last_change":"2024-03-30T01:51:31.292415+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.292415+0000","last_undegraded":"2024-03-30T01:51:31.292415+0000","last_fullsized":"2024-03-30T01:51:31.292415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.302274+0000","last_change":"2024-03-30T01:51:31.302274+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.302274+0000","last_undegraded":"2024-03-30T01:51:31.302274+0000","last_fullsized":"2024-03-30T01:51:31.302274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:16.099108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.299810+0000","last_change":"2024-03-30T01:51:31.299810+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.299810+0000","last_undegraded":"2024-03-30T01:51:31.299810+0000","last_fullsized":"2024-03-30T01:51:31.299810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:16:47.699775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.298009+0000","last_change":"2024-03-30T01:51:31.298009+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.298009+0000","last_undegraded":"2024-03-30T01:51:31.298009+0000","last_fullsized":"2024-03-30T01:51:31.298009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:28.389656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.307089+0000","last_change":"2024-03-30T01:51:31.307089+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.307089+0000","last_undegraded":"2024-03-30T01:51:31.307089+0000","last_fullsized":"2024-03-30T01:51:31.307089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.295606+0000","last_change":"2024-03-30T01:51:31.295606+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.295606+0000","last_undegraded":"2024-03-30T01:51:31.295606+0000","last_fullsized":"2024-03-30T01:51:31.295606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.300282+0000","last_change":"2024-03-30T01:51:31.300282+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.300282+0000","last_undegraded":"2024-03-30T01:51:31.300282+0000","last_fullsized":"2024-03-30T01:51:31.300282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.297741+0000","last_change":"2024-03-30T01:51:31.297741+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.297741+0000","last_undegraded":"2024-03-30T01:51:31.297741+0000","last_fullsized":"2024-03-30T01:51:31.297741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.293261+0000","last_change":"2024-03-30T01:51:31.293261+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.293261+0000","last_undegraded":"2024-03-30T01:51:31.293261+0000","last_fullsized":"2024-03-30T01:51:31.293261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:30:14.002651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.294594+0000","last_change":"2024-03-30T01:51:31.294594+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.294594+0000","last_undegraded":"2024-03-30T01:51:31.294594+0000","last_fullsized":"2024-03-30T01:51:31.294594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.302124+0000","last_change":"2024-03-30T01:51:31.302124+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.302124+0000","last_undegraded":"2024-03-30T01:51:31.302124+0000","last_fullsized":"2024-03-30T01:51:31.302124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:42:26.214040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.289759+0000","last_change":"2024-03-30T01:51:31.289759+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.289759+0000","last_undegraded":"2024-03-30T01:51:31.289759+0000","last_fullsized":"2024-03-30T01:51:31.289759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:18.328608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T01:51:32.283509+0000","last_change":"2024-03-30T01:51:32.283509+0000","last_active":"2024-03-30T01:51:32.283509+0000","last_peered":"2024-03-30T01:51:32.283509+0000","last_clean":"2024-03-30T01:51:32.283509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:32.283509+0000","last_undegraded":"2024-03-30T01:51:32.283509+0000","last_fullsized":"2024-03-30T01:51:32.283509+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-03-30T01:51:31.294838+0000","last_change":"2024-03-30T01:51:31.294838+0000","last_active":"2024-03-30T01:51:31.268504+0000","last_peered":"2024-03-30T01:51:31.268504+0000","last_clean":"2024-03-30T01:51:31.268504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T01:51:31.294838+0000","last_undegraded":"2024-03-30T01:51:31.294838+0000","last_fullsized":"2024-03-30T01:51:31.294838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T07:39:05.794505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":761856,"data_stored":641916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.605}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.506}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.621}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8280000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9730000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6890000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9359999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2709999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.877}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0910000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.877}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5269999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8460000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":50529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6439999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6870000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.597}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5820000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.518}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4769999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.837}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7969999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0920000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":757760,"data_stored":640897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.476}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T01:51:37.695 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T01:51:37.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.942+0000 7f340d600640 1 Processor -- start 2024-03-30T01:51:37.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.942+0000 7f340d600640 1 -- start start 2024-03-30T01:51:37.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.944+0000 7f340d600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3408143790 0x7f34080cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:37.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.944+0000 7f340d600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3408070500 0x7f3408070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:37.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.944+0000 7f340d600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f34080cc530 0x7f34080cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:37.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.944+0000 7f340d600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34080a76a0 con 0x7f3408143790 2024-03-30T01:51:37.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.944+0000 7f340d600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3408070ea0 con 0x7f34080cc530 2024-03-30T01:51:37.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.944+0000 7f340d600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34080b38e0 con 0x7f3408070500 2024-03-30T01:51:37.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.944+0000 7f3406a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3408143790 0x7f34080cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:37.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.944+0000 7f3406a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3408143790 0x7f34080cbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45848/0 (socket says 172.21.15.133:45848) 2024-03-30T01:51:37.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.944+0000 7f3406a00640 1 -- 172.21.15.133:0/4253345867 learned_addr learned my addr 172.21.15.133:0/4253345867 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:37.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.944+0000 7f3406000640 1 --2- 172.21.15.133:0/4253345867 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3408070500 0x7f3408070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:37.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.944+0000 7f3407400640 1 --2- 172.21.15.133:0/4253345867 >> v2:172.21.15.137:3300/0 conn(0x7f34080cc530 0x7f34080cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:37.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.944+0000 7f3406a00640 1 -- 172.21.15.133:0/4253345867 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3408070500 msgr2=0x7f3408070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:37.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.944+0000 7f3406a00640 1 --2- 172.21.15.133:0/4253345867 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3408070500 0x7f3408070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:37.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.944+0000 7f3406a00640 1 -- 172.21.15.133:0/4253345867 >> v2:172.21.15.137:3300/0 conn(0x7f34080cc530 msgr2=0x7f34080cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:37.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.944+0000 7f3406a00640 1 --2- 172.21.15.133:0/4253345867 >> v2:172.21.15.137:3300/0 conn(0x7f34080cc530 0x7f34080cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:37.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.944+0000 7f3406a00640 1 -- 172.21.15.133:0/4253345867 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34080ccf00 con 0x7f3408143790 2024-03-30T01:51:37.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.945+0000 7f3406a00640 1 --2- 172.21.15.133:0/4253345867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3408143790 0x7f34080cbb10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f34080b3070 tx=0x7f33f802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a22dbbb44c396a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:37.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.946+0000 7f3405600640 1 -- 172.21.15.133:0/4253345867 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f802cb00 con 0x7f3408143790 2024-03-30T01:51:37.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.946+0000 7f3405600640 1 -- 172.21.15.133:0/4253345867 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f802cc60 con 0x7f3408143790 2024-03-30T01:51:37.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.946+0000 7f3405600640 1 -- 172.21.15.133:0/4253345867 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f80343f0 con 0x7f3408143790 2024-03-30T01:51:37.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.946+0000 7f340d600640 1 -- 172.21.15.133:0/4253345867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3408143790 msgr2=0x7f34080cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:37.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.946+0000 7f340d600640 1 --2- 172.21.15.133:0/4253345867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3408143790 0x7f34080cbb10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f34080b3070 tx=0x7f33f802bf60 comp rx=0 tx=0).stop 2024-03-30T01:51:37.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.947+0000 7f340d600640 1 -- 172.21.15.133:0/4253345867 shutdown_connections 2024-03-30T01:51:37.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.947+0000 7f340d600640 1 --2- 172.21.15.133:0/4253345867 >> v2:172.21.15.137:3300/0 conn(0x7f34080cc530 0x7f34080cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:37.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.947+0000 7f340d600640 1 --2- 172.21.15.133:0/4253345867 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3408070500 0x7f3408070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:37.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.947+0000 7f340d600640 1 --2- 172.21.15.133:0/4253345867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3408143790 0x7f34080cbb10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:37.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.947+0000 7f340d600640 1 -- 172.21.15.133:0/4253345867 >> 172.21.15.133:0/4253345867 conn(0x7f34080b07a0 msgr2=0x7f34080b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:37.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.947+0000 7f340d600640 1 -- 172.21.15.133:0/4253345867 shutdown_connections 2024-03-30T01:51:37.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.947+0000 7f340d600640 1 -- 172.21.15.133:0/4253345867 wait complete. 2024-03-30T01:51:37.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.948+0000 7f340d600640 1 Processor -- start 2024-03-30T01:51:37.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.948+0000 7f340d600640 1 -- start start 2024-03-30T01:51:37.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.949+0000 7f340d600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3408070500 0x7f340815d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:37.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.949+0000 7f340d600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34080cc530 0x7f340813bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:37.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.949+0000 7f340d600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3408143790 0x7f3408135e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:37.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.949+0000 7f340d600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340813ab40 con 0x7f3408143790 2024-03-30T01:51:37.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.949+0000 7f340d600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340813ae20 con 0x7f34080cc530 2024-03-30T01:51:37.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.949+0000 7f340d600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340813b100 con 0x7f3408070500 2024-03-30T01:51:37.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.950+0000 7f3407400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3408143790 0x7f3408135e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:37.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.950+0000 7f3407400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3408143790 0x7f3408135e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45862/0 (socket says 172.21.15.133:45862) 2024-03-30T01:51:37.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.950+0000 7f3407400640 1 -- 172.21.15.133:0/1708928690 learned_addr learned my addr 172.21.15.133:0/1708928690 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:37.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.950+0000 7f3406a00640 1 --2- 172.21.15.133:0/1708928690 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3408070500 0x7f340815d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:37.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.950+0000 7f3406000640 1 --2- 172.21.15.133:0/1708928690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34080cc530 0x7f340813bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:37.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.950+0000 7f3407400640 1 -- 172.21.15.133:0/1708928690 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3408070500 msgr2=0x7f340815d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:37.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.950+0000 7f3407400640 1 --2- 172.21.15.133:0/1708928690 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3408070500 0x7f340815d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:37.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.950+0000 7f3407400640 1 -- 172.21.15.133:0/1708928690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34080cc530 msgr2=0x7f340813bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:37.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.950+0000 7f3407400640 1 --2- 172.21.15.133:0/1708928690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34080cc530 0x7f340813bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:37.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.950+0000 7f3407400640 1 -- 172.21.15.133:0/1708928690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f8009b30 con 0x7f3408143790 2024-03-30T01:51:37.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.950+0000 7f3407400640 1 --2- 172.21.15.133:0/1708928690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3408143790 0x7f3408135e70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f340000d800 tx=0x7f340000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:37.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.951+0000 7f33fea00640 1 -- 172.21.15.133:0/1708928690 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340000b6c0 con 0x7f3408143790 2024-03-30T01:51:37.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.951+0000 7f33fea00640 1 -- 172.21.15.133:0/1708928690 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340000b840 con 0x7f3408143790 2024-03-30T01:51:37.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.951+0000 7f33fea00640 1 -- 172.21.15.133:0/1708928690 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340000bbf0 con 0x7f3408143790 2024-03-30T01:51:37.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.951+0000 7f340d600640 1 -- 172.21.15.133:0/1708928690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f340813b3e0 con 0x7f3408143790 2024-03-30T01:51:37.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.951+0000 7f340d600640 1 -- 172.21.15.133:0/1708928690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3408139910 con 0x7f3408143790 2024-03-30T01:51:37.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.952+0000 7f340d600640 1 -- 172.21.15.133:0/1708928690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3408066d80 con 0x7f3408143790 2024-03-30T01:51:37.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.953+0000 7f33fea00640 1 -- 172.21.15.133:0/1708928690 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f340000bd50 con 0x7f3408143790 2024-03-30T01:51:37.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.954+0000 7f33fea00640 1 --2- 172.21.15.133:0/1708928690 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f33e806ac00 0x7f33e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:37.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.954+0000 7f33fea00640 1 -- 172.21.15.133:0/1708928690 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34000898d0 con 0x7f3408143790 2024-03-30T01:51:37.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.954+0000 7f3406a00640 1 --2- 172.21.15.133:0/1708928690 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f33e806ac00 0x7f33e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:37.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.955+0000 7f3406a00640 1 --2- 172.21.15.133:0/1708928690 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f33e806ac00 0x7f33e806d0c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f33f8035000 tx=0x7f33f8030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:37.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:37.959+0000 7f33fea00640 1 -- 172.21.15.133:0/1708928690 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f3400054a20 con 0x7f3408143790 2024-03-30T01:51:38.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.150+0000 7f340d600640 1 -- 172.21.15.133:0/1708928690 --> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34080cb030 con 0x7f33e806ac00 2024-03-30T01:51:38.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.159+0000 7f33fea00640 1 -- 172.21.15.133:0/1708928690 <== mgr.4105 v2:172.21.15.133:6832/37234 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264559 (secure 0 0 0) 0x7f33f8044090 con 0x7f33e806ac00 2024-03-30T01:51:38.170 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:38.171 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-03-30T01:51:38.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.165+0000 7f340d600640 1 -- 172.21.15.133:0/1708928690 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f33e806ac00 msgr2=0x7f33e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:38.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.165+0000 7f340d600640 1 --2- 172.21.15.133:0/1708928690 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f33e806ac00 0x7f33e806d0c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f33f8035000 tx=0x7f33f8030000 comp rx=0 tx=0).stop 2024-03-30T01:51:38.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.165+0000 7f340d600640 1 -- 172.21.15.133:0/1708928690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3408143790 msgr2=0x7f3408135e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:38.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.165+0000 7f340d600640 1 --2- 172.21.15.133:0/1708928690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3408143790 0x7f3408135e70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f340000d800 tx=0x7f340000dcc0 comp rx=0 tx=0).stop 2024-03-30T01:51:38.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.165+0000 7f340d600640 1 -- 172.21.15.133:0/1708928690 shutdown_connections 2024-03-30T01:51:38.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.165+0000 7f340d600640 1 --2- 172.21.15.133:0/1708928690 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f33e806ac00 0x7f33e806d0c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:38.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.165+0000 7f340d600640 1 --2- 172.21.15.133:0/1708928690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3408143790 0x7f3408135e70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:38.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.165+0000 7f340d600640 1 --2- 172.21.15.133:0/1708928690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34080cc530 0x7f340813bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:38.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.165+0000 7f340d600640 1 --2- 172.21.15.133:0/1708928690 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3408070500 0x7f340815d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:38.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.165+0000 7f340d600640 1 -- 172.21.15.133:0/1708928690 >> 172.21.15.133:0/1708928690 conn(0x7f34080b07a0 msgr2=0x7f34081405c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:38.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.165+0000 7f340d600640 1 -- 172.21.15.133:0/1708928690 shutdown_connections 2024-03-30T01:51:38.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.165+0000 7f340d600640 1 -- 172.21.15.133:0/1708928690 wait complete. 2024-03-30T01:51:38.190 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-03-30T01:51:37.698018+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218972,"kb_used_data":2804,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755748,"statfs":{"total":773094113280,"available":772869885952,"internally_reserved":0,"allocated":2871296,"data_stored":1744306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,10],"upper_bound":32},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001682"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.351409+0000","last_change":"2024-03-30T01:51:32.812760+0000","last_active":"2024-03-30T01:51:34.351409+0000","last_peered":"2024-03-30T01:51:34.351409+0000","last_clean":"2024-03-30T01:51:34.351409+0000","last_became_active":"2024-03-30T01:51:32.812445+0000","last_became_peered":"2024-03-30T01:51:32.812445+0000","last_unstale":"2024-03-30T01:51:34.351409+0000","last_undegraded":"2024-03-30T01:51:34.351409+0000","last_fullsized":"2024-03-30T01:51:34.351409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:43.327711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791881+0000","last_change":"2024-03-30T01:51:32.811824+0000","last_active":"2024-03-30T01:51:33.791881+0000","last_peered":"2024-03-30T01:51:33.791881+0000","last_clean":"2024-03-30T01:51:33.791881+0000","last_became_active":"2024-03-30T01:51:32.811515+0000","last_became_peered":"2024-03-30T01:51:32.811515+0000","last_unstale":"2024-03-30T01:51:33.791881+0000","last_undegraded":"2024-03-30T01:51:33.791881+0000","last_fullsized":"2024-03-30T01:51:33.791881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951932+0000","last_change":"2024-03-30T01:51:32.799724+0000","last_active":"2024-03-30T01:51:33.951932+0000","last_peered":"2024-03-30T01:51:33.951932+0000","last_clean":"2024-03-30T01:51:33.951932+0000","last_became_active":"2024-03-30T01:51:32.799212+0000","last_became_peered":"2024-03-30T01:51:32.799212+0000","last_unstale":"2024-03-30T01:51:33.951932+0000","last_undegraded":"2024-03-30T01:51:33.951932+0000","last_fullsized":"2024-03-30T01:51:33.951932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:56:56.891377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792368+0000","last_change":"2024-03-30T01:51:32.806655+0000","last_active":"2024-03-30T01:51:33.792368+0000","last_peered":"2024-03-30T01:51:33.792368+0000","last_clean":"2024-03-30T01:51:33.792368+0000","last_became_active":"2024-03-30T01:51:32.806055+0000","last_became_peered":"2024-03-30T01:51:32.806055+0000","last_unstale":"2024-03-30T01:51:33.792368+0000","last_undegraded":"2024-03-30T01:51:33.792368+0000","last_fullsized":"2024-03-30T01:51:33.792368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:16:38.980879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350701+0000","last_change":"2024-03-30T01:51:32.820075+0000","last_active":"2024-03-30T01:51:34.350701+0000","last_peered":"2024-03-30T01:51:34.350701+0000","last_clean":"2024-03-30T01:51:34.350701+0000","last_became_active":"2024-03-30T01:51:32.819814+0000","last_became_peered":"2024-03-30T01:51:32.819814+0000","last_unstale":"2024-03-30T01:51:34.350701+0000","last_undegraded":"2024-03-30T01:51:34.350701+0000","last_fullsized":"2024-03-30T01:51:34.350701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:38:15.645425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793528+0000","last_change":"2024-03-30T01:51:32.803089+0000","last_active":"2024-03-30T01:51:33.793528+0000","last_peered":"2024-03-30T01:51:33.793528+0000","last_clean":"2024-03-30T01:51:33.793528+0000","last_became_active":"2024-03-30T01:51:32.802757+0000","last_became_peered":"2024-03-30T01:51:32.802757+0000","last_unstale":"2024-03-30T01:51:33.793528+0000","last_undegraded":"2024-03-30T01:51:33.793528+0000","last_fullsized":"2024-03-30T01:51:33.793528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:38:15.645425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350340+0000","last_change":"2024-03-30T01:51:32.818444+0000","last_active":"2024-03-30T01:51:34.350340+0000","last_peered":"2024-03-30T01:51:34.350340+0000","last_clean":"2024-03-30T01:51:34.350340+0000","last_became_active":"2024-03-30T01:51:32.818124+0000","last_became_peered":"2024-03-30T01:51:32.818124+0000","last_unstale":"2024-03-30T01:51:34.350340+0000","last_undegraded":"2024-03-30T01:51:34.350340+0000","last_fullsized":"2024-03-30T01:51:34.350340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:13:11.318115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357046+0000","last_change":"2024-03-30T01:51:32.821461+0000","last_active":"2024-03-30T01:51:36.357046+0000","last_peered":"2024-03-30T01:51:36.357046+0000","last_clean":"2024-03-30T01:51:36.357046+0000","last_became_active":"2024-03-30T01:51:32.821281+0000","last_became_peered":"2024-03-30T01:51:32.821281+0000","last_unstale":"2024-03-30T01:51:36.357046+0000","last_undegraded":"2024-03-30T01:51:36.357046+0000","last_fullsized":"2024-03-30T01:51:36.357046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.351614+0000","last_change":"2024-03-30T01:51:32.829942+0000","last_active":"2024-03-30T01:51:34.351614+0000","last_peered":"2024-03-30T01:51:34.351614+0000","last_clean":"2024-03-30T01:51:34.351614+0000","last_became_active":"2024-03-30T01:51:32.829594+0000","last_became_peered":"2024-03-30T01:51:32.829594+0000","last_unstale":"2024-03-30T01:51:34.351614+0000","last_undegraded":"2024-03-30T01:51:34.351614+0000","last_fullsized":"2024-03-30T01:51:34.351614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:43:22.251326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359569+0000","last_change":"2024-03-30T01:51:32.812680+0000","last_active":"2024-03-30T01:51:36.359569+0000","last_peered":"2024-03-30T01:51:36.359569+0000","last_clean":"2024-03-30T01:51:36.359569+0000","last_became_active":"2024-03-30T01:51:32.812333+0000","last_became_peered":"2024-03-30T01:51:32.812333+0000","last_unstale":"2024-03-30T01:51:36.359569+0000","last_undegraded":"2024-03-30T01:51:36.359569+0000","last_fullsized":"2024-03-30T01:51:36.359569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:13:08.942873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359121+0000","last_change":"2024-03-30T01:51:32.826749+0000","last_active":"2024-03-30T01:51:36.359121+0000","last_peered":"2024-03-30T01:51:36.359121+0000","last_clean":"2024-03-30T01:51:36.359121+0000","last_became_active":"2024-03-30T01:51:32.824642+0000","last_became_peered":"2024-03-30T01:51:32.824642+0000","last_unstale":"2024-03-30T01:51:36.359121+0000","last_undegraded":"2024-03-30T01:51:36.359121+0000","last_fullsized":"2024-03-30T01:51:36.359121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794544+0000","last_change":"2024-03-30T01:51:32.816597+0000","last_active":"2024-03-30T01:51:33.794544+0000","last_peered":"2024-03-30T01:51:33.794544+0000","last_clean":"2024-03-30T01:51:33.794544+0000","last_became_active":"2024-03-30T01:51:32.816310+0000","last_became_peered":"2024-03-30T01:51:32.816310+0000","last_unstale":"2024-03-30T01:51:33.794544+0000","last_undegraded":"2024-03-30T01:51:33.794544+0000","last_fullsized":"2024-03-30T01:51:33.794544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:42:27.229045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356973+0000","last_change":"2024-03-30T01:51:32.816094+0000","last_active":"2024-03-30T01:51:36.356973+0000","last_peered":"2024-03-30T01:51:36.356973+0000","last_clean":"2024-03-30T01:51:36.356973+0000","last_became_active":"2024-03-30T01:51:32.815841+0000","last_became_peered":"2024-03-30T01:51:32.815841+0000","last_unstale":"2024-03-30T01:51:36.356973+0000","last_undegraded":"2024-03-30T01:51:36.356973+0000","last_fullsized":"2024-03-30T01:51:36.356973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:08:35.439480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951373+0000","last_change":"2024-03-30T01:51:32.808528+0000","last_active":"2024-03-30T01:51:33.951373+0000","last_peered":"2024-03-30T01:51:33.951373+0000","last_clean":"2024-03-30T01:51:33.951373+0000","last_became_active":"2024-03-30T01:51:32.808290+0000","last_became_peered":"2024-03-30T01:51:32.808290+0000","last_unstale":"2024-03-30T01:51:33.951373+0000","last_undegraded":"2024-03-30T01:51:33.951373+0000","last_fullsized":"2024-03-30T01:51:33.951373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:16:16.111272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791232+0000","last_change":"2024-03-30T01:51:32.818830+0000","last_active":"2024-03-30T01:51:33.791232+0000","last_peered":"2024-03-30T01:51:33.791232+0000","last_clean":"2024-03-30T01:51:33.791232+0000","last_became_active":"2024-03-30T01:51:32.818684+0000","last_became_peered":"2024-03-30T01:51:32.818684+0000","last_unstale":"2024-03-30T01:51:33.791232+0000","last_undegraded":"2024-03-30T01:51:33.791232+0000","last_fullsized":"2024-03-30T01:51:33.791232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:12:19.249116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793142+0000","last_change":"2024-03-30T01:51:32.810544+0000","last_active":"2024-03-30T01:51:33.793142+0000","last_peered":"2024-03-30T01:51:33.793142+0000","last_clean":"2024-03-30T01:51:33.793142+0000","last_became_active":"2024-03-30T01:51:32.809383+0000","last_became_peered":"2024-03-30T01:51:32.809383+0000","last_unstale":"2024-03-30T01:51:33.793142+0000","last_undegraded":"2024-03-30T01:51:33.793142+0000","last_fullsized":"2024-03-30T01:51:33.793142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T04:10:09.271050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794103+0000","last_change":"2024-03-30T01:51:32.814598+0000","last_active":"2024-03-30T01:51:33.794103+0000","last_peered":"2024-03-30T01:51:33.794103+0000","last_clean":"2024-03-30T01:51:33.794103+0000","last_became_active":"2024-03-30T01:51:32.814343+0000","last_became_peered":"2024-03-30T01:51:32.814343+0000","last_unstale":"2024-03-30T01:51:33.794103+0000","last_undegraded":"2024-03-30T01:51:33.794103+0000","last_fullsized":"2024-03-30T01:51:33.794103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:45:46.717709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356214+0000","last_change":"2024-03-30T01:51:32.810030+0000","last_active":"2024-03-30T01:51:36.356214+0000","last_peered":"2024-03-30T01:51:36.356214+0000","last_clean":"2024-03-30T01:51:36.356214+0000","last_became_active":"2024-03-30T01:51:32.809667+0000","last_became_peered":"2024-03-30T01:51:32.809667+0000","last_unstale":"2024-03-30T01:51:36.356214+0000","last_undegraded":"2024-03-30T01:51:36.356214+0000","last_fullsized":"2024-03-30T01:51:36.356214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:43:14.180564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350888+0000","last_change":"2024-03-30T01:51:32.825796+0000","last_active":"2024-03-30T01:51:34.350888+0000","last_peered":"2024-03-30T01:51:34.350888+0000","last_clean":"2024-03-30T01:51:34.350888+0000","last_became_active":"2024-03-30T01:51:32.825501+0000","last_became_peered":"2024-03-30T01:51:32.825501+0000","last_unstale":"2024-03-30T01:51:34.350888+0000","last_undegraded":"2024-03-30T01:51:34.350888+0000","last_fullsized":"2024-03-30T01:51:34.350888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:16:38.980879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359143+0000","last_change":"2024-03-30T01:51:32.816941+0000","last_active":"2024-03-30T01:51:36.359143+0000","last_peered":"2024-03-30T01:51:36.359143+0000","last_clean":"2024-03-30T01:51:36.359143+0000","last_became_active":"2024-03-30T01:51:32.816645+0000","last_became_peered":"2024-03-30T01:51:32.816645+0000","last_unstale":"2024-03-30T01:51:36.359143+0000","last_undegraded":"2024-03-30T01:51:36.359143+0000","last_fullsized":"2024-03-30T01:51:36.359143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:42:27.229045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951735+0000","last_change":"2024-03-30T01:51:32.807172+0000","last_active":"2024-03-30T01:51:33.951735+0000","last_peered":"2024-03-30T01:51:33.951735+0000","last_clean":"2024-03-30T01:51:33.951735+0000","last_became_active":"2024-03-30T01:51:32.805878+0000","last_became_peered":"2024-03-30T01:51:32.805878+0000","last_unstale":"2024-03-30T01:51:33.951735+0000","last_undegraded":"2024-03-30T01:51:33.951735+0000","last_fullsized":"2024-03-30T01:51:33.951735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:04:01.115269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793786+0000","last_change":"2024-03-30T01:51:32.814459+0000","last_active":"2024-03-30T01:51:33.793786+0000","last_peered":"2024-03-30T01:51:33.793786+0000","last_clean":"2024-03-30T01:51:33.793786+0000","last_became_active":"2024-03-30T01:51:32.814174+0000","last_became_peered":"2024-03-30T01:51:32.814174+0000","last_unstale":"2024-03-30T01:51:33.793786+0000","last_undegraded":"2024-03-30T01:51:33.793786+0000","last_fullsized":"2024-03-30T01:51:33.793786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:50.171426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356748+0000","last_change":"2024-03-30T01:51:32.822182+0000","last_active":"2024-03-30T01:51:36.356748+0000","last_peered":"2024-03-30T01:51:36.356748+0000","last_clean":"2024-03-30T01:51:36.356748+0000","last_became_active":"2024-03-30T01:51:32.821907+0000","last_became_peered":"2024-03-30T01:51:32.821907+0000","last_unstale":"2024-03-30T01:51:36.356748+0000","last_undegraded":"2024-03-30T01:51:36.356748+0000","last_fullsized":"2024-03-30T01:51:36.356748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T07:15:13.311008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793836+0000","last_change":"2024-03-30T01:51:32.810773+0000","last_active":"2024-03-30T01:51:33.793836+0000","last_peered":"2024-03-30T01:51:33.793836+0000","last_clean":"2024-03-30T01:51:33.793836+0000","last_became_active":"2024-03-30T01:51:32.810446+0000","last_became_peered":"2024-03-30T01:51:32.810446+0000","last_unstale":"2024-03-30T01:51:33.793836+0000","last_undegraded":"2024-03-30T01:51:33.793836+0000","last_fullsized":"2024-03-30T01:51:33.793836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357256+0000","last_change":"2024-03-30T01:51:32.824519+0000","last_active":"2024-03-30T01:51:36.357256+0000","last_peered":"2024-03-30T01:51:36.357256+0000","last_clean":"2024-03-30T01:51:36.357256+0000","last_became_active":"2024-03-30T01:51:32.824210+0000","last_became_peered":"2024-03-30T01:51:32.824210+0000","last_unstale":"2024-03-30T01:51:36.357256+0000","last_undegraded":"2024-03-30T01:51:36.357256+0000","last_fullsized":"2024-03-30T01:51:36.357256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:16:16.111272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359568+0000","last_change":"2024-03-30T01:51:32.823849+0000","last_active":"2024-03-30T01:51:36.359568+0000","last_peered":"2024-03-30T01:51:36.359568+0000","last_clean":"2024-03-30T01:51:36.359568+0000","last_became_active":"2024-03-30T01:51:32.823467+0000","last_became_peered":"2024-03-30T01:51:32.823467+0000","last_unstale":"2024-03-30T01:51:36.359568+0000","last_undegraded":"2024-03-30T01:51:36.359568+0000","last_fullsized":"2024-03-30T01:51:36.359568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792289+0000","last_change":"2024-03-30T01:51:32.815312+0000","last_active":"2024-03-30T01:51:33.792289+0000","last_peered":"2024-03-30T01:51:33.792289+0000","last_clean":"2024-03-30T01:51:33.792289+0000","last_became_active":"2024-03-30T01:51:32.814565+0000","last_became_peered":"2024-03-30T01:51:32.814565+0000","last_unstale":"2024-03-30T01:51:33.792289+0000","last_undegraded":"2024-03-30T01:51:33.792289+0000","last_fullsized":"2024-03-30T01:51:33.792289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:31:32.555378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357196+0000","last_change":"2024-03-30T01:51:32.821245+0000","last_active":"2024-03-30T01:51:36.357196+0000","last_peered":"2024-03-30T01:51:36.357196+0000","last_clean":"2024-03-30T01:51:36.357196+0000","last_became_active":"2024-03-30T01:51:32.821080+0000","last_became_peered":"2024-03-30T01:51:32.821080+0000","last_unstale":"2024-03-30T01:51:36.357196+0000","last_undegraded":"2024-03-30T01:51:36.357196+0000","last_fullsized":"2024-03-30T01:51:36.357196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:48.498455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951866+0000","last_change":"2024-03-30T01:51:32.795415+0000","last_active":"2024-03-30T01:51:33.951866+0000","last_peered":"2024-03-30T01:51:33.951866+0000","last_clean":"2024-03-30T01:51:33.951866+0000","last_became_active":"2024-03-30T01:51:32.795077+0000","last_became_peered":"2024-03-30T01:51:32.795077+0000","last_unstale":"2024-03-30T01:51:33.951866+0000","last_undegraded":"2024-03-30T01:51:33.951866+0000","last_fullsized":"2024-03-30T01:51:33.951866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794033+0000","last_change":"2024-03-30T01:51:32.809765+0000","last_active":"2024-03-30T01:51:33.794033+0000","last_peered":"2024-03-30T01:51:33.794033+0000","last_clean":"2024-03-30T01:51:33.794033+0000","last_became_active":"2024-03-30T01:51:32.809483+0000","last_became_peered":"2024-03-30T01:51:32.809483+0000","last_unstale":"2024-03-30T01:51:33.794033+0000","last_undegraded":"2024-03-30T01:51:33.794033+0000","last_fullsized":"2024-03-30T01:51:33.794033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:12:19.249116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356211+0000","last_change":"2024-03-30T01:51:32.802662+0000","last_active":"2024-03-30T01:51:36.356211+0000","last_peered":"2024-03-30T01:51:36.356211+0000","last_clean":"2024-03-30T01:51:36.356211+0000","last_became_active":"2024-03-30T01:51:32.802418+0000","last_became_peered":"2024-03-30T01:51:32.802418+0000","last_unstale":"2024-03-30T01:51:36.356211+0000","last_undegraded":"2024-03-30T01:51:36.356211+0000","last_fullsized":"2024-03-30T01:51:36.356211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:29.404661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.358729+0000","last_change":"2024-03-30T01:51:32.825195+0000","last_active":"2024-03-30T01:51:36.358729+0000","last_peered":"2024-03-30T01:51:36.358729+0000","last_clean":"2024-03-30T01:51:36.358729+0000","last_became_active":"2024-03-30T01:51:32.824918+0000","last_became_peered":"2024-03-30T01:51:32.824918+0000","last_unstale":"2024-03-30T01:51:36.358729+0000","last_undegraded":"2024-03-30T01:51:36.358729+0000","last_fullsized":"2024-03-30T01:51:36.358729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:16:16.111272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793866+0000","last_change":"2024-03-30T01:51:32.818991+0000","last_active":"2024-03-30T01:51:33.793866+0000","last_peered":"2024-03-30T01:51:33.793866+0000","last_clean":"2024-03-30T01:51:33.793866+0000","last_became_active":"2024-03-30T01:51:32.818661+0000","last_became_peered":"2024-03-30T01:51:32.818661+0000","last_unstale":"2024-03-30T01:51:33.793866+0000","last_undegraded":"2024-03-30T01:51:33.793866+0000","last_fullsized":"2024-03-30T01:51:33.793866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:16:48.714780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.827029+0000","last_change":"2024-03-30T01:51:32.334786+0000","last_active":"2024-03-30T01:51:32.827029+0000","last_peered":"2024-03-30T01:51:32.827029+0000","last_clean":"2024-03-30T01:51:32.827029+0000","last_became_active":"2024-03-30T01:51:32.334439+0000","last_became_peered":"2024-03-30T01:51:32.334439+0000","last_unstale":"2024-03-30T01:51:32.827029+0000","last_undegraded":"2024-03-30T01:51:32.827029+0000","last_fullsized":"2024-03-30T01:51:32.827029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:16:10.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951993+0000","last_change":"2024-03-30T01:51:32.802436+0000","last_active":"2024-03-30T01:51:33.951993+0000","last_peered":"2024-03-30T01:51:33.951993+0000","last_clean":"2024-03-30T01:51:33.951993+0000","last_became_active":"2024-03-30T01:51:32.802174+0000","last_became_peered":"2024-03-30T01:51:32.802174+0000","last_unstale":"2024-03-30T01:51:33.951993+0000","last_undegraded":"2024-03-30T01:51:33.951993+0000","last_fullsized":"2024-03-30T01:51:33.951993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T07:15:13.311008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.831313+0000","last_change":"2024-03-30T01:51:32.333125+0000","last_active":"2024-03-30T01:51:32.831313+0000","last_peered":"2024-03-30T01:51:32.831313+0000","last_clean":"2024-03-30T01:51:32.831313+0000","last_became_active":"2024-03-30T01:51:32.332556+0000","last_became_peered":"2024-03-30T01:51:32.332556+0000","last_unstale":"2024-03-30T01:51:32.831313+0000","last_undegraded":"2024-03-30T01:51:32.831313+0000","last_fullsized":"2024-03-30T01:51:32.831313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.801373+0000","last_change":"2024-03-30T01:51:32.339115+0000","last_active":"2024-03-30T01:51:32.801373+0000","last_peered":"2024-03-30T01:51:32.801373+0000","last_clean":"2024-03-30T01:51:32.801373+0000","last_became_active":"2024-03-30T01:51:32.338822+0000","last_became_peered":"2024-03-30T01:51:32.338822+0000","last_unstale":"2024-03-30T01:51:32.801373+0000","last_undegraded":"2024-03-30T01:51:32.801373+0000","last_fullsized":"2024-03-30T01:51:32.801373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356877+0000","last_change":"2024-03-30T01:51:32.800804+0000","last_active":"2024-03-30T01:51:36.356877+0000","last_peered":"2024-03-30T01:51:36.356877+0000","last_clean":"2024-03-30T01:51:36.356877+0000","last_became_active":"2024-03-30T01:51:32.800357+0000","last_became_peered":"2024-03-30T01:51:32.800357+0000","last_unstale":"2024-03-30T01:51:36.356877+0000","last_undegraded":"2024-03-30T01:51:36.356877+0000","last_fullsized":"2024-03-30T01:51:36.356877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:12:19.249116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.789786+0000","last_change":"2024-03-30T01:51:32.324045+0000","last_active":"2024-03-30T01:51:32.789786+0000","last_peered":"2024-03-30T01:51:32.789786+0000","last_clean":"2024-03-30T01:51:32.789786+0000","last_became_active":"2024-03-30T01:51:32.323466+0000","last_became_peered":"2024-03-30T01:51:32.323466+0000","last_unstale":"2024-03-30T01:51:32.789786+0000","last_undegraded":"2024-03-30T01:51:32.789786+0000","last_fullsized":"2024-03-30T01:51:32.789786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:16.099108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791017+0000","last_change":"2024-03-30T01:51:32.809356+0000","last_active":"2024-03-30T01:51:33.791017+0000","last_peered":"2024-03-30T01:51:33.791017+0000","last_clean":"2024-03-30T01:51:33.791017+0000","last_became_active":"2024-03-30T01:51:32.809059+0000","last_became_peered":"2024-03-30T01:51:32.809059+0000","last_unstale":"2024-03-30T01:51:33.791017+0000","last_undegraded":"2024-03-30T01:51:33.791017+0000","last_fullsized":"2024-03-30T01:51:33.791017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.809422+0000","last_change":"2024-03-30T01:51:32.339350+0000","last_active":"2024-03-30T01:51:32.809422+0000","last_peered":"2024-03-30T01:51:32.809422+0000","last_clean":"2024-03-30T01:51:32.809422+0000","last_became_active":"2024-03-30T01:51:32.338514+0000","last_became_peered":"2024-03-30T01:51:32.338514+0000","last_unstale":"2024-03-30T01:51:32.809422+0000","last_undegraded":"2024-03-30T01:51:32.809422+0000","last_fullsized":"2024-03-30T01:51:32.809422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:49:06.802141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792834+0000","last_change":"2024-03-30T01:51:32.816915+0000","last_active":"2024-03-30T01:51:33.792834+0000","last_peered":"2024-03-30T01:51:33.792834+0000","last_clean":"2024-03-30T01:51:33.792834+0000","last_became_active":"2024-03-30T01:51:32.814653+0000","last_became_peered":"2024-03-30T01:51:32.814653+0000","last_unstale":"2024-03-30T01:51:33.792834+0000","last_undegraded":"2024-03-30T01:51:33.792834+0000","last_fullsized":"2024-03-30T01:51:33.792834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:08:35.439480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.791633+0000","last_change":"2024-03-30T01:51:32.341633+0000","last_active":"2024-03-30T01:51:32.791633+0000","last_peered":"2024-03-30T01:51:32.791633+0000","last_clean":"2024-03-30T01:51:32.791633+0000","last_became_active":"2024-03-30T01:51:32.341346+0000","last_became_peered":"2024-03-30T01:51:32.341346+0000","last_unstale":"2024-03-30T01:51:32.791633+0000","last_undegraded":"2024-03-30T01:51:32.791633+0000","last_fullsized":"2024-03-30T01:51:32.791633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.952480+0000","last_change":"2024-03-30T01:51:32.798259+0000","last_active":"2024-03-30T01:51:33.952480+0000","last_peered":"2024-03-30T01:51:33.952480+0000","last_clean":"2024-03-30T01:51:33.952480+0000","last_became_active":"2024-03-30T01:51:32.797868+0000","last_became_peered":"2024-03-30T01:51:32.797868+0000","last_unstale":"2024-03-30T01:51:33.952480+0000","last_undegraded":"2024-03-30T01:51:33.952480+0000","last_fullsized":"2024-03-30T01:51:33.952480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.829577+0000","last_change":"2024-03-30T01:51:32.335884+0000","last_active":"2024-03-30T01:51:32.829577+0000","last_peered":"2024-03-30T01:51:32.829577+0000","last_clean":"2024-03-30T01:51:32.829577+0000","last_became_active":"2024-03-30T01:51:32.335615+0000","last_became_peered":"2024-03-30T01:51:32.335615+0000","last_unstale":"2024-03-30T01:51:32.829577+0000","last_undegraded":"2024-03-30T01:51:32.829577+0000","last_fullsized":"2024-03-30T01:51:32.829577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794581+0000","last_change":"2024-03-30T01:51:32.817329+0000","last_active":"2024-03-30T01:51:33.794581+0000","last_peered":"2024-03-30T01:51:33.794581+0000","last_clean":"2024-03-30T01:51:33.794581+0000","last_became_active":"2024-03-30T01:51:32.817034+0000","last_became_peered":"2024-03-30T01:51:32.817034+0000","last_unstale":"2024-03-30T01:51:33.794581+0000","last_undegraded":"2024-03-30T01:51:33.794581+0000","last_fullsized":"2024-03-30T01:51:33.794581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:29.404661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.838419+0000","last_change":"2024-03-30T01:51:32.344369+0000","last_active":"2024-03-30T01:51:32.838419+0000","last_peered":"2024-03-30T01:51:32.838419+0000","last_clean":"2024-03-30T01:51:32.838419+0000","last_became_active":"2024-03-30T01:51:32.344031+0000","last_became_peered":"2024-03-30T01:51:32.344031+0000","last_unstale":"2024-03-30T01:51:32.838419+0000","last_undegraded":"2024-03-30T01:51:32.838419+0000","last_fullsized":"2024-03-30T01:51:32.838419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:16:10.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350569+0000","last_change":"2024-03-30T01:51:32.822087+0000","last_active":"2024-03-30T01:51:34.350569+0000","last_peered":"2024-03-30T01:51:34.350569+0000","last_clean":"2024-03-30T01:51:34.350569+0000","last_became_active":"2024-03-30T01:51:32.821664+0000","last_became_peered":"2024-03-30T01:51:32.821664+0000","last_unstale":"2024-03-30T01:51:34.350569+0000","last_undegraded":"2024-03-30T01:51:34.350569+0000","last_fullsized":"2024-03-30T01:51:34.350569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:45:46.717709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.833595+0000","last_change":"2024-03-30T01:51:32.328895+0000","last_active":"2024-03-30T01:51:32.833595+0000","last_peered":"2024-03-30T01:51:32.833595+0000","last_clean":"2024-03-30T01:51:32.833595+0000","last_became_active":"2024-03-30T01:51:32.327604+0000","last_became_peered":"2024-03-30T01:51:32.327604+0000","last_unstale":"2024-03-30T01:51:32.833595+0000","last_undegraded":"2024-03-30T01:51:32.833595+0000","last_fullsized":"2024-03-30T01:51:32.833595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:18.328608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951478+0000","last_change":"2024-03-30T01:51:32.813992+0000","last_active":"2024-03-30T01:51:33.951478+0000","last_peered":"2024-03-30T01:51:33.951478+0000","last_clean":"2024-03-30T01:51:33.951478+0000","last_became_active":"2024-03-30T01:51:32.813751+0000","last_became_peered":"2024-03-30T01:51:32.813751+0000","last_unstale":"2024-03-30T01:51:33.951478+0000","last_undegraded":"2024-03-30T01:51:33.951478+0000","last_fullsized":"2024-03-30T01:51:33.951478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:48.498455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.794977+0000","last_change":"2024-03-30T01:51:32.326767+0000","last_active":"2024-03-30T01:51:32.794977+0000","last_peered":"2024-03-30T01:51:32.794977+0000","last_clean":"2024-03-30T01:51:32.794977+0000","last_became_active":"2024-03-30T01:51:32.326514+0000","last_became_peered":"2024-03-30T01:51:32.326514+0000","last_unstale":"2024-03-30T01:51:32.794977+0000","last_undegraded":"2024-03-30T01:51:32.794977+0000","last_fullsized":"2024-03-30T01:51:32.794977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:49:06.802141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350753+0000","last_change":"2024-03-30T01:51:32.831620+0000","last_active":"2024-03-30T01:51:34.350753+0000","last_peered":"2024-03-30T01:51:34.350753+0000","last_clean":"2024-03-30T01:51:34.350753+0000","last_became_active":"2024-03-30T01:51:32.829086+0000","last_became_peered":"2024-03-30T01:51:32.829086+0000","last_unstale":"2024-03-30T01:51:34.350753+0000","last_undegraded":"2024-03-30T01:51:34.350753+0000","last_fullsized":"2024-03-30T01:51:34.350753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:48:32.312063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.808536+0000","last_change":"2024-03-30T01:51:32.333519+0000","last_active":"2024-03-30T01:51:32.808536+0000","last_peered":"2024-03-30T01:51:32.808536+0000","last_clean":"2024-03-30T01:51:32.808536+0000","last_became_active":"2024-03-30T01:51:32.332785+0000","last_became_peered":"2024-03-30T01:51:32.332785+0000","last_unstale":"2024-03-30T01:51:32.808536+0000","last_undegraded":"2024-03-30T01:51:32.808536+0000","last_fullsized":"2024-03-30T01:51:32.808536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.358827+0000","last_change":"2024-03-30T01:51:32.820310+0000","last_active":"2024-03-30T01:51:36.358827+0000","last_peered":"2024-03-30T01:51:36.358827+0000","last_clean":"2024-03-30T01:51:36.358827+0000","last_became_active":"2024-03-30T01:51:32.819632+0000","last_became_peered":"2024-03-30T01:51:32.819632+0000","last_unstale":"2024-03-30T01:51:36.358827+0000","last_undegraded":"2024-03-30T01:51:36.358827+0000","last_fullsized":"2024-03-30T01:51:36.358827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:24:14.776848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.816543+0000","last_change":"2024-03-30T01:51:32.320300+0000","last_active":"2024-03-30T01:51:32.816543+0000","last_peered":"2024-03-30T01:51:32.816543+0000","last_clean":"2024-03-30T01:51:32.816543+0000","last_became_active":"2024-03-30T01:51:32.319459+0000","last_became_peered":"2024-03-30T01:51:32.319459+0000","last_unstale":"2024-03-30T01:51:32.816543+0000","last_undegraded":"2024-03-30T01:51:32.816543+0000","last_fullsized":"2024-03-30T01:51:32.816543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:16:10.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350739+0000","last_change":"2024-03-30T01:51:32.824724+0000","last_active":"2024-03-30T01:51:34.350739+0000","last_peered":"2024-03-30T01:51:34.350739+0000","last_clean":"2024-03-30T01:51:34.350739+0000","last_became_active":"2024-03-30T01:51:32.824435+0000","last_became_peered":"2024-03-30T01:51:32.824435+0000","last_unstale":"2024-03-30T01:51:34.350739+0000","last_undegraded":"2024-03-30T01:51:34.350739+0000","last_fullsized":"2024-03-30T01:51:34.350739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T04:10:09.271050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.830672+0000","last_change":"2024-03-30T01:51:32.324209+0000","last_active":"2024-03-30T01:51:32.830672+0000","last_peered":"2024-03-30T01:51:32.830672+0000","last_clean":"2024-03-30T01:51:32.830672+0000","last_became_active":"2024-03-30T01:51:32.323909+0000","last_became_peered":"2024-03-30T01:51:32.323909+0000","last_unstale":"2024-03-30T01:51:32.830672+0000","last_undegraded":"2024-03-30T01:51:32.830672+0000","last_fullsized":"2024-03-30T01:51:32.830672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:29:54.309497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.351210+0000","last_change":"2024-03-30T01:51:32.829602+0000","last_active":"2024-03-30T01:51:34.351210+0000","last_peered":"2024-03-30T01:51:34.351210+0000","last_clean":"2024-03-30T01:51:34.351210+0000","last_became_active":"2024-03-30T01:51:32.829279+0000","last_became_peered":"2024-03-30T01:51:32.829279+0000","last_unstale":"2024-03-30T01:51:34.351210+0000","last_undegraded":"2024-03-30T01:51:34.351210+0000","last_fullsized":"2024-03-30T01:51:34.351210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:15:59.657625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.819729+0000","last_change":"2024-03-30T01:51:32.329496+0000","last_active":"2024-03-30T01:51:32.819729+0000","last_peered":"2024-03-30T01:51:32.819729+0000","last_clean":"2024-03-30T01:51:32.819729+0000","last_became_active":"2024-03-30T01:51:32.329197+0000","last_became_peered":"2024-03-30T01:51:32.329197+0000","last_unstale":"2024-03-30T01:51:32.819729+0000","last_undegraded":"2024-03-30T01:51:32.819729+0000","last_fullsized":"2024-03-30T01:51:32.819729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.351541+0000","last_change":"2024-03-30T01:51:32.829567+0000","last_active":"2024-03-30T01:51:34.351541+0000","last_peered":"2024-03-30T01:51:34.351541+0000","last_clean":"2024-03-30T01:51:34.351541+0000","last_became_active":"2024-03-30T01:51:32.829295+0000","last_became_peered":"2024-03-30T01:51:32.829295+0000","last_unstale":"2024-03-30T01:51:34.351541+0000","last_undegraded":"2024-03-30T01:51:34.351541+0000","last_fullsized":"2024-03-30T01:51:34.351541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:50.171426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.830796+0000","last_change":"2024-03-30T01:51:32.331167+0000","last_active":"2024-03-30T01:51:32.830796+0000","last_peered":"2024-03-30T01:51:32.830796+0000","last_clean":"2024-03-30T01:51:32.830796+0000","last_became_active":"2024-03-30T01:51:32.330851+0000","last_became_peered":"2024-03-30T01:51:32.330851+0000","last_unstale":"2024-03-30T01:51:32.830796+0000","last_undegraded":"2024-03-30T01:51:32.830796+0000","last_fullsized":"2024-03-30T01:51:32.830796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:43:13.165559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792872+0000","last_change":"2024-03-30T01:51:32.806466+0000","last_active":"2024-03-30T01:51:33.792872+0000","last_peered":"2024-03-30T01:51:33.792872+0000","last_clean":"2024-03-30T01:51:33.792872+0000","last_became_active":"2024-03-30T01:51:32.800403+0000","last_became_peered":"2024-03-30T01:51:32.800403+0000","last_unstale":"2024-03-30T01:51:33.792872+0000","last_undegraded":"2024-03-30T01:51:33.792872+0000","last_fullsized":"2024-03-30T01:51:33.792872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.801178+0000","last_change":"2024-03-30T01:51:32.328539+0000","last_active":"2024-03-30T01:51:32.801178+0000","last_peered":"2024-03-30T01:51:32.801178+0000","last_clean":"2024-03-30T01:51:32.801178+0000","last_became_active":"2024-03-30T01:51:32.328066+0000","last_became_peered":"2024-03-30T01:51:32.328066+0000","last_unstale":"2024-03-30T01:51:32.801178+0000","last_undegraded":"2024-03-30T01:51:32.801178+0000","last_fullsized":"2024-03-30T01:51:32.801178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:18.328608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350589+0000","last_change":"2024-03-30T01:51:32.831571+0000","last_active":"2024-03-30T01:51:34.350589+0000","last_peered":"2024-03-30T01:51:34.350589+0000","last_clean":"2024-03-30T01:51:34.350589+0000","last_became_active":"2024-03-30T01:51:32.830419+0000","last_became_peered":"2024-03-30T01:51:32.830419+0000","last_unstale":"2024-03-30T01:51:34.350589+0000","last_undegraded":"2024-03-30T01:51:34.350589+0000","last_fullsized":"2024-03-30T01:51:34.350589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:43:58.638314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.804265+0000","last_change":"2024-03-30T01:51:23.358245+0000","last_active":"2024-03-30T01:51:32.804265+0000","last_peered":"2024-03-30T01:51:32.804265+0000","last_clean":"2024-03-30T01:51:32.804265+0000","last_became_active":"2024-03-30T01:51:23.355914+0000","last_became_peered":"2024-03-30T01:51:23.355914+0000","last_unstale":"2024-03-30T01:51:32.804265+0000","last_undegraded":"2024-03-30T01:51:32.804265+0000","last_fullsized":"2024-03-30T01:51:32.804265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_clean_scrub_stamp":"2024-03-30T01:51:21.990253+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:21:19.291194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.789893+0000","last_change":"2024-03-30T01:51:32.328546+0000","last_active":"2024-03-30T01:51:32.789893+0000","last_peered":"2024-03-30T01:51:32.789893+0000","last_clean":"2024-03-30T01:51:32.789893+0000","last_became_active":"2024-03-30T01:51:32.328108+0000","last_became_peered":"2024-03-30T01:51:32.328108+0000","last_unstale":"2024-03-30T01:51:32.789893+0000","last_undegraded":"2024-03-30T01:51:32.789893+0000","last_fullsized":"2024-03-30T01:51:32.789893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356791+0000","last_change":"2024-03-30T01:51:32.817812+0000","last_active":"2024-03-30T01:51:36.356791+0000","last_peered":"2024-03-30T01:51:36.356791+0000","last_clean":"2024-03-30T01:51:36.356791+0000","last_became_active":"2024-03-30T01:51:32.816217+0000","last_became_peered":"2024-03-30T01:51:32.816217+0000","last_unstale":"2024-03-30T01:51:36.356791+0000","last_undegraded":"2024-03-30T01:51:36.356791+0000","last_fullsized":"2024-03-30T01:51:36.356791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.804176+0000","last_change":"2024-03-30T01:51:32.340288+0000","last_active":"2024-03-30T01:51:32.804176+0000","last_peered":"2024-03-30T01:51:32.804176+0000","last_clean":"2024-03-30T01:51:32.804176+0000","last_became_active":"2024-03-30T01:51:32.339870+0000","last_became_peered":"2024-03-30T01:51:32.339870+0000","last_unstale":"2024-03-30T01:51:32.804176+0000","last_undegraded":"2024-03-30T01:51:32.804176+0000","last_fullsized":"2024-03-30T01:51:32.804176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:28.389656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951417+0000","last_change":"2024-03-30T01:51:32.795840+0000","last_active":"2024-03-30T01:51:33.951417+0000","last_peered":"2024-03-30T01:51:33.951417+0000","last_clean":"2024-03-30T01:51:33.951417+0000","last_became_active":"2024-03-30T01:51:32.795458+0000","last_became_peered":"2024-03-30T01:51:32.795458+0000","last_unstale":"2024-03-30T01:51:33.951417+0000","last_undegraded":"2024-03-30T01:51:33.951417+0000","last_fullsized":"2024-03-30T01:51:33.951417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:24:14.776848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.798439+0000","last_change":"2024-03-30T01:51:32.332992+0000","last_active":"2024-03-30T01:51:32.798439+0000","last_peered":"2024-03-30T01:51:32.798439+0000","last_clean":"2024-03-30T01:51:32.798439+0000","last_became_active":"2024-03-30T01:51:32.332735+0000","last_became_peered":"2024-03-30T01:51:32.332735+0000","last_unstale":"2024-03-30T01:51:32.798439+0000","last_undegraded":"2024-03-30T01:51:32.798439+0000","last_fullsized":"2024-03-30T01:51:32.798439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:49:06.802141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791299+0000","last_change":"2024-03-30T01:51:32.812474+0000","last_active":"2024-03-30T01:51:33.791299+0000","last_peered":"2024-03-30T01:51:33.791299+0000","last_clean":"2024-03-30T01:51:33.791299+0000","last_became_active":"2024-03-30T01:51:32.812149+0000","last_became_peered":"2024-03-30T01:51:32.812149+0000","last_unstale":"2024-03-30T01:51:33.791299+0000","last_undegraded":"2024-03-30T01:51:33.791299+0000","last_fullsized":"2024-03-30T01:51:33.791299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:48.498455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.794770+0000","last_change":"2024-03-30T01:51:32.331651+0000","last_active":"2024-03-30T01:51:32.794770+0000","last_peered":"2024-03-30T01:51:32.794770+0000","last_clean":"2024-03-30T01:51:32.794770+0000","last_became_active":"2024-03-30T01:51:32.331150+0000","last_became_peered":"2024-03-30T01:51:32.331150+0000","last_unstale":"2024-03-30T01:51:32.794770+0000","last_undegraded":"2024-03-30T01:51:32.794770+0000","last_fullsized":"2024-03-30T01:51:32.794770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794329+0000","last_change":"2024-03-30T01:51:32.808411+0000","last_active":"2024-03-30T01:51:33.794329+0000","last_peered":"2024-03-30T01:51:33.794329+0000","last_clean":"2024-03-30T01:51:33.794329+0000","last_became_active":"2024-03-30T01:51:32.807032+0000","last_became_peered":"2024-03-30T01:51:32.807032+0000","last_unstale":"2024-03-30T01:51:33.794329+0000","last_undegraded":"2024-03-30T01:51:33.794329+0000","last_fullsized":"2024-03-30T01:51:33.794329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:43:14.180564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.805618+0000","last_change":"2024-03-30T01:51:32.332641+0000","last_active":"2024-03-30T01:51:32.805618+0000","last_peered":"2024-03-30T01:51:32.805618+0000","last_clean":"2024-03-30T01:51:32.805618+0000","last_became_active":"2024-03-30T01:51:32.332372+0000","last_became_peered":"2024-03-30T01:51:32.332372+0000","last_unstale":"2024-03-30T01:51:32.805618+0000","last_undegraded":"2024-03-30T01:51:32.805618+0000","last_fullsized":"2024-03-30T01:51:32.805618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:16.099108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793089+0000","last_change":"2024-03-30T01:51:32.801706+0000","last_active":"2024-03-30T01:51:33.793089+0000","last_peered":"2024-03-30T01:51:33.793089+0000","last_clean":"2024-03-30T01:51:33.793089+0000","last_became_active":"2024-03-30T01:51:32.799681+0000","last_became_peered":"2024-03-30T01:51:32.799681+0000","last_unstale":"2024-03-30T01:51:33.793089+0000","last_undegraded":"2024-03-30T01:51:33.793089+0000","last_fullsized":"2024-03-30T01:51:33.793089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:26:47.924608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.811947+0000","last_change":"2024-03-30T01:51:32.340251+0000","last_active":"2024-03-30T01:51:32.811947+0000","last_peered":"2024-03-30T01:51:32.811947+0000","last_clean":"2024-03-30T01:51:32.811947+0000","last_became_active":"2024-03-30T01:51:32.339947+0000","last_became_peered":"2024-03-30T01:51:32.339947+0000","last_unstale":"2024-03-30T01:51:32.811947+0000","last_undegraded":"2024-03-30T01:51:32.811947+0000","last_fullsized":"2024-03-30T01:51:32.811947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:16:47.699775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791546+0000","last_change":"2024-03-30T01:51:32.806047+0000","last_active":"2024-03-30T01:51:33.791546+0000","last_peered":"2024-03-30T01:51:33.791546+0000","last_clean":"2024-03-30T01:51:33.791546+0000","last_became_active":"2024-03-30T01:51:32.805805+0000","last_became_peered":"2024-03-30T01:51:32.805805+0000","last_unstale":"2024-03-30T01:51:33.791546+0000","last_undegraded":"2024-03-30T01:51:33.791546+0000","last_fullsized":"2024-03-30T01:51:33.791546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:13:08.942873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.807432+0000","last_change":"2024-03-30T01:51:32.342956+0000","last_active":"2024-03-30T01:51:32.807432+0000","last_peered":"2024-03-30T01:51:32.807432+0000","last_clean":"2024-03-30T01:51:32.807432+0000","last_became_active":"2024-03-30T01:51:32.342396+0000","last_became_peered":"2024-03-30T01:51:32.342396+0000","last_unstale":"2024-03-30T01:51:32.807432+0000","last_undegraded":"2024-03-30T01:51:32.807432+0000","last_fullsized":"2024-03-30T01:51:32.807432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:28.389656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357308+0000","last_change":"2024-03-30T01:51:32.821007+0000","last_active":"2024-03-30T01:51:36.357308+0000","last_peered":"2024-03-30T01:51:36.357308+0000","last_clean":"2024-03-30T01:51:36.357308+0000","last_became_active":"2024-03-30T01:51:32.820784+0000","last_became_peered":"2024-03-30T01:51:32.820784+0000","last_unstale":"2024-03-30T01:51:36.357308+0000","last_undegraded":"2024-03-30T01:51:36.357308+0000","last_fullsized":"2024-03-30T01:51:36.357308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:26:47.924608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.830948+0000","last_change":"2024-03-30T01:51:32.340196+0000","last_active":"2024-03-30T01:51:32.830948+0000","last_peered":"2024-03-30T01:51:32.830948+0000","last_clean":"2024-03-30T01:51:32.830948+0000","last_became_active":"2024-03-30T01:51:32.338419+0000","last_became_peered":"2024-03-30T01:51:32.338419+0000","last_unstale":"2024-03-30T01:51:32.830948+0000","last_undegraded":"2024-03-30T01:51:32.830948+0000","last_fullsized":"2024-03-30T01:51:32.830948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951714+0000","last_change":"2024-03-30T01:51:32.814179+0000","last_active":"2024-03-30T01:51:33.951714+0000","last_peered":"2024-03-30T01:51:33.951714+0000","last_clean":"2024-03-30T01:51:33.951714+0000","last_became_active":"2024-03-30T01:51:32.813873+0000","last_became_peered":"2024-03-30T01:51:32.813873+0000","last_unstale":"2024-03-30T01:51:33.951714+0000","last_undegraded":"2024-03-30T01:51:33.951714+0000","last_fullsized":"2024-03-30T01:51:33.951714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:13:08.942873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.804043+0000","last_change":"2024-03-30T01:51:32.339346+0000","last_active":"2024-03-30T01:51:32.804043+0000","last_peered":"2024-03-30T01:51:32.804043+0000","last_clean":"2024-03-30T01:51:32.804043+0000","last_became_active":"2024-03-30T01:51:32.339038+0000","last_became_peered":"2024-03-30T01:51:32.339038+0000","last_unstale":"2024-03-30T01:51:32.804043+0000","last_undegraded":"2024-03-30T01:51:32.804043+0000","last_fullsized":"2024-03-30T01:51:32.804043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793437+0000","last_change":"2024-03-30T01:51:32.803943+0000","last_active":"2024-03-30T01:51:33.793437+0000","last_peered":"2024-03-30T01:51:33.793437+0000","last_clean":"2024-03-30T01:51:33.793437+0000","last_became_active":"2024-03-30T01:51:32.802118+0000","last_became_peered":"2024-03-30T01:51:32.802118+0000","last_unstale":"2024-03-30T01:51:33.793437+0000","last_undegraded":"2024-03-30T01:51:33.793437+0000","last_fullsized":"2024-03-30T01:51:33.793437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:17.114113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.804568+0000","last_change":"2024-03-30T01:51:32.336889+0000","last_active":"2024-03-30T01:51:32.804568+0000","last_peered":"2024-03-30T01:51:32.804568+0000","last_clean":"2024-03-30T01:51:32.804568+0000","last_became_active":"2024-03-30T01:51:32.336560+0000","last_became_peered":"2024-03-30T01:51:32.336560+0000","last_unstale":"2024-03-30T01:51:32.804568+0000","last_undegraded":"2024-03-30T01:51:32.804568+0000","last_fullsized":"2024-03-30T01:51:32.804568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356993+0000","last_change":"2024-03-30T01:51:32.816142+0000","last_active":"2024-03-30T01:51:36.356993+0000","last_peered":"2024-03-30T01:51:36.356993+0000","last_clean":"2024-03-30T01:51:36.356993+0000","last_became_active":"2024-03-30T01:51:32.814782+0000","last_became_peered":"2024-03-30T01:51:32.814782+0000","last_unstale":"2024-03-30T01:51:36.356993+0000","last_undegraded":"2024-03-30T01:51:36.356993+0000","last_fullsized":"2024-03-30T01:51:36.356993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:13:08.942873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.805047+0000","last_change":"2024-03-30T01:51:32.334063+0000","last_active":"2024-03-30T01:51:32.805047+0000","last_peered":"2024-03-30T01:51:32.805047+0000","last_clean":"2024-03-30T01:51:32.805047+0000","last_became_active":"2024-03-30T01:51:32.332760+0000","last_became_peered":"2024-03-30T01:51:32.332760+0000","last_unstale":"2024-03-30T01:51:32.805047+0000","last_undegraded":"2024-03-30T01:51:32.805047+0000","last_fullsized":"2024-03-30T01:51:32.805047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357089+0000","last_change":"2024-03-30T01:51:32.808609+0000","last_active":"2024-03-30T01:51:36.357089+0000","last_peered":"2024-03-30T01:51:36.357089+0000","last_clean":"2024-03-30T01:51:36.357089+0000","last_became_active":"2024-03-30T01:51:32.803595+0000","last_became_peered":"2024-03-30T01:51:32.803595+0000","last_unstale":"2024-03-30T01:51:36.357089+0000","last_undegraded":"2024-03-30T01:51:36.357089+0000","last_fullsized":"2024-03-30T01:51:36.357089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:31:32.555378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.832173+0000","last_change":"2024-03-30T01:51:32.340790+0000","last_active":"2024-03-30T01:51:32.832173+0000","last_peered":"2024-03-30T01:51:32.832173+0000","last_clean":"2024-03-30T01:51:32.832173+0000","last_became_active":"2024-03-30T01:51:32.340490+0000","last_became_peered":"2024-03-30T01:51:32.340490+0000","last_unstale":"2024-03-30T01:51:32.832173+0000","last_undegraded":"2024-03-30T01:51:32.832173+0000","last_fullsized":"2024-03-30T01:51:32.832173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:30:14.002651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359197+0000","last_change":"2024-03-30T01:51:32.827543+0000","last_active":"2024-03-30T01:51:36.359197+0000","last_peered":"2024-03-30T01:51:36.359197+0000","last_clean":"2024-03-30T01:51:36.359197+0000","last_became_active":"2024-03-30T01:51:32.827208+0000","last_became_peered":"2024-03-30T01:51:32.827208+0000","last_unstale":"2024-03-30T01:51:36.359197+0000","last_undegraded":"2024-03-30T01:51:36.359197+0000","last_fullsized":"2024-03-30T01:51:36.359197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:56:56.891377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792948+0000","last_change":"2024-03-30T01:51:32.796699+0000","last_active":"2024-03-30T01:51:33.792948+0000","last_peered":"2024-03-30T01:51:33.792948+0000","last_clean":"2024-03-30T01:51:33.792948+0000","last_became_active":"2024-03-30T01:51:32.796427+0000","last_became_peered":"2024-03-30T01:51:32.796427+0000","last_unstale":"2024-03-30T01:51:33.792948+0000","last_undegraded":"2024-03-30T01:51:33.792948+0000","last_fullsized":"2024-03-30T01:51:33.792948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:48:32.312063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.831028+0000","last_change":"2024-03-30T01:51:32.340270+0000","last_active":"2024-03-30T01:51:32.831028+0000","last_peered":"2024-03-30T01:51:32.831028+0000","last_clean":"2024-03-30T01:51:32.831028+0000","last_became_active":"2024-03-30T01:51:32.339869+0000","last_became_peered":"2024-03-30T01:51:32.339869+0000","last_unstale":"2024-03-30T01:51:32.831028+0000","last_undegraded":"2024-03-30T01:51:32.831028+0000","last_fullsized":"2024-03-30T01:51:32.831028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792626+0000","last_change":"2024-03-30T01:51:32.806687+0000","last_active":"2024-03-30T01:51:33.792626+0000","last_peered":"2024-03-30T01:51:33.792626+0000","last_clean":"2024-03-30T01:51:33.792626+0000","last_became_active":"2024-03-30T01:51:32.806461+0000","last_became_peered":"2024-03-30T01:51:32.806461+0000","last_unstale":"2024-03-30T01:51:33.792626+0000","last_undegraded":"2024-03-30T01:51:33.792626+0000","last_fullsized":"2024-03-30T01:51:33.792626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:15:59.657625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.833260+0000","last_change":"2024-03-30T01:51:32.343222+0000","last_active":"2024-03-30T01:51:32.833260+0000","last_peered":"2024-03-30T01:51:32.833260+0000","last_clean":"2024-03-30T01:51:32.833260+0000","last_became_active":"2024-03-30T01:51:32.342933+0000","last_became_peered":"2024-03-30T01:51:32.342933+0000","last_unstale":"2024-03-30T01:51:32.833260+0000","last_undegraded":"2024-03-30T01:51:32.833260+0000","last_fullsized":"2024-03-30T01:51:32.833260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:42:26.214040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.952250+0000","last_change":"2024-03-30T01:51:32.798373+0000","last_active":"2024-03-30T01:51:33.952250+0000","last_peered":"2024-03-30T01:51:33.952250+0000","last_clean":"2024-03-30T01:51:33.952250+0000","last_became_active":"2024-03-30T01:51:32.798184+0000","last_became_peered":"2024-03-30T01:51:32.798184+0000","last_unstale":"2024-03-30T01:51:33.952250+0000","last_undegraded":"2024-03-30T01:51:33.952250+0000","last_fullsized":"2024-03-30T01:51:33.952250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:12:19.249116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.826599+0000","last_change":"2024-03-30T01:51:32.336950+0000","last_active":"2024-03-30T01:51:32.826599+0000","last_peered":"2024-03-30T01:51:32.826599+0000","last_clean":"2024-03-30T01:51:32.826599+0000","last_became_active":"2024-03-30T01:51:32.336685+0000","last_became_peered":"2024-03-30T01:51:32.336685+0000","last_unstale":"2024-03-30T01:51:32.826599+0000","last_undegraded":"2024-03-30T01:51:32.826599+0000","last_fullsized":"2024-03-30T01:51:32.826599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:18.328608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357072+0000","last_change":"2024-03-30T01:51:32.818072+0000","last_active":"2024-03-30T01:51:36.357072+0000","last_peered":"2024-03-30T01:51:36.357072+0000","last_clean":"2024-03-30T01:51:36.357072+0000","last_became_active":"2024-03-30T01:51:32.816795+0000","last_became_peered":"2024-03-30T01:51:32.816795+0000","last_unstale":"2024-03-30T01:51:36.357072+0000","last_undegraded":"2024-03-30T01:51:36.357072+0000","last_fullsized":"2024-03-30T01:51:36.357072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:16:38.980879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.834008+0000","last_change":"2024-03-30T01:51:32.336309+0000","last_active":"2024-03-30T01:51:32.834008+0000","last_peered":"2024-03-30T01:51:32.834008+0000","last_clean":"2024-03-30T01:51:32.834008+0000","last_became_active":"2024-03-30T01:51:32.335769+0000","last_became_peered":"2024-03-30T01:51:32.335769+0000","last_unstale":"2024-03-30T01:51:32.834008+0000","last_undegraded":"2024-03-30T01:51:32.834008+0000","last_fullsized":"2024-03-30T01:51:32.834008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T07:39:05.794505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.605}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6779999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":66162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.49}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.811999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.9900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.109}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.6950000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.1520000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.8160000000000007}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7050000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7250000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.298}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.7949999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.1280000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.294}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9209999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.8600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":69879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,10],"upper_bound":32},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.742}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5150000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5389999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6639999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7769999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.859}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0249999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2530000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.992}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":660885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5980000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7230000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T01:51:38.195 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-30T01:51:38.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.442+0000 7f1042a00640 1 Processor -- start 2024-03-30T01:51:38.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.442+0000 7f1042a00640 1 -- start start 2024-03-30T01:51:38.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.444+0000 7f1042a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f103c15cc50 0x7f103c0d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:38.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.444+0000 7f1042a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f103c0cfb80 0x7f103c0b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:38.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.444+0000 7f1042a00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f103c15d030 con 0x7f103c0d2240 2024-03-30T01:51:38.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.444+0000 7f1042a00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f103c0d1c50 con 0x7f103c0cfb80 2024-03-30T01:51:38.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.444+0000 7f1042a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103c0b5af0 con 0x7f103c15cc50 2024-03-30T01:51:38.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.444+0000 7f103b400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f103c0d2240 0x7f103c0cf470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53912/0 (socket says 172.21.15.133:53912) 2024-03-30T01:51:38.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.444+0000 7f103b400640 1 -- 172.21.15.133:0/2487755593 learned_addr learned my addr 172.21.15.133:0/2487755593 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:38.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.444+0000 7f1040a00640 1 --2- 172.21.15.133:0/2487755593 >> v2:172.21.15.133:3300/0 conn(0x7f103c0cfb80 0x7f103c0b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:38.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.445+0000 7f103be00640 1 --2- 172.21.15.133:0/2487755593 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f103c15cc50 0x7f103c0d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:38.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.445+0000 7f103aa00640 1 -- 172.21.15.133:0/2487755593 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102910838 0 0) 0x7f103c15d030 con 0x7f103c0d2240 2024-03-30T01:51:38.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.445+0000 7f103aa00640 1 -- 172.21.15.133:0/2487755593 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1020003520 con 0x7f103c0d2240 2024-03-30T01:51:38.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.445+0000 7f1040a00640 1 -- 172.21.15.133:0/2487755593 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f103c15cc50 msgr2=0x7f103c0d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:38.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.445+0000 7f1040a00640 1 --2- 172.21.15.133:0/2487755593 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f103c15cc50 0x7f103c0d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:38.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.445+0000 7f1040a00640 1 -- 172.21.15.133:0/2487755593 >> v1:172.21.15.133:6789/0 conn(0x7f103c0d2240 legacy=0x7f103c0cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:38.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.445+0000 7f1040a00640 1 -- 172.21.15.133:0/2487755593 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103c0d10d0 con 0x7f103c0cfb80 2024-03-30T01:51:38.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.446+0000 7f1040a00640 1 --2- 172.21.15.133:0/2487755593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f103c0cfb80 0x7f103c0b14f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1034009d90 tx=0x7f103402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce58c0c51054068 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:38.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.446+0000 7f103aa00640 1 -- 172.21.15.133:0/2487755593 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103402cc50 con 0x7f103c0cfb80 2024-03-30T01:51:38.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.446+0000 7f103aa00640 1 -- 172.21.15.133:0/2487755593 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103402cdb0 con 0x7f103c0cfb80 2024-03-30T01:51:38.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.446+0000 7f103aa00640 1 -- 172.21.15.133:0/2487755593 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1034034660 con 0x7f103c0cfb80 2024-03-30T01:51:38.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.447+0000 7f1042a00640 1 -- 172.21.15.133:0/2487755593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f103c0cfb80 msgr2=0x7f103c0b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:38.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.447+0000 7f1042a00640 1 --2- 172.21.15.133:0/2487755593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f103c0cfb80 0x7f103c0b14f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1034009d90 tx=0x7f103402bea0 comp rx=0 tx=0).stop 2024-03-30T01:51:38.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.447+0000 7f1042a00640 1 -- 172.21.15.133:0/2487755593 shutdown_connections 2024-03-30T01:51:38.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.447+0000 7f1042a00640 1 --2- 172.21.15.133:0/2487755593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f103c0cfb80 0x7f103c0b14f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:38.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.447+0000 7f1042a00640 1 --2- 172.21.15.133:0/2487755593 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f103c15cc50 0x7f103c0d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:38.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.447+0000 7f1042a00640 1 -- 172.21.15.133:0/2487755593 >> 172.21.15.133:0/2487755593 conn(0x7f103c071a40 msgr2=0x7f103c06b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:38.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.447+0000 7f1042a00640 1 -- 172.21.15.133:0/2487755593 shutdown_connections 2024-03-30T01:51:38.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.447+0000 7f1042a00640 1 -- 172.21.15.133:0/2487755593 wait complete. 2024-03-30T01:51:38.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.449+0000 7f1042a00640 1 Processor -- start 2024-03-30T01:51:38.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.449+0000 7f1042a00640 1 -- start start 2024-03-30T01:51:38.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.450+0000 7f1042a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f103c0cfb80 0x7f103c14bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:38.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.450+0000 7f1042a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f103c0d2240 0x7f103c0c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:38.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.450+0000 7f1042a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f103c15cc50 0x7f103c14fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:38.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.450+0000 7f1042a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c0c9240 con 0x7f103c0d2240 2024-03-30T01:51:38.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.450+0000 7f1042a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c14ffd0 con 0x7f103c0cfb80 2024-03-30T01:51:38.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.450+0000 7f1042a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103c14cbb0 con 0x7f103c15cc50 2024-03-30T01:51:38.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.450+0000 7f103b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f103c0d2240 0x7f103c0c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:38.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.450+0000 7f103b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f103c0d2240 0x7f103c0c8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45876/0 (socket says 172.21.15.133:45876) 2024-03-30T01:51:38.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.450+0000 7f103b400640 1 -- 172.21.15.133:0/1232115208 learned_addr learned my addr 172.21.15.133:0/1232115208 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:38.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.450+0000 7f103be00640 1 --2- 172.21.15.133:0/1232115208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f103c0cfb80 0x7f103c14bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:38.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.450+0000 7f103b400640 1 -- 172.21.15.133:0/1232115208 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f103c15cc50 msgr2=0x7f103c14fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:38.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.450+0000 7f103b400640 1 --2- 172.21.15.133:0/1232115208 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f103c15cc50 0x7f103c14fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:38.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.450+0000 7f103b400640 1 -- 172.21.15.133:0/1232115208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f103c0cfb80 msgr2=0x7f103c14bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:38.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.450+0000 7f103b400640 1 --2- 172.21.15.133:0/1232115208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f103c0cfb80 0x7f103c14bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:38.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.450+0000 7f103b400640 1 -- 172.21.15.133:0/1232115208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1034009a70 con 0x7f103c0d2240 2024-03-30T01:51:38.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.451+0000 7f103b400640 1 --2- 172.21.15.133:0/1232115208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f103c0d2240 0x7f103c0c8d00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f102400c500 tx=0x7f102400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:38.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.451+0000 7f1033e00640 1 -- 172.21.15.133:0/1232115208 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1024005ce0 con 0x7f103c0d2240 2024-03-30T01:51:38.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.451+0000 7f1033e00640 1 -- 172.21.15.133:0/1232115208 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1024005e40 con 0x7f103c0d2240 2024-03-30T01:51:38.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.451+0000 7f1033e00640 1 -- 172.21.15.133:0/1232115208 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1024007330 con 0x7f103c0d2240 2024-03-30T01:51:38.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.451+0000 7f1042a00640 1 -- 172.21.15.133:0/1232115208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103c14c310 con 0x7f103c0d2240 2024-03-30T01:51:38.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.451+0000 7f1042a00640 1 -- 172.21.15.133:0/1232115208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f103c14c8d0 con 0x7f103c0d2240 2024-03-30T01:51:38.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.452+0000 7f1042a00640 1 -- 172.21.15.133:0/1232115208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f103c066d80 con 0x7f103c0d2240 2024-03-30T01:51:38.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.453+0000 7f1033e00640 1 -- 172.21.15.133:0/1232115208 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1024007550 con 0x7f103c0d2240 2024-03-30T01:51:38.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.454+0000 7f1033e00640 1 --2- 172.21.15.133:0/1232115208 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f101806ac00 0x7f101806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:38.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.455+0000 7f1033e00640 1 -- 172.21.15.133:0/1232115208 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1024088a40 con 0x7f103c0d2240 2024-03-30T01:51:38.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.455+0000 7f103be00640 1 --2- 172.21.15.133:0/1232115208 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f101806ac00 0x7f101806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:38.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.455+0000 7f103be00640 1 --2- 172.21.15.133:0/1232115208 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f101806ac00 0x7f101806d0c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f102c006fd0 tx=0x7f102c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:38.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.459+0000 7f1033e00640 1 -- 172.21.15.133:0/1232115208 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f1024053cd0 con 0x7f103c0d2240 2024-03-30T01:51:38.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.733+0000 7f1042a00640 1 -- 172.21.15.133:0/1232115208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f103c0ca3a0 con 0x7f103c0d2240 2024-03-30T01:51:38.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.734+0000 7f1033e00640 1 -- 172.21.15.133:0/1232115208 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1010 (secure 0 0 0) 0x7f1024017080 con 0x7f103c0d2240 2024-03-30T01:51:38.740 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:38.740 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":30,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1711763480,"num_in_osds":8,"osd_in_since":1711763472,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592730,"bytes_used":224227328,"bytes_avail":772869885952,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4285}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-03-30T01:51:08.649207+0000","services":{}},"progress_events":{}} 2024-03-30T01:51:38.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.736+0000 7f1042a00640 1 -- 172.21.15.133:0/1232115208 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f101806ac00 msgr2=0x7f101806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:38.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.736+0000 7f1042a00640 1 --2- 172.21.15.133:0/1232115208 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f101806ac00 0x7f101806d0c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f102c006fd0 tx=0x7f102c008040 comp rx=0 tx=0).stop 2024-03-30T01:51:38.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.736+0000 7f1042a00640 1 -- 172.21.15.133:0/1232115208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f103c0d2240 msgr2=0x7f103c0c8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:38.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.736+0000 7f1042a00640 1 --2- 172.21.15.133:0/1232115208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f103c0d2240 0x7f103c0c8d00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f102400c500 tx=0x7f102400c9c0 comp rx=0 tx=0).stop 2024-03-30T01:51:38.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.736+0000 7f1042a00640 1 -- 172.21.15.133:0/1232115208 shutdown_connections 2024-03-30T01:51:38.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.736+0000 7f1042a00640 1 --2- 172.21.15.133:0/1232115208 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f101806ac00 0x7f101806d0c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:38.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.736+0000 7f1042a00640 1 --2- 172.21.15.133:0/1232115208 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f103c15cc50 0x7f103c14fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:38.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.736+0000 7f1042a00640 1 --2- 172.21.15.133:0/1232115208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f103c0d2240 0x7f103c0c8d00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:38.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.736+0000 7f1042a00640 1 --2- 172.21.15.133:0/1232115208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f103c0cfb80 0x7f103c14bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:38.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.736+0000 7f1042a00640 1 -- 172.21.15.133:0/1232115208 >> 172.21.15.133:0/1232115208 conn(0x7f103c071a40 msgr2=0x7f103c15f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:38.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.736+0000 7f1042a00640 1 -- 172.21.15.133:0/1232115208 shutdown_connections 2024-03-30T01:51:38.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.736+0000 7f1042a00640 1 -- 172.21.15.133:0/1232115208 wait complete. 2024-03-30T01:51:38.760 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-30T01:51:38.760 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T01:51:38.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.947+0000 7f9fc2400640 1 Processor -- start 2024-03-30T01:51:38.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.947+0000 7f9fc2400640 1 -- start start 2024-03-30T01:51:38.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.948+0000 7f9fc2400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9fbc06e2e0 0x7f9fbc070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:38.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.948+0000 7f9fc2400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fbc070a40 0x7f9fbc15d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:38.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.949+0000 7f9fc2400640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fbc070e90 con 0x7f9fbc143220 2024-03-30T01:51:38.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.949+0000 7f9fc2400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fbc0cc5c0 con 0x7f9fbc06e2e0 2024-03-30T01:51:38.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.949+0000 7f9fc2400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc0ce400 con 0x7f9fbc070a40 2024-03-30T01:51:38.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.949+0000 7f9fbb400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9fbc143220 0x7f9fbc0cd990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53914/0 (socket says 172.21.15.133:53914) 2024-03-30T01:51:38.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.949+0000 7f9fbb400640 1 -- 172.21.15.133:0/3698391038 learned_addr learned my addr 172.21.15.133:0/3698391038 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:38.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.949+0000 7f9fbbe00640 1 --2- 172.21.15.133:0/3698391038 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fbc070a40 0x7f9fbc15d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:38.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.949+0000 7f9fb2a00640 1 --2- 172.21.15.133:0/3698391038 >> v2:172.21.15.137:3300/0 conn(0x7f9fbc06e2e0 0x7f9fbc070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:38.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.949+0000 7f9fbaa00640 1 -- 172.21.15.133:0/3698391038 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873674159 0 0) 0x7f9fac001110 con 0x7f9fbc143220 2024-03-30T01:51:38.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.949+0000 7f9fbaa00640 1 -- 172.21.15.133:0/3698391038 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fa0003520 con 0x7f9fbc143220 2024-03-30T01:51:38.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.950+0000 7f9fbaa00640 1 -- 172.21.15.133:0/3698391038 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3601728726 0 0) 0x7f9fa0003520 con 0x7f9fbc143220 2024-03-30T01:51:38.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.950+0000 7f9fbaa00640 1 -- 172.21.15.133:0/3698391038 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fbc070a40 msgr2=0x7f9fbc15d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:38.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.950+0000 7f9fbaa00640 1 --2- 172.21.15.133:0/3698391038 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fbc070a40 0x7f9fbc15d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:38.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.950+0000 7f9fbaa00640 1 -- 172.21.15.133:0/3698391038 >> v2:172.21.15.137:3300/0 conn(0x7f9fbc06e2e0 msgr2=0x7f9fbc070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:38.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.950+0000 7f9fbaa00640 1 --2- 172.21.15.133:0/3698391038 >> v2:172.21.15.137:3300/0 conn(0x7f9fbc06e2e0 0x7f9fbc070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:38.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.950+0000 7f9fbaa00640 1 -- 172.21.15.133:0/3698391038 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fbc06d0e0 con 0x7f9fbc143220 2024-03-30T01:51:38.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.950+0000 7f9fbaa00640 1 -- 172.21.15.133:0/3698391038 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f9fac001800 con 0x7f9fbc143220 2024-03-30T01:51:38.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.950+0000 7f9fbaa00640 1 -- 172.21.15.133:0/3698391038 >> v1:172.21.15.133:6789/0 conn(0x7f9fbc143220 legacy=0x7f9fbc0cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:38.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.950+0000 7f9fbaa00640 1 --2- 172.21.15.133:0/3698391038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fa0003970 0x7f9fa0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:38.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.950+0000 7f9fbaa00640 1 --2- 172.21.15.133:0/3698391038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fa00047c0 0x7f9fa0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:38.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.950+0000 7f9fbaa00640 1 --2- 172.21.15.133:0/3698391038 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fbc070a40 0x7f9fa0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:38.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.950+0000 7f9fbaa00640 1 -- 172.21.15.133:0/3698391038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc0ce400 con 0x7f9fa0003970 2024-03-30T01:51:38.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.950+0000 7f9fbaa00640 1 -- 172.21.15.133:0/3698391038 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa000db90 con 0x7f9fa00047c0 2024-03-30T01:51:38.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.950+0000 7f9fbaa00640 1 -- 172.21.15.133:0/3698391038 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa000dcd0 con 0x7f9fbc070a40 2024-03-30T01:51:38.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.950+0000 7f9fbb400640 1 --2- 172.21.15.133:0/3698391038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fa0003970 0x7f9fa0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:38.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.950+0000 7f9fbbe00640 1 --2- 172.21.15.133:0/3698391038 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fbc070a40 0x7f9fa0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:38.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.950+0000 7f9fb2a00640 1 --2- 172.21.15.133:0/3698391038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fa00047c0 0x7f9fa0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:38.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.950+0000 7f9fbb400640 1 -- 172.21.15.133:0/3698391038 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fbc070a40 msgr2=0x7f9fa0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:38.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.950+0000 7f9fbb400640 1 --2- 172.21.15.133:0/3698391038 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fbc070a40 0x7f9fa0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:38.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.950+0000 7f9fbb400640 1 -- 172.21.15.133:0/3698391038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fa00047c0 msgr2=0x7f9fa0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:38.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.950+0000 7f9fbb400640 1 --2- 172.21.15.133:0/3698391038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fa00047c0 0x7f9fa0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:38.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.950+0000 7f9fbb400640 1 -- 172.21.15.133:0/3698391038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa0003520 con 0x7f9fa0003970 2024-03-30T01:51:38.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.951+0000 7f9fb2a00640 1 --2- 172.21.15.133:0/3698391038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fa00047c0 0x7f9fa0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:38.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.951+0000 7f9fbb400640 1 --2- 172.21.15.133:0/3698391038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fa0003970 0x7f9fa0003d90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00c210 tx=0x7f9fa00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44cdbbeb2aa2e01a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:38.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.952+0000 7f9fbaa00640 1 -- 172.21.15.133:0/3698391038 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac005ad0 con 0x7f9fa0003970 2024-03-30T01:51:38.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.952+0000 7f9fbaa00640 1 -- 172.21.15.133:0/3698391038 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac005c30 con 0x7f9fa0003970 2024-03-30T01:51:38.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.952+0000 7f9fbaa00640 1 -- 172.21.15.133:0/3698391038 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac02c8d0 con 0x7f9fa0003970 2024-03-30T01:51:38.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.952+0000 7f9fc2400640 1 -- 172.21.15.133:0/3698391038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fa0003970 msgr2=0x7f9fa0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:38.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.952+0000 7f9fc2400640 1 --2- 172.21.15.133:0/3698391038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fa0003970 0x7f9fa0003d90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00c210 tx=0x7f9fa00057f0 comp rx=0 tx=0).stop 2024-03-30T01:51:38.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.952+0000 7f9fbbe00640 1 -- 172.21.15.133:0/3698391038 reap_dead start 2024-03-30T01:51:38.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.952+0000 7f9fc2400640 1 -- 172.21.15.133:0/3698391038 shutdown_connections 2024-03-30T01:51:38.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.952+0000 7f9fc2400640 1 -- 172.21.15.133:0/3698391038 >> 172.21.15.133:0/3698391038 conn(0x7f9fbc0b07a0 msgr2=0x7f9fbc0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:38.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.952+0000 7f9fc2400640 1 -- 172.21.15.133:0/3698391038 shutdown_connections 2024-03-30T01:51:38.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.952+0000 7f9fc2400640 1 -- 172.21.15.133:0/3698391038 wait complete. 2024-03-30T01:51:38.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.954+0000 7f9fc2400640 1 Processor -- start 2024-03-30T01:51:38.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.954+0000 7f9fc2400640 1 -- start start 2024-03-30T01:51:38.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.955+0000 7f9fc2400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fa0003970 0x7f9fbc13e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:38.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.955+0000 7f9fc2400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fbc13acb0 0x7f9fbc13b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:38.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.955+0000 7f9fc2400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fbc147f30 0x7f9fbc1483b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:38.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.955+0000 7f9fc2400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc13b650 con 0x7f9fa0003970 2024-03-30T01:51:38.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.955+0000 7f9fc2400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc148cd0 con 0x7f9fbc13acb0 2024-03-30T01:51:38.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.955+0000 7f9fc2400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc145e40 con 0x7f9fbc147f30 2024-03-30T01:51:38.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.955+0000 7f9fbb400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fa0003970 0x7f9fbc13e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:38.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.955+0000 7f9fbb400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fa0003970 0x7f9fbc13e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45892/0 (socket says 172.21.15.133:45892) 2024-03-30T01:51:38.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.955+0000 7f9fbb400640 1 -- 172.21.15.133:0/3566775273 learned_addr learned my addr 172.21.15.133:0/3566775273 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:38.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.956+0000 7f9fbbe00640 1 --2- 172.21.15.133:0/3566775273 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fbc147f30 0x7f9fbc1483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:38.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.956+0000 7f9fb2a00640 1 --2- 172.21.15.133:0/3566775273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fbc13acb0 0x7f9fbc13b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:38.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.956+0000 7f9fbb400640 1 -- 172.21.15.133:0/3566775273 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fbc147f30 msgr2=0x7f9fbc1483b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:38.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.956+0000 7f9fbb400640 1 --2- 172.21.15.133:0/3566775273 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fbc147f30 0x7f9fbc1483b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:38.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.956+0000 7f9fbb400640 1 -- 172.21.15.133:0/3566775273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fbc13acb0 msgr2=0x7f9fbc13b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:38.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.956+0000 7f9fbb400640 1 --2- 172.21.15.133:0/3566775273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fbc13acb0 0x7f9fbc13b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:38.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.956+0000 7f9fbb400640 1 -- 172.21.15.133:0/3566775273 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fbc146120 con 0x7f9fa0003970 2024-03-30T01:51:38.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.956+0000 7f9fbb400640 1 --2- 172.21.15.133:0/3566775273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fa0003970 0x7f9fbc13e680 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9fac02c540 tx=0x7f9fbc06e9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:38.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.956+0000 7f9fb3e00640 1 -- 172.21.15.133:0/3566775273 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac02cce0 con 0x7f9fa0003970 2024-03-30T01:51:38.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.956+0000 7f9fb3e00640 1 -- 172.21.15.133:0/3566775273 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac02ce40 con 0x7f9fa0003970 2024-03-30T01:51:38.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.956+0000 7f9fc2400640 1 -- 172.21.15.133:0/3566775273 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fbc146400 con 0x7f9fa0003970 2024-03-30T01:51:38.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.956+0000 7f9fb3e00640 1 -- 172.21.15.133:0/3566775273 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac007290 con 0x7f9fa0003970 2024-03-30T01:51:38.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.957+0000 7f9fc2400640 1 -- 172.21.15.133:0/3566775273 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fbc1488f0 con 0x7f9fa0003970 2024-03-30T01:51:38.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.958+0000 7f9fc2400640 1 -- 172.21.15.133:0/3566775273 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fbc066d80 con 0x7f9fa0003970 2024-03-30T01:51:38.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.958+0000 7f9fb3e00640 1 -- 172.21.15.133:0/3566775273 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9fac032070 con 0x7f9fa0003970 2024-03-30T01:51:38.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.959+0000 7f9fb3e00640 1 --2- 172.21.15.133:0/3566775273 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9f9806ac30 0x7f9f9806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:38.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.959+0000 7f9fb3e00640 1 -- 172.21.15.133:0/3566775273 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fac03c040 con 0x7f9fa0003970 2024-03-30T01:51:38.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.960+0000 7f9fb2a00640 1 --2- 172.21.15.133:0/3566775273 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9f9806ac30 0x7f9f9806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:38.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.960+0000 7f9fb2a00640 1 --2- 172.21.15.133:0/3566775273 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9f9806ac30 0x7f9f9806d0f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc1427b0 tx=0x7f9fa4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:38.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:38.964+0000 7f9fb3e00640 1 -- 172.21.15.133:0/3566775273 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f9fac0755f0 con 0x7f9fa0003970 2024-03-30T01:51:39.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:39.154+0000 7f9fc2400640 1 -- 172.21.15.133:0/3566775273 --> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9fbc06d6a0 con 0x7f9f9806ac30 2024-03-30T01:51:39.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:39.163+0000 7f9fb3e00640 1 -- 172.21.15.133:0/3566775273 <== mgr.4105 v2:172.21.15.133:6832/37234 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264559 (secure 0 0 0) 0x7f9fa40118e0 con 0x7f9f9806ac30 2024-03-30T01:51:39.173 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:39.174 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-03-30T01:51:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:39.169+0000 7f9fc2400640 1 -- 172.21.15.133:0/3566775273 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9f9806ac30 msgr2=0x7f9f9806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:39.169+0000 7f9fc2400640 1 --2- 172.21.15.133:0/3566775273 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9f9806ac30 0x7f9f9806d0f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc1427b0 tx=0x7f9fa4008040 comp rx=0 tx=0).stop 2024-03-30T01:51:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:39.169+0000 7f9fc2400640 1 -- 172.21.15.133:0/3566775273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fa0003970 msgr2=0x7f9fbc13e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:39.169+0000 7f9fc2400640 1 --2- 172.21.15.133:0/3566775273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fa0003970 0x7f9fbc13e680 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9fac02c540 tx=0x7f9fbc06e9d0 comp rx=0 tx=0).stop 2024-03-30T01:51:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:39.169+0000 7f9fc2400640 1 -- 172.21.15.133:0/3566775273 shutdown_connections 2024-03-30T01:51:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:39.169+0000 7f9fc2400640 1 --2- 172.21.15.133:0/3566775273 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9f9806ac30 0x7f9f9806d0f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:39.169+0000 7f9fc2400640 1 --2- 172.21.15.133:0/3566775273 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fbc147f30 0x7f9fbc1483b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:39.169+0000 7f9fc2400640 1 --2- 172.21.15.133:0/3566775273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fbc13acb0 0x7f9fbc13b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:39.169+0000 7f9fc2400640 1 --2- 172.21.15.133:0/3566775273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fa0003970 0x7f9fbc13e680 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:39.169+0000 7f9fc2400640 1 -- 172.21.15.133:0/3566775273 >> 172.21.15.133:0/3566775273 conn(0x7f9fbc0b07a0 msgr2=0x7f9fbc0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:39.169+0000 7f9fc2400640 1 -- 172.21.15.133:0/3566775273 shutdown_connections 2024-03-30T01:51:39.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:39.169+0000 7f9fc2400640 1 -- 172.21.15.133:0/3566775273 wait complete. 2024-03-30T01:51:39.195 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-03-30T01:51:37.698018+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218972,"kb_used_data":2804,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755748,"statfs":{"total":773094113280,"available":772869885952,"internally_reserved":0,"allocated":2871296,"data_stored":1744306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,10],"upper_bound":32},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001682"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.351409+0000","last_change":"2024-03-30T01:51:32.812760+0000","last_active":"2024-03-30T01:51:34.351409+0000","last_peered":"2024-03-30T01:51:34.351409+0000","last_clean":"2024-03-30T01:51:34.351409+0000","last_became_active":"2024-03-30T01:51:32.812445+0000","last_became_peered":"2024-03-30T01:51:32.812445+0000","last_unstale":"2024-03-30T01:51:34.351409+0000","last_undegraded":"2024-03-30T01:51:34.351409+0000","last_fullsized":"2024-03-30T01:51:34.351409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:43.327711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791881+0000","last_change":"2024-03-30T01:51:32.811824+0000","last_active":"2024-03-30T01:51:33.791881+0000","last_peered":"2024-03-30T01:51:33.791881+0000","last_clean":"2024-03-30T01:51:33.791881+0000","last_became_active":"2024-03-30T01:51:32.811515+0000","last_became_peered":"2024-03-30T01:51:32.811515+0000","last_unstale":"2024-03-30T01:51:33.791881+0000","last_undegraded":"2024-03-30T01:51:33.791881+0000","last_fullsized":"2024-03-30T01:51:33.791881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951932+0000","last_change":"2024-03-30T01:51:32.799724+0000","last_active":"2024-03-30T01:51:33.951932+0000","last_peered":"2024-03-30T01:51:33.951932+0000","last_clean":"2024-03-30T01:51:33.951932+0000","last_became_active":"2024-03-30T01:51:32.799212+0000","last_became_peered":"2024-03-30T01:51:32.799212+0000","last_unstale":"2024-03-30T01:51:33.951932+0000","last_undegraded":"2024-03-30T01:51:33.951932+0000","last_fullsized":"2024-03-30T01:51:33.951932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:56:56.891377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792368+0000","last_change":"2024-03-30T01:51:32.806655+0000","last_active":"2024-03-30T01:51:33.792368+0000","last_peered":"2024-03-30T01:51:33.792368+0000","last_clean":"2024-03-30T01:51:33.792368+0000","last_became_active":"2024-03-30T01:51:32.806055+0000","last_became_peered":"2024-03-30T01:51:32.806055+0000","last_unstale":"2024-03-30T01:51:33.792368+0000","last_undegraded":"2024-03-30T01:51:33.792368+0000","last_fullsized":"2024-03-30T01:51:33.792368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:16:38.980879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350701+0000","last_change":"2024-03-30T01:51:32.820075+0000","last_active":"2024-03-30T01:51:34.350701+0000","last_peered":"2024-03-30T01:51:34.350701+0000","last_clean":"2024-03-30T01:51:34.350701+0000","last_became_active":"2024-03-30T01:51:32.819814+0000","last_became_peered":"2024-03-30T01:51:32.819814+0000","last_unstale":"2024-03-30T01:51:34.350701+0000","last_undegraded":"2024-03-30T01:51:34.350701+0000","last_fullsized":"2024-03-30T01:51:34.350701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:38:15.645425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793528+0000","last_change":"2024-03-30T01:51:32.803089+0000","last_active":"2024-03-30T01:51:33.793528+0000","last_peered":"2024-03-30T01:51:33.793528+0000","last_clean":"2024-03-30T01:51:33.793528+0000","last_became_active":"2024-03-30T01:51:32.802757+0000","last_became_peered":"2024-03-30T01:51:32.802757+0000","last_unstale":"2024-03-30T01:51:33.793528+0000","last_undegraded":"2024-03-30T01:51:33.793528+0000","last_fullsized":"2024-03-30T01:51:33.793528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:38:15.645425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350340+0000","last_change":"2024-03-30T01:51:32.818444+0000","last_active":"2024-03-30T01:51:34.350340+0000","last_peered":"2024-03-30T01:51:34.350340+0000","last_clean":"2024-03-30T01:51:34.350340+0000","last_became_active":"2024-03-30T01:51:32.818124+0000","last_became_peered":"2024-03-30T01:51:32.818124+0000","last_unstale":"2024-03-30T01:51:34.350340+0000","last_undegraded":"2024-03-30T01:51:34.350340+0000","last_fullsized":"2024-03-30T01:51:34.350340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:13:11.318115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357046+0000","last_change":"2024-03-30T01:51:32.821461+0000","last_active":"2024-03-30T01:51:36.357046+0000","last_peered":"2024-03-30T01:51:36.357046+0000","last_clean":"2024-03-30T01:51:36.357046+0000","last_became_active":"2024-03-30T01:51:32.821281+0000","last_became_peered":"2024-03-30T01:51:32.821281+0000","last_unstale":"2024-03-30T01:51:36.357046+0000","last_undegraded":"2024-03-30T01:51:36.357046+0000","last_fullsized":"2024-03-30T01:51:36.357046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.351614+0000","last_change":"2024-03-30T01:51:32.829942+0000","last_active":"2024-03-30T01:51:34.351614+0000","last_peered":"2024-03-30T01:51:34.351614+0000","last_clean":"2024-03-30T01:51:34.351614+0000","last_became_active":"2024-03-30T01:51:32.829594+0000","last_became_peered":"2024-03-30T01:51:32.829594+0000","last_unstale":"2024-03-30T01:51:34.351614+0000","last_undegraded":"2024-03-30T01:51:34.351614+0000","last_fullsized":"2024-03-30T01:51:34.351614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:43:22.251326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359569+0000","last_change":"2024-03-30T01:51:32.812680+0000","last_active":"2024-03-30T01:51:36.359569+0000","last_peered":"2024-03-30T01:51:36.359569+0000","last_clean":"2024-03-30T01:51:36.359569+0000","last_became_active":"2024-03-30T01:51:32.812333+0000","last_became_peered":"2024-03-30T01:51:32.812333+0000","last_unstale":"2024-03-30T01:51:36.359569+0000","last_undegraded":"2024-03-30T01:51:36.359569+0000","last_fullsized":"2024-03-30T01:51:36.359569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:13:08.942873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359121+0000","last_change":"2024-03-30T01:51:32.826749+0000","last_active":"2024-03-30T01:51:36.359121+0000","last_peered":"2024-03-30T01:51:36.359121+0000","last_clean":"2024-03-30T01:51:36.359121+0000","last_became_active":"2024-03-30T01:51:32.824642+0000","last_became_peered":"2024-03-30T01:51:32.824642+0000","last_unstale":"2024-03-30T01:51:36.359121+0000","last_undegraded":"2024-03-30T01:51:36.359121+0000","last_fullsized":"2024-03-30T01:51:36.359121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794544+0000","last_change":"2024-03-30T01:51:32.816597+0000","last_active":"2024-03-30T01:51:33.794544+0000","last_peered":"2024-03-30T01:51:33.794544+0000","last_clean":"2024-03-30T01:51:33.794544+0000","last_became_active":"2024-03-30T01:51:32.816310+0000","last_became_peered":"2024-03-30T01:51:32.816310+0000","last_unstale":"2024-03-30T01:51:33.794544+0000","last_undegraded":"2024-03-30T01:51:33.794544+0000","last_fullsized":"2024-03-30T01:51:33.794544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:42:27.229045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356973+0000","last_change":"2024-03-30T01:51:32.816094+0000","last_active":"2024-03-30T01:51:36.356973+0000","last_peered":"2024-03-30T01:51:36.356973+0000","last_clean":"2024-03-30T01:51:36.356973+0000","last_became_active":"2024-03-30T01:51:32.815841+0000","last_became_peered":"2024-03-30T01:51:32.815841+0000","last_unstale":"2024-03-30T01:51:36.356973+0000","last_undegraded":"2024-03-30T01:51:36.356973+0000","last_fullsized":"2024-03-30T01:51:36.356973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:08:35.439480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951373+0000","last_change":"2024-03-30T01:51:32.808528+0000","last_active":"2024-03-30T01:51:33.951373+0000","last_peered":"2024-03-30T01:51:33.951373+0000","last_clean":"2024-03-30T01:51:33.951373+0000","last_became_active":"2024-03-30T01:51:32.808290+0000","last_became_peered":"2024-03-30T01:51:32.808290+0000","last_unstale":"2024-03-30T01:51:33.951373+0000","last_undegraded":"2024-03-30T01:51:33.951373+0000","last_fullsized":"2024-03-30T01:51:33.951373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:16:16.111272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791232+0000","last_change":"2024-03-30T01:51:32.818830+0000","last_active":"2024-03-30T01:51:33.791232+0000","last_peered":"2024-03-30T01:51:33.791232+0000","last_clean":"2024-03-30T01:51:33.791232+0000","last_became_active":"2024-03-30T01:51:32.818684+0000","last_became_peered":"2024-03-30T01:51:32.818684+0000","last_unstale":"2024-03-30T01:51:33.791232+0000","last_undegraded":"2024-03-30T01:51:33.791232+0000","last_fullsized":"2024-03-30T01:51:33.791232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:12:19.249116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793142+0000","last_change":"2024-03-30T01:51:32.810544+0000","last_active":"2024-03-30T01:51:33.793142+0000","last_peered":"2024-03-30T01:51:33.793142+0000","last_clean":"2024-03-30T01:51:33.793142+0000","last_became_active":"2024-03-30T01:51:32.809383+0000","last_became_peered":"2024-03-30T01:51:32.809383+0000","last_unstale":"2024-03-30T01:51:33.793142+0000","last_undegraded":"2024-03-30T01:51:33.793142+0000","last_fullsized":"2024-03-30T01:51:33.793142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T04:10:09.271050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794103+0000","last_change":"2024-03-30T01:51:32.814598+0000","last_active":"2024-03-30T01:51:33.794103+0000","last_peered":"2024-03-30T01:51:33.794103+0000","last_clean":"2024-03-30T01:51:33.794103+0000","last_became_active":"2024-03-30T01:51:32.814343+0000","last_became_peered":"2024-03-30T01:51:32.814343+0000","last_unstale":"2024-03-30T01:51:33.794103+0000","last_undegraded":"2024-03-30T01:51:33.794103+0000","last_fullsized":"2024-03-30T01:51:33.794103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:45:46.717709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356214+0000","last_change":"2024-03-30T01:51:32.810030+0000","last_active":"2024-03-30T01:51:36.356214+0000","last_peered":"2024-03-30T01:51:36.356214+0000","last_clean":"2024-03-30T01:51:36.356214+0000","last_became_active":"2024-03-30T01:51:32.809667+0000","last_became_peered":"2024-03-30T01:51:32.809667+0000","last_unstale":"2024-03-30T01:51:36.356214+0000","last_undegraded":"2024-03-30T01:51:36.356214+0000","last_fullsized":"2024-03-30T01:51:36.356214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:43:14.180564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350888+0000","last_change":"2024-03-30T01:51:32.825796+0000","last_active":"2024-03-30T01:51:34.350888+0000","last_peered":"2024-03-30T01:51:34.350888+0000","last_clean":"2024-03-30T01:51:34.350888+0000","last_became_active":"2024-03-30T01:51:32.825501+0000","last_became_peered":"2024-03-30T01:51:32.825501+0000","last_unstale":"2024-03-30T01:51:34.350888+0000","last_undegraded":"2024-03-30T01:51:34.350888+0000","last_fullsized":"2024-03-30T01:51:34.350888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:16:38.980879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359143+0000","last_change":"2024-03-30T01:51:32.816941+0000","last_active":"2024-03-30T01:51:36.359143+0000","last_peered":"2024-03-30T01:51:36.359143+0000","last_clean":"2024-03-30T01:51:36.359143+0000","last_became_active":"2024-03-30T01:51:32.816645+0000","last_became_peered":"2024-03-30T01:51:32.816645+0000","last_unstale":"2024-03-30T01:51:36.359143+0000","last_undegraded":"2024-03-30T01:51:36.359143+0000","last_fullsized":"2024-03-30T01:51:36.359143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:42:27.229045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951735+0000","last_change":"2024-03-30T01:51:32.807172+0000","last_active":"2024-03-30T01:51:33.951735+0000","last_peered":"2024-03-30T01:51:33.951735+0000","last_clean":"2024-03-30T01:51:33.951735+0000","last_became_active":"2024-03-30T01:51:32.805878+0000","last_became_peered":"2024-03-30T01:51:32.805878+0000","last_unstale":"2024-03-30T01:51:33.951735+0000","last_undegraded":"2024-03-30T01:51:33.951735+0000","last_fullsized":"2024-03-30T01:51:33.951735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:04:01.115269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793786+0000","last_change":"2024-03-30T01:51:32.814459+0000","last_active":"2024-03-30T01:51:33.793786+0000","last_peered":"2024-03-30T01:51:33.793786+0000","last_clean":"2024-03-30T01:51:33.793786+0000","last_became_active":"2024-03-30T01:51:32.814174+0000","last_became_peered":"2024-03-30T01:51:32.814174+0000","last_unstale":"2024-03-30T01:51:33.793786+0000","last_undegraded":"2024-03-30T01:51:33.793786+0000","last_fullsized":"2024-03-30T01:51:33.793786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:50.171426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356748+0000","last_change":"2024-03-30T01:51:32.822182+0000","last_active":"2024-03-30T01:51:36.356748+0000","last_peered":"2024-03-30T01:51:36.356748+0000","last_clean":"2024-03-30T01:51:36.356748+0000","last_became_active":"2024-03-30T01:51:32.821907+0000","last_became_peered":"2024-03-30T01:51:32.821907+0000","last_unstale":"2024-03-30T01:51:36.356748+0000","last_undegraded":"2024-03-30T01:51:36.356748+0000","last_fullsized":"2024-03-30T01:51:36.356748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T07:15:13.311008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793836+0000","last_change":"2024-03-30T01:51:32.810773+0000","last_active":"2024-03-30T01:51:33.793836+0000","last_peered":"2024-03-30T01:51:33.793836+0000","last_clean":"2024-03-30T01:51:33.793836+0000","last_became_active":"2024-03-30T01:51:32.810446+0000","last_became_peered":"2024-03-30T01:51:32.810446+0000","last_unstale":"2024-03-30T01:51:33.793836+0000","last_undegraded":"2024-03-30T01:51:33.793836+0000","last_fullsized":"2024-03-30T01:51:33.793836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357256+0000","last_change":"2024-03-30T01:51:32.824519+0000","last_active":"2024-03-30T01:51:36.357256+0000","last_peered":"2024-03-30T01:51:36.357256+0000","last_clean":"2024-03-30T01:51:36.357256+0000","last_became_active":"2024-03-30T01:51:32.824210+0000","last_became_peered":"2024-03-30T01:51:32.824210+0000","last_unstale":"2024-03-30T01:51:36.357256+0000","last_undegraded":"2024-03-30T01:51:36.357256+0000","last_fullsized":"2024-03-30T01:51:36.357256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:16:16.111272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359568+0000","last_change":"2024-03-30T01:51:32.823849+0000","last_active":"2024-03-30T01:51:36.359568+0000","last_peered":"2024-03-30T01:51:36.359568+0000","last_clean":"2024-03-30T01:51:36.359568+0000","last_became_active":"2024-03-30T01:51:32.823467+0000","last_became_peered":"2024-03-30T01:51:32.823467+0000","last_unstale":"2024-03-30T01:51:36.359568+0000","last_undegraded":"2024-03-30T01:51:36.359568+0000","last_fullsized":"2024-03-30T01:51:36.359568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792289+0000","last_change":"2024-03-30T01:51:32.815312+0000","last_active":"2024-03-30T01:51:33.792289+0000","last_peered":"2024-03-30T01:51:33.792289+0000","last_clean":"2024-03-30T01:51:33.792289+0000","last_became_active":"2024-03-30T01:51:32.814565+0000","last_became_peered":"2024-03-30T01:51:32.814565+0000","last_unstale":"2024-03-30T01:51:33.792289+0000","last_undegraded":"2024-03-30T01:51:33.792289+0000","last_fullsized":"2024-03-30T01:51:33.792289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:31:32.555378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357196+0000","last_change":"2024-03-30T01:51:32.821245+0000","last_active":"2024-03-30T01:51:36.357196+0000","last_peered":"2024-03-30T01:51:36.357196+0000","last_clean":"2024-03-30T01:51:36.357196+0000","last_became_active":"2024-03-30T01:51:32.821080+0000","last_became_peered":"2024-03-30T01:51:32.821080+0000","last_unstale":"2024-03-30T01:51:36.357196+0000","last_undegraded":"2024-03-30T01:51:36.357196+0000","last_fullsized":"2024-03-30T01:51:36.357196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:48.498455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951866+0000","last_change":"2024-03-30T01:51:32.795415+0000","last_active":"2024-03-30T01:51:33.951866+0000","last_peered":"2024-03-30T01:51:33.951866+0000","last_clean":"2024-03-30T01:51:33.951866+0000","last_became_active":"2024-03-30T01:51:32.795077+0000","last_became_peered":"2024-03-30T01:51:32.795077+0000","last_unstale":"2024-03-30T01:51:33.951866+0000","last_undegraded":"2024-03-30T01:51:33.951866+0000","last_fullsized":"2024-03-30T01:51:33.951866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794033+0000","last_change":"2024-03-30T01:51:32.809765+0000","last_active":"2024-03-30T01:51:33.794033+0000","last_peered":"2024-03-30T01:51:33.794033+0000","last_clean":"2024-03-30T01:51:33.794033+0000","last_became_active":"2024-03-30T01:51:32.809483+0000","last_became_peered":"2024-03-30T01:51:32.809483+0000","last_unstale":"2024-03-30T01:51:33.794033+0000","last_undegraded":"2024-03-30T01:51:33.794033+0000","last_fullsized":"2024-03-30T01:51:33.794033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:12:19.249116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356211+0000","last_change":"2024-03-30T01:51:32.802662+0000","last_active":"2024-03-30T01:51:36.356211+0000","last_peered":"2024-03-30T01:51:36.356211+0000","last_clean":"2024-03-30T01:51:36.356211+0000","last_became_active":"2024-03-30T01:51:32.802418+0000","last_became_peered":"2024-03-30T01:51:32.802418+0000","last_unstale":"2024-03-30T01:51:36.356211+0000","last_undegraded":"2024-03-30T01:51:36.356211+0000","last_fullsized":"2024-03-30T01:51:36.356211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:29.404661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.358729+0000","last_change":"2024-03-30T01:51:32.825195+0000","last_active":"2024-03-30T01:51:36.358729+0000","last_peered":"2024-03-30T01:51:36.358729+0000","last_clean":"2024-03-30T01:51:36.358729+0000","last_became_active":"2024-03-30T01:51:32.824918+0000","last_became_peered":"2024-03-30T01:51:32.824918+0000","last_unstale":"2024-03-30T01:51:36.358729+0000","last_undegraded":"2024-03-30T01:51:36.358729+0000","last_fullsized":"2024-03-30T01:51:36.358729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:16:16.111272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793866+0000","last_change":"2024-03-30T01:51:32.818991+0000","last_active":"2024-03-30T01:51:33.793866+0000","last_peered":"2024-03-30T01:51:33.793866+0000","last_clean":"2024-03-30T01:51:33.793866+0000","last_became_active":"2024-03-30T01:51:32.818661+0000","last_became_peered":"2024-03-30T01:51:32.818661+0000","last_unstale":"2024-03-30T01:51:33.793866+0000","last_undegraded":"2024-03-30T01:51:33.793866+0000","last_fullsized":"2024-03-30T01:51:33.793866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:16:48.714780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.827029+0000","last_change":"2024-03-30T01:51:32.334786+0000","last_active":"2024-03-30T01:51:32.827029+0000","last_peered":"2024-03-30T01:51:32.827029+0000","last_clean":"2024-03-30T01:51:32.827029+0000","last_became_active":"2024-03-30T01:51:32.334439+0000","last_became_peered":"2024-03-30T01:51:32.334439+0000","last_unstale":"2024-03-30T01:51:32.827029+0000","last_undegraded":"2024-03-30T01:51:32.827029+0000","last_fullsized":"2024-03-30T01:51:32.827029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:16:10.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951993+0000","last_change":"2024-03-30T01:51:32.802436+0000","last_active":"2024-03-30T01:51:33.951993+0000","last_peered":"2024-03-30T01:51:33.951993+0000","last_clean":"2024-03-30T01:51:33.951993+0000","last_became_active":"2024-03-30T01:51:32.802174+0000","last_became_peered":"2024-03-30T01:51:32.802174+0000","last_unstale":"2024-03-30T01:51:33.951993+0000","last_undegraded":"2024-03-30T01:51:33.951993+0000","last_fullsized":"2024-03-30T01:51:33.951993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T07:15:13.311008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.831313+0000","last_change":"2024-03-30T01:51:32.333125+0000","last_active":"2024-03-30T01:51:32.831313+0000","last_peered":"2024-03-30T01:51:32.831313+0000","last_clean":"2024-03-30T01:51:32.831313+0000","last_became_active":"2024-03-30T01:51:32.332556+0000","last_became_peered":"2024-03-30T01:51:32.332556+0000","last_unstale":"2024-03-30T01:51:32.831313+0000","last_undegraded":"2024-03-30T01:51:32.831313+0000","last_fullsized":"2024-03-30T01:51:32.831313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.801373+0000","last_change":"2024-03-30T01:51:32.339115+0000","last_active":"2024-03-30T01:51:32.801373+0000","last_peered":"2024-03-30T01:51:32.801373+0000","last_clean":"2024-03-30T01:51:32.801373+0000","last_became_active":"2024-03-30T01:51:32.338822+0000","last_became_peered":"2024-03-30T01:51:32.338822+0000","last_unstale":"2024-03-30T01:51:32.801373+0000","last_undegraded":"2024-03-30T01:51:32.801373+0000","last_fullsized":"2024-03-30T01:51:32.801373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356877+0000","last_change":"2024-03-30T01:51:32.800804+0000","last_active":"2024-03-30T01:51:36.356877+0000","last_peered":"2024-03-30T01:51:36.356877+0000","last_clean":"2024-03-30T01:51:36.356877+0000","last_became_active":"2024-03-30T01:51:32.800357+0000","last_became_peered":"2024-03-30T01:51:32.800357+0000","last_unstale":"2024-03-30T01:51:36.356877+0000","last_undegraded":"2024-03-30T01:51:36.356877+0000","last_fullsized":"2024-03-30T01:51:36.356877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:12:19.249116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.789786+0000","last_change":"2024-03-30T01:51:32.324045+0000","last_active":"2024-03-30T01:51:32.789786+0000","last_peered":"2024-03-30T01:51:32.789786+0000","last_clean":"2024-03-30T01:51:32.789786+0000","last_became_active":"2024-03-30T01:51:32.323466+0000","last_became_peered":"2024-03-30T01:51:32.323466+0000","last_unstale":"2024-03-30T01:51:32.789786+0000","last_undegraded":"2024-03-30T01:51:32.789786+0000","last_fullsized":"2024-03-30T01:51:32.789786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:16.099108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791017+0000","last_change":"2024-03-30T01:51:32.809356+0000","last_active":"2024-03-30T01:51:33.791017+0000","last_peered":"2024-03-30T01:51:33.791017+0000","last_clean":"2024-03-30T01:51:33.791017+0000","last_became_active":"2024-03-30T01:51:32.809059+0000","last_became_peered":"2024-03-30T01:51:32.809059+0000","last_unstale":"2024-03-30T01:51:33.791017+0000","last_undegraded":"2024-03-30T01:51:33.791017+0000","last_fullsized":"2024-03-30T01:51:33.791017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.809422+0000","last_change":"2024-03-30T01:51:32.339350+0000","last_active":"2024-03-30T01:51:32.809422+0000","last_peered":"2024-03-30T01:51:32.809422+0000","last_clean":"2024-03-30T01:51:32.809422+0000","last_became_active":"2024-03-30T01:51:32.338514+0000","last_became_peered":"2024-03-30T01:51:32.338514+0000","last_unstale":"2024-03-30T01:51:32.809422+0000","last_undegraded":"2024-03-30T01:51:32.809422+0000","last_fullsized":"2024-03-30T01:51:32.809422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:49:06.802141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792834+0000","last_change":"2024-03-30T01:51:32.816915+0000","last_active":"2024-03-30T01:51:33.792834+0000","last_peered":"2024-03-30T01:51:33.792834+0000","last_clean":"2024-03-30T01:51:33.792834+0000","last_became_active":"2024-03-30T01:51:32.814653+0000","last_became_peered":"2024-03-30T01:51:32.814653+0000","last_unstale":"2024-03-30T01:51:33.792834+0000","last_undegraded":"2024-03-30T01:51:33.792834+0000","last_fullsized":"2024-03-30T01:51:33.792834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:08:35.439480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.791633+0000","last_change":"2024-03-30T01:51:32.341633+0000","last_active":"2024-03-30T01:51:32.791633+0000","last_peered":"2024-03-30T01:51:32.791633+0000","last_clean":"2024-03-30T01:51:32.791633+0000","last_became_active":"2024-03-30T01:51:32.341346+0000","last_became_peered":"2024-03-30T01:51:32.341346+0000","last_unstale":"2024-03-30T01:51:32.791633+0000","last_undegraded":"2024-03-30T01:51:32.791633+0000","last_fullsized":"2024-03-30T01:51:32.791633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.952480+0000","last_change":"2024-03-30T01:51:32.798259+0000","last_active":"2024-03-30T01:51:33.952480+0000","last_peered":"2024-03-30T01:51:33.952480+0000","last_clean":"2024-03-30T01:51:33.952480+0000","last_became_active":"2024-03-30T01:51:32.797868+0000","last_became_peered":"2024-03-30T01:51:32.797868+0000","last_unstale":"2024-03-30T01:51:33.952480+0000","last_undegraded":"2024-03-30T01:51:33.952480+0000","last_fullsized":"2024-03-30T01:51:33.952480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.829577+0000","last_change":"2024-03-30T01:51:32.335884+0000","last_active":"2024-03-30T01:51:32.829577+0000","last_peered":"2024-03-30T01:51:32.829577+0000","last_clean":"2024-03-30T01:51:32.829577+0000","last_became_active":"2024-03-30T01:51:32.335615+0000","last_became_peered":"2024-03-30T01:51:32.335615+0000","last_unstale":"2024-03-30T01:51:32.829577+0000","last_undegraded":"2024-03-30T01:51:32.829577+0000","last_fullsized":"2024-03-30T01:51:32.829577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794581+0000","last_change":"2024-03-30T01:51:32.817329+0000","last_active":"2024-03-30T01:51:33.794581+0000","last_peered":"2024-03-30T01:51:33.794581+0000","last_clean":"2024-03-30T01:51:33.794581+0000","last_became_active":"2024-03-30T01:51:32.817034+0000","last_became_peered":"2024-03-30T01:51:32.817034+0000","last_unstale":"2024-03-30T01:51:33.794581+0000","last_undegraded":"2024-03-30T01:51:33.794581+0000","last_fullsized":"2024-03-30T01:51:33.794581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:29.404661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.838419+0000","last_change":"2024-03-30T01:51:32.344369+0000","last_active":"2024-03-30T01:51:32.838419+0000","last_peered":"2024-03-30T01:51:32.838419+0000","last_clean":"2024-03-30T01:51:32.838419+0000","last_became_active":"2024-03-30T01:51:32.344031+0000","last_became_peered":"2024-03-30T01:51:32.344031+0000","last_unstale":"2024-03-30T01:51:32.838419+0000","last_undegraded":"2024-03-30T01:51:32.838419+0000","last_fullsized":"2024-03-30T01:51:32.838419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:16:10.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350569+0000","last_change":"2024-03-30T01:51:32.822087+0000","last_active":"2024-03-30T01:51:34.350569+0000","last_peered":"2024-03-30T01:51:34.350569+0000","last_clean":"2024-03-30T01:51:34.350569+0000","last_became_active":"2024-03-30T01:51:32.821664+0000","last_became_peered":"2024-03-30T01:51:32.821664+0000","last_unstale":"2024-03-30T01:51:34.350569+0000","last_undegraded":"2024-03-30T01:51:34.350569+0000","last_fullsized":"2024-03-30T01:51:34.350569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:45:46.717709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.833595+0000","last_change":"2024-03-30T01:51:32.328895+0000","last_active":"2024-03-30T01:51:32.833595+0000","last_peered":"2024-03-30T01:51:32.833595+0000","last_clean":"2024-03-30T01:51:32.833595+0000","last_became_active":"2024-03-30T01:51:32.327604+0000","last_became_peered":"2024-03-30T01:51:32.327604+0000","last_unstale":"2024-03-30T01:51:32.833595+0000","last_undegraded":"2024-03-30T01:51:32.833595+0000","last_fullsized":"2024-03-30T01:51:32.833595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:18.328608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951478+0000","last_change":"2024-03-30T01:51:32.813992+0000","last_active":"2024-03-30T01:51:33.951478+0000","last_peered":"2024-03-30T01:51:33.951478+0000","last_clean":"2024-03-30T01:51:33.951478+0000","last_became_active":"2024-03-30T01:51:32.813751+0000","last_became_peered":"2024-03-30T01:51:32.813751+0000","last_unstale":"2024-03-30T01:51:33.951478+0000","last_undegraded":"2024-03-30T01:51:33.951478+0000","last_fullsized":"2024-03-30T01:51:33.951478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:48.498455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.794977+0000","last_change":"2024-03-30T01:51:32.326767+0000","last_active":"2024-03-30T01:51:32.794977+0000","last_peered":"2024-03-30T01:51:32.794977+0000","last_clean":"2024-03-30T01:51:32.794977+0000","last_became_active":"2024-03-30T01:51:32.326514+0000","last_became_peered":"2024-03-30T01:51:32.326514+0000","last_unstale":"2024-03-30T01:51:32.794977+0000","last_undegraded":"2024-03-30T01:51:32.794977+0000","last_fullsized":"2024-03-30T01:51:32.794977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:49:06.802141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350753+0000","last_change":"2024-03-30T01:51:32.831620+0000","last_active":"2024-03-30T01:51:34.350753+0000","last_peered":"2024-03-30T01:51:34.350753+0000","last_clean":"2024-03-30T01:51:34.350753+0000","last_became_active":"2024-03-30T01:51:32.829086+0000","last_became_peered":"2024-03-30T01:51:32.829086+0000","last_unstale":"2024-03-30T01:51:34.350753+0000","last_undegraded":"2024-03-30T01:51:34.350753+0000","last_fullsized":"2024-03-30T01:51:34.350753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:48:32.312063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.808536+0000","last_change":"2024-03-30T01:51:32.333519+0000","last_active":"2024-03-30T01:51:32.808536+0000","last_peered":"2024-03-30T01:51:32.808536+0000","last_clean":"2024-03-30T01:51:32.808536+0000","last_became_active":"2024-03-30T01:51:32.332785+0000","last_became_peered":"2024-03-30T01:51:32.332785+0000","last_unstale":"2024-03-30T01:51:32.808536+0000","last_undegraded":"2024-03-30T01:51:32.808536+0000","last_fullsized":"2024-03-30T01:51:32.808536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.358827+0000","last_change":"2024-03-30T01:51:32.820310+0000","last_active":"2024-03-30T01:51:36.358827+0000","last_peered":"2024-03-30T01:51:36.358827+0000","last_clean":"2024-03-30T01:51:36.358827+0000","last_became_active":"2024-03-30T01:51:32.819632+0000","last_became_peered":"2024-03-30T01:51:32.819632+0000","last_unstale":"2024-03-30T01:51:36.358827+0000","last_undegraded":"2024-03-30T01:51:36.358827+0000","last_fullsized":"2024-03-30T01:51:36.358827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:24:14.776848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.816543+0000","last_change":"2024-03-30T01:51:32.320300+0000","last_active":"2024-03-30T01:51:32.816543+0000","last_peered":"2024-03-30T01:51:32.816543+0000","last_clean":"2024-03-30T01:51:32.816543+0000","last_became_active":"2024-03-30T01:51:32.319459+0000","last_became_peered":"2024-03-30T01:51:32.319459+0000","last_unstale":"2024-03-30T01:51:32.816543+0000","last_undegraded":"2024-03-30T01:51:32.816543+0000","last_fullsized":"2024-03-30T01:51:32.816543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:16:10.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350739+0000","last_change":"2024-03-30T01:51:32.824724+0000","last_active":"2024-03-30T01:51:34.350739+0000","last_peered":"2024-03-30T01:51:34.350739+0000","last_clean":"2024-03-30T01:51:34.350739+0000","last_became_active":"2024-03-30T01:51:32.824435+0000","last_became_peered":"2024-03-30T01:51:32.824435+0000","last_unstale":"2024-03-30T01:51:34.350739+0000","last_undegraded":"2024-03-30T01:51:34.350739+0000","last_fullsized":"2024-03-30T01:51:34.350739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T04:10:09.271050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.830672+0000","last_change":"2024-03-30T01:51:32.324209+0000","last_active":"2024-03-30T01:51:32.830672+0000","last_peered":"2024-03-30T01:51:32.830672+0000","last_clean":"2024-03-30T01:51:32.830672+0000","last_became_active":"2024-03-30T01:51:32.323909+0000","last_became_peered":"2024-03-30T01:51:32.323909+0000","last_unstale":"2024-03-30T01:51:32.830672+0000","last_undegraded":"2024-03-30T01:51:32.830672+0000","last_fullsized":"2024-03-30T01:51:32.830672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:29:54.309497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.351210+0000","last_change":"2024-03-30T01:51:32.829602+0000","last_active":"2024-03-30T01:51:34.351210+0000","last_peered":"2024-03-30T01:51:34.351210+0000","last_clean":"2024-03-30T01:51:34.351210+0000","last_became_active":"2024-03-30T01:51:32.829279+0000","last_became_peered":"2024-03-30T01:51:32.829279+0000","last_unstale":"2024-03-30T01:51:34.351210+0000","last_undegraded":"2024-03-30T01:51:34.351210+0000","last_fullsized":"2024-03-30T01:51:34.351210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:15:59.657625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.819729+0000","last_change":"2024-03-30T01:51:32.329496+0000","last_active":"2024-03-30T01:51:32.819729+0000","last_peered":"2024-03-30T01:51:32.819729+0000","last_clean":"2024-03-30T01:51:32.819729+0000","last_became_active":"2024-03-30T01:51:32.329197+0000","last_became_peered":"2024-03-30T01:51:32.329197+0000","last_unstale":"2024-03-30T01:51:32.819729+0000","last_undegraded":"2024-03-30T01:51:32.819729+0000","last_fullsized":"2024-03-30T01:51:32.819729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.351541+0000","last_change":"2024-03-30T01:51:32.829567+0000","last_active":"2024-03-30T01:51:34.351541+0000","last_peered":"2024-03-30T01:51:34.351541+0000","last_clean":"2024-03-30T01:51:34.351541+0000","last_became_active":"2024-03-30T01:51:32.829295+0000","last_became_peered":"2024-03-30T01:51:32.829295+0000","last_unstale":"2024-03-30T01:51:34.351541+0000","last_undegraded":"2024-03-30T01:51:34.351541+0000","last_fullsized":"2024-03-30T01:51:34.351541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:50.171426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.830796+0000","last_change":"2024-03-30T01:51:32.331167+0000","last_active":"2024-03-30T01:51:32.830796+0000","last_peered":"2024-03-30T01:51:32.830796+0000","last_clean":"2024-03-30T01:51:32.830796+0000","last_became_active":"2024-03-30T01:51:32.330851+0000","last_became_peered":"2024-03-30T01:51:32.330851+0000","last_unstale":"2024-03-30T01:51:32.830796+0000","last_undegraded":"2024-03-30T01:51:32.830796+0000","last_fullsized":"2024-03-30T01:51:32.830796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:43:13.165559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792872+0000","last_change":"2024-03-30T01:51:32.806466+0000","last_active":"2024-03-30T01:51:33.792872+0000","last_peered":"2024-03-30T01:51:33.792872+0000","last_clean":"2024-03-30T01:51:33.792872+0000","last_became_active":"2024-03-30T01:51:32.800403+0000","last_became_peered":"2024-03-30T01:51:32.800403+0000","last_unstale":"2024-03-30T01:51:33.792872+0000","last_undegraded":"2024-03-30T01:51:33.792872+0000","last_fullsized":"2024-03-30T01:51:33.792872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.801178+0000","last_change":"2024-03-30T01:51:32.328539+0000","last_active":"2024-03-30T01:51:32.801178+0000","last_peered":"2024-03-30T01:51:32.801178+0000","last_clean":"2024-03-30T01:51:32.801178+0000","last_became_active":"2024-03-30T01:51:32.328066+0000","last_became_peered":"2024-03-30T01:51:32.328066+0000","last_unstale":"2024-03-30T01:51:32.801178+0000","last_undegraded":"2024-03-30T01:51:32.801178+0000","last_fullsized":"2024-03-30T01:51:32.801178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:18.328608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350589+0000","last_change":"2024-03-30T01:51:32.831571+0000","last_active":"2024-03-30T01:51:34.350589+0000","last_peered":"2024-03-30T01:51:34.350589+0000","last_clean":"2024-03-30T01:51:34.350589+0000","last_became_active":"2024-03-30T01:51:32.830419+0000","last_became_peered":"2024-03-30T01:51:32.830419+0000","last_unstale":"2024-03-30T01:51:34.350589+0000","last_undegraded":"2024-03-30T01:51:34.350589+0000","last_fullsized":"2024-03-30T01:51:34.350589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:43:58.638314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.804265+0000","last_change":"2024-03-30T01:51:23.358245+0000","last_active":"2024-03-30T01:51:32.804265+0000","last_peered":"2024-03-30T01:51:32.804265+0000","last_clean":"2024-03-30T01:51:32.804265+0000","last_became_active":"2024-03-30T01:51:23.355914+0000","last_became_peered":"2024-03-30T01:51:23.355914+0000","last_unstale":"2024-03-30T01:51:32.804265+0000","last_undegraded":"2024-03-30T01:51:32.804265+0000","last_fullsized":"2024-03-30T01:51:32.804265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_clean_scrub_stamp":"2024-03-30T01:51:21.990253+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:21:19.291194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.789893+0000","last_change":"2024-03-30T01:51:32.328546+0000","last_active":"2024-03-30T01:51:32.789893+0000","last_peered":"2024-03-30T01:51:32.789893+0000","last_clean":"2024-03-30T01:51:32.789893+0000","last_became_active":"2024-03-30T01:51:32.328108+0000","last_became_peered":"2024-03-30T01:51:32.328108+0000","last_unstale":"2024-03-30T01:51:32.789893+0000","last_undegraded":"2024-03-30T01:51:32.789893+0000","last_fullsized":"2024-03-30T01:51:32.789893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356791+0000","last_change":"2024-03-30T01:51:32.817812+0000","last_active":"2024-03-30T01:51:36.356791+0000","last_peered":"2024-03-30T01:51:36.356791+0000","last_clean":"2024-03-30T01:51:36.356791+0000","last_became_active":"2024-03-30T01:51:32.816217+0000","last_became_peered":"2024-03-30T01:51:32.816217+0000","last_unstale":"2024-03-30T01:51:36.356791+0000","last_undegraded":"2024-03-30T01:51:36.356791+0000","last_fullsized":"2024-03-30T01:51:36.356791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.804176+0000","last_change":"2024-03-30T01:51:32.340288+0000","last_active":"2024-03-30T01:51:32.804176+0000","last_peered":"2024-03-30T01:51:32.804176+0000","last_clean":"2024-03-30T01:51:32.804176+0000","last_became_active":"2024-03-30T01:51:32.339870+0000","last_became_peered":"2024-03-30T01:51:32.339870+0000","last_unstale":"2024-03-30T01:51:32.804176+0000","last_undegraded":"2024-03-30T01:51:32.804176+0000","last_fullsized":"2024-03-30T01:51:32.804176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:28.389656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951417+0000","last_change":"2024-03-30T01:51:32.795840+0000","last_active":"2024-03-30T01:51:33.951417+0000","last_peered":"2024-03-30T01:51:33.951417+0000","last_clean":"2024-03-30T01:51:33.951417+0000","last_became_active":"2024-03-30T01:51:32.795458+0000","last_became_peered":"2024-03-30T01:51:32.795458+0000","last_unstale":"2024-03-30T01:51:33.951417+0000","last_undegraded":"2024-03-30T01:51:33.951417+0000","last_fullsized":"2024-03-30T01:51:33.951417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:24:14.776848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.798439+0000","last_change":"2024-03-30T01:51:32.332992+0000","last_active":"2024-03-30T01:51:32.798439+0000","last_peered":"2024-03-30T01:51:32.798439+0000","last_clean":"2024-03-30T01:51:32.798439+0000","last_became_active":"2024-03-30T01:51:32.332735+0000","last_became_peered":"2024-03-30T01:51:32.332735+0000","last_unstale":"2024-03-30T01:51:32.798439+0000","last_undegraded":"2024-03-30T01:51:32.798439+0000","last_fullsized":"2024-03-30T01:51:32.798439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:49:06.802141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791299+0000","last_change":"2024-03-30T01:51:32.812474+0000","last_active":"2024-03-30T01:51:33.791299+0000","last_peered":"2024-03-30T01:51:33.791299+0000","last_clean":"2024-03-30T01:51:33.791299+0000","last_became_active":"2024-03-30T01:51:32.812149+0000","last_became_peered":"2024-03-30T01:51:32.812149+0000","last_unstale":"2024-03-30T01:51:33.791299+0000","last_undegraded":"2024-03-30T01:51:33.791299+0000","last_fullsized":"2024-03-30T01:51:33.791299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:48.498455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.794770+0000","last_change":"2024-03-30T01:51:32.331651+0000","last_active":"2024-03-30T01:51:32.794770+0000","last_peered":"2024-03-30T01:51:32.794770+0000","last_clean":"2024-03-30T01:51:32.794770+0000","last_became_active":"2024-03-30T01:51:32.331150+0000","last_became_peered":"2024-03-30T01:51:32.331150+0000","last_unstale":"2024-03-30T01:51:32.794770+0000","last_undegraded":"2024-03-30T01:51:32.794770+0000","last_fullsized":"2024-03-30T01:51:32.794770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794329+0000","last_change":"2024-03-30T01:51:32.808411+0000","last_active":"2024-03-30T01:51:33.794329+0000","last_peered":"2024-03-30T01:51:33.794329+0000","last_clean":"2024-03-30T01:51:33.794329+0000","last_became_active":"2024-03-30T01:51:32.807032+0000","last_became_peered":"2024-03-30T01:51:32.807032+0000","last_unstale":"2024-03-30T01:51:33.794329+0000","last_undegraded":"2024-03-30T01:51:33.794329+0000","last_fullsized":"2024-03-30T01:51:33.794329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:43:14.180564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.805618+0000","last_change":"2024-03-30T01:51:32.332641+0000","last_active":"2024-03-30T01:51:32.805618+0000","last_peered":"2024-03-30T01:51:32.805618+0000","last_clean":"2024-03-30T01:51:32.805618+0000","last_became_active":"2024-03-30T01:51:32.332372+0000","last_became_peered":"2024-03-30T01:51:32.332372+0000","last_unstale":"2024-03-30T01:51:32.805618+0000","last_undegraded":"2024-03-30T01:51:32.805618+0000","last_fullsized":"2024-03-30T01:51:32.805618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:16.099108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793089+0000","last_change":"2024-03-30T01:51:32.801706+0000","last_active":"2024-03-30T01:51:33.793089+0000","last_peered":"2024-03-30T01:51:33.793089+0000","last_clean":"2024-03-30T01:51:33.793089+0000","last_became_active":"2024-03-30T01:51:32.799681+0000","last_became_peered":"2024-03-30T01:51:32.799681+0000","last_unstale":"2024-03-30T01:51:33.793089+0000","last_undegraded":"2024-03-30T01:51:33.793089+0000","last_fullsized":"2024-03-30T01:51:33.793089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:26:47.924608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.811947+0000","last_change":"2024-03-30T01:51:32.340251+0000","last_active":"2024-03-30T01:51:32.811947+0000","last_peered":"2024-03-30T01:51:32.811947+0000","last_clean":"2024-03-30T01:51:32.811947+0000","last_became_active":"2024-03-30T01:51:32.339947+0000","last_became_peered":"2024-03-30T01:51:32.339947+0000","last_unstale":"2024-03-30T01:51:32.811947+0000","last_undegraded":"2024-03-30T01:51:32.811947+0000","last_fullsized":"2024-03-30T01:51:32.811947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:16:47.699775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791546+0000","last_change":"2024-03-30T01:51:32.806047+0000","last_active":"2024-03-30T01:51:33.791546+0000","last_peered":"2024-03-30T01:51:33.791546+0000","last_clean":"2024-03-30T01:51:33.791546+0000","last_became_active":"2024-03-30T01:51:32.805805+0000","last_became_peered":"2024-03-30T01:51:32.805805+0000","last_unstale":"2024-03-30T01:51:33.791546+0000","last_undegraded":"2024-03-30T01:51:33.791546+0000","last_fullsized":"2024-03-30T01:51:33.791546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:13:08.942873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.807432+0000","last_change":"2024-03-30T01:51:32.342956+0000","last_active":"2024-03-30T01:51:32.807432+0000","last_peered":"2024-03-30T01:51:32.807432+0000","last_clean":"2024-03-30T01:51:32.807432+0000","last_became_active":"2024-03-30T01:51:32.342396+0000","last_became_peered":"2024-03-30T01:51:32.342396+0000","last_unstale":"2024-03-30T01:51:32.807432+0000","last_undegraded":"2024-03-30T01:51:32.807432+0000","last_fullsized":"2024-03-30T01:51:32.807432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:28.389656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357308+0000","last_change":"2024-03-30T01:51:32.821007+0000","last_active":"2024-03-30T01:51:36.357308+0000","last_peered":"2024-03-30T01:51:36.357308+0000","last_clean":"2024-03-30T01:51:36.357308+0000","last_became_active":"2024-03-30T01:51:32.820784+0000","last_became_peered":"2024-03-30T01:51:32.820784+0000","last_unstale":"2024-03-30T01:51:36.357308+0000","last_undegraded":"2024-03-30T01:51:36.357308+0000","last_fullsized":"2024-03-30T01:51:36.357308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:26:47.924608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.830948+0000","last_change":"2024-03-30T01:51:32.340196+0000","last_active":"2024-03-30T01:51:32.830948+0000","last_peered":"2024-03-30T01:51:32.830948+0000","last_clean":"2024-03-30T01:51:32.830948+0000","last_became_active":"2024-03-30T01:51:32.338419+0000","last_became_peered":"2024-03-30T01:51:32.338419+0000","last_unstale":"2024-03-30T01:51:32.830948+0000","last_undegraded":"2024-03-30T01:51:32.830948+0000","last_fullsized":"2024-03-30T01:51:32.830948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951714+0000","last_change":"2024-03-30T01:51:32.814179+0000","last_active":"2024-03-30T01:51:33.951714+0000","last_peered":"2024-03-30T01:51:33.951714+0000","last_clean":"2024-03-30T01:51:33.951714+0000","last_became_active":"2024-03-30T01:51:32.813873+0000","last_became_peered":"2024-03-30T01:51:32.813873+0000","last_unstale":"2024-03-30T01:51:33.951714+0000","last_undegraded":"2024-03-30T01:51:33.951714+0000","last_fullsized":"2024-03-30T01:51:33.951714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:13:08.942873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.804043+0000","last_change":"2024-03-30T01:51:32.339346+0000","last_active":"2024-03-30T01:51:32.804043+0000","last_peered":"2024-03-30T01:51:32.804043+0000","last_clean":"2024-03-30T01:51:32.804043+0000","last_became_active":"2024-03-30T01:51:32.339038+0000","last_became_peered":"2024-03-30T01:51:32.339038+0000","last_unstale":"2024-03-30T01:51:32.804043+0000","last_undegraded":"2024-03-30T01:51:32.804043+0000","last_fullsized":"2024-03-30T01:51:32.804043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793437+0000","last_change":"2024-03-30T01:51:32.803943+0000","last_active":"2024-03-30T01:51:33.793437+0000","last_peered":"2024-03-30T01:51:33.793437+0000","last_clean":"2024-03-30T01:51:33.793437+0000","last_became_active":"2024-03-30T01:51:32.802118+0000","last_became_peered":"2024-03-30T01:51:32.802118+0000","last_unstale":"2024-03-30T01:51:33.793437+0000","last_undegraded":"2024-03-30T01:51:33.793437+0000","last_fullsized":"2024-03-30T01:51:33.793437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:17.114113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.804568+0000","last_change":"2024-03-30T01:51:32.336889+0000","last_active":"2024-03-30T01:51:32.804568+0000","last_peered":"2024-03-30T01:51:32.804568+0000","last_clean":"2024-03-30T01:51:32.804568+0000","last_became_active":"2024-03-30T01:51:32.336560+0000","last_became_peered":"2024-03-30T01:51:32.336560+0000","last_unstale":"2024-03-30T01:51:32.804568+0000","last_undegraded":"2024-03-30T01:51:32.804568+0000","last_fullsized":"2024-03-30T01:51:32.804568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356993+0000","last_change":"2024-03-30T01:51:32.816142+0000","last_active":"2024-03-30T01:51:36.356993+0000","last_peered":"2024-03-30T01:51:36.356993+0000","last_clean":"2024-03-30T01:51:36.356993+0000","last_became_active":"2024-03-30T01:51:32.814782+0000","last_became_peered":"2024-03-30T01:51:32.814782+0000","last_unstale":"2024-03-30T01:51:36.356993+0000","last_undegraded":"2024-03-30T01:51:36.356993+0000","last_fullsized":"2024-03-30T01:51:36.356993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:13:08.942873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.805047+0000","last_change":"2024-03-30T01:51:32.334063+0000","last_active":"2024-03-30T01:51:32.805047+0000","last_peered":"2024-03-30T01:51:32.805047+0000","last_clean":"2024-03-30T01:51:32.805047+0000","last_became_active":"2024-03-30T01:51:32.332760+0000","last_became_peered":"2024-03-30T01:51:32.332760+0000","last_unstale":"2024-03-30T01:51:32.805047+0000","last_undegraded":"2024-03-30T01:51:32.805047+0000","last_fullsized":"2024-03-30T01:51:32.805047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357089+0000","last_change":"2024-03-30T01:51:32.808609+0000","last_active":"2024-03-30T01:51:36.357089+0000","last_peered":"2024-03-30T01:51:36.357089+0000","last_clean":"2024-03-30T01:51:36.357089+0000","last_became_active":"2024-03-30T01:51:32.803595+0000","last_became_peered":"2024-03-30T01:51:32.803595+0000","last_unstale":"2024-03-30T01:51:36.357089+0000","last_undegraded":"2024-03-30T01:51:36.357089+0000","last_fullsized":"2024-03-30T01:51:36.357089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:31:32.555378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.832173+0000","last_change":"2024-03-30T01:51:32.340790+0000","last_active":"2024-03-30T01:51:32.832173+0000","last_peered":"2024-03-30T01:51:32.832173+0000","last_clean":"2024-03-30T01:51:32.832173+0000","last_became_active":"2024-03-30T01:51:32.340490+0000","last_became_peered":"2024-03-30T01:51:32.340490+0000","last_unstale":"2024-03-30T01:51:32.832173+0000","last_undegraded":"2024-03-30T01:51:32.832173+0000","last_fullsized":"2024-03-30T01:51:32.832173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:30:14.002651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359197+0000","last_change":"2024-03-30T01:51:32.827543+0000","last_active":"2024-03-30T01:51:36.359197+0000","last_peered":"2024-03-30T01:51:36.359197+0000","last_clean":"2024-03-30T01:51:36.359197+0000","last_became_active":"2024-03-30T01:51:32.827208+0000","last_became_peered":"2024-03-30T01:51:32.827208+0000","last_unstale":"2024-03-30T01:51:36.359197+0000","last_undegraded":"2024-03-30T01:51:36.359197+0000","last_fullsized":"2024-03-30T01:51:36.359197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:56:56.891377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792948+0000","last_change":"2024-03-30T01:51:32.796699+0000","last_active":"2024-03-30T01:51:33.792948+0000","last_peered":"2024-03-30T01:51:33.792948+0000","last_clean":"2024-03-30T01:51:33.792948+0000","last_became_active":"2024-03-30T01:51:32.796427+0000","last_became_peered":"2024-03-30T01:51:32.796427+0000","last_unstale":"2024-03-30T01:51:33.792948+0000","last_undegraded":"2024-03-30T01:51:33.792948+0000","last_fullsized":"2024-03-30T01:51:33.792948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:48:32.312063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.831028+0000","last_change":"2024-03-30T01:51:32.340270+0000","last_active":"2024-03-30T01:51:32.831028+0000","last_peered":"2024-03-30T01:51:32.831028+0000","last_clean":"2024-03-30T01:51:32.831028+0000","last_became_active":"2024-03-30T01:51:32.339869+0000","last_became_peered":"2024-03-30T01:51:32.339869+0000","last_unstale":"2024-03-30T01:51:32.831028+0000","last_undegraded":"2024-03-30T01:51:32.831028+0000","last_fullsized":"2024-03-30T01:51:32.831028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792626+0000","last_change":"2024-03-30T01:51:32.806687+0000","last_active":"2024-03-30T01:51:33.792626+0000","last_peered":"2024-03-30T01:51:33.792626+0000","last_clean":"2024-03-30T01:51:33.792626+0000","last_became_active":"2024-03-30T01:51:32.806461+0000","last_became_peered":"2024-03-30T01:51:32.806461+0000","last_unstale":"2024-03-30T01:51:33.792626+0000","last_undegraded":"2024-03-30T01:51:33.792626+0000","last_fullsized":"2024-03-30T01:51:33.792626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:15:59.657625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.833260+0000","last_change":"2024-03-30T01:51:32.343222+0000","last_active":"2024-03-30T01:51:32.833260+0000","last_peered":"2024-03-30T01:51:32.833260+0000","last_clean":"2024-03-30T01:51:32.833260+0000","last_became_active":"2024-03-30T01:51:32.342933+0000","last_became_peered":"2024-03-30T01:51:32.342933+0000","last_unstale":"2024-03-30T01:51:32.833260+0000","last_undegraded":"2024-03-30T01:51:32.833260+0000","last_fullsized":"2024-03-30T01:51:32.833260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:42:26.214040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.952250+0000","last_change":"2024-03-30T01:51:32.798373+0000","last_active":"2024-03-30T01:51:33.952250+0000","last_peered":"2024-03-30T01:51:33.952250+0000","last_clean":"2024-03-30T01:51:33.952250+0000","last_became_active":"2024-03-30T01:51:32.798184+0000","last_became_peered":"2024-03-30T01:51:32.798184+0000","last_unstale":"2024-03-30T01:51:33.952250+0000","last_undegraded":"2024-03-30T01:51:33.952250+0000","last_fullsized":"2024-03-30T01:51:33.952250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:12:19.249116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.826599+0000","last_change":"2024-03-30T01:51:32.336950+0000","last_active":"2024-03-30T01:51:32.826599+0000","last_peered":"2024-03-30T01:51:32.826599+0000","last_clean":"2024-03-30T01:51:32.826599+0000","last_became_active":"2024-03-30T01:51:32.336685+0000","last_became_peered":"2024-03-30T01:51:32.336685+0000","last_unstale":"2024-03-30T01:51:32.826599+0000","last_undegraded":"2024-03-30T01:51:32.826599+0000","last_fullsized":"2024-03-30T01:51:32.826599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:18.328608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357072+0000","last_change":"2024-03-30T01:51:32.818072+0000","last_active":"2024-03-30T01:51:36.357072+0000","last_peered":"2024-03-30T01:51:36.357072+0000","last_clean":"2024-03-30T01:51:36.357072+0000","last_became_active":"2024-03-30T01:51:32.816795+0000","last_became_peered":"2024-03-30T01:51:32.816795+0000","last_unstale":"2024-03-30T01:51:36.357072+0000","last_undegraded":"2024-03-30T01:51:36.357072+0000","last_fullsized":"2024-03-30T01:51:36.357072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:16:38.980879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.834008+0000","last_change":"2024-03-30T01:51:32.336309+0000","last_active":"2024-03-30T01:51:32.834008+0000","last_peered":"2024-03-30T01:51:32.834008+0000","last_clean":"2024-03-30T01:51:32.834008+0000","last_became_active":"2024-03-30T01:51:32.335769+0000","last_became_peered":"2024-03-30T01:51:32.335769+0000","last_unstale":"2024-03-30T01:51:32.834008+0000","last_undegraded":"2024-03-30T01:51:32.834008+0000","last_fullsized":"2024-03-30T01:51:32.834008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T07:39:05.794505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.605}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6779999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":66162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.49}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.811999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.9900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.109}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.6950000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.1520000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.8160000000000007}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7050000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7250000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.298}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.7949999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.1280000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.294}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9209999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.8600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":69879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,10],"upper_bound":32},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.742}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5150000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5389999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6639999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7769999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.859}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0249999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2530000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.992}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":660885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5980000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7230000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T01:51:42.200 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T01:51:42.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.411+0000 7f7d2c600640 1 Processor -- start 2024-03-30T01:51:42.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.412+0000 7f7d2c600640 1 -- start start 2024-03-30T01:51:42.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.413+0000 7f7d2c600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7d240d0af0 0x7f7d240cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:42.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.413+0000 7f7d2c600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7d240cf9b0 0x7f7d240b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:42.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.413+0000 7f7d2c600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d2415d030 con 0x7f7d2415cc50 2024-03-30T01:51:42.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.413+0000 7f7d2c600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d240d1c50 con 0x7f7d240d0af0 2024-03-30T01:51:42.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.413+0000 7f7d2c600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d240cfe20 con 0x7f7d240cf9b0 2024-03-30T01:51:42.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.413+0000 7f7d29200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7d240d0af0 0x7f7d240cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:42.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.413+0000 7f7d29c00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7d2415cc50 0x7f7d240d2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53916/0 (socket says 172.21.15.133:53916) 2024-03-30T01:51:42.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.413+0000 7f7d29200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7d240d0af0 0x7f7d240cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45900/0 (socket says 172.21.15.133:45900) 2024-03-30T01:51:42.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.413+0000 7f7d29c00640 1 -- 172.21.15.133:0/168866552 learned_addr learned my addr 172.21.15.133:0/168866552 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:42.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.414+0000 7f7d2a600640 1 --2- 172.21.15.133:0/168866552 >> v2:172.21.15.137:3300/0 conn(0x7f7d240cf9b0 0x7f7d240b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:42.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.414+0000 7f7d29200640 1 -- 172.21.15.133:0/168866552 >> v2:172.21.15.137:3300/0 conn(0x7f7d240cf9b0 msgr2=0x7f7d240b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:42.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.414+0000 7f7d29200640 1 --2- 172.21.15.133:0/168866552 >> v2:172.21.15.137:3300/0 conn(0x7f7d240cf9b0 0x7f7d240b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:42.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.414+0000 7f7d29200640 1 -- 172.21.15.133:0/168866552 >> v1:172.21.15.133:6789/0 conn(0x7f7d2415cc50 legacy=0x7f7d240d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:42.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.414+0000 7f7d29200640 1 -- 172.21.15.133:0/168866552 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d240b5af0 con 0x7f7d240d0af0 2024-03-30T01:51:42.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.414+0000 7f7d23e00640 1 -- 172.21.15.133:0/168866552 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607034783 0 0) 0x7f7d2415d030 con 0x7f7d2415cc50 2024-03-30T01:51:42.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.415+0000 7f7d29200640 1 --2- 172.21.15.133:0/168866552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d240d0af0 0x7f7d240cf470 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7d2406bd10 tx=0x7f7d1002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d428c57630fb43c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:42.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.415+0000 7f7d23e00640 1 -- 172.21.15.133:0/168866552 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d10031830 con 0x7f7d240d0af0 2024-03-30T01:51:42.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.415+0000 7f7d23e00640 1 -- 172.21.15.133:0/168866552 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d10031990 con 0x7f7d240d0af0 2024-03-30T01:51:42.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.415+0000 7f7d23e00640 1 -- 172.21.15.133:0/168866552 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d10031d20 con 0x7f7d240d0af0 2024-03-30T01:51:42.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.416+0000 7f7d2c600640 1 -- 172.21.15.133:0/168866552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d240d0af0 msgr2=0x7f7d240cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:42.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.416+0000 7f7d2c600640 1 --2- 172.21.15.133:0/168866552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d240d0af0 0x7f7d240cf470 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7d2406bd10 tx=0x7f7d1002b8d0 comp rx=0 tx=0).stop 2024-03-30T01:51:42.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.416+0000 7f7d2c600640 1 -- 172.21.15.133:0/168866552 shutdown_connections 2024-03-30T01:51:42.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.416+0000 7f7d2c600640 1 --2- 172.21.15.133:0/168866552 >> v2:172.21.15.137:3300/0 conn(0x7f7d240cf9b0 0x7f7d240b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:42.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.416+0000 7f7d2c600640 1 --2- 172.21.15.133:0/168866552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d240d0af0 0x7f7d240cf470 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:42.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.416+0000 7f7d2c600640 1 -- 172.21.15.133:0/168866552 >> 172.21.15.133:0/168866552 conn(0x7f7d24071a40 msgr2=0x7f7d2406b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:42.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.416+0000 7f7d2c600640 1 -- 172.21.15.133:0/168866552 shutdown_connections 2024-03-30T01:51:42.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.416+0000 7f7d2c600640 1 -- 172.21.15.133:0/168866552 wait complete. 2024-03-30T01:51:42.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.418+0000 7f7d2c600640 1 Processor -- start 2024-03-30T01:51:42.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.418+0000 7f7d2c600640 1 -- start start 2024-03-30T01:51:42.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.419+0000 7f7d2c600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d240cf9b0 0x7f7d241f2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:42.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.419+0000 7f7d2c600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d240d0af0 0x7f7d240cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:42.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.419+0000 7f7d2c600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d2415cc50 0x7f7d240ad380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:42.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.419+0000 7f7d2c600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d240cb870 con 0x7f7d240cf9b0 2024-03-30T01:51:42.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.419+0000 7f7d2c600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d240a9470 con 0x7f7d240d0af0 2024-03-30T01:51:42.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.419+0000 7f7d2c600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d241f3150 con 0x7f7d2415cc50 2024-03-30T01:51:42.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.419+0000 7f7d29c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d240cf9b0 0x7f7d241f2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:42.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.419+0000 7f7d29c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d240cf9b0 0x7f7d241f2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45904/0 (socket says 172.21.15.133:45904) 2024-03-30T01:51:42.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.419+0000 7f7d29c00640 1 -- 172.21.15.133:0/1880918897 learned_addr learned my addr 172.21.15.133:0/1880918897 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:42.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.419+0000 7f7d29200640 1 --2- 172.21.15.133:0/1880918897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d240d0af0 0x7f7d240cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:42.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.419+0000 7f7d2a600640 1 --2- 172.21.15.133:0/1880918897 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d2415cc50 0x7f7d240ad380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:42.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.419+0000 7f7d29c00640 1 -- 172.21.15.133:0/1880918897 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d2415cc50 msgr2=0x7f7d240ad380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:42.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.419+0000 7f7d29c00640 1 --2- 172.21.15.133:0/1880918897 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d2415cc50 0x7f7d240ad380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:42.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.419+0000 7f7d29c00640 1 -- 172.21.15.133:0/1880918897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d240d0af0 msgr2=0x7f7d240cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:42.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.419+0000 7f7d29c00640 1 --2- 172.21.15.133:0/1880918897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d240d0af0 0x7f7d240cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:42.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.419+0000 7f7d29c00640 1 -- 172.21.15.133:0/1880918897 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d10009400 con 0x7f7d240cf9b0 2024-03-30T01:51:42.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.419+0000 7f7d2a600640 1 --2- 172.21.15.133:0/1880918897 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d2415cc50 0x7f7d240ad380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:42.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.420+0000 7f7d29c00640 1 --2- 172.21.15.133:0/1880918897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d240cf9b0 0x7f7d241f2ac0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7d1800c430 tx=0x7f7d1800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:42.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.420+0000 7f7d21600640 1 -- 172.21.15.133:0/1880918897 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d18005ce0 con 0x7f7d240cf9b0 2024-03-30T01:51:42.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.420+0000 7f7d21600640 1 -- 172.21.15.133:0/1880918897 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d18005e40 con 0x7f7d240cf9b0 2024-03-30T01:51:42.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.420+0000 7f7d2c600640 1 -- 172.21.15.133:0/1880918897 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d241f3430 con 0x7f7d240cf9b0 2024-03-30T01:51:42.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.420+0000 7f7d21600640 1 -- 172.21.15.133:0/1880918897 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d18007310 con 0x7f7d240cf9b0 2024-03-30T01:51:42.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.420+0000 7f7d2c600640 1 -- 172.21.15.133:0/1880918897 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d241f39f0 con 0x7f7d240cf9b0 2024-03-30T01:51:42.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.421+0000 7f7d2c600640 1 -- 172.21.15.133:0/1880918897 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d24066d80 con 0x7f7d240cf9b0 2024-03-30T01:51:42.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.422+0000 7f7d21600640 1 -- 172.21.15.133:0/1880918897 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f7d18007470 con 0x7f7d240cf9b0 2024-03-30T01:51:42.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.423+0000 7f7d21600640 1 --2- 172.21.15.133:0/1880918897 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7d0406ac00 0x7f7d0406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:42.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.423+0000 7f7d21600640 1 -- 172.21.15.133:0/1880918897 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d18088990 con 0x7f7d240cf9b0 2024-03-30T01:51:42.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.423+0000 7f7d29200640 1 --2- 172.21.15.133:0/1880918897 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7d0406ac00 0x7f7d0406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:42.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.424+0000 7f7d29200640 1 --2- 172.21.15.133:0/1880918897 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7d0406ac00 0x7f7d0406d0c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7d10036000 tx=0x7f7d1003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:42.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.428+0000 7f7d21600640 1 -- 172.21.15.133:0/1880918897 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f7d18053b70 con 0x7f7d240cf9b0 2024-03-30T01:51:42.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.621+0000 7f7d2c600640 1 -- 172.21.15.133:0/1880918897 --> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d240d1690 con 0x7f7d0406ac00 2024-03-30T01:51:42.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.641+0000 7f7d21600640 1 -- 172.21.15.133:0/1880918897 <== mgr.4105 v2:172.21.15.133:6832/37234 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264559 (secure 0 0 0) 0x7f7d10045410 con 0x7f7d0406ac00 2024-03-30T01:51:42.651 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:42.652 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-03-30T01:51:42.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.646+0000 7f7d2c600640 1 -- 172.21.15.133:0/1880918897 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7d0406ac00 msgr2=0x7f7d0406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:42.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.647+0000 7f7d2c600640 1 --2- 172.21.15.133:0/1880918897 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7d0406ac00 0x7f7d0406d0c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7d10036000 tx=0x7f7d1003c040 comp rx=0 tx=0).stop 2024-03-30T01:51:42.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.647+0000 7f7d2c600640 1 -- 172.21.15.133:0/1880918897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d240cf9b0 msgr2=0x7f7d241f2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:42.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.647+0000 7f7d2c600640 1 --2- 172.21.15.133:0/1880918897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d240cf9b0 0x7f7d241f2ac0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7d1800c430 tx=0x7f7d1800c8f0 comp rx=0 tx=0).stop 2024-03-30T01:51:42.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.647+0000 7f7d2c600640 1 -- 172.21.15.133:0/1880918897 shutdown_connections 2024-03-30T01:51:42.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.647+0000 7f7d2c600640 1 --2- 172.21.15.133:0/1880918897 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7d0406ac00 0x7f7d0406d0c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:42.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.647+0000 7f7d2c600640 1 --2- 172.21.15.133:0/1880918897 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d2415cc50 0x7f7d240ad380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:42.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.647+0000 7f7d2c600640 1 --2- 172.21.15.133:0/1880918897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d240d0af0 0x7f7d240cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:42.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.647+0000 7f7d2c600640 1 --2- 172.21.15.133:0/1880918897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d240cf9b0 0x7f7d241f2ac0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:42.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.647+0000 7f7d2c600640 1 -- 172.21.15.133:0/1880918897 >> 172.21.15.133:0/1880918897 conn(0x7f7d24071a40 msgr2=0x7f7d240d2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:42.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.647+0000 7f7d2c600640 1 -- 172.21.15.133:0/1880918897 shutdown_connections 2024-03-30T01:51:42.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.647+0000 7f7d2c600640 1 -- 172.21.15.133:0/1880918897 wait complete. 2024-03-30T01:51:42.673 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-30T01:51:41.699437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218972,"kb_used_data":2804,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755748,"statfs":{"total":773094113280,"available":772869885952,"internally_reserved":0,"allocated":2871296,"data_stored":1744306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,10],"upper_bound":32},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.917342"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.351409+0000","last_change":"2024-03-30T01:51:32.812760+0000","last_active":"2024-03-30T01:51:34.351409+0000","last_peered":"2024-03-30T01:51:34.351409+0000","last_clean":"2024-03-30T01:51:34.351409+0000","last_became_active":"2024-03-30T01:51:32.812445+0000","last_became_peered":"2024-03-30T01:51:32.812445+0000","last_unstale":"2024-03-30T01:51:34.351409+0000","last_undegraded":"2024-03-30T01:51:34.351409+0000","last_fullsized":"2024-03-30T01:51:34.351409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:43.327711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791881+0000","last_change":"2024-03-30T01:51:32.811824+0000","last_active":"2024-03-30T01:51:33.791881+0000","last_peered":"2024-03-30T01:51:33.791881+0000","last_clean":"2024-03-30T01:51:33.791881+0000","last_became_active":"2024-03-30T01:51:32.811515+0000","last_became_peered":"2024-03-30T01:51:32.811515+0000","last_unstale":"2024-03-30T01:51:33.791881+0000","last_undegraded":"2024-03-30T01:51:33.791881+0000","last_fullsized":"2024-03-30T01:51:33.791881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951932+0000","last_change":"2024-03-30T01:51:32.799724+0000","last_active":"2024-03-30T01:51:33.951932+0000","last_peered":"2024-03-30T01:51:33.951932+0000","last_clean":"2024-03-30T01:51:33.951932+0000","last_became_active":"2024-03-30T01:51:32.799212+0000","last_became_peered":"2024-03-30T01:51:32.799212+0000","last_unstale":"2024-03-30T01:51:33.951932+0000","last_undegraded":"2024-03-30T01:51:33.951932+0000","last_fullsized":"2024-03-30T01:51:33.951932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:56:56.891377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792368+0000","last_change":"2024-03-30T01:51:32.806655+0000","last_active":"2024-03-30T01:51:33.792368+0000","last_peered":"2024-03-30T01:51:33.792368+0000","last_clean":"2024-03-30T01:51:33.792368+0000","last_became_active":"2024-03-30T01:51:32.806055+0000","last_became_peered":"2024-03-30T01:51:32.806055+0000","last_unstale":"2024-03-30T01:51:33.792368+0000","last_undegraded":"2024-03-30T01:51:33.792368+0000","last_fullsized":"2024-03-30T01:51:33.792368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:16:38.980879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350701+0000","last_change":"2024-03-30T01:51:32.820075+0000","last_active":"2024-03-30T01:51:34.350701+0000","last_peered":"2024-03-30T01:51:34.350701+0000","last_clean":"2024-03-30T01:51:34.350701+0000","last_became_active":"2024-03-30T01:51:32.819814+0000","last_became_peered":"2024-03-30T01:51:32.819814+0000","last_unstale":"2024-03-30T01:51:34.350701+0000","last_undegraded":"2024-03-30T01:51:34.350701+0000","last_fullsized":"2024-03-30T01:51:34.350701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:38:15.645425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793528+0000","last_change":"2024-03-30T01:51:32.803089+0000","last_active":"2024-03-30T01:51:33.793528+0000","last_peered":"2024-03-30T01:51:33.793528+0000","last_clean":"2024-03-30T01:51:33.793528+0000","last_became_active":"2024-03-30T01:51:32.802757+0000","last_became_peered":"2024-03-30T01:51:32.802757+0000","last_unstale":"2024-03-30T01:51:33.793528+0000","last_undegraded":"2024-03-30T01:51:33.793528+0000","last_fullsized":"2024-03-30T01:51:33.793528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:38:15.645425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350340+0000","last_change":"2024-03-30T01:51:32.818444+0000","last_active":"2024-03-30T01:51:34.350340+0000","last_peered":"2024-03-30T01:51:34.350340+0000","last_clean":"2024-03-30T01:51:34.350340+0000","last_became_active":"2024-03-30T01:51:32.818124+0000","last_became_peered":"2024-03-30T01:51:32.818124+0000","last_unstale":"2024-03-30T01:51:34.350340+0000","last_undegraded":"2024-03-30T01:51:34.350340+0000","last_fullsized":"2024-03-30T01:51:34.350340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:13:11.318115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357046+0000","last_change":"2024-03-30T01:51:32.821461+0000","last_active":"2024-03-30T01:51:36.357046+0000","last_peered":"2024-03-30T01:51:36.357046+0000","last_clean":"2024-03-30T01:51:36.357046+0000","last_became_active":"2024-03-30T01:51:32.821281+0000","last_became_peered":"2024-03-30T01:51:32.821281+0000","last_unstale":"2024-03-30T01:51:36.357046+0000","last_undegraded":"2024-03-30T01:51:36.357046+0000","last_fullsized":"2024-03-30T01:51:36.357046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.351614+0000","last_change":"2024-03-30T01:51:32.829942+0000","last_active":"2024-03-30T01:51:34.351614+0000","last_peered":"2024-03-30T01:51:34.351614+0000","last_clean":"2024-03-30T01:51:34.351614+0000","last_became_active":"2024-03-30T01:51:32.829594+0000","last_became_peered":"2024-03-30T01:51:32.829594+0000","last_unstale":"2024-03-30T01:51:34.351614+0000","last_undegraded":"2024-03-30T01:51:34.351614+0000","last_fullsized":"2024-03-30T01:51:34.351614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:43:22.251326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359569+0000","last_change":"2024-03-30T01:51:32.812680+0000","last_active":"2024-03-30T01:51:36.359569+0000","last_peered":"2024-03-30T01:51:36.359569+0000","last_clean":"2024-03-30T01:51:36.359569+0000","last_became_active":"2024-03-30T01:51:32.812333+0000","last_became_peered":"2024-03-30T01:51:32.812333+0000","last_unstale":"2024-03-30T01:51:36.359569+0000","last_undegraded":"2024-03-30T01:51:36.359569+0000","last_fullsized":"2024-03-30T01:51:36.359569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:13:08.942873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359121+0000","last_change":"2024-03-30T01:51:32.826749+0000","last_active":"2024-03-30T01:51:36.359121+0000","last_peered":"2024-03-30T01:51:36.359121+0000","last_clean":"2024-03-30T01:51:36.359121+0000","last_became_active":"2024-03-30T01:51:32.824642+0000","last_became_peered":"2024-03-30T01:51:32.824642+0000","last_unstale":"2024-03-30T01:51:36.359121+0000","last_undegraded":"2024-03-30T01:51:36.359121+0000","last_fullsized":"2024-03-30T01:51:36.359121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794544+0000","last_change":"2024-03-30T01:51:32.816597+0000","last_active":"2024-03-30T01:51:33.794544+0000","last_peered":"2024-03-30T01:51:33.794544+0000","last_clean":"2024-03-30T01:51:33.794544+0000","last_became_active":"2024-03-30T01:51:32.816310+0000","last_became_peered":"2024-03-30T01:51:32.816310+0000","last_unstale":"2024-03-30T01:51:33.794544+0000","last_undegraded":"2024-03-30T01:51:33.794544+0000","last_fullsized":"2024-03-30T01:51:33.794544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:42:27.229045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356973+0000","last_change":"2024-03-30T01:51:32.816094+0000","last_active":"2024-03-30T01:51:36.356973+0000","last_peered":"2024-03-30T01:51:36.356973+0000","last_clean":"2024-03-30T01:51:36.356973+0000","last_became_active":"2024-03-30T01:51:32.815841+0000","last_became_peered":"2024-03-30T01:51:32.815841+0000","last_unstale":"2024-03-30T01:51:36.356973+0000","last_undegraded":"2024-03-30T01:51:36.356973+0000","last_fullsized":"2024-03-30T01:51:36.356973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:08:35.439480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951373+0000","last_change":"2024-03-30T01:51:32.808528+0000","last_active":"2024-03-30T01:51:33.951373+0000","last_peered":"2024-03-30T01:51:33.951373+0000","last_clean":"2024-03-30T01:51:33.951373+0000","last_became_active":"2024-03-30T01:51:32.808290+0000","last_became_peered":"2024-03-30T01:51:32.808290+0000","last_unstale":"2024-03-30T01:51:33.951373+0000","last_undegraded":"2024-03-30T01:51:33.951373+0000","last_fullsized":"2024-03-30T01:51:33.951373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:16:16.111272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791232+0000","last_change":"2024-03-30T01:51:32.818830+0000","last_active":"2024-03-30T01:51:33.791232+0000","last_peered":"2024-03-30T01:51:33.791232+0000","last_clean":"2024-03-30T01:51:33.791232+0000","last_became_active":"2024-03-30T01:51:32.818684+0000","last_became_peered":"2024-03-30T01:51:32.818684+0000","last_unstale":"2024-03-30T01:51:33.791232+0000","last_undegraded":"2024-03-30T01:51:33.791232+0000","last_fullsized":"2024-03-30T01:51:33.791232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:12:19.249116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793142+0000","last_change":"2024-03-30T01:51:32.810544+0000","last_active":"2024-03-30T01:51:33.793142+0000","last_peered":"2024-03-30T01:51:33.793142+0000","last_clean":"2024-03-30T01:51:33.793142+0000","last_became_active":"2024-03-30T01:51:32.809383+0000","last_became_peered":"2024-03-30T01:51:32.809383+0000","last_unstale":"2024-03-30T01:51:33.793142+0000","last_undegraded":"2024-03-30T01:51:33.793142+0000","last_fullsized":"2024-03-30T01:51:33.793142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T04:10:09.271050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794103+0000","last_change":"2024-03-30T01:51:32.814598+0000","last_active":"2024-03-30T01:51:33.794103+0000","last_peered":"2024-03-30T01:51:33.794103+0000","last_clean":"2024-03-30T01:51:33.794103+0000","last_became_active":"2024-03-30T01:51:32.814343+0000","last_became_peered":"2024-03-30T01:51:32.814343+0000","last_unstale":"2024-03-30T01:51:33.794103+0000","last_undegraded":"2024-03-30T01:51:33.794103+0000","last_fullsized":"2024-03-30T01:51:33.794103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:45:46.717709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356214+0000","last_change":"2024-03-30T01:51:32.810030+0000","last_active":"2024-03-30T01:51:36.356214+0000","last_peered":"2024-03-30T01:51:36.356214+0000","last_clean":"2024-03-30T01:51:36.356214+0000","last_became_active":"2024-03-30T01:51:32.809667+0000","last_became_peered":"2024-03-30T01:51:32.809667+0000","last_unstale":"2024-03-30T01:51:36.356214+0000","last_undegraded":"2024-03-30T01:51:36.356214+0000","last_fullsized":"2024-03-30T01:51:36.356214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:43:14.180564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350888+0000","last_change":"2024-03-30T01:51:32.825796+0000","last_active":"2024-03-30T01:51:34.350888+0000","last_peered":"2024-03-30T01:51:34.350888+0000","last_clean":"2024-03-30T01:51:34.350888+0000","last_became_active":"2024-03-30T01:51:32.825501+0000","last_became_peered":"2024-03-30T01:51:32.825501+0000","last_unstale":"2024-03-30T01:51:34.350888+0000","last_undegraded":"2024-03-30T01:51:34.350888+0000","last_fullsized":"2024-03-30T01:51:34.350888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:16:38.980879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359143+0000","last_change":"2024-03-30T01:51:32.816941+0000","last_active":"2024-03-30T01:51:36.359143+0000","last_peered":"2024-03-30T01:51:36.359143+0000","last_clean":"2024-03-30T01:51:36.359143+0000","last_became_active":"2024-03-30T01:51:32.816645+0000","last_became_peered":"2024-03-30T01:51:32.816645+0000","last_unstale":"2024-03-30T01:51:36.359143+0000","last_undegraded":"2024-03-30T01:51:36.359143+0000","last_fullsized":"2024-03-30T01:51:36.359143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:42:27.229045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951735+0000","last_change":"2024-03-30T01:51:32.807172+0000","last_active":"2024-03-30T01:51:33.951735+0000","last_peered":"2024-03-30T01:51:33.951735+0000","last_clean":"2024-03-30T01:51:33.951735+0000","last_became_active":"2024-03-30T01:51:32.805878+0000","last_became_peered":"2024-03-30T01:51:32.805878+0000","last_unstale":"2024-03-30T01:51:33.951735+0000","last_undegraded":"2024-03-30T01:51:33.951735+0000","last_fullsized":"2024-03-30T01:51:33.951735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:04:01.115269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793786+0000","last_change":"2024-03-30T01:51:32.814459+0000","last_active":"2024-03-30T01:51:33.793786+0000","last_peered":"2024-03-30T01:51:33.793786+0000","last_clean":"2024-03-30T01:51:33.793786+0000","last_became_active":"2024-03-30T01:51:32.814174+0000","last_became_peered":"2024-03-30T01:51:32.814174+0000","last_unstale":"2024-03-30T01:51:33.793786+0000","last_undegraded":"2024-03-30T01:51:33.793786+0000","last_fullsized":"2024-03-30T01:51:33.793786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:50.171426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356748+0000","last_change":"2024-03-30T01:51:32.822182+0000","last_active":"2024-03-30T01:51:36.356748+0000","last_peered":"2024-03-30T01:51:36.356748+0000","last_clean":"2024-03-30T01:51:36.356748+0000","last_became_active":"2024-03-30T01:51:32.821907+0000","last_became_peered":"2024-03-30T01:51:32.821907+0000","last_unstale":"2024-03-30T01:51:36.356748+0000","last_undegraded":"2024-03-30T01:51:36.356748+0000","last_fullsized":"2024-03-30T01:51:36.356748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T07:15:13.311008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793836+0000","last_change":"2024-03-30T01:51:32.810773+0000","last_active":"2024-03-30T01:51:33.793836+0000","last_peered":"2024-03-30T01:51:33.793836+0000","last_clean":"2024-03-30T01:51:33.793836+0000","last_became_active":"2024-03-30T01:51:32.810446+0000","last_became_peered":"2024-03-30T01:51:32.810446+0000","last_unstale":"2024-03-30T01:51:33.793836+0000","last_undegraded":"2024-03-30T01:51:33.793836+0000","last_fullsized":"2024-03-30T01:51:33.793836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357256+0000","last_change":"2024-03-30T01:51:32.824519+0000","last_active":"2024-03-30T01:51:36.357256+0000","last_peered":"2024-03-30T01:51:36.357256+0000","last_clean":"2024-03-30T01:51:36.357256+0000","last_became_active":"2024-03-30T01:51:32.824210+0000","last_became_peered":"2024-03-30T01:51:32.824210+0000","last_unstale":"2024-03-30T01:51:36.357256+0000","last_undegraded":"2024-03-30T01:51:36.357256+0000","last_fullsized":"2024-03-30T01:51:36.357256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:16:16.111272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359568+0000","last_change":"2024-03-30T01:51:32.823849+0000","last_active":"2024-03-30T01:51:36.359568+0000","last_peered":"2024-03-30T01:51:36.359568+0000","last_clean":"2024-03-30T01:51:36.359568+0000","last_became_active":"2024-03-30T01:51:32.823467+0000","last_became_peered":"2024-03-30T01:51:32.823467+0000","last_unstale":"2024-03-30T01:51:36.359568+0000","last_undegraded":"2024-03-30T01:51:36.359568+0000","last_fullsized":"2024-03-30T01:51:36.359568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792289+0000","last_change":"2024-03-30T01:51:32.815312+0000","last_active":"2024-03-30T01:51:33.792289+0000","last_peered":"2024-03-30T01:51:33.792289+0000","last_clean":"2024-03-30T01:51:33.792289+0000","last_became_active":"2024-03-30T01:51:32.814565+0000","last_became_peered":"2024-03-30T01:51:32.814565+0000","last_unstale":"2024-03-30T01:51:33.792289+0000","last_undegraded":"2024-03-30T01:51:33.792289+0000","last_fullsized":"2024-03-30T01:51:33.792289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:31:32.555378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357196+0000","last_change":"2024-03-30T01:51:32.821245+0000","last_active":"2024-03-30T01:51:36.357196+0000","last_peered":"2024-03-30T01:51:36.357196+0000","last_clean":"2024-03-30T01:51:36.357196+0000","last_became_active":"2024-03-30T01:51:32.821080+0000","last_became_peered":"2024-03-30T01:51:32.821080+0000","last_unstale":"2024-03-30T01:51:36.357196+0000","last_undegraded":"2024-03-30T01:51:36.357196+0000","last_fullsized":"2024-03-30T01:51:36.357196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:48.498455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951866+0000","last_change":"2024-03-30T01:51:32.795415+0000","last_active":"2024-03-30T01:51:33.951866+0000","last_peered":"2024-03-30T01:51:33.951866+0000","last_clean":"2024-03-30T01:51:33.951866+0000","last_became_active":"2024-03-30T01:51:32.795077+0000","last_became_peered":"2024-03-30T01:51:32.795077+0000","last_unstale":"2024-03-30T01:51:33.951866+0000","last_undegraded":"2024-03-30T01:51:33.951866+0000","last_fullsized":"2024-03-30T01:51:33.951866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794033+0000","last_change":"2024-03-30T01:51:32.809765+0000","last_active":"2024-03-30T01:51:33.794033+0000","last_peered":"2024-03-30T01:51:33.794033+0000","last_clean":"2024-03-30T01:51:33.794033+0000","last_became_active":"2024-03-30T01:51:32.809483+0000","last_became_peered":"2024-03-30T01:51:32.809483+0000","last_unstale":"2024-03-30T01:51:33.794033+0000","last_undegraded":"2024-03-30T01:51:33.794033+0000","last_fullsized":"2024-03-30T01:51:33.794033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:12:19.249116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356211+0000","last_change":"2024-03-30T01:51:32.802662+0000","last_active":"2024-03-30T01:51:36.356211+0000","last_peered":"2024-03-30T01:51:36.356211+0000","last_clean":"2024-03-30T01:51:36.356211+0000","last_became_active":"2024-03-30T01:51:32.802418+0000","last_became_peered":"2024-03-30T01:51:32.802418+0000","last_unstale":"2024-03-30T01:51:36.356211+0000","last_undegraded":"2024-03-30T01:51:36.356211+0000","last_fullsized":"2024-03-30T01:51:36.356211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:29.404661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.358729+0000","last_change":"2024-03-30T01:51:32.825195+0000","last_active":"2024-03-30T01:51:36.358729+0000","last_peered":"2024-03-30T01:51:36.358729+0000","last_clean":"2024-03-30T01:51:36.358729+0000","last_became_active":"2024-03-30T01:51:32.824918+0000","last_became_peered":"2024-03-30T01:51:32.824918+0000","last_unstale":"2024-03-30T01:51:36.358729+0000","last_undegraded":"2024-03-30T01:51:36.358729+0000","last_fullsized":"2024-03-30T01:51:36.358729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:16:16.111272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793866+0000","last_change":"2024-03-30T01:51:32.818991+0000","last_active":"2024-03-30T01:51:33.793866+0000","last_peered":"2024-03-30T01:51:33.793866+0000","last_clean":"2024-03-30T01:51:33.793866+0000","last_became_active":"2024-03-30T01:51:32.818661+0000","last_became_peered":"2024-03-30T01:51:32.818661+0000","last_unstale":"2024-03-30T01:51:33.793866+0000","last_undegraded":"2024-03-30T01:51:33.793866+0000","last_fullsized":"2024-03-30T01:51:33.793866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:16:48.714780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.827029+0000","last_change":"2024-03-30T01:51:32.334786+0000","last_active":"2024-03-30T01:51:32.827029+0000","last_peered":"2024-03-30T01:51:32.827029+0000","last_clean":"2024-03-30T01:51:32.827029+0000","last_became_active":"2024-03-30T01:51:32.334439+0000","last_became_peered":"2024-03-30T01:51:32.334439+0000","last_unstale":"2024-03-30T01:51:32.827029+0000","last_undegraded":"2024-03-30T01:51:32.827029+0000","last_fullsized":"2024-03-30T01:51:32.827029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:16:10.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951993+0000","last_change":"2024-03-30T01:51:32.802436+0000","last_active":"2024-03-30T01:51:33.951993+0000","last_peered":"2024-03-30T01:51:33.951993+0000","last_clean":"2024-03-30T01:51:33.951993+0000","last_became_active":"2024-03-30T01:51:32.802174+0000","last_became_peered":"2024-03-30T01:51:32.802174+0000","last_unstale":"2024-03-30T01:51:33.951993+0000","last_undegraded":"2024-03-30T01:51:33.951993+0000","last_fullsized":"2024-03-30T01:51:33.951993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T07:15:13.311008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.831313+0000","last_change":"2024-03-30T01:51:32.333125+0000","last_active":"2024-03-30T01:51:32.831313+0000","last_peered":"2024-03-30T01:51:32.831313+0000","last_clean":"2024-03-30T01:51:32.831313+0000","last_became_active":"2024-03-30T01:51:32.332556+0000","last_became_peered":"2024-03-30T01:51:32.332556+0000","last_unstale":"2024-03-30T01:51:32.831313+0000","last_undegraded":"2024-03-30T01:51:32.831313+0000","last_fullsized":"2024-03-30T01:51:32.831313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.801373+0000","last_change":"2024-03-30T01:51:32.339115+0000","last_active":"2024-03-30T01:51:32.801373+0000","last_peered":"2024-03-30T01:51:32.801373+0000","last_clean":"2024-03-30T01:51:32.801373+0000","last_became_active":"2024-03-30T01:51:32.338822+0000","last_became_peered":"2024-03-30T01:51:32.338822+0000","last_unstale":"2024-03-30T01:51:32.801373+0000","last_undegraded":"2024-03-30T01:51:32.801373+0000","last_fullsized":"2024-03-30T01:51:32.801373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356877+0000","last_change":"2024-03-30T01:51:32.800804+0000","last_active":"2024-03-30T01:51:36.356877+0000","last_peered":"2024-03-30T01:51:36.356877+0000","last_clean":"2024-03-30T01:51:36.356877+0000","last_became_active":"2024-03-30T01:51:32.800357+0000","last_became_peered":"2024-03-30T01:51:32.800357+0000","last_unstale":"2024-03-30T01:51:36.356877+0000","last_undegraded":"2024-03-30T01:51:36.356877+0000","last_fullsized":"2024-03-30T01:51:36.356877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:12:19.249116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.789786+0000","last_change":"2024-03-30T01:51:32.324045+0000","last_active":"2024-03-30T01:51:32.789786+0000","last_peered":"2024-03-30T01:51:32.789786+0000","last_clean":"2024-03-30T01:51:32.789786+0000","last_became_active":"2024-03-30T01:51:32.323466+0000","last_became_peered":"2024-03-30T01:51:32.323466+0000","last_unstale":"2024-03-30T01:51:32.789786+0000","last_undegraded":"2024-03-30T01:51:32.789786+0000","last_fullsized":"2024-03-30T01:51:32.789786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:16.099108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791017+0000","last_change":"2024-03-30T01:51:32.809356+0000","last_active":"2024-03-30T01:51:33.791017+0000","last_peered":"2024-03-30T01:51:33.791017+0000","last_clean":"2024-03-30T01:51:33.791017+0000","last_became_active":"2024-03-30T01:51:32.809059+0000","last_became_peered":"2024-03-30T01:51:32.809059+0000","last_unstale":"2024-03-30T01:51:33.791017+0000","last_undegraded":"2024-03-30T01:51:33.791017+0000","last_fullsized":"2024-03-30T01:51:33.791017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.809422+0000","last_change":"2024-03-30T01:51:32.339350+0000","last_active":"2024-03-30T01:51:32.809422+0000","last_peered":"2024-03-30T01:51:32.809422+0000","last_clean":"2024-03-30T01:51:32.809422+0000","last_became_active":"2024-03-30T01:51:32.338514+0000","last_became_peered":"2024-03-30T01:51:32.338514+0000","last_unstale":"2024-03-30T01:51:32.809422+0000","last_undegraded":"2024-03-30T01:51:32.809422+0000","last_fullsized":"2024-03-30T01:51:32.809422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:49:06.802141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792834+0000","last_change":"2024-03-30T01:51:32.816915+0000","last_active":"2024-03-30T01:51:33.792834+0000","last_peered":"2024-03-30T01:51:33.792834+0000","last_clean":"2024-03-30T01:51:33.792834+0000","last_became_active":"2024-03-30T01:51:32.814653+0000","last_became_peered":"2024-03-30T01:51:32.814653+0000","last_unstale":"2024-03-30T01:51:33.792834+0000","last_undegraded":"2024-03-30T01:51:33.792834+0000","last_fullsized":"2024-03-30T01:51:33.792834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:08:35.439480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.791633+0000","last_change":"2024-03-30T01:51:32.341633+0000","last_active":"2024-03-30T01:51:32.791633+0000","last_peered":"2024-03-30T01:51:32.791633+0000","last_clean":"2024-03-30T01:51:32.791633+0000","last_became_active":"2024-03-30T01:51:32.341346+0000","last_became_peered":"2024-03-30T01:51:32.341346+0000","last_unstale":"2024-03-30T01:51:32.791633+0000","last_undegraded":"2024-03-30T01:51:32.791633+0000","last_fullsized":"2024-03-30T01:51:32.791633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.952480+0000","last_change":"2024-03-30T01:51:32.798259+0000","last_active":"2024-03-30T01:51:33.952480+0000","last_peered":"2024-03-30T01:51:33.952480+0000","last_clean":"2024-03-30T01:51:33.952480+0000","last_became_active":"2024-03-30T01:51:32.797868+0000","last_became_peered":"2024-03-30T01:51:32.797868+0000","last_unstale":"2024-03-30T01:51:33.952480+0000","last_undegraded":"2024-03-30T01:51:33.952480+0000","last_fullsized":"2024-03-30T01:51:33.952480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.829577+0000","last_change":"2024-03-30T01:51:32.335884+0000","last_active":"2024-03-30T01:51:32.829577+0000","last_peered":"2024-03-30T01:51:32.829577+0000","last_clean":"2024-03-30T01:51:32.829577+0000","last_became_active":"2024-03-30T01:51:32.335615+0000","last_became_peered":"2024-03-30T01:51:32.335615+0000","last_unstale":"2024-03-30T01:51:32.829577+0000","last_undegraded":"2024-03-30T01:51:32.829577+0000","last_fullsized":"2024-03-30T01:51:32.829577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794581+0000","last_change":"2024-03-30T01:51:32.817329+0000","last_active":"2024-03-30T01:51:33.794581+0000","last_peered":"2024-03-30T01:51:33.794581+0000","last_clean":"2024-03-30T01:51:33.794581+0000","last_became_active":"2024-03-30T01:51:32.817034+0000","last_became_peered":"2024-03-30T01:51:32.817034+0000","last_unstale":"2024-03-30T01:51:33.794581+0000","last_undegraded":"2024-03-30T01:51:33.794581+0000","last_fullsized":"2024-03-30T01:51:33.794581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:29.404661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.838419+0000","last_change":"2024-03-30T01:51:32.344369+0000","last_active":"2024-03-30T01:51:32.838419+0000","last_peered":"2024-03-30T01:51:32.838419+0000","last_clean":"2024-03-30T01:51:32.838419+0000","last_became_active":"2024-03-30T01:51:32.344031+0000","last_became_peered":"2024-03-30T01:51:32.344031+0000","last_unstale":"2024-03-30T01:51:32.838419+0000","last_undegraded":"2024-03-30T01:51:32.838419+0000","last_fullsized":"2024-03-30T01:51:32.838419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:16:10.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350569+0000","last_change":"2024-03-30T01:51:32.822087+0000","last_active":"2024-03-30T01:51:34.350569+0000","last_peered":"2024-03-30T01:51:34.350569+0000","last_clean":"2024-03-30T01:51:34.350569+0000","last_became_active":"2024-03-30T01:51:32.821664+0000","last_became_peered":"2024-03-30T01:51:32.821664+0000","last_unstale":"2024-03-30T01:51:34.350569+0000","last_undegraded":"2024-03-30T01:51:34.350569+0000","last_fullsized":"2024-03-30T01:51:34.350569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:45:46.717709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.833595+0000","last_change":"2024-03-30T01:51:32.328895+0000","last_active":"2024-03-30T01:51:32.833595+0000","last_peered":"2024-03-30T01:51:32.833595+0000","last_clean":"2024-03-30T01:51:32.833595+0000","last_became_active":"2024-03-30T01:51:32.327604+0000","last_became_peered":"2024-03-30T01:51:32.327604+0000","last_unstale":"2024-03-30T01:51:32.833595+0000","last_undegraded":"2024-03-30T01:51:32.833595+0000","last_fullsized":"2024-03-30T01:51:32.833595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:18.328608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951478+0000","last_change":"2024-03-30T01:51:32.813992+0000","last_active":"2024-03-30T01:51:33.951478+0000","last_peered":"2024-03-30T01:51:33.951478+0000","last_clean":"2024-03-30T01:51:33.951478+0000","last_became_active":"2024-03-30T01:51:32.813751+0000","last_became_peered":"2024-03-30T01:51:32.813751+0000","last_unstale":"2024-03-30T01:51:33.951478+0000","last_undegraded":"2024-03-30T01:51:33.951478+0000","last_fullsized":"2024-03-30T01:51:33.951478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:48.498455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.794977+0000","last_change":"2024-03-30T01:51:32.326767+0000","last_active":"2024-03-30T01:51:32.794977+0000","last_peered":"2024-03-30T01:51:32.794977+0000","last_clean":"2024-03-30T01:51:32.794977+0000","last_became_active":"2024-03-30T01:51:32.326514+0000","last_became_peered":"2024-03-30T01:51:32.326514+0000","last_unstale":"2024-03-30T01:51:32.794977+0000","last_undegraded":"2024-03-30T01:51:32.794977+0000","last_fullsized":"2024-03-30T01:51:32.794977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:49:06.802141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350753+0000","last_change":"2024-03-30T01:51:32.831620+0000","last_active":"2024-03-30T01:51:34.350753+0000","last_peered":"2024-03-30T01:51:34.350753+0000","last_clean":"2024-03-30T01:51:34.350753+0000","last_became_active":"2024-03-30T01:51:32.829086+0000","last_became_peered":"2024-03-30T01:51:32.829086+0000","last_unstale":"2024-03-30T01:51:34.350753+0000","last_undegraded":"2024-03-30T01:51:34.350753+0000","last_fullsized":"2024-03-30T01:51:34.350753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:48:32.312063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.808536+0000","last_change":"2024-03-30T01:51:32.333519+0000","last_active":"2024-03-30T01:51:32.808536+0000","last_peered":"2024-03-30T01:51:32.808536+0000","last_clean":"2024-03-30T01:51:32.808536+0000","last_became_active":"2024-03-30T01:51:32.332785+0000","last_became_peered":"2024-03-30T01:51:32.332785+0000","last_unstale":"2024-03-30T01:51:32.808536+0000","last_undegraded":"2024-03-30T01:51:32.808536+0000","last_fullsized":"2024-03-30T01:51:32.808536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.358827+0000","last_change":"2024-03-30T01:51:32.820310+0000","last_active":"2024-03-30T01:51:36.358827+0000","last_peered":"2024-03-30T01:51:36.358827+0000","last_clean":"2024-03-30T01:51:36.358827+0000","last_became_active":"2024-03-30T01:51:32.819632+0000","last_became_peered":"2024-03-30T01:51:32.819632+0000","last_unstale":"2024-03-30T01:51:36.358827+0000","last_undegraded":"2024-03-30T01:51:36.358827+0000","last_fullsized":"2024-03-30T01:51:36.358827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:24:14.776848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.816543+0000","last_change":"2024-03-30T01:51:32.320300+0000","last_active":"2024-03-30T01:51:32.816543+0000","last_peered":"2024-03-30T01:51:32.816543+0000","last_clean":"2024-03-30T01:51:32.816543+0000","last_became_active":"2024-03-30T01:51:32.319459+0000","last_became_peered":"2024-03-30T01:51:32.319459+0000","last_unstale":"2024-03-30T01:51:32.816543+0000","last_undegraded":"2024-03-30T01:51:32.816543+0000","last_fullsized":"2024-03-30T01:51:32.816543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:16:10.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350739+0000","last_change":"2024-03-30T01:51:32.824724+0000","last_active":"2024-03-30T01:51:34.350739+0000","last_peered":"2024-03-30T01:51:34.350739+0000","last_clean":"2024-03-30T01:51:34.350739+0000","last_became_active":"2024-03-30T01:51:32.824435+0000","last_became_peered":"2024-03-30T01:51:32.824435+0000","last_unstale":"2024-03-30T01:51:34.350739+0000","last_undegraded":"2024-03-30T01:51:34.350739+0000","last_fullsized":"2024-03-30T01:51:34.350739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T04:10:09.271050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.830672+0000","last_change":"2024-03-30T01:51:32.324209+0000","last_active":"2024-03-30T01:51:32.830672+0000","last_peered":"2024-03-30T01:51:32.830672+0000","last_clean":"2024-03-30T01:51:32.830672+0000","last_became_active":"2024-03-30T01:51:32.323909+0000","last_became_peered":"2024-03-30T01:51:32.323909+0000","last_unstale":"2024-03-30T01:51:32.830672+0000","last_undegraded":"2024-03-30T01:51:32.830672+0000","last_fullsized":"2024-03-30T01:51:32.830672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:29:54.309497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.351210+0000","last_change":"2024-03-30T01:51:32.829602+0000","last_active":"2024-03-30T01:51:34.351210+0000","last_peered":"2024-03-30T01:51:34.351210+0000","last_clean":"2024-03-30T01:51:34.351210+0000","last_became_active":"2024-03-30T01:51:32.829279+0000","last_became_peered":"2024-03-30T01:51:32.829279+0000","last_unstale":"2024-03-30T01:51:34.351210+0000","last_undegraded":"2024-03-30T01:51:34.351210+0000","last_fullsized":"2024-03-30T01:51:34.351210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:15:59.657625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.819729+0000","last_change":"2024-03-30T01:51:32.329496+0000","last_active":"2024-03-30T01:51:32.819729+0000","last_peered":"2024-03-30T01:51:32.819729+0000","last_clean":"2024-03-30T01:51:32.819729+0000","last_became_active":"2024-03-30T01:51:32.329197+0000","last_became_peered":"2024-03-30T01:51:32.329197+0000","last_unstale":"2024-03-30T01:51:32.819729+0000","last_undegraded":"2024-03-30T01:51:32.819729+0000","last_fullsized":"2024-03-30T01:51:32.819729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.351541+0000","last_change":"2024-03-30T01:51:32.829567+0000","last_active":"2024-03-30T01:51:34.351541+0000","last_peered":"2024-03-30T01:51:34.351541+0000","last_clean":"2024-03-30T01:51:34.351541+0000","last_became_active":"2024-03-30T01:51:32.829295+0000","last_became_peered":"2024-03-30T01:51:32.829295+0000","last_unstale":"2024-03-30T01:51:34.351541+0000","last_undegraded":"2024-03-30T01:51:34.351541+0000","last_fullsized":"2024-03-30T01:51:34.351541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:50.171426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.830796+0000","last_change":"2024-03-30T01:51:32.331167+0000","last_active":"2024-03-30T01:51:32.830796+0000","last_peered":"2024-03-30T01:51:32.830796+0000","last_clean":"2024-03-30T01:51:32.830796+0000","last_became_active":"2024-03-30T01:51:32.330851+0000","last_became_peered":"2024-03-30T01:51:32.330851+0000","last_unstale":"2024-03-30T01:51:32.830796+0000","last_undegraded":"2024-03-30T01:51:32.830796+0000","last_fullsized":"2024-03-30T01:51:32.830796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:43:13.165559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792872+0000","last_change":"2024-03-30T01:51:32.806466+0000","last_active":"2024-03-30T01:51:33.792872+0000","last_peered":"2024-03-30T01:51:33.792872+0000","last_clean":"2024-03-30T01:51:33.792872+0000","last_became_active":"2024-03-30T01:51:32.800403+0000","last_became_peered":"2024-03-30T01:51:32.800403+0000","last_unstale":"2024-03-30T01:51:33.792872+0000","last_undegraded":"2024-03-30T01:51:33.792872+0000","last_fullsized":"2024-03-30T01:51:33.792872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.801178+0000","last_change":"2024-03-30T01:51:32.328539+0000","last_active":"2024-03-30T01:51:32.801178+0000","last_peered":"2024-03-30T01:51:32.801178+0000","last_clean":"2024-03-30T01:51:32.801178+0000","last_became_active":"2024-03-30T01:51:32.328066+0000","last_became_peered":"2024-03-30T01:51:32.328066+0000","last_unstale":"2024-03-30T01:51:32.801178+0000","last_undegraded":"2024-03-30T01:51:32.801178+0000","last_fullsized":"2024-03-30T01:51:32.801178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:18.328608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350589+0000","last_change":"2024-03-30T01:51:32.831571+0000","last_active":"2024-03-30T01:51:34.350589+0000","last_peered":"2024-03-30T01:51:34.350589+0000","last_clean":"2024-03-30T01:51:34.350589+0000","last_became_active":"2024-03-30T01:51:32.830419+0000","last_became_peered":"2024-03-30T01:51:32.830419+0000","last_unstale":"2024-03-30T01:51:34.350589+0000","last_undegraded":"2024-03-30T01:51:34.350589+0000","last_fullsized":"2024-03-30T01:51:34.350589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:43:58.638314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.804265+0000","last_change":"2024-03-30T01:51:23.358245+0000","last_active":"2024-03-30T01:51:32.804265+0000","last_peered":"2024-03-30T01:51:32.804265+0000","last_clean":"2024-03-30T01:51:32.804265+0000","last_became_active":"2024-03-30T01:51:23.355914+0000","last_became_peered":"2024-03-30T01:51:23.355914+0000","last_unstale":"2024-03-30T01:51:32.804265+0000","last_undegraded":"2024-03-30T01:51:32.804265+0000","last_fullsized":"2024-03-30T01:51:32.804265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_clean_scrub_stamp":"2024-03-30T01:51:21.990253+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:21:19.291194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.789893+0000","last_change":"2024-03-30T01:51:32.328546+0000","last_active":"2024-03-30T01:51:32.789893+0000","last_peered":"2024-03-30T01:51:32.789893+0000","last_clean":"2024-03-30T01:51:32.789893+0000","last_became_active":"2024-03-30T01:51:32.328108+0000","last_became_peered":"2024-03-30T01:51:32.328108+0000","last_unstale":"2024-03-30T01:51:32.789893+0000","last_undegraded":"2024-03-30T01:51:32.789893+0000","last_fullsized":"2024-03-30T01:51:32.789893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356791+0000","last_change":"2024-03-30T01:51:32.817812+0000","last_active":"2024-03-30T01:51:36.356791+0000","last_peered":"2024-03-30T01:51:36.356791+0000","last_clean":"2024-03-30T01:51:36.356791+0000","last_became_active":"2024-03-30T01:51:32.816217+0000","last_became_peered":"2024-03-30T01:51:32.816217+0000","last_unstale":"2024-03-30T01:51:36.356791+0000","last_undegraded":"2024-03-30T01:51:36.356791+0000","last_fullsized":"2024-03-30T01:51:36.356791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.804176+0000","last_change":"2024-03-30T01:51:32.340288+0000","last_active":"2024-03-30T01:51:32.804176+0000","last_peered":"2024-03-30T01:51:32.804176+0000","last_clean":"2024-03-30T01:51:32.804176+0000","last_became_active":"2024-03-30T01:51:32.339870+0000","last_became_peered":"2024-03-30T01:51:32.339870+0000","last_unstale":"2024-03-30T01:51:32.804176+0000","last_undegraded":"2024-03-30T01:51:32.804176+0000","last_fullsized":"2024-03-30T01:51:32.804176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:28.389656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951417+0000","last_change":"2024-03-30T01:51:32.795840+0000","last_active":"2024-03-30T01:51:33.951417+0000","last_peered":"2024-03-30T01:51:33.951417+0000","last_clean":"2024-03-30T01:51:33.951417+0000","last_became_active":"2024-03-30T01:51:32.795458+0000","last_became_peered":"2024-03-30T01:51:32.795458+0000","last_unstale":"2024-03-30T01:51:33.951417+0000","last_undegraded":"2024-03-30T01:51:33.951417+0000","last_fullsized":"2024-03-30T01:51:33.951417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:24:14.776848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.798439+0000","last_change":"2024-03-30T01:51:32.332992+0000","last_active":"2024-03-30T01:51:32.798439+0000","last_peered":"2024-03-30T01:51:32.798439+0000","last_clean":"2024-03-30T01:51:32.798439+0000","last_became_active":"2024-03-30T01:51:32.332735+0000","last_became_peered":"2024-03-30T01:51:32.332735+0000","last_unstale":"2024-03-30T01:51:32.798439+0000","last_undegraded":"2024-03-30T01:51:32.798439+0000","last_fullsized":"2024-03-30T01:51:32.798439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:49:06.802141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791299+0000","last_change":"2024-03-30T01:51:32.812474+0000","last_active":"2024-03-30T01:51:33.791299+0000","last_peered":"2024-03-30T01:51:33.791299+0000","last_clean":"2024-03-30T01:51:33.791299+0000","last_became_active":"2024-03-30T01:51:32.812149+0000","last_became_peered":"2024-03-30T01:51:32.812149+0000","last_unstale":"2024-03-30T01:51:33.791299+0000","last_undegraded":"2024-03-30T01:51:33.791299+0000","last_fullsized":"2024-03-30T01:51:33.791299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:48.498455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.794770+0000","last_change":"2024-03-30T01:51:32.331651+0000","last_active":"2024-03-30T01:51:32.794770+0000","last_peered":"2024-03-30T01:51:32.794770+0000","last_clean":"2024-03-30T01:51:32.794770+0000","last_became_active":"2024-03-30T01:51:32.331150+0000","last_became_peered":"2024-03-30T01:51:32.331150+0000","last_unstale":"2024-03-30T01:51:32.794770+0000","last_undegraded":"2024-03-30T01:51:32.794770+0000","last_fullsized":"2024-03-30T01:51:32.794770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794329+0000","last_change":"2024-03-30T01:51:32.808411+0000","last_active":"2024-03-30T01:51:33.794329+0000","last_peered":"2024-03-30T01:51:33.794329+0000","last_clean":"2024-03-30T01:51:33.794329+0000","last_became_active":"2024-03-30T01:51:32.807032+0000","last_became_peered":"2024-03-30T01:51:32.807032+0000","last_unstale":"2024-03-30T01:51:33.794329+0000","last_undegraded":"2024-03-30T01:51:33.794329+0000","last_fullsized":"2024-03-30T01:51:33.794329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:43:14.180564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.805618+0000","last_change":"2024-03-30T01:51:32.332641+0000","last_active":"2024-03-30T01:51:32.805618+0000","last_peered":"2024-03-30T01:51:32.805618+0000","last_clean":"2024-03-30T01:51:32.805618+0000","last_became_active":"2024-03-30T01:51:32.332372+0000","last_became_peered":"2024-03-30T01:51:32.332372+0000","last_unstale":"2024-03-30T01:51:32.805618+0000","last_undegraded":"2024-03-30T01:51:32.805618+0000","last_fullsized":"2024-03-30T01:51:32.805618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:16.099108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793089+0000","last_change":"2024-03-30T01:51:32.801706+0000","last_active":"2024-03-30T01:51:33.793089+0000","last_peered":"2024-03-30T01:51:33.793089+0000","last_clean":"2024-03-30T01:51:33.793089+0000","last_became_active":"2024-03-30T01:51:32.799681+0000","last_became_peered":"2024-03-30T01:51:32.799681+0000","last_unstale":"2024-03-30T01:51:33.793089+0000","last_undegraded":"2024-03-30T01:51:33.793089+0000","last_fullsized":"2024-03-30T01:51:33.793089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:26:47.924608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.811947+0000","last_change":"2024-03-30T01:51:32.340251+0000","last_active":"2024-03-30T01:51:32.811947+0000","last_peered":"2024-03-30T01:51:32.811947+0000","last_clean":"2024-03-30T01:51:32.811947+0000","last_became_active":"2024-03-30T01:51:32.339947+0000","last_became_peered":"2024-03-30T01:51:32.339947+0000","last_unstale":"2024-03-30T01:51:32.811947+0000","last_undegraded":"2024-03-30T01:51:32.811947+0000","last_fullsized":"2024-03-30T01:51:32.811947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:16:47.699775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791546+0000","last_change":"2024-03-30T01:51:32.806047+0000","last_active":"2024-03-30T01:51:33.791546+0000","last_peered":"2024-03-30T01:51:33.791546+0000","last_clean":"2024-03-30T01:51:33.791546+0000","last_became_active":"2024-03-30T01:51:32.805805+0000","last_became_peered":"2024-03-30T01:51:32.805805+0000","last_unstale":"2024-03-30T01:51:33.791546+0000","last_undegraded":"2024-03-30T01:51:33.791546+0000","last_fullsized":"2024-03-30T01:51:33.791546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:13:08.942873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.807432+0000","last_change":"2024-03-30T01:51:32.342956+0000","last_active":"2024-03-30T01:51:32.807432+0000","last_peered":"2024-03-30T01:51:32.807432+0000","last_clean":"2024-03-30T01:51:32.807432+0000","last_became_active":"2024-03-30T01:51:32.342396+0000","last_became_peered":"2024-03-30T01:51:32.342396+0000","last_unstale":"2024-03-30T01:51:32.807432+0000","last_undegraded":"2024-03-30T01:51:32.807432+0000","last_fullsized":"2024-03-30T01:51:32.807432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:28.389656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357308+0000","last_change":"2024-03-30T01:51:32.821007+0000","last_active":"2024-03-30T01:51:36.357308+0000","last_peered":"2024-03-30T01:51:36.357308+0000","last_clean":"2024-03-30T01:51:36.357308+0000","last_became_active":"2024-03-30T01:51:32.820784+0000","last_became_peered":"2024-03-30T01:51:32.820784+0000","last_unstale":"2024-03-30T01:51:36.357308+0000","last_undegraded":"2024-03-30T01:51:36.357308+0000","last_fullsized":"2024-03-30T01:51:36.357308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:26:47.924608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.830948+0000","last_change":"2024-03-30T01:51:32.340196+0000","last_active":"2024-03-30T01:51:32.830948+0000","last_peered":"2024-03-30T01:51:32.830948+0000","last_clean":"2024-03-30T01:51:32.830948+0000","last_became_active":"2024-03-30T01:51:32.338419+0000","last_became_peered":"2024-03-30T01:51:32.338419+0000","last_unstale":"2024-03-30T01:51:32.830948+0000","last_undegraded":"2024-03-30T01:51:32.830948+0000","last_fullsized":"2024-03-30T01:51:32.830948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951714+0000","last_change":"2024-03-30T01:51:32.814179+0000","last_active":"2024-03-30T01:51:33.951714+0000","last_peered":"2024-03-30T01:51:33.951714+0000","last_clean":"2024-03-30T01:51:33.951714+0000","last_became_active":"2024-03-30T01:51:32.813873+0000","last_became_peered":"2024-03-30T01:51:32.813873+0000","last_unstale":"2024-03-30T01:51:33.951714+0000","last_undegraded":"2024-03-30T01:51:33.951714+0000","last_fullsized":"2024-03-30T01:51:33.951714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:13:08.942873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.804043+0000","last_change":"2024-03-30T01:51:32.339346+0000","last_active":"2024-03-30T01:51:32.804043+0000","last_peered":"2024-03-30T01:51:32.804043+0000","last_clean":"2024-03-30T01:51:32.804043+0000","last_became_active":"2024-03-30T01:51:32.339038+0000","last_became_peered":"2024-03-30T01:51:32.339038+0000","last_unstale":"2024-03-30T01:51:32.804043+0000","last_undegraded":"2024-03-30T01:51:32.804043+0000","last_fullsized":"2024-03-30T01:51:32.804043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793437+0000","last_change":"2024-03-30T01:51:32.803943+0000","last_active":"2024-03-30T01:51:33.793437+0000","last_peered":"2024-03-30T01:51:33.793437+0000","last_clean":"2024-03-30T01:51:33.793437+0000","last_became_active":"2024-03-30T01:51:32.802118+0000","last_became_peered":"2024-03-30T01:51:32.802118+0000","last_unstale":"2024-03-30T01:51:33.793437+0000","last_undegraded":"2024-03-30T01:51:33.793437+0000","last_fullsized":"2024-03-30T01:51:33.793437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:17.114113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.804568+0000","last_change":"2024-03-30T01:51:32.336889+0000","last_active":"2024-03-30T01:51:32.804568+0000","last_peered":"2024-03-30T01:51:32.804568+0000","last_clean":"2024-03-30T01:51:32.804568+0000","last_became_active":"2024-03-30T01:51:32.336560+0000","last_became_peered":"2024-03-30T01:51:32.336560+0000","last_unstale":"2024-03-30T01:51:32.804568+0000","last_undegraded":"2024-03-30T01:51:32.804568+0000","last_fullsized":"2024-03-30T01:51:32.804568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356993+0000","last_change":"2024-03-30T01:51:32.816142+0000","last_active":"2024-03-30T01:51:36.356993+0000","last_peered":"2024-03-30T01:51:36.356993+0000","last_clean":"2024-03-30T01:51:36.356993+0000","last_became_active":"2024-03-30T01:51:32.814782+0000","last_became_peered":"2024-03-30T01:51:32.814782+0000","last_unstale":"2024-03-30T01:51:36.356993+0000","last_undegraded":"2024-03-30T01:51:36.356993+0000","last_fullsized":"2024-03-30T01:51:36.356993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:13:08.942873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.805047+0000","last_change":"2024-03-30T01:51:32.334063+0000","last_active":"2024-03-30T01:51:32.805047+0000","last_peered":"2024-03-30T01:51:32.805047+0000","last_clean":"2024-03-30T01:51:32.805047+0000","last_became_active":"2024-03-30T01:51:32.332760+0000","last_became_peered":"2024-03-30T01:51:32.332760+0000","last_unstale":"2024-03-30T01:51:32.805047+0000","last_undegraded":"2024-03-30T01:51:32.805047+0000","last_fullsized":"2024-03-30T01:51:32.805047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357089+0000","last_change":"2024-03-30T01:51:32.808609+0000","last_active":"2024-03-30T01:51:36.357089+0000","last_peered":"2024-03-30T01:51:36.357089+0000","last_clean":"2024-03-30T01:51:36.357089+0000","last_became_active":"2024-03-30T01:51:32.803595+0000","last_became_peered":"2024-03-30T01:51:32.803595+0000","last_unstale":"2024-03-30T01:51:36.357089+0000","last_undegraded":"2024-03-30T01:51:36.357089+0000","last_fullsized":"2024-03-30T01:51:36.357089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:31:32.555378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.832173+0000","last_change":"2024-03-30T01:51:32.340790+0000","last_active":"2024-03-30T01:51:32.832173+0000","last_peered":"2024-03-30T01:51:32.832173+0000","last_clean":"2024-03-30T01:51:32.832173+0000","last_became_active":"2024-03-30T01:51:32.340490+0000","last_became_peered":"2024-03-30T01:51:32.340490+0000","last_unstale":"2024-03-30T01:51:32.832173+0000","last_undegraded":"2024-03-30T01:51:32.832173+0000","last_fullsized":"2024-03-30T01:51:32.832173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:30:14.002651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359197+0000","last_change":"2024-03-30T01:51:32.827543+0000","last_active":"2024-03-30T01:51:36.359197+0000","last_peered":"2024-03-30T01:51:36.359197+0000","last_clean":"2024-03-30T01:51:36.359197+0000","last_became_active":"2024-03-30T01:51:32.827208+0000","last_became_peered":"2024-03-30T01:51:32.827208+0000","last_unstale":"2024-03-30T01:51:36.359197+0000","last_undegraded":"2024-03-30T01:51:36.359197+0000","last_fullsized":"2024-03-30T01:51:36.359197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:56:56.891377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792948+0000","last_change":"2024-03-30T01:51:32.796699+0000","last_active":"2024-03-30T01:51:33.792948+0000","last_peered":"2024-03-30T01:51:33.792948+0000","last_clean":"2024-03-30T01:51:33.792948+0000","last_became_active":"2024-03-30T01:51:32.796427+0000","last_became_peered":"2024-03-30T01:51:32.796427+0000","last_unstale":"2024-03-30T01:51:33.792948+0000","last_undegraded":"2024-03-30T01:51:33.792948+0000","last_fullsized":"2024-03-30T01:51:33.792948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:48:32.312063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.831028+0000","last_change":"2024-03-30T01:51:32.340270+0000","last_active":"2024-03-30T01:51:32.831028+0000","last_peered":"2024-03-30T01:51:32.831028+0000","last_clean":"2024-03-30T01:51:32.831028+0000","last_became_active":"2024-03-30T01:51:32.339869+0000","last_became_peered":"2024-03-30T01:51:32.339869+0000","last_unstale":"2024-03-30T01:51:32.831028+0000","last_undegraded":"2024-03-30T01:51:32.831028+0000","last_fullsized":"2024-03-30T01:51:32.831028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792626+0000","last_change":"2024-03-30T01:51:32.806687+0000","last_active":"2024-03-30T01:51:33.792626+0000","last_peered":"2024-03-30T01:51:33.792626+0000","last_clean":"2024-03-30T01:51:33.792626+0000","last_became_active":"2024-03-30T01:51:32.806461+0000","last_became_peered":"2024-03-30T01:51:32.806461+0000","last_unstale":"2024-03-30T01:51:33.792626+0000","last_undegraded":"2024-03-30T01:51:33.792626+0000","last_fullsized":"2024-03-30T01:51:33.792626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:15:59.657625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.833260+0000","last_change":"2024-03-30T01:51:32.343222+0000","last_active":"2024-03-30T01:51:32.833260+0000","last_peered":"2024-03-30T01:51:32.833260+0000","last_clean":"2024-03-30T01:51:32.833260+0000","last_became_active":"2024-03-30T01:51:32.342933+0000","last_became_peered":"2024-03-30T01:51:32.342933+0000","last_unstale":"2024-03-30T01:51:32.833260+0000","last_undegraded":"2024-03-30T01:51:32.833260+0000","last_fullsized":"2024-03-30T01:51:32.833260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:42:26.214040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.952250+0000","last_change":"2024-03-30T01:51:32.798373+0000","last_active":"2024-03-30T01:51:33.952250+0000","last_peered":"2024-03-30T01:51:33.952250+0000","last_clean":"2024-03-30T01:51:33.952250+0000","last_became_active":"2024-03-30T01:51:32.798184+0000","last_became_peered":"2024-03-30T01:51:32.798184+0000","last_unstale":"2024-03-30T01:51:33.952250+0000","last_undegraded":"2024-03-30T01:51:33.952250+0000","last_fullsized":"2024-03-30T01:51:33.952250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:12:19.249116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.826599+0000","last_change":"2024-03-30T01:51:32.336950+0000","last_active":"2024-03-30T01:51:32.826599+0000","last_peered":"2024-03-30T01:51:32.826599+0000","last_clean":"2024-03-30T01:51:32.826599+0000","last_became_active":"2024-03-30T01:51:32.336685+0000","last_became_peered":"2024-03-30T01:51:32.336685+0000","last_unstale":"2024-03-30T01:51:32.826599+0000","last_undegraded":"2024-03-30T01:51:32.826599+0000","last_fullsized":"2024-03-30T01:51:32.826599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:18.328608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357072+0000","last_change":"2024-03-30T01:51:32.818072+0000","last_active":"2024-03-30T01:51:36.357072+0000","last_peered":"2024-03-30T01:51:36.357072+0000","last_clean":"2024-03-30T01:51:36.357072+0000","last_became_active":"2024-03-30T01:51:32.816795+0000","last_became_peered":"2024-03-30T01:51:32.816795+0000","last_unstale":"2024-03-30T01:51:36.357072+0000","last_undegraded":"2024-03-30T01:51:36.357072+0000","last_fullsized":"2024-03-30T01:51:36.357072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:16:38.980879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.834008+0000","last_change":"2024-03-30T01:51:32.336309+0000","last_active":"2024-03-30T01:51:32.834008+0000","last_peered":"2024-03-30T01:51:32.834008+0000","last_clean":"2024-03-30T01:51:32.834008+0000","last_became_active":"2024-03-30T01:51:32.335769+0000","last_became_peered":"2024-03-30T01:51:32.335769+0000","last_unstale":"2024-03-30T01:51:32.834008+0000","last_undegraded":"2024-03-30T01:51:32.834008+0000","last_fullsized":"2024-03-30T01:51:32.834008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T07:39:05.794505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.605}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6779999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":66162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.49}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.811999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.9900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.109}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.6950000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.1520000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.8160000000000007}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7050000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7250000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.298}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.7949999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.1280000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.294}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9209999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.8600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":69879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,10],"upper_bound":32},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.742}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5150000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5389999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6639999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7769999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.859}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0249999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2530000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.992}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":660885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5980000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7230000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T01:51:42.677 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-30T01:51:42.678 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-30T01:51:42.678 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-30T01:51:42.678 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-30T01:51:42.678 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-30T01:51:42.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.913+0000 7fb17f000640 1 Processor -- start 2024-03-30T01:51:42.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.914+0000 7fb17f000640 1 -- start start 2024-03-30T01:51:42.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.915+0000 7fb17f000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb1780cfb80 0x7fb1780b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:42.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.915+0000 7fb17f000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17815d030 con 0x7fb1780d0af0 2024-03-30T01:51:42.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.915+0000 7fb17f000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1780b5af0 con 0x7fb17815cc50 2024-03-30T01:51:42.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.915+0000 7fb17f000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1780d1c50 con 0x7fb1780cfb80 2024-03-30T01:51:42.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.915+0000 7fb16fe00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb1780d0af0 0x7fb1780cf470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53930/0 (socket says 172.21.15.133:53930) 2024-03-30T01:51:42.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.915+0000 7fb16fe00640 1 -- 172.21.15.133:0/3084305448 learned_addr learned my addr 172.21.15.133:0/3084305448 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:42.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.916+0000 7fb17d000640 1 --2- 172.21.15.133:0/3084305448 >> v2:172.21.15.137:3300/0 conn(0x7fb1780cfb80 0x7fb1780b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:42.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.916+0000 7fb177400640 1 -- 172.21.15.133:0/3084305448 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016621544 0 0) 0x7fb17815d030 con 0x7fb1780d0af0 2024-03-30T01:51:42.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.916+0000 7fb177400640 1 -- 172.21.15.133:0/3084305448 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb15c003520 con 0x7fb1780d0af0 2024-03-30T01:51:42.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.916+0000 7fb177400640 1 -- 172.21.15.133:0/3084305448 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3616950585 0 0) 0x7fb15c003520 con 0x7fb1780d0af0 2024-03-30T01:51:42.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.916+0000 7fb177400640 1 -- 172.21.15.133:0/3084305448 >> v2:172.21.15.137:3300/0 conn(0x7fb1780cfb80 msgr2=0x7fb1780b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:42.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.916+0000 7fb177400640 1 --2- 172.21.15.133:0/3084305448 >> v2:172.21.15.137:3300/0 conn(0x7fb1780cfb80 0x7fb1780b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:42.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.916+0000 7fb177400640 1 -- 172.21.15.133:0/3084305448 >> v1:172.21.15.137:6789/0 conn(0x7fb17815cc50 legacy=0x7fb1780d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:42.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.916+0000 7fb177400640 1 -- 172.21.15.133:0/3084305448 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1780d10d0 con 0x7fb1780d0af0 2024-03-30T01:51:42.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.916+0000 7fb177400640 1 -- 172.21.15.133:0/3084305448 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fb160001690 con 0x7fb1780d0af0 2024-03-30T01:51:42.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.916+0000 7fb177400640 1 -- 172.21.15.133:0/3084305448 >> v1:172.21.15.133:6789/0 conn(0x7fb1780d0af0 legacy=0x7fb1780cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:42.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.916+0000 7fb177400640 1 --2- 172.21.15.133:0/3084305448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb15c003970 0x7fb15c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:42.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.916+0000 7fb177400640 1 --2- 172.21.15.133:0/3084305448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb15c0047c0 0x7fb15c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:42.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.916+0000 7fb177400640 1 --2- 172.21.15.133:0/3084305448 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb15c005180 0x7fb15c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:42.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.916+0000 7fb177400640 1 -- 172.21.15.133:0/3084305448 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1780d1c50 con 0x7fb15c003970 2024-03-30T01:51:42.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.916+0000 7fb177400640 1 -- 172.21.15.133:0/3084305448 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15c00c020 con 0x7fb15c0047c0 2024-03-30T01:51:42.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.916+0000 7fb177400640 1 -- 172.21.15.133:0/3084305448 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb15c00c1e0 con 0x7fb15c005180 2024-03-30T01:51:42.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.917+0000 7fb177e00640 1 --2- 172.21.15.133:0/3084305448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb15c003970 0x7fb15c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:42.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.917+0000 7fb16fe00640 1 --2- 172.21.15.133:0/3084305448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb15c0047c0 0x7fb15c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:42.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.917+0000 7fb17d000640 1 --2- 172.21.15.133:0/3084305448 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb15c005180 0x7fb15c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:42.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.917+0000 7fb177e00640 1 -- 172.21.15.133:0/3084305448 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb15c005180 msgr2=0x7fb15c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:42.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.917+0000 7fb177e00640 1 --2- 172.21.15.133:0/3084305448 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb15c005180 0x7fb15c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:42.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.917+0000 7fb177e00640 1 -- 172.21.15.133:0/3084305448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb15c0047c0 msgr2=0x7fb15c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:42.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.917+0000 7fb177e00640 1 --2- 172.21.15.133:0/3084305448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb15c0047c0 0x7fb15c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:42.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.917+0000 7fb177e00640 1 -- 172.21.15.133:0/3084305448 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15c003520 con 0x7fb15c003970 2024-03-30T01:51:42.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.917+0000 7fb17d000640 1 -- 172.21.15.133:0/3084305448 reap_dead start 2024-03-30T01:51:42.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.918+0000 7fb177e00640 1 --2- 172.21.15.133:0/3084305448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb15c003970 0x7fb15c003d90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb168001750 tx=0x7fb15c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac431a12a1bfbebc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:42.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.918+0000 7fb177400640 1 -- 172.21.15.133:0/3084305448 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1680052d0 con 0x7fb15c003970 2024-03-30T01:51:42.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.918+0000 7fb177400640 1 -- 172.21.15.133:0/3084305448 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16802e050 con 0x7fb15c003970 2024-03-30T01:51:42.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.918+0000 7fb177400640 1 -- 172.21.15.133:0/3084305448 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb168003830 con 0x7fb15c003970 2024-03-30T01:51:42.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.919+0000 7fb17f000640 1 -- 172.21.15.133:0/3084305448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb15c003970 msgr2=0x7fb15c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:42.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.919+0000 7fb17f000640 1 --2- 172.21.15.133:0/3084305448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb15c003970 0x7fb15c003d90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb168001750 tx=0x7fb15c0057f0 comp rx=0 tx=0).stop 2024-03-30T01:51:42.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.919+0000 7fb17f000640 1 -- 172.21.15.133:0/3084305448 shutdown_connections 2024-03-30T01:51:42.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.919+0000 7fb17f000640 1 --2- 172.21.15.133:0/3084305448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb15c003970 0x7fb15c003d90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:42.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.919+0000 7fb17f000640 1 -- 172.21.15.133:0/3084305448 >> 172.21.15.133:0/3084305448 conn(0x7fb178071a40 msgr2=0x7fb17806b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:42.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.919+0000 7fb17f000640 1 -- 172.21.15.133:0/3084305448 shutdown_connections 2024-03-30T01:51:42.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.919+0000 7fb17f000640 1 -- 172.21.15.133:0/3084305448 wait complete. 2024-03-30T01:51:42.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.921+0000 7fb17f000640 1 Processor -- start 2024-03-30T01:51:42.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.921+0000 7fb17f000640 1 -- start start 2024-03-30T01:51:42.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.922+0000 7fb17f000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb15c003970 0x7fb1780c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:42.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.922+0000 7fb17f000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1781f1ea0 0x7fb1780c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:42.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.922+0000 7fb17f000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1781f2320 0x7fb1780c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:42.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.922+0000 7fb17f000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1781f6af0 con 0x7fb15c003970 2024-03-30T01:51:42.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.922+0000 7fb17f000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1781f5f70 con 0x7fb1781f2320 2024-03-30T01:51:42.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.922+0000 7fb17f000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1781f6250 con 0x7fb1781f1ea0 2024-03-30T01:51:42.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.922+0000 7fb177e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb15c003970 0x7fb1780c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:42.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.922+0000 7fb177e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb15c003970 0x7fb1780c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45926/0 (socket says 172.21.15.133:45926) 2024-03-30T01:51:42.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.922+0000 7fb177e00640 1 -- 172.21.15.133:0/3209841772 learned_addr learned my addr 172.21.15.133:0/3209841772 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:42.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.922+0000 7fb16fe00640 1 --2- 172.21.15.133:0/3209841772 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1781f1ea0 0x7fb1780c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:42.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.923+0000 7fb177e00640 1 -- 172.21.15.133:0/3209841772 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1781f1ea0 msgr2=0x7fb1780c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:42.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.923+0000 7fb177e00640 1 --2- 172.21.15.133:0/3209841772 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1781f1ea0 0x7fb1780c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:42.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.923+0000 7fb177e00640 1 -- 172.21.15.133:0/3209841772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1781f2320 msgr2=0x7fb1780c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:42.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.923+0000 7fb17d000640 1 --2- 172.21.15.133:0/3209841772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1781f2320 0x7fb1780c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:42.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.923+0000 7fb177e00640 1 --2- 172.21.15.133:0/3209841772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1781f2320 0x7fb1780c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:42.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.923+0000 7fb177e00640 1 -- 172.21.15.133:0/3209841772 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1781f6530 con 0x7fb15c003970 2024-03-30T01:51:42.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.923+0000 7fb16fe00640 1 --2- 172.21.15.133:0/3209841772 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1781f1ea0 0x7fb1780c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:42.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.923+0000 7fb177e00640 1 --2- 172.21.15.133:0/3209841772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb15c003970 0x7fb1780c6530 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb16802bc30 tx=0x7fb168001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:42.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.923+0000 7fb174c00640 1 -- 172.21.15.133:0/3209841772 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1680076c0 con 0x7fb15c003970 2024-03-30T01:51:42.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.923+0000 7fb174c00640 1 -- 172.21.15.133:0/3209841772 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb168007a30 con 0x7fb15c003970 2024-03-30T01:51:42.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.923+0000 7fb174c00640 1 -- 172.21.15.133:0/3209841772 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb168006be0 con 0x7fb15c003970 2024-03-30T01:51:42.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.923+0000 7fb17f000640 1 -- 172.21.15.133:0/3209841772 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1781f6af0 con 0x7fb15c003970 2024-03-30T01:51:42.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.923+0000 7fb17f000640 1 -- 172.21.15.133:0/3209841772 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1780c6a70 con 0x7fb15c003970 2024-03-30T01:51:42.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.925+0000 7fb17f000640 1 -- 172.21.15.133:0/3209841772 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1780d38e0 con 0x7fb15c003970 2024-03-30T01:51:42.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.925+0000 7fb174c00640 1 -- 172.21.15.133:0/3209841772 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb168006d40 con 0x7fb15c003970 2024-03-30T01:51:42.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.927+0000 7fb174c00640 1 --2- 172.21.15.133:0/3209841772 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb15406ac00 0x7fb15406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:42.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.927+0000 7fb174c00640 1 -- 172.21.15.133:0/3209841772 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1680ab0b0 con 0x7fb15c003970 2024-03-30T01:51:42.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.927+0000 7fb16fe00640 1 --2- 172.21.15.133:0/3209841772 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb15406ac00 0x7fb15406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:42.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.927+0000 7fb16fe00640 1 --2- 172.21.15.133:0/3209841772 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb15406ac00 0x7fb15406d0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb160001eb0 tx=0x7fb160000f10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:42.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:42.932+0000 7fb174c00640 1 -- 172.21.15.133:0/3209841772 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fb168076310 con 0x7fb15c003970 2024-03-30T01:51:43.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.169+0000 7fb17f000640 1 -- 172.21.15.133:0/3209841772 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb178066d80 con 0x7fb15c003970 2024-03-30T01:51:43.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.175+0000 7fb174c00640 1 -- 172.21.15.133:0/3209841772 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170934 (secure 0 0 0) 0x7fb168079930 con 0x7fb15c003970 2024-03-30T01:51:43.183 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:43.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.179+0000 7fb17f000640 1 -- 172.21.15.133:0/3209841772 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb15406ac00 msgr2=0x7fb15406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:43.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.179+0000 7fb17f000640 1 --2- 172.21.15.133:0/3209841772 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb15406ac00 0x7fb15406d0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb160001eb0 tx=0x7fb160000f10 comp rx=0 tx=0).stop 2024-03-30T01:51:43.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.179+0000 7fb17f000640 1 -- 172.21.15.133:0/3209841772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb15c003970 msgr2=0x7fb1780c6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.179+0000 7fb17f000640 1 --2- 172.21.15.133:0/3209841772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb15c003970 0x7fb1780c6530 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb16802bc30 tx=0x7fb168001120 comp rx=0 tx=0).stop 2024-03-30T01:51:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.179+0000 7fb17f000640 1 -- 172.21.15.133:0/3209841772 shutdown_connections 2024-03-30T01:51:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.179+0000 7fb17f000640 1 --2- 172.21.15.133:0/3209841772 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb15406ac00 0x7fb15406d0c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.179+0000 7fb17f000640 1 --2- 172.21.15.133:0/3209841772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1781f2320 0x7fb1780c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.179+0000 7fb17f000640 1 --2- 172.21.15.133:0/3209841772 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1781f1ea0 0x7fb1780c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.179+0000 7fb17f000640 1 --2- 172.21.15.133:0/3209841772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb15c003970 0x7fb1780c6530 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.179+0000 7fb17f000640 1 -- 172.21.15.133:0/3209841772 >> 172.21.15.133:0/3209841772 conn(0x7fb178071a40 msgr2=0x7fb1780b8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.179+0000 7fb17f000640 1 -- 172.21.15.133:0/3209841772 shutdown_connections 2024-03-30T01:51:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.179+0000 7fb17f000640 1 -- 172.21.15.133:0/3209841772 wait complete. 2024-03-30T01:51:43.202 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":5,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":37234},{"type":"v1","addr":"172.21.15.133:6833","nonce":37234}]},"active_addr":"172.21.15.133:6833/37234","active_change":"2024-03-30T01:51:13.673309+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":2751923327}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":1930019731}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":1048763933}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":4256332982}]}]} 2024-03-30T01:51:43.205 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-30T01:51:43.205 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-30T01:51:43.205 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:51:43.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.402+0000 7f018de00640 1 Processor -- start 2024-03-30T01:51:43.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.402+0000 7f018de00640 1 -- start start 2024-03-30T01:51:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.404+0000 7f018de00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f018815cc50 0x7f01880d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.404+0000 7f018de00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f018815d030 con 0x7f01880cfb80 2024-03-30T01:51:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.404+0000 7f018de00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01880b5af0 con 0x7f01880d2240 2024-03-30T01:51:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.404+0000 7f018de00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01880d1c50 con 0x7f018815cc50 2024-03-30T01:51:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.404+0000 7f0187400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f01880cfb80 0x7f01880b14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53944/0 (socket says 172.21.15.133:53944) 2024-03-30T01:51:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.404+0000 7f0187400640 1 -- 172.21.15.133:0/225473949 learned_addr learned my addr 172.21.15.133:0/225473949 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.405+0000 7f0186a00640 1 --2- 172.21.15.133:0/225473949 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f018815cc50 0x7f01880d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.405+0000 7f0185600640 1 -- 172.21.15.133:0/225473949 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485707362 0 0) 0x7f018815d030 con 0x7f01880cfb80 2024-03-30T01:51:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.405+0000 7f0185600640 1 -- 172.21.15.133:0/225473949 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f016c003520 con 0x7f01880cfb80 2024-03-30T01:51:43.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.405+0000 7f0185600640 1 -- 172.21.15.133:0/225473949 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 995085239 0 0) 0x7f016c003520 con 0x7f01880cfb80 2024-03-30T01:51:43.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.405+0000 7f0185600640 1 -- 172.21.15.133:0/225473949 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f018815cc50 msgr2=0x7f01880d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:43.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.405+0000 7f0185600640 1 --2- 172.21.15.133:0/225473949 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f018815cc50 0x7f01880d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:43.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.405+0000 7f0185600640 1 -- 172.21.15.133:0/225473949 >> v1:172.21.15.137:6789/0 conn(0x7f01880d2240 legacy=0x7f01880cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:43.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.405+0000 7f0185600640 1 -- 172.21.15.133:0/225473949 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01880d10d0 con 0x7f01880cfb80 2024-03-30T01:51:43.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.405+0000 7f0185600640 1 -- 172.21.15.133:0/225473949 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f0180001670 con 0x7f01880cfb80 2024-03-30T01:51:43.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.405+0000 7f0185600640 1 -- 172.21.15.133:0/225473949 >> v1:172.21.15.133:6789/0 conn(0x7f01880cfb80 legacy=0x7f01880b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:43.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.405+0000 7f0185600640 1 --2- 172.21.15.133:0/225473949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f016c0039a0 0x7f016c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:43.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.405+0000 7f0185600640 1 --2- 172.21.15.133:0/225473949 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f018815cc50 0x7f016c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:43.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.405+0000 7f0185600640 1 --2- 172.21.15.133:0/225473949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f016c004d00 0x7f016c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:43.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.405+0000 7f0185600640 1 -- 172.21.15.133:0/225473949 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01880d1c50 con 0x7f016c0039a0 2024-03-30T01:51:43.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.405+0000 7f0185600640 1 -- 172.21.15.133:0/225473949 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c00ba30 con 0x7f016c004d00 2024-03-30T01:51:43.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.405+0000 7f0185600640 1 -- 172.21.15.133:0/225473949 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016c00bbf0 con 0x7f018815cc50 2024-03-30T01:51:43.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.405+0000 7f0186a00640 1 --2- 172.21.15.133:0/225473949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f016c0039a0 0x7f016c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:43.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.406+0000 7f0186000640 1 --2- 172.21.15.133:0/225473949 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f018815cc50 0x7f016c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:43.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.406+0000 7f0186a00640 1 -- 172.21.15.133:0/225473949 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f018815cc50 msgr2=0x7f016c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:43.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.406+0000 7f0186a00640 1 --2- 172.21.15.133:0/225473949 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f018815cc50 0x7f016c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:43.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.406+0000 7f0186a00640 1 -- 172.21.15.133:0/225473949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f016c004d00 msgr2=0x7f016c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:43.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.406+0000 7f0186a00640 1 --2- 172.21.15.133:0/225473949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f016c004d00 0x7f016c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:43.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.406+0000 7f0186a00640 1 -- 172.21.15.133:0/225473949 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c003520 con 0x7f016c0039a0 2024-03-30T01:51:43.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.406+0000 7f0186000640 1 --2- 172.21.15.133:0/225473949 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f018815cc50 0x7f016c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:43.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.407+0000 7f0186a00640 1 --2- 172.21.15.133:0/225473949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f016c0039a0 0x7f016c003dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0178009f90 tx=0x7f016c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573dd35cdb090ff8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:43.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.407+0000 7f0185600640 1 -- 172.21.15.133:0/225473949 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017802cbd0 con 0x7f016c0039a0 2024-03-30T01:51:43.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.407+0000 7f0185600640 1 -- 172.21.15.133:0/225473949 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017800f040 con 0x7f016c0039a0 2024-03-30T01:51:43.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.407+0000 7f0185600640 1 -- 172.21.15.133:0/225473949 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0178034440 con 0x7f016c0039a0 2024-03-30T01:51:43.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.408+0000 7f018de00640 1 -- 172.21.15.133:0/225473949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f016c0039a0 msgr2=0x7f016c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:43.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.408+0000 7f018de00640 1 --2- 172.21.15.133:0/225473949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f016c0039a0 0x7f016c003dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0178009f90 tx=0x7f016c0057f0 comp rx=0 tx=0).stop 2024-03-30T01:51:43.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.408+0000 7f0187400640 1 -- 172.21.15.133:0/225473949 reap_dead start 2024-03-30T01:51:43.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.408+0000 7f018de00640 1 -- 172.21.15.133:0/225473949 shutdown_connections 2024-03-30T01:51:43.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.408+0000 7f018de00640 1 -- 172.21.15.133:0/225473949 >> 172.21.15.133:0/225473949 conn(0x7f0188071a40 msgr2=0x7f018806b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:43.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.408+0000 7f018de00640 1 -- 172.21.15.133:0/225473949 shutdown_connections 2024-03-30T01:51:43.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.408+0000 7f018de00640 1 -- 172.21.15.133:0/225473949 wait complete. 2024-03-30T01:51:43.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.410+0000 7f018de00640 1 Processor -- start 2024-03-30T01:51:43.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.410+0000 7f018de00640 1 -- start start 2024-03-30T01:51:43.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.411+0000 7f018de00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f016c0039a0 0x7f0188155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:43.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.411+0000 7f018de00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01880c8970 0x7f0188158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:43.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.411+0000 7f018de00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0188158da0 0x7f018815ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:43.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.411+0000 7f018de00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01881543b0 con 0x7f0188158da0 2024-03-30T01:51:43.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.411+0000 7f018de00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0188154690 con 0x7f01880c8970 2024-03-30T01:51:43.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.411+0000 7f018de00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0188154970 con 0x7f016c0039a0 2024-03-30T01:51:43.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.411+0000 7f0187400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0188158da0 0x7f018815ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:43.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.411+0000 7f0187400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0188158da0 0x7f018815ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45936/0 (socket says 172.21.15.133:45936) 2024-03-30T01:51:43.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.411+0000 7f0187400640 1 -- 172.21.15.133:0/745390637 learned_addr learned my addr 172.21.15.133:0/745390637 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:43.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.411+0000 7f0186a00640 1 --2- 172.21.15.133:0/745390637 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f016c0039a0 0x7f0188155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:43.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.411+0000 7f0186000640 1 --2- 172.21.15.133:0/745390637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01880c8970 0x7f0188158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:43.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.411+0000 7f0187400640 1 -- 172.21.15.133:0/745390637 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f016c0039a0 msgr2=0x7f0188155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:43.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.411+0000 7f0187400640 1 --2- 172.21.15.133:0/745390637 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f016c0039a0 0x7f0188155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:43.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.411+0000 7f0187400640 1 -- 172.21.15.133:0/745390637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01880c8970 msgr2=0x7f0188158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:43.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.411+0000 7f0187400640 1 --2- 172.21.15.133:0/745390637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01880c8970 0x7f0188158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:43.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.411+0000 7f0187400640 1 -- 172.21.15.133:0/745390637 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0188154c50 con 0x7f0188158da0 2024-03-30T01:51:43.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.412+0000 7f0187400640 1 --2- 172.21.15.133:0/745390637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0188158da0 0x7f018815ac30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f018806c120 tx=0x7f018000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:43.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.412+0000 7f017f400640 1 -- 172.21.15.133:0/745390637 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180007440 con 0x7f0188158da0 2024-03-30T01:51:43.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.412+0000 7f017f400640 1 -- 172.21.15.133:0/745390637 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01800075c0 con 0x7f0188158da0 2024-03-30T01:51:43.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.412+0000 7f017f400640 1 -- 172.21.15.133:0/745390637 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180004a20 con 0x7f0188158da0 2024-03-30T01:51:43.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.412+0000 7f018de00640 1 -- 172.21.15.133:0/745390637 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0188154f30 con 0x7f0188158da0 2024-03-30T01:51:43.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.412+0000 7f018de00640 1 -- 172.21.15.133:0/745390637 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0188154040 con 0x7f0188158da0 2024-03-30T01:51:43.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.413+0000 7f018de00640 1 -- 172.21.15.133:0/745390637 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0188155150 con 0x7f0188158da0 2024-03-30T01:51:43.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.414+0000 7f017f400640 1 -- 172.21.15.133:0/745390637 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0180004b80 con 0x7f0188158da0 2024-03-30T01:51:43.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.415+0000 7f017f400640 1 --2- 172.21.15.133:0/745390637 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f016406ac00 0x7f016406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:43.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.415+0000 7f017f400640 1 -- 172.21.15.133:0/745390637 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0180088630 con 0x7f0188158da0 2024-03-30T01:51:43.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.415+0000 7f0186a00640 1 --2- 172.21.15.133:0/745390637 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f016406ac00 0x7f016406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:43.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.416+0000 7f0186a00640 1 --2- 172.21.15.133:0/745390637 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f016406ac00 0x7f016406d0c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0178036000 tx=0x7f017802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:43.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.420+0000 7f017f400640 1 -- 172.21.15.133:0/745390637 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f01800536e0 con 0x7f0188158da0 2024-03-30T01:51:43.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.614+0000 7f018de00640 1 -- 172.21.15.133:0/745390637 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01880ca160 con 0x7f0188158da0 2024-03-30T01:51:43.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.615+0000 7f017f400640 1 -- 172.21.15.133:0/745390637 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f0180056d00 con 0x7f0188158da0 2024-03-30T01:51:43.622 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:43.622 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:51:33.780665+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:51:31.245378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T01:51:31.774247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:51:43.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.618+0000 7f018de00640 1 -- 172.21.15.133:0/745390637 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f016406ac00 msgr2=0x7f016406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:43.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.618+0000 7f018de00640 1 --2- 172.21.15.133:0/745390637 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f016406ac00 0x7f016406d0c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0178036000 tx=0x7f017802e000 comp rx=0 tx=0).stop 2024-03-30T01:51:43.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.618+0000 7f018de00640 1 -- 172.21.15.133:0/745390637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0188158da0 msgr2=0x7f018815ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:43.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.618+0000 7f018de00640 1 --2- 172.21.15.133:0/745390637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0188158da0 0x7f018815ac30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f018806c120 tx=0x7f018000c890 comp rx=0 tx=0).stop 2024-03-30T01:51:43.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.618+0000 7f018de00640 1 -- 172.21.15.133:0/745390637 shutdown_connections 2024-03-30T01:51:43.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.618+0000 7f018de00640 1 --2- 172.21.15.133:0/745390637 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f016406ac00 0x7f016406d0c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:43.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.618+0000 7f018de00640 1 --2- 172.21.15.133:0/745390637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0188158da0 0x7f018815ac30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:43.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.618+0000 7f018de00640 1 --2- 172.21.15.133:0/745390637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01880c8970 0x7f0188158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:43.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.618+0000 7f018de00640 1 --2- 172.21.15.133:0/745390637 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f016c0039a0 0x7f0188155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:43.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.618+0000 7f018de00640 1 -- 172.21.15.133:0/745390637 >> 172.21.15.133:0/745390637 conn(0x7f0188071a40 msgr2=0x7f018815f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:43.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.619+0000 7f018de00640 1 -- 172.21.15.133:0/745390637 shutdown_connections 2024-03-30T01:51:43.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.619+0000 7f018de00640 1 -- 172.21.15.133:0/745390637 wait complete. 2024-03-30T01:51:43.643 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-30T01:51:43.643 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:51:43.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.851+0000 7f61ac800640 1 Processor -- start 2024-03-30T01:51:43.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.852+0000 7f61ac800640 1 -- start start 2024-03-30T01:51:43.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.853+0000 7f61ac800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f61a4143790 0x7f61a40cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:43.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.853+0000 7f61ac800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61a40ccc40 0x7f61a4070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:43.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.853+0000 7f61ac800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a40a76a0 con 0x7f61a4070500 2024-03-30T01:51:43.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.853+0000 7f61ac800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a4070ed0 con 0x7f61a4143790 2024-03-30T01:51:43.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.853+0000 7f61ac800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a40b38e0 con 0x7f61a40ccc40 2024-03-30T01:51:43.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.853+0000 7f61a9e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f61a4143790 0x7f61a40cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:43.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.853+0000 7f61a9400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f61a4070500 0x7f61a40cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53960/0 (socket says 172.21.15.133:53960) 2024-03-30T01:51:43.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.853+0000 7f61a9400640 1 -- 172.21.15.133:0/3688951337 learned_addr learned my addr 172.21.15.133:0/3688951337 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:43.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.854+0000 7f61a9e00640 1 -- 172.21.15.133:0/3688951337 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61a40ccc40 msgr2=0x7f61a4070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:43.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.854+0000 7f61a9e00640 1 --2- 172.21.15.133:0/3688951337 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61a40ccc40 0x7f61a4070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:43.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.854+0000 7f61a9e00640 1 -- 172.21.15.133:0/3688951337 >> v1:172.21.15.133:6789/0 conn(0x7f61a4070500 legacy=0x7f61a40cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:43.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.854+0000 7f61a9e00640 1 -- 172.21.15.133:0/3688951337 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a40cd180 con 0x7f61a4143790 2024-03-30T01:51:43.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.854+0000 7f61a8a00640 1 -- 172.21.15.133:0/3688951337 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225043695 0 0) 0x7f61a40a76a0 con 0x7f61a4070500 2024-03-30T01:51:43.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.855+0000 7f61a9e00640 1 --2- 172.21.15.133:0/3688951337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61a4143790 0x7f61a40cbb10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f619c009d90 tx=0x7f619c02bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5825b36ec5eee65 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:43.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.855+0000 7f61a8a00640 1 -- 172.21.15.133:0/3688951337 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c02cce0 con 0x7f61a4143790 2024-03-30T01:51:43.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.855+0000 7f61a8a00640 1 -- 172.21.15.133:0/3688951337 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619c02ce40 con 0x7f61a4143790 2024-03-30T01:51:43.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.855+0000 7f61a8a00640 1 -- 172.21.15.133:0/3688951337 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c034660 con 0x7f61a4143790 2024-03-30T01:51:43.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.856+0000 7f61ac800640 1 -- 172.21.15.133:0/3688951337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61a4143790 msgr2=0x7f61a40cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:43.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.856+0000 7f61ac800640 1 --2- 172.21.15.133:0/3688951337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61a4143790 0x7f61a40cbb10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f619c009d90 tx=0x7f619c02bf30 comp rx=0 tx=0).stop 2024-03-30T01:51:43.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.856+0000 7f61ac800640 1 -- 172.21.15.133:0/3688951337 shutdown_connections 2024-03-30T01:51:43.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.856+0000 7f61ac800640 1 --2- 172.21.15.133:0/3688951337 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61a40ccc40 0x7f61a4070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:43.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.856+0000 7f61ac800640 1 --2- 172.21.15.133:0/3688951337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61a4143790 0x7f61a40cbb10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:43.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.856+0000 7f61ac800640 1 -- 172.21.15.133:0/3688951337 >> 172.21.15.133:0/3688951337 conn(0x7f61a40b07a0 msgr2=0x7f61a40b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:43.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.856+0000 7f61ac800640 1 -- 172.21.15.133:0/3688951337 shutdown_connections 2024-03-30T01:51:43.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.856+0000 7f61ac800640 1 -- 172.21.15.133:0/3688951337 wait complete. 2024-03-30T01:51:43.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.857+0000 7f61ac800640 1 Processor -- start 2024-03-30T01:51:43.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.858+0000 7f61ac800640 1 -- start start 2024-03-30T01:51:43.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.858+0000 7f61ac800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61a4070500 0x7f61a41f29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:43.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.858+0000 7f61ac800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61a40ccc40 0x7f61a40ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:43.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.858+0000 7f61ac800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61a4143790 0x7f61a406c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:43.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.859+0000 7f61ac800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a41f2f00 con 0x7f61a4143790 2024-03-30T01:51:43.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.859+0000 7f61ac800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a406d6b0 con 0x7f61a40ccc40 2024-03-30T01:51:43.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.859+0000 7f61ac800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a413ea10 con 0x7f61a4070500 2024-03-30T01:51:43.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.859+0000 7f61aa800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61a4143790 0x7f61a406c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:43.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.859+0000 7f61aa800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61a4143790 0x7f61a406c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45946/0 (socket says 172.21.15.133:45946) 2024-03-30T01:51:43.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.859+0000 7f61aa800640 1 -- 172.21.15.133:0/2719672822 learned_addr learned my addr 172.21.15.133:0/2719672822 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:43.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.859+0000 7f61a9e00640 1 --2- 172.21.15.133:0/2719672822 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61a4070500 0x7f61a41f29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:43.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.859+0000 7f61a9400640 1 --2- 172.21.15.133:0/2719672822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61a40ccc40 0x7f61a40ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:43.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.859+0000 7f61aa800640 1 -- 172.21.15.133:0/2719672822 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61a4070500 msgr2=0x7f61a41f29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:43.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.859+0000 7f61aa800640 1 --2- 172.21.15.133:0/2719672822 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61a4070500 0x7f61a41f29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:43.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.859+0000 7f61aa800640 1 -- 172.21.15.133:0/2719672822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61a40ccc40 msgr2=0x7f61a40ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:43.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.859+0000 7f61aa800640 1 --2- 172.21.15.133:0/2719672822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61a40ccc40 0x7f61a40ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:43.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.859+0000 7f61aa800640 1 -- 172.21.15.133:0/2719672822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619c009a70 con 0x7f61a4143790 2024-03-30T01:51:43.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.860+0000 7f61aa800640 1 --2- 172.21.15.133:0/2719672822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61a4143790 0x7f61a406c280 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f61a000b420 tx=0x7f61a000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:43.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.860+0000 7f619a000640 1 -- 172.21.15.133:0/2719672822 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0011830 con 0x7f61a4143790 2024-03-30T01:51:43.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.860+0000 7f619a000640 1 -- 172.21.15.133:0/2719672822 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a0011990 con 0x7f61a4143790 2024-03-30T01:51:43.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.860+0000 7f619a000640 1 -- 172.21.15.133:0/2719672822 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0011d40 con 0x7f61a4143790 2024-03-30T01:51:43.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.860+0000 7f61ac800640 1 -- 172.21.15.133:0/2719672822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a413de00 con 0x7f61a4143790 2024-03-30T01:51:43.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.860+0000 7f61ac800640 1 -- 172.21.15.133:0/2719672822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a413e3c0 con 0x7f61a4143790 2024-03-30T01:51:43.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.861+0000 7f61ac800640 1 -- 172.21.15.133:0/2719672822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a4066d80 con 0x7f61a4143790 2024-03-30T01:51:43.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.862+0000 7f619a000640 1 -- 172.21.15.133:0/2719672822 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f61a001b460 con 0x7f61a4143790 2024-03-30T01:51:43.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.863+0000 7f619a000640 1 --2- 172.21.15.133:0/2719672822 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f618806ac00 0x7f618806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:43.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.863+0000 7f619a000640 1 -- 172.21.15.133:0/2719672822 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61a0089090 con 0x7f61a4143790 2024-03-30T01:51:43.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.863+0000 7f61a9e00640 1 --2- 172.21.15.133:0/2719672822 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f618806ac00 0x7f618806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:43.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.864+0000 7f61a9e00640 1 --2- 172.21.15.133:0/2719672822 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f618806ac00 0x7f618806d0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f619c036000 tx=0x7f619c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:43.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:43.868+0000 7f619a000640 1 -- 172.21.15.133:0/2719672822 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f61a0054270 con 0x7f61a4143790 2024-03-30T01:51:44.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.060+0000 7f61ac800640 1 -- 172.21.15.133:0/2719672822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61a413eb50 con 0x7f61a4143790 2024-03-30T01:51:44.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.063+0000 7f619a000640 1 -- 172.21.15.133:0/2719672822 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f61a0057890 con 0x7f61a4143790 2024-03-30T01:51:44.070 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:44.070 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:51:33.780665+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:51:31.245378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T01:51:31.774247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:51:44.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.065+0000 7f61ac800640 1 -- 172.21.15.133:0/2719672822 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f618806ac00 msgr2=0x7f618806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.065+0000 7f61ac800640 1 --2- 172.21.15.133:0/2719672822 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f618806ac00 0x7f618806d0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f619c036000 tx=0x7f619c030000 comp rx=0 tx=0).stop 2024-03-30T01:51:44.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.065+0000 7f61ac800640 1 -- 172.21.15.133:0/2719672822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61a4143790 msgr2=0x7f61a406c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.065+0000 7f61ac800640 1 --2- 172.21.15.133:0/2719672822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61a4143790 0x7f61a406c280 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f61a000b420 tx=0x7f61a000b8e0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.066+0000 7f61ac800640 1 -- 172.21.15.133:0/2719672822 shutdown_connections 2024-03-30T01:51:44.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.066+0000 7f61ac800640 1 --2- 172.21.15.133:0/2719672822 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f618806ac00 0x7f618806d0c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.066+0000 7f61ac800640 1 --2- 172.21.15.133:0/2719672822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61a4143790 0x7f61a406c280 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.066+0000 7f61ac800640 1 --2- 172.21.15.133:0/2719672822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61a40ccc40 0x7f61a40ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.066+0000 7f61ac800640 1 --2- 172.21.15.133:0/2719672822 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61a4070500 0x7f61a41f29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.066+0000 7f61ac800640 1 -- 172.21.15.133:0/2719672822 >> 172.21.15.133:0/2719672822 conn(0x7f61a40b07a0 msgr2=0x7f61a4142890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.066+0000 7f61ac800640 1 -- 172.21.15.133:0/2719672822 shutdown_connections 2024-03-30T01:51:44.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.066+0000 7f61ac800640 1 -- 172.21.15.133:0/2719672822 wait complete. 2024-03-30T01:51:44.093 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-30T01:51:44.094 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-30T01:51:44.094 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-30T01:51:44.095 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-30T01:51:44.095 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-30T01:51:44.096 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-30T01:51:44.096 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-30T01:51:44.097 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-30T01:51:44.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.385+0000 7f4b38800640 1 Processor -- start 2024-03-30T01:51:44.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.385+0000 7f4b38800640 1 -- start start 2024-03-30T01:51:44.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.388+0000 7f4b38800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4b2c04fa50 0x7f4b2c04fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.388+0000 7f4b38800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4b2c0df3e0 0x7f4b2c038280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.389+0000 7f4b38800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2c006860 con 0x7f4b2c0387c0 2024-03-30T01:51:44.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.389+0000 7f4b35400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4b2c0df3e0 0x7f4b2c038280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.389+0000 7f4b35400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4b2c0df3e0 0x7f4b2c038280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45956/0 (socket says 172.21.15.133:45956) 2024-03-30T01:51:44.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.389+0000 7f4b35400640 1 -- 172.21.15.133:0/4248808156 learned_addr learned my addr 172.21.15.133:0/4248808156 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.389+0000 7f4b38800640 1 -- 172.21.15.133:0/4248808156 --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2c007730 con 0x7f4b2c0df3e0 2024-03-30T01:51:44.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.389+0000 7f4b38800640 1 -- 172.21.15.133:0/4248808156 --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2c050370 con 0x7f4b2c04fa50 2024-03-30T01:51:44.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.389+0000 7f4b35e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4b2c04fa50 0x7f4b2c04fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.390+0000 7f4b35400640 1 -- 172.21.15.133:0/4248808156 >> v2:172.21.15.137:3300/0 conn(0x7f4b2c04fa50 msgr2=0x7f4b2c04fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:44.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.390+0000 7f4b35400640 1 --2- 172.21.15.133:0/4248808156 >> v2:172.21.15.137:3300/0 conn(0x7f4b2c04fa50 0x7f4b2c04fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.390+0000 7f4b35400640 1 -- 172.21.15.133:0/4248808156 >> v1:172.21.15.137:6789/0 conn(0x7f4b2c0387c0 legacy=0x7f4b2c038c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:44.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.390+0000 7f4b35400640 1 -- 172.21.15.133:0/4248808156 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c006ab0 con 0x7f4b2c0df3e0 2024-03-30T01:51:44.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.392+0000 7f4527c00640 1 Processor -- start 2024-03-30T01:51:44.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.392+0000 7f4b35400640 1 --2- 172.21.15.133:0/4248808156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b2c0df3e0 0x7f4b2c038280 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c052970 tx=0x7f4b2002ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57441b9013cc07bc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.392+0000 7f4527c00640 1 -- start start 2024-03-30T01:51:44.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.392+0000 7f4b34a00640 1 -- 172.21.15.133:0/4248808156 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b20008df0 con 0x7f4b2c0df3e0 2024-03-30T01:51:44.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.393+0000 7f4b34a00640 1 -- 172.21.15.133:0/4248808156 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2000a0d0 con 0x7f4b2c0df3e0 2024-03-30T01:51:44.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.393+0000 7f4b34a00640 1 -- 172.21.15.133:0/4248808156 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2000a460 con 0x7f4b2c0df3e0 2024-03-30T01:51:44.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.394+0000 7f4b38800640 1 -- 172.21.15.133:0/4248808156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b2c0df3e0 msgr2=0x7f4b2c038280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.394+0000 7f4b38800640 1 --2- 172.21.15.133:0/4248808156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b2c0df3e0 0x7f4b2c038280 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c052970 tx=0x7f4b2002ca30 comp rx=0 tx=0).stop 2024-03-30T01:51:44.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.393+0000 7f6410a00640 1 Processor -- start 2024-03-30T01:51:44.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.393+0000 7f6410a00640 1 -- start start 2024-03-30T01:51:44.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.394+0000 7f4527c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f452015b600 0x7f45200b2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.394+0000 7f4527c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4520165960 0x7f45200cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.394+0000 7f4b38800640 1 -- 172.21.15.133:0/4248808156 shutdown_connections 2024-03-30T01:51:44.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.394+0000 7f4b38800640 1 --2- 172.21.15.133:0/4248808156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b2c0df3e0 0x7f4b2c038280 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.394+0000 7f4b38800640 1 --2- 172.21.15.133:0/4248808156 >> v2:172.21.15.137:3300/0 conn(0x7f4b2c04fa50 0x7f4b2c04fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.394+0000 7f4b38800640 1 -- 172.21.15.133:0/4248808156 >> 172.21.15.133:0/4248808156 conn(0x7f4b2c009f70 msgr2=0x7f4b2c00a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.394+0000 7f4527c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4520164c30 con 0x7f45200b27d0 2024-03-30T01:51:44.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.394+0000 7f4527c00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45201654d0 con 0x7f4520165960 2024-03-30T01:51:44.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.394+0000 7f4527c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45200b2d30 con 0x7f452015b600 2024-03-30T01:51:44.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.395+0000 7f451fe00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4520165960 0x7f45200cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.395+0000 7f451fe00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4520165960 0x7f45200cb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45970/0 (socket says 172.21.15.133:45970) 2024-03-30T01:51:44.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.395+0000 7f451fe00640 1 -- 172.21.15.133:0/757615666 learned_addr learned my addr 172.21.15.133:0/757615666 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.395+0000 7f4525200640 1 --2- 172.21.15.133:0/757615666 >> v2:172.21.15.137:3300/0 conn(0x7f452015b600 0x7f45200b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.394+0000 7f94c6c00640 1 Processor -- start 2024-03-30T01:51:44.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.395+0000 7f94c6c00640 1 -- start start 2024-03-30T01:51:44.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.395+0000 7f4b38800640 1 -- 172.21.15.133:0/4248808156 shutdown_connections 2024-03-30T01:51:44.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.395+0000 7f4b38800640 1 -- 172.21.15.133:0/4248808156 wait complete. 2024-03-30T01:51:44.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.395+0000 7f6410a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f640c152da0 0x7f640c153210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.395+0000 7f6410a00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640c15cdf0 con 0x7f640c0b38c0 2024-03-30T01:51:44.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.395+0000 7f6410a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640c159570 con 0x7f640c06e5f0 2024-03-30T01:51:44.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.395+0000 7f6410a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640c15a110 con 0x7f640c152da0 2024-03-30T01:51:44.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.396+0000 7f451f400640 1 -- 172.21.15.133:0/757615666 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729409438 0 0) 0x7f4520164c30 con 0x7f45200b27d0 2024-03-30T01:51:44.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.396+0000 7f451f400640 1 -- 172.21.15.133:0/757615666 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4504003520 con 0x7f45200b27d0 2024-03-30T01:51:44.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.396+0000 7f6409e00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f640c0b38c0 0x7f640c159a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53966/0 (socket says 172.21.15.133:53966) 2024-03-30T01:51:44.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.396+0000 7f640a800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f640c152da0 0x7f640c153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.396+0000 7f640a800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f640c152da0 0x7f640c153210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.133:35864/0 (socket says 172.21.15.133:35864) 2024-03-30T01:51:44.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.396+0000 7f640a800640 1 -- 172.21.15.133:0/3829473441 learned_addr learned my addr 172.21.15.133:0/3829473441 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.397+0000 7f94c6c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f94b8004ad0 0x7f94b80540a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.398+0000 7f4b38800640 1 Processor -- start 2024-03-30T01:51:44.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.398+0000 7f4b38800640 1 -- start start 2024-03-30T01:51:44.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.397+0000 7f6408a00640 1 -- 172.21.15.133:0/3829473441 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301646520 0 0) 0x7f63f8001110 con 0x7f640c0b38c0 2024-03-30T01:51:44.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.398+0000 7f6408a00640 1 -- 172.21.15.133:0/3829473441 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63f0003520 con 0x7f640c0b38c0 2024-03-30T01:51:44.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.398+0000 7f6408a00640 1 -- 172.21.15.133:0/3829473441 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3031382111 0 0) 0x7f63f0003520 con 0x7f640c0b38c0 2024-03-30T01:51:44.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.398+0000 7f6408a00640 1 -- 172.21.15.133:0/3829473441 >> v2:172.21.15.137:3300/0 conn(0x7f640c152da0 msgr2=0x7f640c153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:44.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.398+0000 7f6408a00640 1 --2- 172.21.15.133:0/3829473441 >> v2:172.21.15.137:3300/0 conn(0x7f640c152da0 0x7f640c153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.397+0000 7f94c6c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f94b80503c0 0x7f94b80e9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.397+0000 7f94c6c00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b8007030 con 0x7f94b80549a0 2024-03-30T01:51:44.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.397+0000 7f94c6c00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b8007310 con 0x7f94b80503c0 2024-03-30T01:51:44.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.397+0000 7f94c6c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b80075f0 con 0x7f94b8004ad0 2024-03-30T01:51:44.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.398+0000 7f94c5800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f94b8004ad0 0x7f94b80540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.398+0000 7f94c5800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f94b8004ad0 0x7f94b80540a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.133:35866/0 (socket says 172.21.15.133:35866) 2024-03-30T01:51:44.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.398+0000 7f94c5800640 1 -- 172.21.15.133:0/3811008863 learned_addr learned my addr 172.21.15.133:0/3811008863 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.396+0000 7f4525200640 1 -- 172.21.15.133:0/757615666 >> v2:172.21.15.133:3300/0 conn(0x7f4520165960 msgr2=0x7f45200cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:44.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.396+0000 7f4525200640 1 --2- 172.21.15.133:0/757615666 >> v2:172.21.15.133:3300/0 conn(0x7f4520165960 0x7f45200cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.396+0000 7f4525200640 1 -- 172.21.15.133:0/757615666 >> v1:172.21.15.137:6789/0 conn(0x7f45200b27d0 legacy=0x7f45200704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.396+0000 7f4525200640 1 -- 172.21.15.133:0/757615666 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4520164e80 con 0x7f452015b600 2024-03-30T01:51:44.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.398+0000 7f6408a00640 1 -- 172.21.15.133:0/3829473441 >> v1:172.21.15.137:6789/0 conn(0x7f640c06e5f0 legacy=0x7f640c15c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.399+0000 7f6408a00640 1 -- 172.21.15.133:0/3829473441 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c15d030 con 0x7f640c0b38c0 2024-03-30T01:51:44.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.399+0000 7f6408a00640 1 -- 172.21.15.133:0/3829473441 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f63f8001800 con 0x7f640c0b38c0 2024-03-30T01:51:44.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.399+0000 7f6408a00640 1 -- 172.21.15.133:0/3829473441 >> v1:172.21.15.133:6789/0 conn(0x7f640c0b38c0 legacy=0x7f640c159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.399+0000 7f6408a00640 1 --2- 172.21.15.133:0/3829473441 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63f00039c0 0x7f63f0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.399+0000 7f6408a00640 1 --2- 172.21.15.133:0/3829473441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f00047c0 0x7f63f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.399+0000 7f6408a00640 1 --2- 172.21.15.133:0/3829473441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63f0005180 0x7f63f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.399+0000 7f6408a00640 1 -- 172.21.15.133:0/3829473441 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c15a110 con 0x7f63f00047c0 2024-03-30T01:51:44.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.399+0000 7f6408a00640 1 -- 172.21.15.133:0/3829473441 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f0014870 con 0x7f63f0005180 2024-03-30T01:51:44.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.399+0000 7f6408a00640 1 -- 172.21.15.133:0/3829473441 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f0014a30 con 0x7f63f00039c0 2024-03-30T01:51:44.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.399+0000 7f4525200640 1 --2- 172.21.15.133:0/757615666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f452015b600 0x7f45200b2290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f45200717e0 tx=0x7f451802bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab6640535e7c0fa4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.399+0000 7f451f400640 1 -- 172.21.15.133:0/757615666 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451802cb50 con 0x7f452015b600 2024-03-30T01:51:44.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.400+0000 7f451f400640 1 -- 172.21.15.133:0/757615666 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451802ccb0 con 0x7f452015b600 2024-03-30T01:51:44.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.400+0000 7f451f400640 1 -- 172.21.15.133:0/757615666 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4518034660 con 0x7f452015b600 2024-03-30T01:51:44.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.399+0000 7f94c5800640 1 -- 172.21.15.133:0/3811008863 >> v2:172.21.15.133:3300/0 conn(0x7f94b80503c0 msgr2=0x7f94b80e9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:44.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.399+0000 7f94c5800640 1 --2- 172.21.15.133:0/3811008863 >> v2:172.21.15.133:3300/0 conn(0x7f94b80503c0 0x7f94b80e9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.399+0000 7f94c5800640 1 -- 172.21.15.133:0/3811008863 >> v1:172.21.15.133:6789/0 conn(0x7f94b80549a0 legacy=0x7f94b804fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:44.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.399+0000 7f94c5800640 1 -- 172.21.15.133:0/3811008863 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b80078d0 con 0x7f94b8004ad0 2024-03-30T01:51:44.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.400+0000 7f6409e00640 1 --2- 172.21.15.133:0/3829473441 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63f00039c0 0x7f63f0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.400+0000 7f4b38800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b2c0387c0 0x7f4b2c04e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.400+0000 7f4b38800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b2c04fa50 0x7f4b2c0e1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.400+0000 7f26a1c00640 1 Processor -- start 2024-03-30T01:51:44.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.400+0000 7f4b38800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b2c0df3e0 0x7f4b2c0d7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.400+0000 7f640a800640 1 --2- 172.21.15.133:0/3829473441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63f0005180 0x7f63f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.401+0000 7f4b38800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c04d040 con 0x7f4b2c04fa50 2024-03-30T01:51:44.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.401+0000 7f4b38800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0e12a0 con 0x7f4b2c0df3e0 2024-03-30T01:51:44.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.401+0000 7f4b38800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0e1580 con 0x7f4b2c0387c0 2024-03-30T01:51:44.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.400+0000 7f26a1c00640 1 -- start start 2024-03-30T01:51:44.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.401+0000 7f6409400640 1 --2- 172.21.15.133:0/3829473441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f00047c0 0x7f63f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.401+0000 7f4b35e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b2c0387c0 0x7f4b2c04e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.401+0000 7f4b35e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b2c0387c0 0x7f4b2c04e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.133:52690/0 (socket says 172.21.15.133:52690) 2024-03-30T01:51:44.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.401+0000 7f4b35e00640 1 -- 172.21.15.133:0/2942112184 learned_addr learned my addr 172.21.15.133:0/2942112184 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.401+0000 7f4b35400640 1 --2- 172.21.15.133:0/2942112184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b2c04fa50 0x7f4b2c0e1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.401+0000 7f6409e00640 1 -- 172.21.15.133:0/3829473441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63f0005180 msgr2=0x7f63f000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:44.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.401+0000 7f6409e00640 1 --2- 172.21.15.133:0/3829473441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63f0005180 0x7f63f000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.401+0000 7f6409e00640 1 -- 172.21.15.133:0/3829473441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f00047c0 msgr2=0x7f63f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:44.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.401+0000 7f6409e00640 1 --2- 172.21.15.133:0/3829473441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f00047c0 0x7f63f0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.401+0000 7f6409e00640 1 -- 172.21.15.133:0/3829473441 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f0003520 con 0x7f63f00039c0 2024-03-30T01:51:44.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.402+0000 7f640a800640 1 -- 172.21.15.133:0/3829473441 reap_dead start 2024-03-30T01:51:44.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.401+0000 7f4527c00640 1 -- 172.21.15.133:0/757615666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f452015b600 msgr2=0x7f45200b2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.401+0000 7f4527c00640 1 --2- 172.21.15.133:0/757615666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f452015b600 0x7f45200b2290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f45200717e0 tx=0x7f451802bda0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.402+0000 7f4b36800640 1 --2- 172.21.15.133:0/2942112184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b2c0df3e0 0x7f4b2c0d7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.402+0000 7f94c5800640 1 --2- 172.21.15.133:0/3811008863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94b8004ad0 0x7f94b80540a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f94b8008a50 tx=0x7f94b402b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0bc694c005c1d0a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.402+0000 7f26a1c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f269c15ea60 0x7f269c070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.402+0000 7f4b35e00640 1 -- 172.21.15.133:0/2942112184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b2c0df3e0 msgr2=0x7f4b2c0d7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.402+0000 7f4b35e00640 1 --2- 172.21.15.133:0/2942112184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b2c0df3e0 0x7f4b2c0d7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.402+0000 7f4b35e00640 1 -- 172.21.15.133:0/2942112184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b2c04fa50 msgr2=0x7f4b2c0e1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.402+0000 7f94bfe00640 1 -- 172.21.15.133:0/3811008863 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4031890 con 0x7f94b8004ad0 2024-03-30T01:51:44.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.403+0000 7f94bfe00640 1 -- 172.21.15.133:0/3811008863 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b40319f0 con 0x7f94b8004ad0 2024-03-30T01:51:44.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.403+0000 7f94bfe00640 1 -- 172.21.15.133:0/3811008863 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4031d80 con 0x7f94b8004ad0 2024-03-30T01:51:44.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.402+0000 7f26a1c00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f269c0b3db0 con 0x7f269c0b38b0 2024-03-30T01:51:44.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.403+0000 7f4b35e00640 1 --2- 172.21.15.133:0/2942112184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b2c04fa50 0x7f4b2c0e1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.403+0000 7f4b35e00640 1 -- 172.21.15.133:0/2942112184 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b20007040 con 0x7f4b2c0387c0 2024-03-30T01:51:44.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.403+0000 7f26a1c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f269c15ee40 con 0x7f269c070a40 2024-03-30T01:51:44.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.403+0000 7f26a1c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f269c070eb0 con 0x7f269c15ea60 2024-03-30T01:51:44.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.403+0000 7f269b400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f269c0b38b0 0x7f269c0b18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53996/0 (socket says 172.21.15.133:53996) 2024-03-30T01:51:44.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.403+0000 7f269b400640 1 -- 172.21.15.133:0/3416031552 learned_addr learned my addr 172.21.15.133:0/3416031552 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:44.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.403+0000 7f269aa00640 1 --2- 172.21.15.133:0/3416031552 >> v2:172.21.15.137:3300/0 conn(0x7f269c15ea60 0x7f269c070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.403+0000 7f4b36800640 1 --2- 172.21.15.133:0/2942112184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b2c0df3e0 0x7f4b2c0d7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:44.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.403+0000 7f4b35400640 1 --2- 172.21.15.133:0/2942112184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b2c04fa50 0x7f4b2c0e1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T01:51:44.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.403+0000 7f6409e00640 1 --2- 172.21.15.133:0/3829473441 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63f00039c0 0x7f63f0003de0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f63f8007f10 tx=0x7f63f00057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c22a3235b80be76 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.403+0000 7f4527c00640 1 -- 172.21.15.133:0/757615666 shutdown_connections 2024-03-30T01:51:44.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.403+0000 7f4527c00640 1 --2- 172.21.15.133:0/757615666 >> v2:172.21.15.133:3300/0 conn(0x7f4520165960 0x7f45200cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.404+0000 7f92c9600640 1 Processor -- start 2024-03-30T01:51:44.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.404+0000 7f6408a00640 1 -- 172.21.15.133:0/3829473441 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f8005a10 con 0x7f63f00039c0 2024-03-30T01:51:44.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.404+0000 7f94c6c00640 1 -- 172.21.15.133:0/3811008863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94b8004ad0 msgr2=0x7f94b80540a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.404+0000 7f94c6c00640 1 --2- 172.21.15.133:0/3811008863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94b8004ad0 0x7f94b80540a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f94b8008a50 tx=0x7f94b402b930 comp rx=0 tx=0).stop 2024-03-30T01:51:44.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.404+0000 7fa24aa00640 1 Processor -- start 2024-03-30T01:51:44.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.404+0000 7f2699600640 1 -- 172.21.15.133:0/3416031552 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1971701990 0 0) 0x7f269c0b3db0 con 0x7f269c0b38b0 2024-03-30T01:51:44.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.404+0000 7f2699600640 1 -- 172.21.15.133:0/3416031552 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2680003520 con 0x7f269c0b38b0 2024-03-30T01:51:44.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.404+0000 7f4b35e00640 1 --2- 172.21.15.133:0/2942112184 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b2c0387c0 0x7f4b2c04e110 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4b2400d800 tx=0x7f4b2400dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.404+0000 7f269aa00640 1 -- 172.21.15.133:0/3416031552 >> v1:172.21.15.137:6789/0 conn(0x7f269c070a40 legacy=0x7f269c0b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.404+0000 7f269aa00640 1 -- 172.21.15.133:0/3416031552 >> v1:172.21.15.133:6789/0 conn(0x7f269c0b38b0 legacy=0x7f269c0b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.404+0000 7f269aa00640 1 -- 172.21.15.133:0/3416031552 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269c161510 con 0x7f269c15ea60 2024-03-30T01:51:44.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.403+0000 7f4527c00640 1 --2- 172.21.15.133:0/757615666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f452015b600 0x7f45200b2290 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.404+0000 7f92c9600640 1 -- start start 2024-03-30T01:51:44.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.404+0000 7f4b2a000640 1 -- 172.21.15.133:0/2942112184 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2400b6c0 con 0x7f4b2c0387c0 2024-03-30T01:51:44.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.404+0000 7f6408a00640 1 -- 172.21.15.133:0/3829473441 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f8005b70 con 0x7f63f00039c0 2024-03-30T01:51:44.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.404+0000 7f6408a00640 1 -- 172.21.15.133:0/3829473441 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f8007070 con 0x7f63f00039c0 2024-03-30T01:51:44.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.405+0000 7f94c6c00640 1 -- 172.21.15.133:0/3811008863 shutdown_connections 2024-03-30T01:51:44.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.405+0000 7f94c6c00640 1 --2- 172.21.15.133:0/3811008863 >> v2:172.21.15.133:3300/0 conn(0x7f94b80503c0 0x7f94b80e9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.405+0000 7f94c6c00640 1 --2- 172.21.15.133:0/3811008863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94b8004ad0 0x7f94b80540a0 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f94b8008a50 tx=0x7f94b402b930 comp rx=0 tx=0).stop 2024-03-30T01:51:44.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.405+0000 7f94c6c00640 1 -- 172.21.15.133:0/3811008863 >> 172.21.15.133:0/3811008863 conn(0x7f94b8054ee0 msgr2=0x7f94b80552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.403+0000 7f4527c00640 1 -- 172.21.15.133:0/757615666 >> 172.21.15.133:0/757615666 conn(0x7f45200b05c0 msgr2=0x7f45200b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.405+0000 7f4527c00640 1 -- 172.21.15.133:0/757615666 shutdown_connections 2024-03-30T01:51:44.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.405+0000 7f6410a00640 1 -- 172.21.15.133:0/3829473441 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63f00039c0 msgr2=0x7f63f0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.405+0000 7f6410a00640 1 --2- 172.21.15.133:0/3829473441 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63f00039c0 0x7f63f0003de0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f63f8007f10 tx=0x7f63f00057f0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.405+0000 7f4b38800640 1 -- 172.21.15.133:0/2942112184 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2c0e1860 con 0x7f4b2c0387c0 2024-03-30T01:51:44.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.405+0000 7f4b38800640 1 -- 172.21.15.133:0/2942112184 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2c04e650 con 0x7f4b2c0387c0 2024-03-30T01:51:44.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.405+0000 7f6410a00640 1 -- 172.21.15.133:0/3829473441 shutdown_connections 2024-03-30T01:51:44.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.405+0000 7f6410a00640 1 --2- 172.21.15.133:0/3829473441 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63f00039c0 0x7f63f0003de0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.405+0000 7f6410a00640 1 -- 172.21.15.133:0/3829473441 >> 172.21.15.133:0/3829473441 conn(0x7f640c0b07a0 msgr2=0x7f640c0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.405+0000 7f6410a00640 1 -- 172.21.15.133:0/3829473441 shutdown_connections 2024-03-30T01:51:44.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.405+0000 7f94c6c00640 1 -- 172.21.15.133:0/3811008863 shutdown_connections 2024-03-30T01:51:44.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.405+0000 7f6410a00640 1 -- 172.21.15.133:0/3829473441 wait complete. 2024-03-30T01:51:44.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.405+0000 7f4527c00640 1 -- 172.21.15.133:0/757615666 wait complete. 2024-03-30T01:51:44.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.405+0000 7f4b2a000640 1 -- 172.21.15.133:0/2942112184 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2400b820 con 0x7f4b2c0387c0 2024-03-30T01:51:44.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.405+0000 7f4b2a000640 1 -- 172.21.15.133:0/2942112184 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2400b6c0 con 0x7f4b2c0387c0 2024-03-30T01:51:44.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.406+0000 7f92c9600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92c415cc50 0x7f92c40d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.406+0000 7f269aa00640 1 --2- 172.21.15.133:0/3416031552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f269c15ea60 0x7f269c070500 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2694009d90 tx=0x7f269402bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d309d3ec084c6f2e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.406+0000 7fa24aa00640 1 -- start start 2024-03-30T01:51:44.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.406+0000 7f92c9600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f92c40d2240 0x7f92c40cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.406+0000 7f92c9600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c415d030 con 0x7f92c40cf9b0 2024-03-30T01:51:44.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.406+0000 7f92c9600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c40d1c50 con 0x7f92c40d2240 2024-03-30T01:51:44.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.406+0000 7f92c9600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c40cfe40 con 0x7f92c415cc50 2024-03-30T01:51:44.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.406+0000 7f2699600640 1 -- 172.21.15.133:0/3416031552 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269402cc70 con 0x7f269c15ea60 2024-03-30T01:51:44.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.407+0000 7f2699600640 1 -- 172.21.15.133:0/3416031552 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269402cdd0 con 0x7f269c15ea60 2024-03-30T01:51:44.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.407+0000 7f2699600640 1 -- 172.21.15.133:0/3416031552 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694034660 con 0x7f269c15ea60 2024-03-30T01:51:44.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.407+0000 7f4b38800640 1 -- 172.21.15.133:0/2942112184 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4b0c000fc0 con 0x7f4b2c0387c0 2024-03-30T01:51:44.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.407+0000 7f92c3400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f92c40cf9b0 0x7f92c40b14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.133:42074/0 (socket says 172.21.15.133:42074) 2024-03-30T01:51:44.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.407+0000 7f92c3400640 1 -- 172.21.15.133:0/1681182297 learned_addr learned my addr 172.21.15.133:0/1681182297 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:44.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.407+0000 7f4527c00640 1 Processor -- start 2024-03-30T01:51:44.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.408+0000 7f6410a00640 1 Processor -- start 2024-03-30T01:51:44.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.408+0000 7fa24aa00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa244152fa0 0x7fa244159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.408+0000 7f4527c00640 1 -- start start 2024-03-30T01:51:44.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.408+0000 7fa24aa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa24406dc10 0x7fa24406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.408+0000 7f92c2000640 1 --2- 172.21.15.133:0/1681182297 >> v2:172.21.15.137:3300/0 conn(0x7f92c40d2240 0x7f92c40cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.408+0000 7fa24aa00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa24406ce60 0x7fa24415c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.408+0000 7fa24aa00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24406d2d0 con 0x7fa24406ce60 2024-03-30T01:51:44.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.408+0000 7fa24aa00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24406ed50 con 0x7fa244152fa0 2024-03-30T01:51:44.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.408+0000 7fa24aa00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24415a020 con 0x7fa24406dc10 2024-03-30T01:51:44.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.408+0000 7fee3fe00640 1 Processor -- start 2024-03-30T01:51:44.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.408+0000 7f6410a00640 1 -- start start 2024-03-30T01:51:44.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.408+0000 7fa243400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa24406dc10 0x7fa24406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7f92c2a00640 1 --2- 172.21.15.133:0/1681182297 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92c415cc50 0x7f92c40d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7f92c1600640 1 -- 172.21.15.133:0/1681182297 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 641062024 0 0) 0x7f92c415d030 con 0x7f92c40cf9b0 2024-03-30T01:51:44.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.407+0000 7f94c6c00640 1 -- 172.21.15.133:0/3811008863 wait complete. 2024-03-30T01:51:44.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.408+0000 7fa243400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa24406dc10 0x7fa24406c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.133:52696/0 (socket says 172.21.15.133:52696) 2024-03-30T01:51:44.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.408+0000 7fa243400640 1 -- 172.21.15.133:0/734994036 learned_addr learned my addr 172.21.15.133:0/734994036 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7f26a1c00640 1 -- 172.21.15.133:0/3416031552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f269c15ea60 msgr2=0x7f269c070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7f26a1c00640 1 --2- 172.21.15.133:0/3416031552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f269c15ea60 0x7f269c070500 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2694009d90 tx=0x7f269402bec0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7f92c1600640 1 -- 172.21.15.133:0/1681182297 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92a8003520 con 0x7f92c40cf9b0 2024-03-30T01:51:44.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7f94c6c00640 1 Processor -- start 2024-03-30T01:51:44.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7fa243e00640 1 --2- 172.21.15.133:0/734994036 >> v2:172.21.15.137:3300/0 conn(0x7fa244152fa0 0x7fa244159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7f26a1c00640 1 -- 172.21.15.133:0/3416031552 shutdown_connections 2024-03-30T01:51:44.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7f4527c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45200b27d0 0x7f452014fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7f4527c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f452015b600 0x7f4520152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7f26a1c00640 1 --2- 172.21.15.133:0/3416031552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f269c15ea60 0x7f269c070500 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7f94c6c00640 1 -- start start 2024-03-30T01:51:44.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7f6410a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63f00039c0 0x7f640c156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7f6410a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f640c141e90 0x7f640c1422f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7f6410a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f640c14db20 0x7f640c14dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7fa243400640 1 -- 172.21.15.133:0/734994036 >> v2:172.21.15.137:3300/0 conn(0x7fa244152fa0 msgr2=0x7fa244159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:44.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.410+0000 7f26a1c00640 1 -- 172.21.15.133:0/3416031552 >> 172.21.15.133:0/3416031552 conn(0x7f269c0b07a0 msgr2=0x7f269c0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7f6410a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c142830 con 0x7f640c141e90 2024-03-30T01:51:44.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7f6410a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c14e850 con 0x7f640c14db20 2024-03-30T01:51:44.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7f6410a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640c14eb30 con 0x7f63f00039c0 2024-03-30T01:51:44.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.410+0000 7f4527c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4520165960 0x7f4520152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7fa243400640 1 --2- 172.21.15.133:0/734994036 >> v2:172.21.15.137:3300/0 conn(0x7fa244152fa0 0x7fa244159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.410+0000 7f92c2000640 1 -- 172.21.15.133:0/1681182297 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92c415cc50 msgr2=0x7f92c40d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:44.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.410+0000 7f26a1c00640 1 -- 172.21.15.133:0/3416031552 shutdown_connections 2024-03-30T01:51:44.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.410+0000 7f4527c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452015cc00 con 0x7f4520165960 2024-03-30T01:51:44.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.410+0000 7f451fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f452015b600 0x7f4520152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7fa243400640 1 -- 172.21.15.133:0/734994036 >> v2:172.21.15.133:3300/0 conn(0x7fa24406ce60 msgr2=0x7fa24415c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:44.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.410+0000 7f6409e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63f00039c0 0x7f640c156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.410+0000 7f4525c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4520165960 0x7f4520152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.410+0000 7f451fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f452015b600 0x7f4520152540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.133:35934/0 (socket says 172.21.15.133:35934) 2024-03-30T01:51:44.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.410+0000 7f451fe00640 1 -- 172.21.15.133:0/2855006994 learned_addr learned my addr 172.21.15.133:0/2855006994 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.410+0000 7f4527c00640 1 -- 172.21.15.133:0/2855006994 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4520153d90 con 0x7f452015b600 2024-03-30T01:51:44.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.410+0000 7f26a1c00640 1 -- 172.21.15.133:0/3416031552 wait complete. 2024-03-30T01:51:44.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.410+0000 7f4527c00640 1 -- 172.21.15.133:0/2855006994 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45201537d0 con 0x7f45200b27d0 2024-03-30T01:51:44.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.410+0000 7f6409e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63f00039c0 0x7f640c156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.133:52724/0 (socket says 172.21.15.133:52724) 2024-03-30T01:51:44.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.410+0000 7f6409e00640 1 -- 172.21.15.133:0/658293695 learned_addr learned my addr 172.21.15.133:0/658293695 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7fee3fe00640 1 -- start start 2024-03-30T01:51:44.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.410+0000 7f640a800640 1 --2- 172.21.15.133:0/658293695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f640c14db20 0x7f640c14dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7f4525200640 1 --2- 172.21.15.133:0/2855006994 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45200b27d0 0x7f452014fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7f6409400640 1 --2- 172.21.15.133:0/658293695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f640c141e90 0x7f640c1422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7f4b2a000640 1 -- 172.21.15.133:0/2942112184 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f4b2400b990 con 0x7f4b2c0387c0 2024-03-30T01:51:44.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7fa243400640 1 --2- 172.21.15.133:0/734994036 >> v2:172.21.15.133:3300/0 conn(0x7fa24406ce60 0x7fa24415c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.409+0000 7fa243400640 1 -- 172.21.15.133:0/734994036 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24406e140 con 0x7fa24406dc10 2024-03-30T01:51:44.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7f94c6c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94b80503c0 0x7f94b804af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7fee3fe00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee400cd3a0 0x7fee400cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7fee3fe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fee400b59c0 0x7fee400b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7fee3fe00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee400d1690 con 0x7fee400cf2b0 2024-03-30T01:51:44.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7fee3fe00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee400b57f0 con 0x7fee400cd3a0 2024-03-30T01:51:44.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7fee3fe00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee400cdd40 con 0x7fee400b59c0 2024-03-30T01:51:44.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.410+0000 7f92c2000640 1 --2- 172.21.15.133:0/1681182297 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92c415cc50 0x7f92c40d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.410+0000 7f92c1600640 1 -- 172.21.15.133:0/1681182297 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2946445730 0 0) 0x7f92a8003520 con 0x7f92c40cf9b0 2024-03-30T01:51:44.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.410+0000 7f92c2000640 1 -- 172.21.15.133:0/1681182297 >> v1:172.21.15.137:6789/0 conn(0x7f92c40cf9b0 legacy=0x7f92c40b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.410+0000 7f92c2000640 1 -- 172.21.15.133:0/1681182297 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c40b5af0 con 0x7f92c40d2240 2024-03-30T01:51:44.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7f92c2a00640 1 --2- 172.21.15.133:0/1681182297 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92c415cc50 0x7f92c40d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T01:51:44.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7f94c6c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94b80549a0 0x7f94b8005e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7f94c6c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94b80de790 0x7f94b80eb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7f6409e00640 1 -- 172.21.15.133:0/658293695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f640c14db20 msgr2=0x7f640c14dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7f6409e00640 1 --2- 172.21.15.133:0/658293695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f640c14db20 0x7f640c14dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7f6409e00640 1 -- 172.21.15.133:0/658293695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f640c141e90 msgr2=0x7f640c1422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7f6409e00640 1 --2- 172.21.15.133:0/658293695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f640c141e90 0x7f640c1422f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7f6409e00640 1 -- 172.21.15.133:0/658293695 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c14ee10 con 0x7f63f00039c0 2024-03-30T01:51:44.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7f94c6c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b80ec910 con 0x7f94b80503c0 2024-03-30T01:51:44.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7f94c6c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b804b600 con 0x7f94b80de790 2024-03-30T01:51:44.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7f94c6c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b804b850 con 0x7f94b80549a0 2024-03-30T01:51:44.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7f451fe00640 1 -- 172.21.15.133:0/2855006994 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45200b27d0 msgr2=0x7f452014fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7f451fe00640 1 --2- 172.21.15.133:0/2855006994 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45200b27d0 0x7f452014fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7f451fe00640 1 -- 172.21.15.133:0/2855006994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4520165960 msgr2=0x7f4520152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7f451fe00640 1 --2- 172.21.15.133:0/2855006994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4520165960 0x7f4520152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.411+0000 7f451fe00640 1 -- 172.21.15.133:0/2855006994 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4518009a70 con 0x7f452015b600 2024-03-30T01:51:44.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.412+0000 7f94c4e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94b80549a0 0x7f94b8005e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.412+0000 7fee36000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee400cd3a0 0x7fee400cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.412+0000 7f94c5800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94b80503c0 0x7f94b804af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.412+0000 7f94c4e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94b80549a0 0x7f94b8005e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.133:52736/0 (socket says 172.21.15.133:52736) 2024-03-30T01:51:44.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.412+0000 7f94c4e00640 1 -- 172.21.15.133:0/3277070763 learned_addr learned my addr 172.21.15.133:0/3277070763 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.412+0000 7fee36000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee400cd3a0 0x7fee400cd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46002/0 (socket says 172.21.15.133:46002) 2024-03-30T01:51:44.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.412+0000 7fee36000640 1 -- 172.21.15.133:0/1624755438 learned_addr learned my addr 172.21.15.133:0/1624755438 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.412+0000 7f451fe00640 1 --2- 172.21.15.133:0/2855006994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f452015b600 0x7f4520152540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f450c00e870 tx=0x7f450c00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.412+0000 7f6409e00640 1 --2- 172.21.15.133:0/658293695 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63f00039c0 0x7f640c156000 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f63f8007f10 tx=0x7f640c1590f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.412+0000 7f94c6200640 1 --2- 172.21.15.133:0/3277070763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94b80de790 0x7f94b80eb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.412+0000 7fee3f400640 1 --2- 172.21.15.133:0/1624755438 >> v2:172.21.15.137:3300/0 conn(0x7fee400b59c0 0x7fee400b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.412+0000 7f4b2a000640 1 --2- 172.21.15.133:0/2942112184 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4b1406ac60 0x7f4b1406d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.412+0000 7f4b2a000640 1 -- 172.21.15.133:0/2942112184 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b24089520 con 0x7f4b2c0387c0 2024-03-30T01:51:44.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.413+0000 7f4b2a000640 1 --2- 172.21.15.133:0/2942112184 >> [v2:172.21.15.133:6816/37492,v1:172.21.15.133:6818/37492] conn(0x7f4b14072e80 0x7f4b140752a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.413+0000 7f4b2a000640 1 -- 172.21.15.133:0/2942112184 --> [v2:172.21.15.133:6816/37492,v1:172.21.15.133:6818/37492] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4b14075950 con 0x7f4b14072e80 2024-03-30T01:51:44.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.413+0000 7f4b2a000640 1 -- 172.21.15.133:0/2942112184 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b2408bb40 con 0x7f4b2c0387c0 2024-03-30T01:51:44.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.413+0000 7f4b35400640 1 --2- 172.21.15.133:0/2942112184 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4b1406ac60 0x7f4b1406d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.413+0000 7f6402000640 1 -- 172.21.15.133:0/658293695 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f803c070 con 0x7f63f00039c0 2024-03-30T01:51:44.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.413+0000 7f6402000640 1 -- 172.21.15.133:0/658293695 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f8001110 con 0x7f63f00039c0 2024-03-30T01:51:44.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.413+0000 7f6402000640 1 -- 172.21.15.133:0/658293695 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f80049e0 con 0x7f63f00039c0 2024-03-30T01:51:44.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.413+0000 7fee36000640 1 -- 172.21.15.133:0/1624755438 >> v2:172.21.15.137:3300/0 conn(0x7fee400b59c0 msgr2=0x7fee400b5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:44.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.413+0000 7fee36000640 1 --2- 172.21.15.133:0/1624755438 >> v2:172.21.15.137:3300/0 conn(0x7fee400b59c0 0x7fee400b5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.413+0000 7fee36000640 1 -- 172.21.15.133:0/1624755438 >> v1:172.21.15.137:6789/0 conn(0x7fee400cf2b0 legacy=0x7fee400cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.413+0000 7fee36000640 1 -- 172.21.15.133:0/1624755438 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee400d0a80 con 0x7fee400cd3a0 2024-03-30T01:51:44.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.413+0000 7f94c4e00640 1 -- 172.21.15.133:0/3277070763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94b80de790 msgr2=0x7f94b80eb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.413+0000 7f94c4e00640 1 --2- 172.21.15.133:0/3277070763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94b80de790 0x7f94b80eb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.413+0000 7f94c4e00640 1 -- 172.21.15.133:0/3277070763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94b80503c0 msgr2=0x7f94b804af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.413+0000 7f92c2000640 1 --2- 172.21.15.133:0/1681182297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92c40d2240 0x7f92c40cf470 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f92b00097a0 tx=0x7f92b002b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=274488c7ebce8d64 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.413+0000 7f451cc00640 1 -- 172.21.15.133:0/2855006994 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c00ee60 con 0x7f452015b600 2024-03-30T01:51:44.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.413+0000 7f451cc00640 1 -- 172.21.15.133:0/2855006994 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450c00c940 con 0x7f452015b600 2024-03-30T01:51:44.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.413+0000 7fa243400640 1 --2- 172.21.15.133:0/734994036 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa24406dc10 0x7fa24406c920 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa244072920 tx=0x7fa230030120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e16e0addf96235e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.413+0000 7f451cc00640 1 -- 172.21.15.133:0/2855006994 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c00ccf0 con 0x7f452015b600 2024-03-30T01:51:44.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.413+0000 7f94c4e00640 1 --2- 172.21.15.133:0/3277070763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94b80503c0 0x7f94b804af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.413+0000 7f94c4e00640 1 -- 172.21.15.133:0/3277070763 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b40094d0 con 0x7f94b80549a0 2024-03-30T01:51:44.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.413+0000 7f94c5800640 1 --2- 172.21.15.133:0/3277070763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94b80503c0 0x7f94b804af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T01:51:44.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.414+0000 7f4b36800640 1 --2- 172.21.15.133:0/2942112184 >> [v2:172.21.15.133:6816/37492,v1:172.21.15.133:6818/37492] conn(0x7f4b14072e80 0x7f4b140752a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.414+0000 7f94c4e00640 1 --2- 172.21.15.133:0/3277070763 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94b80549a0 0x7f94b8005e40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f94ac00b420 tx=0x7f94ac00b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.413+0000 7f4527c00640 1 -- 172.21.15.133:0/2855006994 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4520153ab0 con 0x7f452015b600 2024-03-30T01:51:44.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.414+0000 7f4527c00640 1 -- 172.21.15.133:0/2855006994 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4520150180 con 0x7f452015b600 2024-03-30T01:51:44.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.414+0000 7fa242a00640 1 -- 172.21.15.133:0/734994036 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23003a400 con 0x7fa24406dc10 2024-03-30T01:51:44.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.414+0000 7fa242a00640 1 -- 172.21.15.133:0/734994036 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa230034070 con 0x7fa24406dc10 2024-03-30T01:51:44.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.414+0000 7fa242a00640 1 -- 172.21.15.133:0/734994036 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23003a780 con 0x7fa24406dc10 2024-03-30T01:51:44.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.415+0000 7f92c1600640 1 -- 172.21.15.133:0/1681182297 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0019f0 con 0x7f92c40d2240 2024-03-30T01:51:44.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.415+0000 7fee36000640 1 --2- 172.21.15.133:0/1624755438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee400cd3a0 0x7fee400cd800 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fee28009870 tx=0x7fee2802b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80c99472616af26 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.415+0000 7f92c1600640 1 -- 172.21.15.133:0/1681182297 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b002e050 con 0x7f92c40d2240 2024-03-30T01:51:44.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.415+0000 7f92c1600640 1 -- 172.21.15.133:0/1681182297 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b0030730 con 0x7f92c40d2240 2024-03-30T01:51:44.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.415+0000 7f4527c00640 1 -- 172.21.15.133:0/2855006994 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f44f8000fc0 con 0x7f452015b600 2024-03-30T01:51:44.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.415+0000 7f26a1c00640 1 Processor -- start 2024-03-30T01:51:44.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.415+0000 7fee3e000640 1 -- 172.21.15.133:0/1624755438 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee28030850 con 0x7fee400cd3a0 2024-03-30T01:51:44.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.414+0000 7f6410a00640 1 -- 172.21.15.133:0/658293695 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f640c14f0f0 con 0x7f63f00039c0 2024-03-30T01:51:44.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.414+0000 7f6410a00640 1 -- 172.21.15.133:0/658293695 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f640c14e510 con 0x7f63f00039c0 2024-03-30T01:51:44.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.415+0000 7fee3e000640 1 -- 172.21.15.133:0/1624755438 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee280309b0 con 0x7fee400cd3a0 2024-03-30T01:51:44.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.415+0000 7fee3e000640 1 -- 172.21.15.133:0/1624755438 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee28030d40 con 0x7fee400cd3a0 2024-03-30T01:51:44.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.415+0000 7f6410a00640 1 -- 172.21.15.133:0/658293695 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f640c159200 con 0x7f63f00039c0 2024-03-30T01:51:44.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.415+0000 7f94bd600640 1 -- 172.21.15.133:0/3277070763 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac011830 con 0x7f94b80549a0 2024-03-30T01:51:44.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.415+0000 7f26a1c00640 1 -- start start 2024-03-30T01:51:44.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.415+0000 7f94bd600640 1 -- 172.21.15.133:0/3277070763 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ac011990 con 0x7f94b80549a0 2024-03-30T01:51:44.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.415+0000 7f94bd600640 1 -- 172.21.15.133:0/3277070763 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac011d40 con 0x7f94b80549a0 2024-03-30T01:51:44.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.415+0000 7f94c6c00640 1 -- 172.21.15.133:0/3277070763 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b804bb30 con 0x7f94b80549a0 2024-03-30T01:51:44.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.415+0000 7f4b36800640 1 --2- 172.21.15.133:0/2942112184 >> [v2:172.21.15.133:6816/37492,v1:172.21.15.133:6818/37492] conn(0x7f4b14072e80 0x7f4b140752a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.415+0000 7f4b35400640 1 --2- 172.21.15.133:0/2942112184 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4b1406ac60 0x7f4b1406d120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4b20036000 tx=0x7f4b2003b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.416+0000 7f94c6c00640 1 -- 172.21.15.133:0/3277070763 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b80ec5a0 con 0x7f94b80549a0 2024-03-30T01:51:44.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.416+0000 7f92c9600640 1 -- 172.21.15.133:0/1681182297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92c40d2240 msgr2=0x7f92c40cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.416+0000 7f92c9600640 1 --2- 172.21.15.133:0/1681182297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92c40d2240 0x7f92c40cf470 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f92b00097a0 tx=0x7f92b002b790 comp rx=0 tx=0).stop 2024-03-30T01:51:44.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.416+0000 7f92c9600640 1 -- 172.21.15.133:0/1681182297 shutdown_connections 2024-03-30T01:51:44.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.416+0000 7f92c9600640 1 --2- 172.21.15.133:0/1681182297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92c40d2240 0x7f92c40cf470 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.416+0000 7f92c9600640 1 --2- 172.21.15.133:0/1681182297 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92c415cc50 0x7f92c40d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.416+0000 7f92c9600640 1 -- 172.21.15.133:0/1681182297 >> 172.21.15.133:0/1681182297 conn(0x7f92c4071a40 msgr2=0x7f92c406b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.415+0000 7fa24aa00640 1 -- 172.21.15.133:0/734994036 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa24406dc10 msgr2=0x7fa24406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.415+0000 7fa24aa00640 1 --2- 172.21.15.133:0/734994036 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa24406dc10 0x7fa24406c920 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa244072920 tx=0x7fa230030120 comp rx=0 tx=0).stop 2024-03-30T01:51:44.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.417+0000 7fee3fe00640 1 -- 172.21.15.133:0/1624755438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee400cd3a0 msgr2=0x7fee400cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.417+0000 7fee3fe00640 1 --2- 172.21.15.133:0/1624755438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee400cd3a0 0x7fee400cd800 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fee28009870 tx=0x7fee2802b990 comp rx=0 tx=0).stop 2024-03-30T01:51:44.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.417+0000 7fa24aa00640 1 -- 172.21.15.133:0/734994036 shutdown_connections 2024-03-30T01:51:44.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.417+0000 7fa24aa00640 1 --2- 172.21.15.133:0/734994036 >> v2:172.21.15.133:3300/0 conn(0x7fa24406ce60 0x7fa24415c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.417+0000 7fa24aa00640 1 --2- 172.21.15.133:0/734994036 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa24406dc10 0x7fa24406c920 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.417+0000 7fa24aa00640 1 --2- 172.21.15.133:0/734994036 >> v2:172.21.15.137:3300/0 conn(0x7fa244152fa0 0x7fa244159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.417+0000 7fa24aa00640 1 -- 172.21.15.133:0/734994036 >> 172.21.15.133:0/734994036 conn(0x7fa2440b0da0 msgr2=0x7fa244069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.416+0000 7f4b2a000640 1 -- 172.21.15.133:0/2942112184 <== osd.0 v2:172.21.15.133:6816/37492 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f4b14075950 con 0x7f4b14072e80 2024-03-30T01:51:44.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.417+0000 7fee3fe00640 1 -- 172.21.15.133:0/1624755438 shutdown_connections 2024-03-30T01:51:44.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.417+0000 7fee3fe00640 1 --2- 172.21.15.133:0/1624755438 >> v2:172.21.15.137:3300/0 conn(0x7fee400b59c0 0x7fee400b5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.417+0000 7fee3fe00640 1 --2- 172.21.15.133:0/1624755438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee400cd3a0 0x7fee400cd800 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.417+0000 7fee3fe00640 1 -- 172.21.15.133:0/1624755438 >> 172.21.15.133:0/1624755438 conn(0x7fee40071a10 msgr2=0x7fee4006b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.416+0000 7f92c9600640 1 -- 172.21.15.133:0/1681182297 shutdown_connections 2024-03-30T01:51:44.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.416+0000 7f92c9600640 1 -- 172.21.15.133:0/1681182297 wait complete. 2024-03-30T01:51:44.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.417+0000 7f26a1c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f269c070a40 0x7f269c0aa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.417+0000 7f26a1c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f269c0b38b0 0x7f269c0cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.417+0000 7f26a1c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f269c15ea60 0x7f269c0cd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.417+0000 7f26a1c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c15b100 con 0x7f269c15ea60 2024-03-30T01:51:44.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.417+0000 7f26a1c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c1faeb0 con 0x7f269c0b38b0 2024-03-30T01:51:44.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.417+0000 7f26a1c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269c1fabd0 con 0x7f269c070a40 2024-03-30T01:51:44.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.417+0000 7fee3fe00640 1 -- 172.21.15.133:0/1624755438 shutdown_connections 2024-03-30T01:51:44.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.417+0000 7fa24aa00640 1 -- 172.21.15.133:0/734994036 shutdown_connections 2024-03-30T01:51:44.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.418+0000 7fee3fe00640 1 -- 172.21.15.133:0/1624755438 wait complete. 2024-03-30T01:51:44.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.418+0000 7fa24aa00640 1 -- 172.21.15.133:0/734994036 wait complete. 2024-03-30T01:51:44.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.418+0000 7f269a000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f269c0b38b0 0x7f269c0cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.418+0000 7f269a000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f269c0b38b0 0x7f269c0cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.133:35960/0 (socket says 172.21.15.133:35960) 2024-03-30T01:51:44.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.418+0000 7f269a000640 1 -- 172.21.15.133:0/2551472891 learned_addr learned my addr 172.21.15.133:0/2551472891 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.419+0000 7f269a000640 1 -- 172.21.15.133:0/2551472891 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f269c070a40 msgr2=0x7f269c0aa130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-30T01:51:44.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.418+0000 7f94c6c00640 1 -- 172.21.15.133:0/3277070763 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f949c000fc0 con 0x7f94b80549a0 2024-03-30T01:51:44.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.419+0000 7f92c9600640 1 Processor -- start 2024-03-30T01:51:44.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.419+0000 7fee3fe00640 1 Processor -- start 2024-03-30T01:51:44.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.419+0000 7f269aa00640 1 --2- 172.21.15.133:0/2551472891 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f269c070a40 0x7f269c0aa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.420+0000 7f269a000640 1 --2- 172.21.15.133:0/2551472891 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f269c070a40 0x7f269c0aa130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.419+0000 7f451cc00640 1 -- 172.21.15.133:0/2855006994 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f450c013470 con 0x7f452015b600 2024-03-30T01:51:44.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.420+0000 7f269a000640 1 -- 172.21.15.133:0/2551472891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f269c15ea60 msgr2=0x7f269c0cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.420+0000 7f269a000640 1 --2- 172.21.15.133:0/2551472891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f269c15ea60 0x7f269c0cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.420+0000 7f269a000640 1 -- 172.21.15.133:0/2551472891 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2694009a70 con 0x7f269c0b38b0 2024-03-30T01:51:44.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.420+0000 7f451cc00640 1 --2- 172.21.15.133:0/2855006994 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f450006acd0 0x7f450006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.420+0000 7f94bd600640 1 -- 172.21.15.133:0/3277070763 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f94ac01b460 con 0x7f94b80549a0 2024-03-30T01:51:44.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.420+0000 7f451cc00640 1 -- 172.21.15.133:0/2855006994 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f450c089ae0 con 0x7f452015b600 2024-03-30T01:51:44.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.420+0000 7f269a000640 1 --2- 172.21.15.133:0/2551472891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f269c0b38b0 0x7f269c0cd220 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f268800c480 tx=0x7f268800c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.420+0000 7f4525200640 1 --2- 172.21.15.133:0/2855006994 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f450006acd0 0x7f450006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.421+0000 7fee3fe00640 1 -- start start 2024-03-30T01:51:44.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.421+0000 7f94bd600640 1 --2- 172.21.15.133:0/3277070763 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f94a006ac00 0x7f94a006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.421+0000 7f451cc00640 1 --2- 172.21.15.133:0/2855006994 >> [v2:172.21.15.133:6800/37490,v1:172.21.15.133:6801/37490] conn(0x7f4500072ef0 0x7f4500075310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.421+0000 7f2692a00640 1 -- 172.21.15.133:0/2551472891 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26880052d0 con 0x7f269c0b38b0 2024-03-30T01:51:44.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.421+0000 7f2692a00640 1 -- 172.21.15.133:0/2551472891 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2688005430 con 0x7f269c0b38b0 2024-03-30T01:51:44.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.421+0000 7f2692a00640 1 -- 172.21.15.133:0/2551472891 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2688012870 con 0x7f269c0b38b0 2024-03-30T01:51:44.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.421+0000 7f6402000640 1 -- 172.21.15.133:0/658293695 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f63f8032070 con 0x7f63f00039c0 2024-03-30T01:51:44.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.421+0000 7f94bd600640 1 -- 172.21.15.133:0/3277070763 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94ac088d00 con 0x7f94b80549a0 2024-03-30T01:51:44.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.421+0000 7f451cc00640 1 -- 172.21.15.133:0/2855006994 --> [v2:172.21.15.133:6800/37490,v1:172.21.15.133:6801/37490] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45000759c0 con 0x7f4500072ef0 2024-03-30T01:51:44.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.421+0000 7f94bd600640 1 --2- 172.21.15.133:0/3277070763 >> [v2:172.21.15.133:6808/37488,v1:172.21.15.133:6809/37488] conn(0x7f94a0072da0 0x7f94a00751c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.421+0000 7f94bd600640 1 -- 172.21.15.133:0/3277070763 --> [v2:172.21.15.133:6808/37488,v1:172.21.15.133:6809/37488] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f94a0075870 con 0x7f94a0072da0 2024-03-30T01:51:44.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.421+0000 7f94bd600640 1 -- 172.21.15.133:0/3277070763 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94ac08b3c0 con 0x7f94b80549a0 2024-03-30T01:51:44.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.422+0000 7f94c6200640 1 --2- 172.21.15.133:0/3277070763 >> [v2:172.21.15.133:6808/37488,v1:172.21.15.133:6809/37488] conn(0x7f94a0072da0 0x7f94a00751c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.422+0000 7f94c5800640 1 --2- 172.21.15.133:0/3277070763 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f94a006ac00 0x7f94a006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.422+0000 7f4525c00640 1 --2- 172.21.15.133:0/2855006994 >> [v2:172.21.15.133:6800/37490,v1:172.21.15.133:6801/37490] conn(0x7f4500072ef0 0x7f4500075310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.422+0000 7f4525200640 1 --2- 172.21.15.133:0/2855006994 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f450006acd0 0x7f450006d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4518036000 tx=0x7f4518030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.422+0000 7f26a1c00640 1 -- 172.21.15.133:0/2551472891 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f269c14d900 con 0x7f269c0b38b0 2024-03-30T01:51:44.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.422+0000 7f26a1c00640 1 -- 172.21.15.133:0/2551472891 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269c14dec0 con 0x7f269c0b38b0 2024-03-30T01:51:44.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.423+0000 7fee3fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee400b59c0 0x7fee400cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.423+0000 7fee3fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee400cd3a0 0x7fee4014e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.423+0000 7fee3fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fee400cf2b0 0x7fee400ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.423+0000 7fee3fe00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee400cbe40 con 0x7fee400b59c0 2024-03-30T01:51:44.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.423+0000 7fee3fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4014e7d0 con 0x7fee400cd3a0 2024-03-30T01:51:44.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.423+0000 7fee3fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee400cb1c0 con 0x7fee400cf2b0 2024-03-30T01:51:44.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.423+0000 7fee3ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee400b59c0 0x7fee400cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.423+0000 7fee3ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee400b59c0 0x7fee400cc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46030/0 (socket says 172.21.15.133:46030) 2024-03-30T01:51:44.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.423+0000 7fee3ea00640 1 -- 172.21.15.133:0/993247726 learned_addr learned my addr 172.21.15.133:0/993247726 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.423+0000 7f6402000640 1 --2- 172.21.15.133:0/658293695 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f63ec06ad00 0x7f63ec06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.423+0000 7f6402000640 1 -- 172.21.15.133:0/658293695 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63f80aa950 con 0x7f63f00039c0 2024-03-30T01:51:44.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.423+0000 7f6402000640 1 --2- 172.21.15.133:0/658293695 >> [v2:172.21.15.133:6817/37491,v1:172.21.15.133:6819/37491] conn(0x7f63ec072f20 0x7f63ec075340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.423+0000 7f6402000640 1 -- 172.21.15.133:0/658293695 --> [v2:172.21.15.133:6817/37491,v1:172.21.15.133:6819/37491] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f63ec0759f0 con 0x7f63ec072f20 2024-03-30T01:51:44.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.423+0000 7f6402000640 1 -- 172.21.15.133:0/658293695 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63f80aad00 con 0x7f63f00039c0 2024-03-30T01:51:44.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.423+0000 7f94c5800640 1 --2- 172.21.15.133:0/3277070763 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f94a006ac00 0x7f94a006d0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f94b4036000 tx=0x7f94b403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.423+0000 7fa24aa00640 1 Processor -- start 2024-03-30T01:51:44.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.423+0000 7fee36000640 1 --2- 172.21.15.133:0/993247726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee400cd3a0 0x7fee4014e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.423+0000 7fee3f400640 1 --2- 172.21.15.133:0/993247726 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fee400cf2b0 0x7fee400ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.421+0000 7f92c9600640 1 -- start start 2024-03-30T01:51:44.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.423+0000 7f451cc00640 1 -- 172.21.15.133:0/2855006994 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f450c089e90 con 0x7f452015b600 2024-03-30T01:51:44.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.424+0000 7fa24aa00640 1 -- start start 2024-03-30T01:51:44.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.424+0000 7f94c6200640 1 --2- 172.21.15.133:0/3277070763 >> [v2:172.21.15.133:6808/37488,v1:172.21.15.133:6809/37488] conn(0x7f94a0072da0 0x7f94a00751c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.424+0000 7fee3ea00640 1 -- 172.21.15.133:0/993247726 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fee400cf2b0 msgr2=0x7fee400ac9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.424+0000 7fee3ea00640 1 --2- 172.21.15.133:0/993247726 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fee400cf2b0 0x7fee400ac9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.424+0000 7fee3ea00640 1 -- 172.21.15.133:0/993247726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee400cd3a0 msgr2=0x7fee4014e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.424+0000 7fee3ea00640 1 --2- 172.21.15.133:0/993247726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee400cd3a0 0x7fee4014e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.424+0000 7fee3ea00640 1 -- 172.21.15.133:0/993247726 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee280094d0 con 0x7fee400b59c0 2024-03-30T01:51:44.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.424+0000 7f92c9600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92c40cf9b0 0x7f92c4156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.424+0000 7f640a800640 1 --2- 172.21.15.133:0/658293695 >> [v2:172.21.15.133:6817/37491,v1:172.21.15.133:6819/37491] conn(0x7f63ec072f20 0x7f63ec075340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.425+0000 7f6409400640 1 --2- 172.21.15.133:0/658293695 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f63ec06ad00 0x7f63ec06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.425+0000 7f640a800640 1 --2- 172.21.15.133:0/658293695 >> [v2:172.21.15.133:6817/37491,v1:172.21.15.133:6819/37491] conn(0x7f63ec072f20 0x7f63ec075340 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.425+0000 7f94bd600640 1 -- 172.21.15.133:0/3277070763 <== osd.2 v2:172.21.15.133:6808/37488 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f94a0075870 con 0x7f94a0072da0 2024-03-30T01:51:44.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.425+0000 7f92c9600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92c40d2240 0x7f92c41f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.426+0000 7f4525c00640 1 --2- 172.21.15.133:0/2855006994 >> [v2:172.21.15.133:6800/37490,v1:172.21.15.133:6801/37490] conn(0x7f4500072ef0 0x7f4500075310 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.426+0000 7fee3ea00640 1 --2- 172.21.15.133:0/993247726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee400b59c0 0x7fee400cc260 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fee3000c730 tx=0x7fee3000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.425+0000 7f92c2a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92c40cf9b0 0x7f92c4156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.426+0000 7f92c2a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92c40cf9b0 0x7f92c4156ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.133:52778/0 (socket says 172.21.15.133:52778) 2024-03-30T01:51:44.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.426+0000 7f92c2a00640 1 -- 172.21.15.133:0/4040732087 learned_addr learned my addr 172.21.15.133:0/4040732087 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.426+0000 7f92c9600640 1 --2- 172.21.15.133:0/4040732087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92c415cc50 0x7f92c41587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.426+0000 7f92c9600640 1 -- 172.21.15.133:0/4040732087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c41f7390 con 0x7f92c415cc50 2024-03-30T01:51:44.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.426+0000 7f92c9600640 1 -- 172.21.15.133:0/4040732087 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c41f6dd0 con 0x7f92c40d2240 2024-03-30T01:51:44.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.426+0000 7f92c9600640 1 -- 172.21.15.133:0/4040732087 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c41f70b0 con 0x7f92c40cf9b0 2024-03-30T01:51:44.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.426+0000 7f92c2000640 1 --2- 172.21.15.133:0/4040732087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92c40d2240 0x7f92c41f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.426+0000 7f92c3400640 1 --2- 172.21.15.133:0/4040732087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92c415cc50 0x7f92c41587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.426+0000 7fee37400640 1 -- 172.21.15.133:0/993247726 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee30003b70 con 0x7fee400b59c0 2024-03-30T01:51:44.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.426+0000 7fee3fe00640 1 -- 172.21.15.133:0/993247726 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee400cb4a0 con 0x7fee400b59c0 2024-03-30T01:51:44.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.426+0000 7f92c2a00640 1 -- 172.21.15.133:0/4040732087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92c40d2240 msgr2=0x7f92c41f6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.426+0000 7f92c2a00640 1 --2- 172.21.15.133:0/4040732087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92c40d2240 0x7f92c41f6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.427+0000 7f92c2a00640 1 -- 172.21.15.133:0/4040732087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92c415cc50 msgr2=0x7f92c41587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.427+0000 7f92c2a00640 1 --2- 172.21.15.133:0/4040732087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92c415cc50 0x7f92c41587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.427+0000 7f92c2a00640 1 -- 172.21.15.133:0/4040732087 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b4009400 con 0x7f92c40cf9b0 2024-03-30T01:51:44.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.425+0000 7f6409400640 1 --2- 172.21.15.133:0/658293695 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f63ec06ad00 0x7f63ec06d1c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f640c15bfd0 tx=0x7f6404009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.427+0000 7fa24aa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa24406ce60 0x7fa2441f1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.427+0000 7fa24aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa24406dc10 0x7fa24413c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.427+0000 7fa24aa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa244152fa0 0x7fa244157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.427+0000 7fa24aa00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2441f2300 con 0x7fa244152fa0 2024-03-30T01:51:44.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.427+0000 7fa24aa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa244156f10 con 0x7fa24406dc10 2024-03-30T01:51:44.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.427+0000 7fa24aa00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2441571f0 con 0x7fa24406ce60 2024-03-30T01:51:44.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.428+0000 7fa243e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa24406ce60 0x7fa2441f1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.428+0000 7fa243e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa24406ce60 0x7fa2441f1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.133:52792/0 (socket says 172.21.15.133:52792) 2024-03-30T01:51:44.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.428+0000 7fa243e00640 1 -- 172.21.15.133:0/249949677 learned_addr learned my addr 172.21.15.133:0/249949677 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.428+0000 7f92c2a00640 1 --2- 172.21.15.133:0/4040732087 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92c40cf9b0 0x7f92c4156ee0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f92b400e960 tx=0x7f92b400ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.428+0000 7f92baa00640 1 -- 172.21.15.133:0/4040732087 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b400ca00 con 0x7f92c40cf9b0 2024-03-30T01:51:44.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.428+0000 7f92baa00640 1 -- 172.21.15.133:0/4040732087 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b400cb60 con 0x7f92c40cf9b0 2024-03-30T01:51:44.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.428+0000 7f92baa00640 1 -- 172.21.15.133:0/4040732087 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b4013470 con 0x7f92c40cf9b0 2024-03-30T01:51:44.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.428+0000 7f92c9600640 1 -- 172.21.15.133:0/4040732087 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b0009400 con 0x7f92c40cf9b0 2024-03-30T01:51:44.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.428+0000 7f92c9600640 1 -- 172.21.15.133:0/4040732087 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c40b7330 con 0x7f92c40cf9b0 2024-03-30T01:51:44.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.429+0000 7f451cc00640 1 -- 172.21.15.133:0/2855006994 <== osd.3 v2:172.21.15.133:6800/37490 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f45000759c0 con 0x7f4500072ef0 2024-03-30T01:51:44.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.425+0000 7f26a1c00640 1 -- 172.21.15.133:0/2551472891 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f269c161db0 con 0x7f269c0b38b0 2024-03-30T01:51:44.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.427+0000 7f2692a00640 1 -- 172.21.15.133:0/2551472891 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f26880129d0 con 0x7f269c0b38b0 2024-03-30T01:51:44.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.428+0000 7f2692a00640 1 --2- 172.21.15.133:0/2551472891 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f267c06ac00 0x7f267c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.428+0000 7f2692a00640 1 -- 172.21.15.133:0/2551472891 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2688088f60 con 0x7f269c0b38b0 2024-03-30T01:51:44.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.428+0000 7f2692a00640 1 --2- 172.21.15.133:0/2551472891 >> [v2:172.21.15.137:6800/37249,v1:172.21.15.137:6801/37249] conn(0x7f267c072da0 0x7f267c0751c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.428+0000 7fa248a00640 1 --2- 172.21.15.133:0/249949677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa244152fa0 0x7fa244157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.428+0000 7fa243400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa24406dc10 0x7fa24413c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.429+0000 7fa248a00640 1 -- 172.21.15.133:0/249949677 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa24406ce60 msgr2=0x7fa2441f1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.429+0000 7fa248a00640 1 --2- 172.21.15.133:0/249949677 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa24406ce60 0x7fa2441f1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.429+0000 7fa248a00640 1 -- 172.21.15.133:0/249949677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa24406dc10 msgr2=0x7fa24413c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.429+0000 7fa248a00640 1 --2- 172.21.15.133:0/249949677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa24406dc10 0x7fa24413c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.429+0000 7fa248a00640 1 -- 172.21.15.133:0/249949677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23000a570 con 0x7fa244152fa0 2024-03-30T01:51:44.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.428+0000 7f2692a00640 1 -- 172.21.15.133:0/2551472891 --> [v2:172.21.15.137:6800/37249,v1:172.21.15.137:6801/37249] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f267c075870 con 0x7f267c072da0 2024-03-30T01:51:44.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.429+0000 7f2692a00640 1 -- 172.21.15.133:0/2551472891 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26880011e0 con 0x7f269c0b38b0 2024-03-30T01:51:44.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.429+0000 7f92c9600640 1 -- 172.21.15.133:0/4040732087 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f92c40d1690 con 0x7f92c40cf9b0 2024-03-30T01:51:44.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.427+0000 7fee3fe00640 1 -- 172.21.15.133:0/993247726 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee400cba60 con 0x7fee400b59c0 2024-03-30T01:51:44.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.427+0000 7fee37400640 1 -- 172.21.15.133:0/993247726 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee30003cf0 con 0x7fee400b59c0 2024-03-30T01:51:44.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.427+0000 7fee37400640 1 -- 172.21.15.133:0/993247726 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee30003ea0 con 0x7fee400b59c0 2024-03-30T01:51:44.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.429+0000 7fee37400640 1 -- 172.21.15.133:0/993247726 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fee3000aa90 con 0x7fee400b59c0 2024-03-30T01:51:44.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.430+0000 7fa248a00640 1 --2- 172.21.15.133:0/249949677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa244152fa0 0x7fa244157fb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00bf90 tx=0x7fa23c00c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.430+0000 7fee37400640 1 --2- 172.21.15.133:0/993247726 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fee1c06ac00 0x7fee1c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.430+0000 7fee37400640 1 -- 172.21.15.133:0/993247726 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee300890b0 con 0x7fee400b59c0 2024-03-30T01:51:44.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.431+0000 7fa23be00640 1 -- 172.21.15.133:0/249949677 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c014440 con 0x7fa244152fa0 2024-03-30T01:51:44.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.431+0000 7fa23be00640 1 -- 172.21.15.133:0/249949677 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c0145c0 con 0x7fa244152fa0 2024-03-30T01:51:44.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.431+0000 7fa23be00640 1 -- 172.21.15.133:0/249949677 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c014970 con 0x7fa244152fa0 2024-03-30T01:51:44.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.431+0000 7fa24aa00640 1 -- 172.21.15.133:0/249949677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2441574d0 con 0x7fa244152fa0 2024-03-30T01:51:44.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.431+0000 7f6402000640 1 -- 172.21.15.133:0/658293695 <== osd.1 v2:172.21.15.133:6817/37491 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f63ec0759f0 con 0x7f63ec072f20 2024-03-30T01:51:44.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.431+0000 7f269aa00640 1 --2- 172.21.15.133:0/2551472891 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f267c06ac00 0x7f267c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.431+0000 7fee3fe00640 1 --2- 172.21.15.133:0/993247726 >> [v2:172.21.15.137:6824/37271,v1:172.21.15.137:6825/37271] conn(0x7fee180015e0 0x7fee18003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.431+0000 7fee3fe00640 1 -- 172.21.15.133:0/993247726 --> [v2:172.21.15.137:6824/37271,v1:172.21.15.137:6825/37271] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fee18006b40 con 0x7fee180015e0 2024-03-30T01:51:44.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.431+0000 7fa24aa00640 1 -- 172.21.15.133:0/249949677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa244157a90 con 0x7fa244152fa0 2024-03-30T01:51:44.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.431+0000 7f269b400640 1 --2- 172.21.15.133:0/2551472891 >> [v2:172.21.15.137:6800/37249,v1:172.21.15.137:6801/37249] conn(0x7f267c072da0 0x7f267c0751c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.432+0000 7fee3f400640 1 --2- 172.21.15.133:0/993247726 >> [v2:172.21.15.137:6824/37271,v1:172.21.15.137:6825/37271] conn(0x7fee180015e0 0x7fee18003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.432+0000 7fa24aa00640 1 -- 172.21.15.133:0/249949677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa24406e9e0 con 0x7fa244152fa0 2024-03-30T01:51:44.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.433+0000 7f92baa00640 1 -- 172.21.15.133:0/4040732087 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f92b40135d0 con 0x7f92c40cf9b0 2024-03-30T01:51:44.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.433+0000 7f269b400640 1 --2- 172.21.15.133:0/2551472891 >> [v2:172.21.15.137:6800/37249,v1:172.21.15.137:6801/37249] conn(0x7f267c072da0 0x7f267c0751c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.433+0000 7fee3f400640 1 --2- 172.21.15.133:0/993247726 >> [v2:172.21.15.137:6824/37271,v1:172.21.15.137:6825/37271] conn(0x7fee180015e0 0x7fee18003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.434+0000 7f269aa00640 1 --2- 172.21.15.133:0/2551472891 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f267c06ac00 0x7f267c06d0c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2694036000 tx=0x7f2694030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.434+0000 7fee36000640 1 --2- 172.21.15.133:0/993247726 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fee1c06ac00 0x7fee1c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.434+0000 7f92baa00640 1 --2- 172.21.15.133:0/4040732087 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f92a406ac00 0x7f92a406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.434+0000 7f92baa00640 1 -- 172.21.15.133:0/4040732087 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92b40899f0 con 0x7f92c40cf9b0 2024-03-30T01:51:44.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.434+0000 7f92baa00640 1 --2- 172.21.15.133:0/4040732087 >> [v2:172.21.15.137:6816/37250,v1:172.21.15.137:6817/37250] conn(0x7f92a4072e20 0x7f92a4075240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.434+0000 7f92baa00640 1 -- 172.21.15.133:0/4040732087 --> [v2:172.21.15.137:6816/37250,v1:172.21.15.137:6817/37250] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f92a40758f0 con 0x7f92a4072e20 2024-03-30T01:51:44.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.434+0000 7f92baa00640 1 -- 172.21.15.133:0/4040732087 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92b4089da0 con 0x7f92c40cf9b0 2024-03-30T01:51:44.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.434+0000 7f92c2000640 1 --2- 172.21.15.133:0/4040732087 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f92a406ac00 0x7f92a406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.435+0000 7f92c3400640 1 --2- 172.21.15.133:0/4040732087 >> [v2:172.21.15.137:6816/37250,v1:172.21.15.137:6817/37250] conn(0x7f92a4072e20 0x7f92a4075240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.434+0000 7fa23be00640 1 -- 172.21.15.133:0/249949677 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fa23c01d3b0 con 0x7fa244152fa0 2024-03-30T01:51:44.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.436+0000 7f2692a00640 1 -- 172.21.15.133:0/2551472891 <== osd.5 v2:172.21.15.137:6800/37249 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f267c075870 con 0x7f267c072da0 2024-03-30T01:51:44.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.435+0000 7fa23be00640 1 --2- 172.21.15.133:0/249949677 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa22406ac00 0x7fa22406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.435+0000 7fa23be00640 1 -- 172.21.15.133:0/249949677 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa23c089550 con 0x7fa244152fa0 2024-03-30T01:51:44.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.436+0000 7fa23be00640 1 --2- 172.21.15.133:0/249949677 >> [v2:172.21.15.137:6805/37248,v1:172.21.15.137:6807/37248] conn(0x7fa224072da0 0x7fa2240751c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.436+0000 7fa23be00640 1 -- 172.21.15.133:0/249949677 --> [v2:172.21.15.137:6805/37248,v1:172.21.15.137:6807/37248] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa224075870 con 0x7fa224072da0 2024-03-30T01:51:44.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.436+0000 7fa23be00640 1 -- 172.21.15.133:0/249949677 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa23c054760 con 0x7fa244152fa0 2024-03-30T01:51:44.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.436+0000 7fee37400640 1 -- 172.21.15.133:0/993247726 <== osd.6 v2:172.21.15.137:6824/37271 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fee18006b40 con 0x7fee180015e0 2024-03-30T01:51:44.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.437+0000 7fa243400640 1 --2- 172.21.15.133:0/249949677 >> [v2:172.21.15.137:6805/37248,v1:172.21.15.137:6807/37248] conn(0x7fa224072da0 0x7fa2240751c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.437+0000 7fee36000640 1 --2- 172.21.15.133:0/993247726 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fee1c06ac00 0x7fee1c06d0c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fee28036000 tx=0x7fee28008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.437+0000 7f92c2000640 1 --2- 172.21.15.133:0/4040732087 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f92a406ac00 0x7f92a406d0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f92b0034000 tx=0x7f92b002f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.437+0000 7f92c3400640 1 --2- 172.21.15.133:0/4040732087 >> [v2:172.21.15.137:6816/37250,v1:172.21.15.137:6817/37250] conn(0x7f92a4072e20 0x7f92a4075240 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.437+0000 7fa243e00640 1 --2- 172.21.15.133:0/249949677 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa22406ac00 0x7fa22406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.438+0000 7fa243400640 1 --2- 172.21.15.133:0/249949677 >> [v2:172.21.15.137:6805/37248,v1:172.21.15.137:6807/37248] conn(0x7fa224072da0 0x7fa2240751c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.438+0000 7fa243e00640 1 --2- 172.21.15.133:0/249949677 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa22406ac00 0x7fa22406d0c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa234007a60 tx=0x7fa234008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.440+0000 7f92baa00640 1 -- 172.21.15.133:0/4040732087 <== osd.7 v2:172.21.15.137:6816/37250 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f92a40758f0 con 0x7f92a4072e20 2024-03-30T01:51:44.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.440+0000 7fa23be00640 1 -- 172.21.15.133:0/249949677 <== osd.4 v2:172.21.15.137:6805/37248 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fa224075870 con 0x7fa224072da0 2024-03-30T01:51:44.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.450+0000 7f4b38800640 1 -- 172.21.15.133:0/2942112184 --> [v2:172.21.15.133:6816/37492,v1:172.21.15.133:6818/37492] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4b0c002cb0 con 0x7f4b14072e80 2024-03-30T01:51:44.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.452+0000 7f4b2a000640 1 -- 172.21.15.133:0/2942112184 <== osd.0 v2:172.21.15.133:6816/37492 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4b0c002cb0 con 0x7f4b14072e80 2024-03-30T01:51:44.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.453+0000 7f4b38800640 1 -- 172.21.15.133:0/2942112184 >> [v2:172.21.15.133:6816/37492,v1:172.21.15.133:6818/37492] conn(0x7f4b14072e80 msgr2=0x7f4b140752a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.453+0000 7f4b38800640 1 --2- 172.21.15.133:0/2942112184 >> [v2:172.21.15.133:6816/37492,v1:172.21.15.133:6818/37492] conn(0x7f4b14072e80 0x7f4b140752a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.455+0000 7f4b38800640 1 -- 172.21.15.133:0/2942112184 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4b1406ac60 msgr2=0x7f4b1406d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.455+0000 7f4b38800640 1 --2- 172.21.15.133:0/2942112184 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4b1406ac60 0x7f4b1406d120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4b20036000 tx=0x7f4b2003b040 comp rx=0 tx=0).stop 2024-03-30T01:51:44.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.455+0000 7f4b38800640 1 -- 172.21.15.133:0/2942112184 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b2c0387c0 msgr2=0x7f4b2c04e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.455+0000 7f4b38800640 1 --2- 172.21.15.133:0/2942112184 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b2c0387c0 0x7f4b2c04e110 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4b2400d800 tx=0x7f4b2400dcc0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.455+0000 7f6410a00640 1 -- 172.21.15.133:0/658293695 --> [v2:172.21.15.133:6817/37491,v1:172.21.15.133:6819/37491] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f640c14f610 con 0x7f63ec072f20 2024-03-30T01:51:44.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.455+0000 7f4b36800640 1 -- 172.21.15.133:0/2942112184 reap_dead start 2024-03-30T01:51:44.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.455+0000 7f4b38800640 1 -- 172.21.15.133:0/2942112184 shutdown_connections 2024-03-30T01:51:44.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.455+0000 7f4b38800640 1 -- 172.21.15.133:0/2942112184 >> 172.21.15.133:0/2942112184 conn(0x7f4b2c009f70 msgr2=0x7f4b2c0536b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.455+0000 7f4b38800640 1 -- 172.21.15.133:0/2942112184 shutdown_connections 2024-03-30T01:51:44.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.456+0000 7f4b38800640 1 -- 172.21.15.133:0/2942112184 wait complete. 2024-03-30T01:51:44.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.457+0000 7f6402000640 1 -- 172.21.15.133:0/658293695 <== osd.1 v2:172.21.15.133:6817/37491 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f640c14f610 con 0x7f63ec072f20 2024-03-30T01:51:44.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.460+0000 7f6410a00640 1 -- 172.21.15.133:0/658293695 >> [v2:172.21.15.133:6817/37491,v1:172.21.15.133:6819/37491] conn(0x7f63ec072f20 msgr2=0x7f63ec075340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.460+0000 7f6410a00640 1 --2- 172.21.15.133:0/658293695 >> [v2:172.21.15.133:6817/37491,v1:172.21.15.133:6819/37491] conn(0x7f63ec072f20 0x7f63ec075340 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.461+0000 7f6410a00640 1 -- 172.21.15.133:0/658293695 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f63ec06ad00 msgr2=0x7f63ec06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.461+0000 7f6410a00640 1 --2- 172.21.15.133:0/658293695 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f63ec06ad00 0x7f63ec06d1c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f640c15bfd0 tx=0x7f6404009040 comp rx=0 tx=0).stop 2024-03-30T01:51:44.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.461+0000 7f6410a00640 1 -- 172.21.15.133:0/658293695 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63f00039c0 msgr2=0x7f640c156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.461+0000 7f6410a00640 1 --2- 172.21.15.133:0/658293695 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63f00039c0 0x7f640c156000 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f63f8007f10 tx=0x7f640c1590f0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.462+0000 7f640a800640 1 -- 172.21.15.133:0/658293695 reap_dead start 2024-03-30T01:51:44.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.462+0000 7f6410a00640 1 -- 172.21.15.133:0/658293695 shutdown_connections 2024-03-30T01:51:44.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.462+0000 7f6410a00640 1 -- 172.21.15.133:0/658293695 >> 172.21.15.133:0/658293695 conn(0x7f640c0b07a0 msgr2=0x7f640c06c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.462+0000 7f6410a00640 1 -- 172.21.15.133:0/658293695 shutdown_connections 2024-03-30T01:51:44.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.462+0000 7f6410a00640 1 -- 172.21.15.133:0/658293695 wait complete. 2024-03-30T01:51:44.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.462+0000 7fee3fe00640 1 -- 172.21.15.133:0/993247726 --> [v2:172.21.15.137:6824/37271,v1:172.21.15.137:6825/37271] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fee18005c20 con 0x7fee180015e0 2024-03-30T01:51:44.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.462+0000 7f94c6c00640 1 -- 172.21.15.133:0/3277070763 --> [v2:172.21.15.133:6808/37488,v1:172.21.15.133:6809/37488] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f949c002cb0 con 0x7f94a0072da0 2024-03-30T01:51:44.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.463+0000 7f94bd600640 1 -- 172.21.15.133:0/3277070763 <== osd.2 v2:172.21.15.133:6808/37488 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f949c002cb0 con 0x7f94a0072da0 2024-03-30T01:51:44.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.463+0000 7fee37400640 1 -- 172.21.15.133:0/993247726 <== osd.6 v2:172.21.15.137:6824/37271 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fee18005c20 con 0x7fee180015e0 2024-03-30T01:51:44.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.463+0000 7f94c6c00640 1 -- 172.21.15.133:0/3277070763 >> [v2:172.21.15.133:6808/37488,v1:172.21.15.133:6809/37488] conn(0x7f94a0072da0 msgr2=0x7f94a00751c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.463+0000 7f94c6c00640 1 --2- 172.21.15.133:0/3277070763 >> [v2:172.21.15.133:6808/37488,v1:172.21.15.133:6809/37488] conn(0x7f94a0072da0 0x7f94a00751c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.464+0000 7fee3fe00640 1 -- 172.21.15.133:0/993247726 >> [v2:172.21.15.137:6824/37271,v1:172.21.15.137:6825/37271] conn(0x7fee180015e0 msgr2=0x7fee18003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.464+0000 7fee3fe00640 1 --2- 172.21.15.133:0/993247726 >> [v2:172.21.15.137:6824/37271,v1:172.21.15.137:6825/37271] conn(0x7fee180015e0 0x7fee18003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.464+0000 7fee3fe00640 1 -- 172.21.15.133:0/993247726 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fee1c06ac00 msgr2=0x7fee1c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.464+0000 7fee3fe00640 1 --2- 172.21.15.133:0/993247726 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fee1c06ac00 0x7fee1c06d0c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fee28036000 tx=0x7fee28008030 comp rx=0 tx=0).stop 2024-03-30T01:51:44.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.464+0000 7fee3fe00640 1 -- 172.21.15.133:0/993247726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee400b59c0 msgr2=0x7fee400cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.464+0000 7fee3fe00640 1 --2- 172.21.15.133:0/993247726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee400b59c0 0x7fee400cc260 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fee3000c730 tx=0x7fee3000cbf0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.465+0000 7fee3f400640 1 -- 172.21.15.133:0/993247726 reap_dead start 2024-03-30T01:51:44.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.465+0000 7fee3fe00640 1 -- 172.21.15.133:0/993247726 shutdown_connections 2024-03-30T01:51:44.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.465+0000 7fee3fe00640 1 -- 172.21.15.133:0/993247726 >> 172.21.15.133:0/993247726 conn(0x7fee40071a10 msgr2=0x7fee400b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.465+0000 7f94c6c00640 1 -- 172.21.15.133:0/3277070763 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f94a006ac00 msgr2=0x7f94a006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.465+0000 7f94c6c00640 1 --2- 172.21.15.133:0/3277070763 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f94a006ac00 0x7f94a006d0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f94b4036000 tx=0x7f94b403c040 comp rx=0 tx=0).stop 2024-03-30T01:51:44.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.465+0000 7f94c6c00640 1 -- 172.21.15.133:0/3277070763 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94b80549a0 msgr2=0x7f94b8005e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.465+0000 7f94c6c00640 1 --2- 172.21.15.133:0/3277070763 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94b80549a0 0x7f94b8005e40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f94ac00b420 tx=0x7f94ac00b8e0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.465+0000 7f94c6200640 1 -- 172.21.15.133:0/3277070763 reap_dead start 2024-03-30T01:51:44.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.467+0000 7fee3fe00640 1 -- 172.21.15.133:0/993247726 shutdown_connections 2024-03-30T01:51:44.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.467+0000 7fee3fe00640 1 -- 172.21.15.133:0/993247726 wait complete. 2024-03-30T01:51:44.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.467+0000 7f4527c00640 1 -- 172.21.15.133:0/2855006994 --> [v2:172.21.15.133:6800/37490,v1:172.21.15.133:6801/37490] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f44f8002cb0 con 0x7f4500072ef0 2024-03-30T01:51:44.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.467+0000 7f94c6c00640 1 -- 172.21.15.133:0/3277070763 shutdown_connections 2024-03-30T01:51:44.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.467+0000 7f94c6c00640 1 -- 172.21.15.133:0/3277070763 >> 172.21.15.133:0/3277070763 conn(0x7f94b8054ee0 msgr2=0x7f94b8039c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.467+0000 7f94c6c00640 1 -- 172.21.15.133:0/3277070763 shutdown_connections 2024-03-30T01:51:44.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.468+0000 7f94c6c00640 1 -- 172.21.15.133:0/3277070763 wait complete. 2024-03-30T01:51:44.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.468+0000 7f451cc00640 1 -- 172.21.15.133:0/2855006994 <== osd.3 v2:172.21.15.133:6800/37490 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f44f8002cb0 con 0x7f4500072ef0 2024-03-30T01:51:44.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.469+0000 7f4527c00640 1 -- 172.21.15.133:0/2855006994 >> [v2:172.21.15.133:6800/37490,v1:172.21.15.133:6801/37490] conn(0x7f4500072ef0 msgr2=0x7f4500075310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.469+0000 7f4527c00640 1 --2- 172.21.15.133:0/2855006994 >> [v2:172.21.15.133:6800/37490,v1:172.21.15.133:6801/37490] conn(0x7f4500072ef0 0x7f4500075310 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.469+0000 7f4527c00640 1 -- 172.21.15.133:0/2855006994 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f450006acd0 msgr2=0x7f450006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.469+0000 7f4527c00640 1 --2- 172.21.15.133:0/2855006994 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f450006acd0 0x7f450006d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4518036000 tx=0x7f4518030000 comp rx=0 tx=0).stop 2024-03-30T01:51:44.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.469+0000 7f4527c00640 1 -- 172.21.15.133:0/2855006994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f452015b600 msgr2=0x7f4520152540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.469+0000 7f4527c00640 1 --2- 172.21.15.133:0/2855006994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f452015b600 0x7f4520152540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f450c00e870 tx=0x7f450c00ed30 comp rx=0 tx=0).stop 2024-03-30T01:51:44.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.469+0000 7f4525c00640 1 -- 172.21.15.133:0/2855006994 reap_dead start 2024-03-30T01:51:44.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.469+0000 7fa24aa00640 1 -- 172.21.15.133:0/249949677 --> [v2:172.21.15.137:6805/37248,v1:172.21.15.137:6807/37248] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa24406e700 con 0x7fa224072da0 2024-03-30T01:51:44.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.469+0000 7f26a1c00640 1 -- 172.21.15.133:0/2551472891 --> [v2:172.21.15.137:6800/37249,v1:172.21.15.137:6801/37249] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f269c161ad0 con 0x7f267c072da0 2024-03-30T01:51:44.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.470+0000 7f4527c00640 1 -- 172.21.15.133:0/2855006994 shutdown_connections 2024-03-30T01:51:44.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.470+0000 7f4527c00640 1 -- 172.21.15.133:0/2855006994 >> 172.21.15.133:0/2855006994 conn(0x7f45200b05c0 msgr2=0x7f45200704d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.470+0000 7f92c9600640 1 -- 172.21.15.133:0/4040732087 --> [v2:172.21.15.137:6816/37250,v1:172.21.15.137:6817/37250] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f92c40d13b0 con 0x7f92a4072e20 2024-03-30T01:51:44.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.470+0000 7fa23be00640 1 -- 172.21.15.133:0/249949677 <== osd.4 v2:172.21.15.137:6805/37248 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa23003a630 con 0x7fa224072da0 2024-03-30T01:51:44.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.471+0000 7f4527c00640 1 -- 172.21.15.133:0/2855006994 shutdown_connections 2024-03-30T01:51:44.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.471+0000 7f4527c00640 1 -- 172.21.15.133:0/2855006994 wait complete. 2024-03-30T01:51:44.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.471+0000 7fa24aa00640 1 -- 172.21.15.133:0/249949677 >> [v2:172.21.15.137:6805/37248,v1:172.21.15.137:6807/37248] conn(0x7fa224072da0 msgr2=0x7fa2240751c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.471+0000 7fa24aa00640 1 --2- 172.21.15.133:0/249949677 >> [v2:172.21.15.137:6805/37248,v1:172.21.15.137:6807/37248] conn(0x7fa224072da0 0x7fa2240751c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.471+0000 7f2692a00640 1 -- 172.21.15.133:0/2551472891 <== osd.5 v2:172.21.15.137:6800/37249 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f268c0058b0 con 0x7f267c072da0 2024-03-30T01:51:44.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.472+0000 7fa24aa00640 1 -- 172.21.15.133:0/249949677 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa22406ac00 msgr2=0x7fa22406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.472+0000 7fa24aa00640 1 --2- 172.21.15.133:0/249949677 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa22406ac00 0x7fa22406d0c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa234007a60 tx=0x7fa234008040 comp rx=0 tx=0).stop 2024-03-30T01:51:44.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.472+0000 7fa24aa00640 1 -- 172.21.15.133:0/249949677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa244152fa0 msgr2=0x7fa244157fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.472+0000 7fa24aa00640 1 --2- 172.21.15.133:0/249949677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa244152fa0 0x7fa244157fb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00bf90 tx=0x7fa23c00c4d0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.472+0000 7fa248a00640 1 -- 172.21.15.133:0/249949677 reap_dead start 2024-03-30T01:51:44.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.472+0000 7f26a1c00640 1 -- 172.21.15.133:0/2551472891 >> [v2:172.21.15.137:6800/37249,v1:172.21.15.137:6801/37249] conn(0x7f267c072da0 msgr2=0x7f267c0751c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.472+0000 7f26a1c00640 1 --2- 172.21.15.133:0/2551472891 >> [v2:172.21.15.137:6800/37249,v1:172.21.15.137:6801/37249] conn(0x7f267c072da0 0x7f267c0751c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.472+0000 7f92baa00640 1 -- 172.21.15.133:0/4040732087 <== osd.7 v2:172.21.15.137:6816/37250 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f92bc001ef0 con 0x7f92a4072e20 2024-03-30T01:51:44.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.472+0000 7f26a1c00640 1 -- 172.21.15.133:0/2551472891 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f267c06ac00 msgr2=0x7f267c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.472+0000 7f26a1c00640 1 --2- 172.21.15.133:0/2551472891 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f267c06ac00 0x7f267c06d0c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2694036000 tx=0x7f2694030000 comp rx=0 tx=0).stop 2024-03-30T01:51:44.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.473+0000 7f26a1c00640 1 -- 172.21.15.133:0/2551472891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f269c0b38b0 msgr2=0x7f269c0cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.473+0000 7f26a1c00640 1 --2- 172.21.15.133:0/2551472891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f269c0b38b0 0x7f269c0cd220 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f268800c480 tx=0x7f268800c940 comp rx=0 tx=0).stop 2024-03-30T01:51:44.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.473+0000 7f269b400640 1 -- 172.21.15.133:0/2551472891 reap_dead start 2024-03-30T01:51:44.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.473+0000 7f26a1c00640 1 -- 172.21.15.133:0/2551472891 shutdown_connections 2024-03-30T01:51:44.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.473+0000 7f26a1c00640 1 -- 172.21.15.133:0/2551472891 >> 172.21.15.133:0/2551472891 conn(0x7f269c0b07a0 msgr2=0x7f269c06c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.473+0000 7f92c9600640 1 -- 172.21.15.133:0/4040732087 >> [v2:172.21.15.137:6816/37250,v1:172.21.15.137:6817/37250] conn(0x7f92a4072e20 msgr2=0x7f92a4075240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.473+0000 7f92c9600640 1 --2- 172.21.15.133:0/4040732087 >> [v2:172.21.15.137:6816/37250,v1:172.21.15.137:6817/37250] conn(0x7f92a4072e20 0x7f92a4075240 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.473+0000 7f26a1c00640 1 -- 172.21.15.133:0/2551472891 shutdown_connections 2024-03-30T01:51:44.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.473+0000 7f26a1c00640 1 -- 172.21.15.133:0/2551472891 wait complete. 2024-03-30T01:51:44.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.473+0000 7f92c9600640 1 -- 172.21.15.133:0/4040732087 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f92a406ac00 msgr2=0x7f92a406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.473+0000 7f92c9600640 1 --2- 172.21.15.133:0/4040732087 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f92a406ac00 0x7f92a406d0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f92b0034000 tx=0x7f92b002f000 comp rx=0 tx=0).stop 2024-03-30T01:51:44.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.473+0000 7f92c9600640 1 -- 172.21.15.133:0/4040732087 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92c40cf9b0 msgr2=0x7f92c4156ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.473+0000 7f92c9600640 1 --2- 172.21.15.133:0/4040732087 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92c40cf9b0 0x7f92c4156ee0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f92b400e960 tx=0x7f92b400ee20 comp rx=0 tx=0).stop 2024-03-30T01:51:44.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.474+0000 7f92c3400640 1 -- 172.21.15.133:0/4040732087 reap_dead start 2024-03-30T01:51:44.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.474+0000 7f92c9600640 1 -- 172.21.15.133:0/4040732087 shutdown_connections 2024-03-30T01:51:44.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.474+0000 7f92c9600640 1 -- 172.21.15.133:0/4040732087 >> 172.21.15.133:0/4040732087 conn(0x7f92c4071a40 msgr2=0x7f92c415bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.475+0000 7f92c9600640 1 -- 172.21.15.133:0/4040732087 shutdown_connections 2024-03-30T01:51:44.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.475+0000 7f92c9600640 1 -- 172.21.15.133:0/4040732087 wait complete. 2024-03-30T01:51:44.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.477+0000 7fa24aa00640 1 -- 172.21.15.133:0/249949677 shutdown_connections 2024-03-30T01:51:44.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.477+0000 7fa24aa00640 1 -- 172.21.15.133:0/249949677 >> 172.21.15.133:0/249949677 conn(0x7fa2440b0da0 msgr2=0x7fa244151100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.477+0000 7fa24aa00640 1 -- 172.21.15.133:0/249949677 shutdown_connections 2024-03-30T01:51:44.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.477+0000 7fa24aa00640 1 -- 172.21.15.133:0/249949677 wait complete. 2024-03-30T01:51:44.531 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2024-03-30T01:51:44.531 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-30T01:51:44.532 INFO:teuthology.orchestra.run.smithi133.stdout:55834574856 2024-03-30T01:51:44.532 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-30T01:51:44.533 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2024-03-30T01:51:44.533 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-30T01:51:44.534 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2024-03-30T01:51:44.534 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-30T01:51:44.535 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2024-03-30T01:51:44.535 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-30T01:51:44.536 INFO:teuthology.orchestra.run.smithi133.stdout:55834574855 2024-03-30T01:51:44.536 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-30T01:51:44.537 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2024-03-30T01:51:44.537 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-30T01:51:44.538 INFO:teuthology.orchestra.run.smithi133.stdout:55834574855 2024-03-30T01:51:44.538 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-30T01:51:44.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.843+0000 7f1589600640 1 Processor -- start 2024-03-30T01:51:44.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.843+0000 7f1589600640 1 -- start start 2024-03-30T01:51:44.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.845+0000 7f1589600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f158416df50 0x7f15840cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.846+0000 7f1582000640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f15840adc60 0x7f158416d840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54012/0 (socket says 172.21.15.133:54012) 2024-03-30T01:51:44.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.846+0000 7f1582a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f158416d460 0x7f15840b2db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.133:42096/0 (socket says 172.21.15.133:42096) 2024-03-30T01:51:44.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.846+0000 7f1583400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f158416df50 0x7f15840cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.846+0000 7f1583400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f158416df50 0x7f15840cc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46056/0 (socket says 172.21.15.133:46056) 2024-03-30T01:51:44.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.846+0000 7f1582000640 1 -- 172.21.15.133:0/2300966604 learned_addr learned my addr 172.21.15.133:0/2300966604 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:44.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.847+0000 7f1589600640 1 -- 172.21.15.133:0/2300966604 --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f158416e3c0 con 0x7f15840adc60 2024-03-30T01:51:44.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.847+0000 7f1589600640 1 -- 172.21.15.133:0/2300966604 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f158406eb20 con 0x7f158416d460 2024-03-30T01:51:44.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.847+0000 7f1589600640 1 -- 172.21.15.133:0/2300966604 --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15840b34c0 con 0x7f158416df50 2024-03-30T01:51:44.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.847+0000 7f1581600640 1 -- 172.21.15.133:0/2300966604 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503498516 0 0) 0x7f158416e3c0 con 0x7f15840adc60 2024-03-30T01:51:44.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.848+0000 7f1581600640 1 -- 172.21.15.133:0/2300966604 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1568003520 con 0x7f15840adc60 2024-03-30T01:51:44.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.848+0000 7f1581600640 1 -- 172.21.15.133:0/2300966604 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185138035 0 0) 0x7f158406eb20 con 0x7f158416d460 2024-03-30T01:51:44.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.848+0000 7f1581600640 1 -- 172.21.15.133:0/2300966604 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f158416e3c0 con 0x7f158416d460 2024-03-30T01:51:44.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.848+0000 7f1583400640 1 -- 172.21.15.133:0/2300966604 >> v1:172.21.15.137:6789/0 conn(0x7f158416d460 legacy=0x7f15840b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.849+0000 7f1583400640 1 -- 172.21.15.133:0/2300966604 >> v1:172.21.15.133:6789/0 conn(0x7f15840adc60 legacy=0x7f158416d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.849+0000 7f1583400640 1 -- 172.21.15.133:0/2300966604 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158406ee00 con 0x7f158416df50 2024-03-30T01:51:44.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.851+0000 7f1583400640 1 --2- 172.21.15.133:0/2300966604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f158416df50 0x7f15840cc8f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f157000c1e0 tx=0x7f157002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d0018f26eda095 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.851+0000 7f1581600640 1 -- 172.21.15.133:0/2300966604 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1570008df0 con 0x7f158416df50 2024-03-30T01:51:44.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.852+0000 7f1581600640 1 -- 172.21.15.133:0/2300966604 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157000a0d0 con 0x7f158416df50 2024-03-30T01:51:44.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.852+0000 7f1581600640 1 -- 172.21.15.133:0/2300966604 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157000a460 con 0x7f158416df50 2024-03-30T01:51:44.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.853+0000 7f1589600640 1 -- 172.21.15.133:0/2300966604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f158416df50 msgr2=0x7f15840cc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.853+0000 7f1589600640 1 --2- 172.21.15.133:0/2300966604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f158416df50 0x7f15840cc8f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f157000c1e0 tx=0x7f157002b980 comp rx=0 tx=0).stop 2024-03-30T01:51:44.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.854+0000 7f1589600640 1 -- 172.21.15.133:0/2300966604 shutdown_connections 2024-03-30T01:51:44.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.854+0000 7f1589600640 1 --2- 172.21.15.133:0/2300966604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f158416df50 0x7f15840cc8f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.854+0000 7f1589600640 1 -- 172.21.15.133:0/2300966604 >> 172.21.15.133:0/2300966604 conn(0x7f15840b0da0 msgr2=0x7f1584069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.854+0000 7f1589600640 1 -- 172.21.15.133:0/2300966604 shutdown_connections 2024-03-30T01:51:44.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.854+0000 7f1589600640 1 -- 172.21.15.133:0/2300966604 wait complete. 2024-03-30T01:51:44.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.857+0000 7f1589600640 1 Processor -- start 2024-03-30T01:51:44.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.857+0000 7f1589600640 1 -- start start 2024-03-30T01:51:44.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.859+0000 7f1589600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15840adc60 0x7f1584161220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.858+0000 7fba67600640 1 Processor -- start 2024-03-30T01:51:44.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.858+0000 7fba67600640 1 -- start start 2024-03-30T01:51:44.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.860+0000 7fba67600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fba58048c00 0x7fba58049030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.860+0000 7fba67600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fba5803a9e0 0x7fba5803adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.860+0000 7fba67600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba58049570 con 0x7fba58009150 2024-03-30T01:51:44.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.860+0000 7fba67600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba58036b50 con 0x7fba58048c00 2024-03-30T01:51:44.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.860+0000 7fba67600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba580535d0 con 0x7fba5803a9e0 2024-03-30T01:51:44.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.860+0000 7fba5fe00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fba58048c00 0x7fba58049030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.859+0000 7f1589600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f158416d460 0x7f158406dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.860+0000 7f1589600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f158416df50 0x7f158406e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.861+0000 7f1582a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15840adc60 0x7f1584161220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.861+0000 7fba64c00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fba58009150 0x7fba58052ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54022/0 (socket says 172.21.15.133:54022) 2024-03-30T01:51:44.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.861+0000 7fba64c00640 1 -- 172.21.15.133:0/2859933167 learned_addr learned my addr 172.21.15.133:0/2859933167 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:44.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.861+0000 7f1582a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15840adc60 0x7f1584161220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46070/0 (socket says 172.21.15.133:46070) 2024-03-30T01:51:44.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.861+0000 7fba65600640 1 --2- 172.21.15.133:0/2859933167 >> v2:172.21.15.137:3300/0 conn(0x7fba5803a9e0 0x7fba5803adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.862+0000 7f1589600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15840a7500 con 0x7f15840adc60 2024-03-30T01:51:44.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.862+0000 7f1589600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158416ba00 con 0x7f158416d460 2024-03-30T01:51:44.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.862+0000 7f1589600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158416bce0 con 0x7f158416df50 2024-03-30T01:51:44.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.862+0000 7f1582a00640 1 -- 172.21.15.133:0/3578557368 learned_addr learned my addr 172.21.15.133:0/3578557368 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.862+0000 7f1583400640 1 --2- 172.21.15.133:0/3578557368 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f158416df50 0x7f158406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.862+0000 7f1582000640 1 --2- 172.21.15.133:0/3578557368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f158416d460 0x7f158406dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.863+0000 7f1583400640 1 -- 172.21.15.133:0/3578557368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f158416d460 msgr2=0x7f158406dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.863+0000 7f1583400640 1 --2- 172.21.15.133:0/3578557368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f158416d460 0x7f158406dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.863+0000 7f1583400640 1 -- 172.21.15.133:0/3578557368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15840adc60 msgr2=0x7f1584161220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.863+0000 7f1583400640 1 --2- 172.21.15.133:0/3578557368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15840adc60 0x7f1584161220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.863+0000 7f1583400640 1 -- 172.21.15.133:0/3578557368 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157000ae30 con 0x7f158416df50 2024-03-30T01:51:44.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.862+0000 7fba5fe00640 1 -- 172.21.15.133:0/2859933167 >> v2:172.21.15.137:3300/0 conn(0x7fba5803a9e0 msgr2=0x7fba5803adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:44.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.862+0000 7fba5fe00640 1 --2- 172.21.15.133:0/2859933167 >> v2:172.21.15.137:3300/0 conn(0x7fba5803a9e0 0x7fba5803adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.862+0000 7fba5fe00640 1 -- 172.21.15.133:0/2859933167 >> v1:172.21.15.133:6789/0 conn(0x7fba58009150 legacy=0x7fba58052ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:44.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.862+0000 7fba5fe00640 1 -- 172.21.15.133:0/2859933167 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba58009530 con 0x7fba58048c00 2024-03-30T01:51:44.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.863+0000 7f1582000640 1 --2- 172.21.15.133:0/3578557368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f158416d460 0x7f158406dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:44.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.864+0000 7fba5fe00640 1 --2- 172.21.15.133:0/2859933167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba58048c00 0x7fba58049030 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fba5800ec20 tx=0x7fba5402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33582c02f64ddc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.864+0000 7f1583400640 1 --2- 172.21.15.133:0/3578557368 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f158416df50 0x7f158406e150 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1570032000 tx=0x7f15700046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.865+0000 7fba5f400640 1 -- 172.21.15.133:0/2859933167 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba540317c0 con 0x7fba58048c00 2024-03-30T01:51:44.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.865+0000 7fba5f400640 1 -- 172.21.15.133:0/2859933167 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba54031920 con 0x7fba58048c00 2024-03-30T01:51:44.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.865+0000 7fba5f400640 1 -- 172.21.15.133:0/2859933167 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba54031cf0 con 0x7fba58048c00 2024-03-30T01:51:44.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.866+0000 7f157aa00640 1 -- 172.21.15.133:0/3578557368 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157003a940 con 0x7f158416df50 2024-03-30T01:51:44.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.866+0000 7f157aa00640 1 -- 172.21.15.133:0/3578557368 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157003aae0 con 0x7f158416df50 2024-03-30T01:51:44.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.866+0000 7f157aa00640 1 -- 172.21.15.133:0/3578557368 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157003ae90 con 0x7f158416df50 2024-03-30T01:51:44.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.866+0000 7fba67600640 1 -- 172.21.15.133:0/2859933167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba58048c00 msgr2=0x7fba58049030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.866+0000 7fba67600640 1 --2- 172.21.15.133:0/2859933167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba58048c00 0x7fba58049030 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fba5800ec20 tx=0x7fba5402b860 comp rx=0 tx=0).stop 2024-03-30T01:51:44.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.867+0000 7f1589600640 1 -- 172.21.15.133:0/3578557368 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158416bfc0 con 0x7f158416df50 2024-03-30T01:51:44.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.867+0000 7f1589600640 1 -- 172.21.15.133:0/3578557368 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158416c580 con 0x7f158416df50 2024-03-30T01:51:44.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.867+0000 7fba67600640 1 -- 172.21.15.133:0/2859933167 shutdown_connections 2024-03-30T01:51:44.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.867+0000 7fba67600640 1 --2- 172.21.15.133:0/2859933167 >> v2:172.21.15.137:3300/0 conn(0x7fba5803a9e0 0x7fba5803adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.867+0000 7fba67600640 1 --2- 172.21.15.133:0/2859933167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba58048c00 0x7fba58049030 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.867+0000 7fba67600640 1 -- 172.21.15.133:0/2859933167 >> 172.21.15.133:0/2859933167 conn(0x7fba5801ef00 msgr2=0x7fba58055c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.867+0000 7fba67600640 1 -- 172.21.15.133:0/2859933167 shutdown_connections 2024-03-30T01:51:44.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.867+0000 7fba67600640 1 -- 172.21.15.133:0/2859933167 wait complete. 2024-03-30T01:51:44.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.868+0000 7f03c9000640 1 Processor -- start 2024-03-30T01:51:44.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.868+0000 7f03c9000640 1 -- start start 2024-03-30T01:51:44.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.868+0000 7f1589600640 1 -- 172.21.15.133:0/3578557368 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f158406ae30 con 0x7f158416df50 2024-03-30T01:51:44.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.869+0000 7fba67600640 1 Processor -- start 2024-03-30T01:51:44.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.870+0000 7fba67600640 1 -- start start 2024-03-30T01:51:44.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.870+0000 7f03c9000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f03c40d2490 0x7f03c40b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.870+0000 7f03c9000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c40d2000 con 0x7f03c415cc40 2024-03-30T01:51:44.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.870+0000 7f03c9000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c415d020 con 0x7f03c40b8580 2024-03-30T01:51:44.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.870+0000 7f03c9000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c40d13f0 con 0x7f03c40d2490 2024-03-30T01:51:44.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.870+0000 7f03c3e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f03c40b8580 0x7f03c40b59d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.133:42108/0 (socket says 172.21.15.133:42108) 2024-03-30T01:51:44.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.870+0000 7f03c3e00640 1 -- 172.21.15.133:0/1805888787 learned_addr learned my addr 172.21.15.133:0/1805888787 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:44.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.871+0000 7f03c2a00640 1 --2- 172.21.15.133:0/1805888787 >> v2:172.21.15.137:3300/0 conn(0x7f03c40d2490 0x7f03c40b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.871+0000 7fba67600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba58009150 0x7fba580ea4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.871+0000 7fba67600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba5803a9e0 0x7fba580e4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.871+0000 7fba67600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba58048c00 0x7fba580e4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.871+0000 7fba67600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba580e96b0 con 0x7fba58009150 2024-03-30T01:51:44.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.871+0000 7fba67600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba580e8aa0 con 0x7fba5803a9e0 2024-03-30T01:51:44.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.871+0000 7fba67600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba580e8d10 con 0x7fba58048c00 2024-03-30T01:51:44.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.872+0000 7f03c2a00640 1 -- 172.21.15.133:0/1805888787 >> v1:172.21.15.137:6789/0 conn(0x7f03c40b8580 legacy=0x7f03c40b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.872+0000 7fba64c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba58009150 0x7fba580ea4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.872+0000 7fba64c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba58009150 0x7fba580ea4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46088/0 (socket says 172.21.15.133:46088) 2024-03-30T01:51:44.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.872+0000 7fba64c00640 1 -- 172.21.15.133:0/3904253090 learned_addr learned my addr 172.21.15.133:0/3904253090 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.872+0000 7f03c2a00640 1 -- 172.21.15.133:0/1805888787 >> v1:172.21.15.133:6789/0 conn(0x7f03c415cc40 legacy=0x7f03c40d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:44.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.872+0000 7f03c2a00640 1 -- 172.21.15.133:0/1805888787 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c40d16d0 con 0x7f03c40d2490 2024-03-30T01:51:44.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.872+0000 7fba5fe00640 1 --2- 172.21.15.133:0/3904253090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba5803a9e0 0x7fba580e4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.872+0000 7fba64c00640 1 -- 172.21.15.133:0/3904253090 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba58048c00 msgr2=0x7fba580e4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.872+0000 7fba64c00640 1 --2- 172.21.15.133:0/3904253090 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba58048c00 0x7fba580e4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.872+0000 7fba64c00640 1 -- 172.21.15.133:0/3904253090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba5803a9e0 msgr2=0x7fba580e4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.872+0000 7fba64c00640 1 --2- 172.21.15.133:0/3904253090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba5803a9e0 0x7fba580e4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.872+0000 7fba64c00640 1 -- 172.21.15.133:0/3904253090 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba54009400 con 0x7fba58009150 2024-03-30T01:51:44.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.873+0000 7fba64c00640 1 --2- 172.21.15.133:0/3904253090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba58009150 0x7fba580ea4c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fba6002c880 tx=0x7fba60073350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.874+0000 7fba5cc00640 1 -- 172.21.15.133:0/3904253090 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba600721c0 con 0x7fba58009150 2024-03-30T01:51:44.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.874+0000 7fba5cc00640 1 -- 172.21.15.133:0/3904253090 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba60072320 con 0x7fba58009150 2024-03-30T01:51:44.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.874+0000 7fba5cc00640 1 -- 172.21.15.133:0/3904253090 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6006b310 con 0x7fba58009150 2024-03-30T01:51:44.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.875+0000 7fba67600640 1 -- 172.21.15.133:0/3904253090 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba580e8ff0 con 0x7fba58009150 2024-03-30T01:51:44.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.875+0000 7fba67600640 1 -- 172.21.15.133:0/3904253090 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba580eaa00 con 0x7fba58009150 2024-03-30T01:51:44.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.874+0000 7f157aa00640 1 -- 172.21.15.133:0/3578557368 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1570042070 con 0x7f158416df50 2024-03-30T01:51:44.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.876+0000 7f157aa00640 1 --2- 172.21.15.133:0/3578557368 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f156406acd0 0x7f156406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.876+0000 7f157aa00640 1 -- 172.21.15.133:0/3578557368 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15700ab660 con 0x7f158416df50 2024-03-30T01:51:44.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.876+0000 7f03c2a00640 1 --2- 172.21.15.133:0/1805888787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03c40d2490 0x7f03c40b46b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f03b4009720 tx=0x7f03b402b690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad16a985214ece2e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.877+0000 7fba67600640 1 -- 172.21.15.133:0/3904253090 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba580eabf0 con 0x7fba58009150 2024-03-30T01:51:44.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.877+0000 7f62dd000640 1 Processor -- start 2024-03-30T01:51:44.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.877+0000 7f1582a00640 1 --2- 172.21.15.133:0/3578557368 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f156406acd0 0x7f156406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.877+0000 7f03c2000640 1 -- 172.21.15.133:0/1805888787 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b4030710 con 0x7f03c40d2490 2024-03-30T01:51:44.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.877+0000 7f03c2000640 1 -- 172.21.15.133:0/1805888787 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b402e050 con 0x7f03c40d2490 2024-03-30T01:51:44.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.878+0000 7f1582a00640 1 --2- 172.21.15.133:0/3578557368 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f156406acd0 0x7f156406d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f157c001560 tx=0x7f157c005b70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.878+0000 7f03c2000640 1 -- 172.21.15.133:0/1805888787 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b4030710 con 0x7f03c40d2490 2024-03-30T01:51:44.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.877+0000 7f62dd000640 1 -- start start 2024-03-30T01:51:44.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.878+0000 7ff365a00640 1 Processor -- start 2024-03-30T01:51:44.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.879+0000 7f03c9000640 1 -- 172.21.15.133:0/1805888787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03c40d2490 msgr2=0x7f03c40b46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.879+0000 7f03c9000640 1 --2- 172.21.15.133:0/1805888787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03c40d2490 0x7f03c40b46b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f03b4009720 tx=0x7f03b402b690 comp rx=0 tx=0).stop 2024-03-30T01:51:44.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.879+0000 7ff365a00640 1 -- start start 2024-03-30T01:51:44.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.879+0000 7f03c9000640 1 -- 172.21.15.133:0/1805888787 shutdown_connections 2024-03-30T01:51:44.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.879+0000 7f03c9000640 1 --2- 172.21.15.133:0/1805888787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03c40d2490 0x7f03c40b46b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.879+0000 7f03c9000640 1 -- 172.21.15.133:0/1805888787 >> 172.21.15.133:0/1805888787 conn(0x7f03c40cf740 msgr2=0x7f03c40cfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.879+0000 7f03c9000640 1 -- 172.21.15.133:0/1805888787 shutdown_connections 2024-03-30T01:51:44.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.879+0000 7f62dd000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f62d8152fa0 0x7f62d8159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.879+0000 7f62dd000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d806ed50 con 0x7f62d806d030 2024-03-30T01:51:44.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.879+0000 7f62dd000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d815a020 con 0x7f62d806dc10 2024-03-30T01:51:44.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.879+0000 7f62dd000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d806e140 con 0x7f62d8152fa0 2024-03-30T01:51:44.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.879+0000 7fba5cc00640 1 -- 172.21.15.133:0/3904253090 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fba6006b470 con 0x7fba58009150 2024-03-30T01:51:44.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.880+0000 7efc1dc00640 1 Processor -- start 2024-03-30T01:51:44.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.880+0000 7ff365a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff36015cc50 0x7ff3600d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.880+0000 7f62d6800640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f62d806d030 0x7f62d80ccea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54036/0 (socket says 172.21.15.133:54036) 2024-03-30T01:51:44.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.880+0000 7f62d6800640 1 -- 172.21.15.133:0/1948740145 learned_addr learned my addr 172.21.15.133:0/1948740145 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:44.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.880+0000 7f62d5e00640 1 --2- 172.21.15.133:0/1948740145 >> v2:172.21.15.137:3300/0 conn(0x7f62d8152fa0 0x7f62d8159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.880+0000 7f03c9000640 1 -- 172.21.15.133:0/1805888787 wait complete. 2024-03-30T01:51:44.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.880+0000 7ff365a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3600d2240 0x7ff3600cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.880+0000 7ff365a00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff36015d030 con 0x7ff3600cf9b0 2024-03-30T01:51:44.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.880+0000 7ff365a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3600d1c50 con 0x7ff36015cc50 2024-03-30T01:51:44.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.880+0000 7ff365a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3600cfe40 con 0x7ff3600d2240 2024-03-30T01:51:44.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.880+0000 7efc1dc00640 1 -- start start 2024-03-30T01:51:44.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.880+0000 7f62d5e00640 1 -- 172.21.15.133:0/1948740145 >> v1:172.21.15.137:6789/0 conn(0x7f62d806dc10 legacy=0x7f62d806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:44.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.880+0000 7f62d5e00640 1 -- 172.21.15.133:0/1948740145 >> v1:172.21.15.133:6789/0 conn(0x7f62d806d030 legacy=0x7f62d80ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.881+0000 7f62d4a00640 1 -- 172.21.15.133:0/1948740145 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823237714 0 0) 0x7f62d806ed50 con 0x7f62d806d030 2024-03-30T01:51:44.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.881+0000 7f62d5e00640 1 -- 172.21.15.133:0/1948740145 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d806e420 con 0x7f62d8152fa0 2024-03-30T01:51:44.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.881+0000 7ff35ea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff36015cc50 0x7ff3600d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.881+0000 7ff35e000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3600d2240 0x7ff3600cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.881+0000 7ff35ea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff36015cc50 0x7ff3600d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.133:36028/0 (socket says 172.21.15.133:36028) 2024-03-30T01:51:44.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.881+0000 7ff35ea00640 1 -- 172.21.15.133:0/2827655095 learned_addr learned my addr 172.21.15.133:0/2827655095 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.882+0000 7ff35e000640 1 -- 172.21.15.133:0/2827655095 >> v2:172.21.15.137:3300/0 conn(0x7ff36015cc50 msgr2=0x7ff3600d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:44.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.882+0000 7ff35e000640 1 --2- 172.21.15.133:0/2827655095 >> v2:172.21.15.137:3300/0 conn(0x7ff36015cc50 0x7ff3600d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.882+0000 7ff35e000640 1 -- 172.21.15.133:0/2827655095 >> v1:172.21.15.133:6789/0 conn(0x7ff3600cf9b0 legacy=0x7ff3600b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.882+0000 7ff35e000640 1 -- 172.21.15.133:0/2827655095 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3600b5af0 con 0x7ff3600d2240 2024-03-30T01:51:44.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.882+0000 7fba5cc00640 1 --2- 172.21.15.133:0/3904253090 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fba4006ac00 0x7fba4006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.882+0000 7fba5cc00640 1 -- 172.21.15.133:0/3904253090 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba60102a70 con 0x7fba58009150 2024-03-30T01:51:44.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.882+0000 7efc1dc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efc1815cf90 0x7efc180ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.882+0000 7efc1dc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc180cfca0 0x7efc180b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.882+0000 7efc1dc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc180d15d0 con 0x7efc180d1010 2024-03-30T01:51:44.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.882+0000 7efc1dc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc180d18b0 con 0x7efc1815cf90 2024-03-30T01:51:44.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.882+0000 7efc1dc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc180d1b90 con 0x7efc180cfca0 2024-03-30T01:51:44.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.883+0000 7fba5fe00640 1 --2- 172.21.15.133:0/3904253090 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fba4006ac00 0x7fba4006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.883+0000 7efc16a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efc1815cf90 0x7efc180ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.883+0000 7efc16a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efc1815cf90 0x7efc180ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.133:36032/0 (socket says 172.21.15.133:36032) 2024-03-30T01:51:44.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.883+0000 7efc16a00640 1 -- 172.21.15.133:0/1291060495 learned_addr learned my addr 172.21.15.133:0/1291060495 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.883+0000 7f03c9000640 1 Processor -- start 2024-03-30T01:51:44.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.883+0000 7efc17400640 1 --2- 172.21.15.133:0/1291060495 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc180cfca0 0x7efc180b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.884+0000 7fba5fe00640 1 --2- 172.21.15.133:0/3904253090 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fba4006ac00 0x7fba4006d0c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba54036000 tx=0x7fba5403d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.884+0000 7f03c9000640 1 -- start start 2024-03-30T01:51:44.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.884+0000 7ff35e000640 1 --2- 172.21.15.133:0/2827655095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3600d2240 0x7ff3600cf470 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff34c0097a0 tx=0x7ff34c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4de5f9803327f580 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.884+0000 7fdf80a00640 1 Processor -- start 2024-03-30T01:51:44.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.884+0000 7efc15600640 1 -- 172.21.15.133:0/1291060495 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1414050922 0 0) 0x7efc180d15d0 con 0x7efc180d1010 2024-03-30T01:51:44.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.884+0000 7efc17400640 1 -- 172.21.15.133:0/1291060495 >> v2:172.21.15.137:3300/0 conn(0x7efc1815cf90 msgr2=0x7efc180ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:44.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.884+0000 7efc17400640 1 --2- 172.21.15.133:0/1291060495 >> v2:172.21.15.137:3300/0 conn(0x7efc1815cf90 0x7efc180ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.884+0000 7efc17400640 1 -- 172.21.15.133:0/1291060495 >> v1:172.21.15.137:6789/0 conn(0x7efc180d1010 legacy=0x7efc180cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.884+0000 7efc17400640 1 -- 172.21.15.133:0/1291060495 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc180d1e70 con 0x7efc180cfca0 2024-03-30T01:51:44.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.884+0000 7fdf80a00640 1 -- start start 2024-03-30T01:51:44.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.884+0000 7efc16a00640 1 --2- 172.21.15.133:0/1291060495 >> v2:172.21.15.137:3300/0 conn(0x7efc1815cf90 0x7efc180ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T01:51:44.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.885+0000 7f03c9000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03c40b8580 0x7f03c40caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.885+0000 7f03c9000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03c40d2490 0x7f03c406ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.885+0000 7f03c9000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03c415cc40 0x7f03c406d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.885+0000 7f03c9000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c40cab60 con 0x7f03c40d2490 2024-03-30T01:51:44.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.885+0000 7f03c9000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c415b2f0 con 0x7f03c40b8580 2024-03-30T01:51:44.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.885+0000 7f03c9000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c40cb4c0 con 0x7f03c415cc40 2024-03-30T01:51:44.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.885+0000 7f62d5e00640 1 --2- 172.21.15.133:0/1948740145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62d8152fa0 0x7f62d8159ae0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f62d000be90 tx=0x7f62d002dfb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad7233a89374e74f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.886+0000 7efc17400640 1 --2- 172.21.15.133:0/1291060495 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc180cfca0 0x7efc180b63f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efc10009d90 tx=0x7efc1002be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47943bb20b66a779 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.886+0000 7f03c3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03c415cc40 0x7f03c406d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.886+0000 7f03c3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03c415cc40 0x7f03c406d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.133:52838/0 (socket says 172.21.15.133:52838) 2024-03-30T01:51:44.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.886+0000 7f03c3e00640 1 -- 172.21.15.133:0/2962745910 learned_addr learned my addr 172.21.15.133:0/2962745910 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.886+0000 7f03c3400640 1 --2- 172.21.15.133:0/2962745910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03c40b8580 0x7f03c40caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.886+0000 7f03c2a00640 1 --2- 172.21.15.133:0/2962745910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03c40d2490 0x7f03c406ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.886+0000 7fdf80a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdf7c06b0b0 0x7fdf7c0ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.886+0000 7f62d4a00640 1 -- 172.21.15.133:0/1948740145 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d002ed60 con 0x7f62d8152fa0 2024-03-30T01:51:44.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.886+0000 7f62d4a00640 1 -- 172.21.15.133:0/1948740145 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d0032070 con 0x7f62d8152fa0 2024-03-30T01:51:44.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.886+0000 7f62d4a00640 1 -- 172.21.15.133:0/1948740145 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d0038620 con 0x7f62d8152fa0 2024-03-30T01:51:44.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.887+0000 7f03c3e00640 1 -- 172.21.15.133:0/2962745910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03c40b8580 msgr2=0x7f03c40caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.887+0000 7f03c3e00640 1 --2- 172.21.15.133:0/2962745910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03c40b8580 0x7f03c40caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.887+0000 7f03c3e00640 1 -- 172.21.15.133:0/2962745910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03c40d2490 msgr2=0x7f03c406ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.886+0000 7fdf80a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdf7c0cc200 0x7fdf7c13e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.886+0000 7fdf80a00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf7c13f550 con 0x7fdf7c065ea0 2024-03-30T01:51:44.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.887+0000 7fe717600640 1 Processor -- start 2024-03-30T01:51:44.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.886+0000 7fdf80a00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf7c0ce480 con 0x7fdf7c06b0b0 2024-03-30T01:51:44.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.886+0000 7fdf80a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf7c0cdae0 con 0x7fdf7c0cc200 2024-03-30T01:51:44.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.886+0000 7fdf79e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdf7c06b0b0 0x7fdf7c0ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.887+0000 7fdf79e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdf7c06b0b0 0x7fdf7c0ce8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46098/0 (socket says 172.21.15.133:46098) 2024-03-30T01:51:44.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.887+0000 7fdf79e00640 1 -- 172.21.15.133:0/642532830 learned_addr learned my addr 172.21.15.133:0/642532830 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.887+0000 7fdf7a800640 1 --2- 172.21.15.133:0/642532830 >> v2:172.21.15.137:3300/0 conn(0x7fdf7c0cc200 0x7fdf7c13e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.887+0000 7f62dd000640 1 -- 172.21.15.133:0/1948740145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62d8152fa0 msgr2=0x7f62d8159ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.887+0000 7f62dd000640 1 --2- 172.21.15.133:0/1948740145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62d8152fa0 0x7f62d8159ae0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f62d000be90 tx=0x7f62d002dfb0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.888+0000 7f62dd000640 1 -- 172.21.15.133:0/1948740145 shutdown_connections 2024-03-30T01:51:44.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.888+0000 7f62dd000640 1 --2- 172.21.15.133:0/1948740145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62d8152fa0 0x7f62d8159ae0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.888+0000 7f62dd000640 1 -- 172.21.15.133:0/1948740145 >> 172.21.15.133:0/1948740145 conn(0x7f62d80b0da0 msgr2=0x7f62d8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.888+0000 7f03c3e00640 1 --2- 172.21.15.133:0/2962745910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03c40d2490 0x7f03c406ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.888+0000 7f03c3e00640 1 -- 172.21.15.133:0/2962745910 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b4009400 con 0x7f03c415cc40 2024-03-30T01:51:44.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.887+0000 7fe717600640 1 -- start start 2024-03-30T01:51:44.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.887+0000 7fdf7a800640 1 -- 172.21.15.133:0/642532830 >> v2:172.21.15.133:3300/0 conn(0x7fdf7c06b0b0 msgr2=0x7fdf7c0ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:44.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.887+0000 7fdf7a800640 1 --2- 172.21.15.133:0/642532830 >> v2:172.21.15.133:3300/0 conn(0x7fdf7c06b0b0 0x7fdf7c0ce8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.887+0000 7fdf7a800640 1 -- 172.21.15.133:0/642532830 >> v1:172.21.15.133:6789/0 conn(0x7fdf7c065ea0 legacy=0x7fdf7c0cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:44.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.887+0000 7fdf7a800640 1 -- 172.21.15.133:0/642532830 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c0cddc0 con 0x7fdf7c0cc200 2024-03-30T01:51:44.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.888+0000 7fe717600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe71015cc50 0x7fe7100d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.888+0000 7fe717600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7100d2240 0x7fe7100cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.888+0000 7f03c3e00640 1 --2- 172.21.15.133:0/2962745910 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03c415cc40 0x7f03c406d000 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f03b000c780 tx=0x7f03b000cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.888+0000 7fe717600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe71015d030 con 0x7fe7100cf9b0 2024-03-30T01:51:44.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.888+0000 7fe717600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7100d1c50 con 0x7fe71015cc50 2024-03-30T01:51:44.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.888+0000 7fe717600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7100cfe40 con 0x7fe7100d2240 2024-03-30T01:51:44.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.888+0000 7f03c2a00640 1 --2- 172.21.15.133:0/2962745910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03c40d2490 0x7f03c406ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:51:44.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.888+0000 7f62dd000640 1 -- 172.21.15.133:0/1948740145 shutdown_connections 2024-03-30T01:51:44.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.889+0000 7fe714c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe71015cc50 0x7fe7100d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.889+0000 7fe714c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe71015cc50 0x7fe7100d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46102/0 (socket says 172.21.15.133:46102) 2024-03-30T01:51:44.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.889+0000 7fe714c00640 1 -- 172.21.15.133:0/2162779530 learned_addr learned my addr 172.21.15.133:0/2162779530 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.889+0000 7fe70fe00640 1 --2- 172.21.15.133:0/2162779530 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7100d2240 0x7fe7100cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.889+0000 7fe714c00640 1 -- 172.21.15.133:0/2162779530 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7100d2240 msgr2=0x7fe7100cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:44.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.888+0000 7f62dd000640 1 -- 172.21.15.133:0/1948740145 wait complete. 2024-03-30T01:51:44.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.889+0000 7fdf7a800640 1 --2- 172.21.15.133:0/642532830 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf7c0cc200 0x7fdf7c13e7a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c159580 tx=0x7fdf7402bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8b43194d97902d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.890+0000 7fdf78a00640 1 -- 172.21.15.133:0/642532830 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7402cb60 con 0x7fdf7c0cc200 2024-03-30T01:51:44.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.890+0000 7fdf78a00640 1 -- 172.21.15.133:0/642532830 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7402ccc0 con 0x7fdf7c0cc200 2024-03-30T01:51:44.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.890+0000 7fdf78a00640 1 -- 172.21.15.133:0/642532830 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf74034660 con 0x7fdf7c0cc200 2024-03-30T01:51:44.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.889+0000 7fe714c00640 1 --2- 172.21.15.133:0/2162779530 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7100d2240 0x7fe7100cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.889+0000 7fe714c00640 1 -- 172.21.15.133:0/2162779530 >> v1:172.21.15.133:6789/0 conn(0x7fe7100cf9b0 legacy=0x7fe7100b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.889+0000 7fe714c00640 1 -- 172.21.15.133:0/2162779530 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7100b5af0 con 0x7fe71015cc50 2024-03-30T01:51:44.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.889+0000 7fe70fe00640 1 --2- 172.21.15.133:0/2162779530 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7100d2240 0x7fe7100cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:44.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.890+0000 7fdf80a00640 1 -- 172.21.15.133:0/642532830 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf7c0cc200 msgr2=0x7fdf7c13e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.890+0000 7fdf80a00640 1 --2- 172.21.15.133:0/642532830 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf7c0cc200 0x7fdf7c13e7a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c159580 tx=0x7fdf7402bdb0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.890+0000 7fe714c00640 1 --2- 172.21.15.133:0/2162779530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe71015cc50 0x7fe7100d0af0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe708009e50 tx=0x7fe70802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a63a995e0988d25 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.891+0000 7fdf80a00640 1 -- 172.21.15.133:0/642532830 shutdown_connections 2024-03-30T01:51:44.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.891+0000 7fdf80a00640 1 --2- 172.21.15.133:0/642532830 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf7c0cc200 0x7fdf7c13e7a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.891+0000 7fdf80a00640 1 --2- 172.21.15.133:0/642532830 >> v2:172.21.15.133:3300/0 conn(0x7fdf7c06b0b0 0x7fdf7c0ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.891+0000 7fdf80a00640 1 -- 172.21.15.133:0/642532830 >> 172.21.15.133:0/642532830 conn(0x7fdf7c070d50 msgr2=0x7fdf7c071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.891+0000 7fe70f400640 1 -- 172.21.15.133:0/2162779530 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70802cb00 con 0x7fe71015cc50 2024-03-30T01:51:44.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.891+0000 7fe70f400640 1 -- 172.21.15.133:0/2162779530 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70802cc60 con 0x7fe71015cc50 2024-03-30T01:51:44.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.891+0000 7fe70f400640 1 -- 172.21.15.133:0/2162779530 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7080343f0 con 0x7fe71015cc50 2024-03-30T01:51:44.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.891+0000 7fdf80a00640 1 -- 172.21.15.133:0/642532830 shutdown_connections 2024-03-30T01:51:44.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.891+0000 7fdf80a00640 1 -- 172.21.15.133:0/642532830 wait complete. 2024-03-30T01:51:44.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.891+0000 7fba5cc00640 1 -- 172.21.15.133:0/3904253090 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fba580eabf0 con 0x7fba58009150 2024-03-30T01:51:44.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.891+0000 7f62dd000640 1 Processor -- start 2024-03-30T01:51:44.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.891+0000 7f62dd000640 1 -- start start 2024-03-30T01:51:44.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.892+0000 7fe717600640 1 -- 172.21.15.133:0/2162779530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe71015cc50 msgr2=0x7fe7100d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.892+0000 7fe717600640 1 --2- 172.21.15.133:0/2162779530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe71015cc50 0x7fe7100d0af0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe708009e50 tx=0x7fe70802bf60 comp rx=0 tx=0).stop 2024-03-30T01:51:44.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.892+0000 7fe717600640 1 -- 172.21.15.133:0/2162779530 shutdown_connections 2024-03-30T01:51:44.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.892+0000 7fe717600640 1 --2- 172.21.15.133:0/2162779530 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7100d2240 0x7fe7100cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.892+0000 7fe717600640 1 --2- 172.21.15.133:0/2162779530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe71015cc50 0x7fe7100d0af0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.892+0000 7fe717600640 1 -- 172.21.15.133:0/2162779530 >> 172.21.15.133:0/2162779530 conn(0x7fe710071a40 msgr2=0x7fe71006b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.892+0000 7f62dd000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62d806d030 0x7f62d80afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.892+0000 7f62dd000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62d806dc10 0x7f62d81e5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.892+0000 7f62dd000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62d8152fa0 0x7f62d80a7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.892+0000 7f62dd000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d813f400 con 0x7f62d806dc10 2024-03-30T01:51:44.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.892+0000 7f62dd000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d813f6a0 con 0x7f62d806d030 2024-03-30T01:51:44.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.892+0000 7f62dd000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d813f980 con 0x7f62d8152fa0 2024-03-30T01:51:44.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.892+0000 7f62d5400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62d806dc10 0x7f62d81e5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.893+0000 7f62d5400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62d806dc10 0x7f62d81e5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46118/0 (socket says 172.21.15.133:46118) 2024-03-30T01:51:44.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.893+0000 7f62d5400640 1 -- 172.21.15.133:0/1199683715 learned_addr learned my addr 172.21.15.133:0/1199683715 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.893+0000 7f62d5e00640 1 --2- 172.21.15.133:0/1199683715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62d806d030 0x7f62d80afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.892+0000 7fe717600640 1 -- 172.21.15.133:0/2162779530 shutdown_connections 2024-03-30T01:51:44.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.892+0000 7fe717600640 1 -- 172.21.15.133:0/2162779530 wait complete. 2024-03-30T01:51:44.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.893+0000 7f62d6800640 1 --2- 172.21.15.133:0/1199683715 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62d8152fa0 0x7f62d80a7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.893+0000 7f62d5400640 1 -- 172.21.15.133:0/1199683715 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62d8152fa0 msgr2=0x7f62d80a7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.893+0000 7f62d5400640 1 --2- 172.21.15.133:0/1199683715 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62d8152fa0 0x7f62d80a7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.893+0000 7f62d5400640 1 -- 172.21.15.133:0/1199683715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62d806d030 msgr2=0x7f62d80afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.893+0000 7f62d5400640 1 --2- 172.21.15.133:0/1199683715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62d806d030 0x7f62d80afbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.893+0000 7f62d5400640 1 -- 172.21.15.133:0/1199683715 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d000bb70 con 0x7f62d806dc10 2024-03-30T01:51:44.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.893+0000 7f62d5400640 1 --2- 172.21.15.133:0/1199683715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62d806dc10 0x7f62d81e5ee0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f62c400c430 tx=0x7f62c400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.893+0000 7fdf80a00640 1 Processor -- start 2024-03-30T01:51:44.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.894+0000 7fdf80a00640 1 -- start start 2024-03-30T01:51:44.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.894+0000 7f62ce000640 1 -- 172.21.15.133:0/1199683715 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c4011790 con 0x7f62d806dc10 2024-03-30T01:51:44.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.894+0000 7f62ce000640 1 -- 172.21.15.133:0/1199683715 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c40118f0 con 0x7f62d806dc10 2024-03-30T01:51:44.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.894+0000 7f62ce000640 1 -- 172.21.15.133:0/1199683715 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c4011ce0 con 0x7f62d806dc10 2024-03-30T01:51:44.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.894+0000 7f62dd000640 1 -- 172.21.15.133:0/1199683715 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d813fc60 con 0x7f62d806dc10 2024-03-30T01:51:44.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.895+0000 7efc15600640 1 -- 172.21.15.133:0/1291060495 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1002cbe0 con 0x7efc180cfca0 2024-03-30T01:51:44.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.895+0000 7efc15600640 1 -- 172.21.15.133:0/1291060495 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1002cd40 con 0x7efc180cfca0 2024-03-30T01:51:44.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.895+0000 7efc15600640 1 -- 172.21.15.133:0/1291060495 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10034660 con 0x7efc180cfca0 2024-03-30T01:51:44.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.894+0000 7ff35d600640 1 -- 172.21.15.133:0/2827655095 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c02d040 con 0x7ff3600d2240 2024-03-30T01:51:44.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.894+0000 7ff35d600640 1 -- 172.21.15.133:0/2827655095 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34c031810 con 0x7ff3600d2240 2024-03-30T01:51:44.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.894+0000 7ff35d600640 1 -- 172.21.15.133:0/2827655095 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c031ba0 con 0x7ff3600d2240 2024-03-30T01:51:44.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.895+0000 7efc1dc00640 1 -- 172.21.15.133:0/1291060495 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc180cfca0 msgr2=0x7efc180b63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.895+0000 7efc1dc00640 1 --2- 172.21.15.133:0/1291060495 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc180cfca0 0x7efc180b63f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efc10009d90 tx=0x7efc1002be30 comp rx=0 tx=0).stop 2024-03-30T01:51:44.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.894+0000 7f62dd000640 1 -- 172.21.15.133:0/1199683715 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d80a79d0 con 0x7f62d806dc10 2024-03-30T01:51:44.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.896+0000 7fe717600640 1 Processor -- start 2024-03-30T01:51:44.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.895+0000 7fdf80a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf7c065ea0 0x7fdf7c138010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.895+0000 7fdf80a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf7c06b0b0 0x7fdf7c133fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.895+0000 7fdf80a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdf7c0cc200 0x7fdf7c1f1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.895+0000 7fdf80a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c151260 con 0x7fdf7c06b0b0 2024-03-30T01:51:44.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.895+0000 7fdf80a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c1f20f0 con 0x7fdf7c065ea0 2024-03-30T01:51:44.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.895+0000 7fdf80a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c137530 con 0x7fdf7c0cc200 2024-03-30T01:51:44.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.896+0000 7efc1dc00640 1 -- 172.21.15.133:0/1291060495 shutdown_connections 2024-03-30T01:51:44.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.896+0000 7efc1dc00640 1 --2- 172.21.15.133:0/1291060495 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc180cfca0 0x7efc180b63f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.896+0000 7efc1dc00640 1 --2- 172.21.15.133:0/1291060495 >> v2:172.21.15.137:3300/0 conn(0x7efc1815cf90 0x7efc180ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.896+0000 7f03bb400640 1 -- 172.21.15.133:0/2962745910 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b00072d0 con 0x7f03c415cc40 2024-03-30T01:51:44.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.896+0000 7efc1dc00640 1 -- 172.21.15.133:0/1291060495 >> 172.21.15.133:0/1291060495 conn(0x7efc18071a40 msgr2=0x7efc1806b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.896+0000 7f62dd000640 1 -- 172.21.15.133:0/1199683715 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d8140180 con 0x7f62d806dc10 2024-03-30T01:51:44.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.896+0000 7ff365a00640 1 -- 172.21.15.133:0/2827655095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3600d2240 msgr2=0x7ff3600cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.896+0000 7ff365a00640 1 --2- 172.21.15.133:0/2827655095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3600d2240 0x7ff3600cf470 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff34c0097a0 tx=0x7ff34c02b8b0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.896+0000 7fe717600640 1 -- start start 2024-03-30T01:51:44.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.896+0000 7f03bb400640 1 -- 172.21.15.133:0/2962745910 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b0007430 con 0x7f03c415cc40 2024-03-30T01:51:44.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.896+0000 7f03bb400640 1 -- 172.21.15.133:0/2962745910 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b00047e0 con 0x7f03c415cc40 2024-03-30T01:51:44.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.896+0000 7efc1dc00640 1 -- 172.21.15.133:0/1291060495 shutdown_connections 2024-03-30T01:51:44.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.896+0000 7efc1dc00640 1 -- 172.21.15.133:0/1291060495 wait complete. 2024-03-30T01:51:44.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.896+0000 7ff365a00640 1 -- 172.21.15.133:0/2827655095 shutdown_connections 2024-03-30T01:51:44.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.896+0000 7ff365a00640 1 --2- 172.21.15.133:0/2827655095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3600d2240 0x7ff3600cf470 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.896+0000 7ff365a00640 1 --2- 172.21.15.133:0/2827655095 >> v2:172.21.15.137:3300/0 conn(0x7ff36015cc50 0x7ff3600d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.896+0000 7ff365a00640 1 -- 172.21.15.133:0/2827655095 >> 172.21.15.133:0/2827655095 conn(0x7ff360071a40 msgr2=0x7ff36006b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:44.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.896+0000 7f03c9000640 1 -- 172.21.15.133:0/2962745910 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c40c9ee0 con 0x7f03c415cc40 2024-03-30T01:51:44.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.896+0000 7f03c9000640 1 -- 172.21.15.133:0/2962745910 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c40ca4a0 con 0x7f03c415cc40 2024-03-30T01:51:44.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.897+0000 7fe717600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7100cf9b0 0x7fe71014ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.897+0000 7fe717600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7100d2240 0x7fe710153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.898+0000 7fe717600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe71015cc50 0x7fe7100cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.898+0000 7fe717600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7100c9bc0 con 0x7fe7100d2240 2024-03-30T01:51:44.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.898+0000 7fe717600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe710154740 con 0x7fe71015cc50 2024-03-30T01:51:44.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.898+0000 7fe717600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe710154a20 con 0x7fe7100cf9b0 2024-03-30T01:51:44.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.898+0000 7f03c9000640 1 -- 172.21.15.133:0/2962745910 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f039c005250 con 0x7f03c415cc40 2024-03-30T01:51:44.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.898+0000 7fe714c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7100cf9b0 0x7fe71014ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.898+0000 7fe714c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7100cf9b0 0x7fe71014ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.133:52882/0 (socket says 172.21.15.133:52882) 2024-03-30T01:51:44.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.898+0000 7fe714c00640 1 -- 172.21.15.133:0/672667646 learned_addr learned my addr 172.21.15.133:0/672667646 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.898+0000 7f157aa00640 1 -- 172.21.15.133:0/3578557368 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f1570076900 con 0x7f158416df50 2024-03-30T01:51:44.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.898+0000 7efc1dc00640 1 Processor -- start 2024-03-30T01:51:44.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.899+0000 7efc1dc00640 1 -- start start 2024-03-30T01:51:44.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.899+0000 7fe715600640 1 --2- 172.21.15.133:0/672667646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe71015cc50 0x7fe7100cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.899+0000 7fdf79400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf7c06b0b0 0x7fdf7c133fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.899+0000 7fdf79400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf7c06b0b0 0x7fdf7c133fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46120/0 (socket says 172.21.15.133:46120) 2024-03-30T01:51:44.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.899+0000 7fe70fe00640 1 --2- 172.21.15.133:0/672667646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7100d2240 0x7fe710153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.899+0000 7fdf79400640 1 -- 172.21.15.133:0/2743262604 learned_addr learned my addr 172.21.15.133:0/2743262604 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.899+0000 7fe714c00640 1 -- 172.21.15.133:0/672667646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe71015cc50 msgr2=0x7fe7100cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.899+0000 7fe714c00640 1 --2- 172.21.15.133:0/672667646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe71015cc50 0x7fe7100cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.899+0000 7fe714c00640 1 -- 172.21.15.133:0/672667646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7100d2240 msgr2=0x7fe710153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.899+0000 7fe714c00640 1 --2- 172.21.15.133:0/672667646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7100d2240 0x7fe710153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.899+0000 7fe714c00640 1 -- 172.21.15.133:0/672667646 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe708009b30 con 0x7fe7100cf9b0 2024-03-30T01:51:44.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.899+0000 7fdf7a800640 1 --2- 172.21.15.133:0/2743262604 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdf7c0cc200 0x7fdf7c1f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.899+0000 7fdf79e00640 1 --2- 172.21.15.133:0/2743262604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf7c065ea0 0x7fdf7c138010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.898+0000 7f62ce000640 1 -- 172.21.15.133:0/1199683715 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f62c401c460 con 0x7f62d806dc10 2024-03-30T01:51:44.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.899+0000 7f62ce000640 1 --2- 172.21.15.133:0/1199683715 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f62b806ac50 0x7f62b806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.900+0000 7f62ce000640 1 -- 172.21.15.133:0/1199683715 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62c4089bd0 con 0x7f62d806dc10 2024-03-30T01:51:44.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.900+0000 7fe714c00640 1 --2- 172.21.15.133:0/672667646 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7100cf9b0 0x7fe71014ffd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe708036040 tx=0x7fe708004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.900+0000 7efc1dc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc180cfca0 0x7efc180cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.900+0000 7fdf79400640 1 -- 172.21.15.133:0/2743262604 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdf7c0cc200 msgr2=0x7fdf7c1f1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.900+0000 7fdf79400640 1 --2- 172.21.15.133:0/2743262604 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdf7c0cc200 0x7fdf7c1f1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.900+0000 7fdf79400640 1 -- 172.21.15.133:0/2743262604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf7c065ea0 msgr2=0x7fdf7c138010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.900+0000 7fdf79400640 1 --2- 172.21.15.133:0/2743262604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf7c065ea0 0x7fdf7c138010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.900+0000 7fdf79400640 1 -- 172.21.15.133:0/2743262604 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf74009a70 con 0x7fdf7c06b0b0 2024-03-30T01:51:44.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.900+0000 7efc1dc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc180d1010 0x7efc180b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.900+0000 7efc1dc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc1815cf90 0x7efc180b3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.900+0000 7efc1dc00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc180ce030 con 0x7efc1815cf90 2024-03-30T01:51:44.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.900+0000 7efc1dc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc180b4c70 con 0x7efc180cfca0 2024-03-30T01:51:44.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.900+0000 7efc1dc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc180b4060 con 0x7efc180d1010 2024-03-30T01:51:44.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.901+0000 7efc16a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc180cfca0 0x7efc180cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.901+0000 7efc16a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc180cfca0 0x7efc180cc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.133:36092/0 (socket says 172.21.15.133:36092) 2024-03-30T01:51:44.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.901+0000 7efc16a00640 1 -- 172.21.15.133:0/3740274124 learned_addr learned my addr 172.21.15.133:0/3740274124 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.901+0000 7efc17400640 1 --2- 172.21.15.133:0/3740274124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc1815cf90 0x7efc180b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.899+0000 7ff365a00640 1 -- 172.21.15.133:0/2827655095 shutdown_connections 2024-03-30T01:51:44.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.901+0000 7efc16000640 1 --2- 172.21.15.133:0/3740274124 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc180d1010 0x7efc180b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.901+0000 7fdf79400640 1 --2- 172.21.15.133:0/2743262604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf7c06b0b0 0x7fdf7c133fb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800c430 tx=0x7fdf6800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.902+0000 7efc17400640 1 -- 172.21.15.133:0/3740274124 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc180d1010 msgr2=0x7efc180b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.902+0000 7efc17400640 1 --2- 172.21.15.133:0/3740274124 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc180d1010 0x7efc180b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.902+0000 7efc17400640 1 -- 172.21.15.133:0/3740274124 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc180cfca0 msgr2=0x7efc180cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.902+0000 7efc17400640 1 --2- 172.21.15.133:0/3740274124 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc180cfca0 0x7efc180cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.902+0000 7efc17400640 1 -- 172.21.15.133:0/3740274124 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc080094d0 con 0x7efc1815cf90 2024-03-30T01:51:44.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.902+0000 7ff365a00640 1 -- 172.21.15.133:0/2827655095 wait complete. 2024-03-30T01:51:44.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.902+0000 7f62d5e00640 1 --2- 172.21.15.133:0/1199683715 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f62b806ac50 0x7f62b806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.902+0000 7efc17400640 1 --2- 172.21.15.133:0/3740274124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc1815cf90 0x7efc180b3820 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efc10033000 tx=0x7efc10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.901+0000 7f03bb400640 1 -- 172.21.15.133:0/2962745910 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f03b0004940 con 0x7f03c415cc40 2024-03-30T01:51:44.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.905+0000 7ff365a00640 1 Processor -- start 2024-03-30T01:51:44.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.905+0000 7f62d5e00640 1 --2- 172.21.15.133:0/1199683715 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f62b806ac50 0x7f62b806d110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f62d0039000 tx=0x7f62d0034000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.906+0000 7f03bb400640 1 --2- 172.21.15.133:0/2962745910 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f03a406acd0 0x7f03a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.906+0000 7f03bb400640 1 -- 172.21.15.133:0/2962745910 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03b0088e70 con 0x7f03c415cc40 2024-03-30T01:51:44.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.906+0000 7ff365a00640 1 -- start start 2024-03-30T01:51:44.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.906+0000 7f03c3400640 1 --2- 172.21.15.133:0/2962745910 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f03a406acd0 0x7f03a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.907+0000 7f03c3400640 1 --2- 172.21.15.133:0/2962745910 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f03a406acd0 0x7f03a406d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00b450 tx=0x7f03bc00d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.908+0000 7ff365a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3600cf9b0 0x7ff3600b8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.908+0000 7ff365a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3600d2240 0x7ff3601f6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.908+0000 7ff365a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff36015cc50 0x7ff36014ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.908+0000 7ff365a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3600cab80 con 0x7ff36015cc50 2024-03-30T01:51:44.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.908+0000 7ff365a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3600cae20 con 0x7ff3600d2240 2024-03-30T01:51:44.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.908+0000 7ff365a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3600cb100 con 0x7ff3600cf9b0 2024-03-30T01:51:44.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.908+0000 7ff35e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3600d2240 0x7ff3601f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.908+0000 7ff35ea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3600cf9b0 0x7ff3600b8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.908+0000 7ff35ea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3600cf9b0 0x7ff3600b8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.133:52902/0 (socket says 172.21.15.133:52902) 2024-03-30T01:51:44.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.908+0000 7ff35ea00640 1 -- 172.21.15.133:0/3966587682 learned_addr learned my addr 172.21.15.133:0/3966587682 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:44.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.908+0000 7efc0ea00640 1 -- 172.21.15.133:0/3740274124 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10040650 con 0x7efc1815cf90 2024-03-30T01:51:44.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.908+0000 7efc0ea00640 1 -- 172.21.15.133:0/3740274124 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc100407b0 con 0x7efc1815cf90 2024-03-30T01:51:44.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.909+0000 7efc0ea00640 1 -- 172.21.15.133:0/3740274124 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10040ba0 con 0x7efc1815cf90 2024-03-30T01:51:44.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.909+0000 7efc1dc00640 1 -- 172.21.15.133:0/3740274124 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc10009a70 con 0x7efc1815cf90 2024-03-30T01:51:44.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.909+0000 7efc1dc00640 1 -- 172.21.15.133:0/3740274124 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc180b4620 con 0x7efc1815cf90 2024-03-30T01:51:44.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.909+0000 7fdf72000640 1 -- 172.21.15.133:0/2743262604 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf68011790 con 0x7fdf7c06b0b0 2024-03-30T01:51:44.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.909+0000 7fdf72000640 1 -- 172.21.15.133:0/2743262604 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf680118f0 con 0x7fdf7c06b0b0 2024-03-30T01:51:44.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.909+0000 7fdf72000640 1 -- 172.21.15.133:0/2743262604 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf68011ce0 con 0x7fdf7c06b0b0 2024-03-30T01:51:44.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.909+0000 7f62ce000640 1 -- 172.21.15.133:0/1199683715 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f62d8140180 con 0x7f62d806dc10 2024-03-30T01:51:44.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.909+0000 7ff35ea00640 1 -- 172.21.15.133:0/3966587682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3600d2240 msgr2=0x7ff3601f6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.909+0000 7ff35ea00640 1 --2- 172.21.15.133:0/3966587682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3600d2240 0x7ff3601f6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.909+0000 7ff35ea00640 1 -- 172.21.15.133:0/3966587682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff36015cc50 msgr2=0x7ff36014ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:44.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.909+0000 7ff35ea00640 1 --2- 172.21.15.133:0/3966587682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff36015cc50 0x7ff36014ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:44.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.909+0000 7fdf80a00640 1 -- 172.21.15.133:0/2743262604 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf7c137810 con 0x7fdf7c06b0b0 2024-03-30T01:51:44.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.909+0000 7ff35ea00640 1 -- 172.21.15.133:0/3966587682 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c009400 con 0x7ff3600cf9b0 2024-03-30T01:51:44.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.910+0000 7ff35ea00640 1 --2- 172.21.15.133:0/3966587682 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3600cf9b0 0x7ff3600b8470 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff35000e840 tx=0x7ff35000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.910+0000 7efc1dc00640 1 -- 172.21.15.133:0/3740274124 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc1814ab00 con 0x7efc1815cf90 2024-03-30T01:51:44.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.910+0000 7fdf80a00640 1 -- 172.21.15.133:0/2743262604 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf7c1f23d0 con 0x7fdf7c06b0b0 2024-03-30T01:51:44.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.912+0000 7fdf80a00640 1 -- 172.21.15.133:0/2743262604 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf7c137390 con 0x7fdf7c06b0b0 2024-03-30T01:51:44.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.912+0000 7efc0ea00640 1 -- 172.21.15.133:0/3740274124 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7efc10040d00 con 0x7efc1815cf90 2024-03-30T01:51:44.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.913+0000 7efc0ea00640 1 --2- 172.21.15.133:0/3740274124 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efbf806acd0 0x7efbf806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.913+0000 7efc0ea00640 1 -- 172.21.15.133:0/3740274124 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc100abf00 con 0x7efc1815cf90 2024-03-30T01:51:44.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.914+0000 7fdf72000640 1 -- 172.21.15.133:0/2743262604 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fdf6801c460 con 0x7fdf7c06b0b0 2024-03-30T01:51:44.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.914+0000 7efc16a00640 1 --2- 172.21.15.133:0/3740274124 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efbf806acd0 0x7efbf806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.914+0000 7fe70cc00640 1 -- 172.21.15.133:0/672667646 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70803e450 con 0x7fe7100cf9b0 2024-03-30T01:51:44.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.914+0000 7fe70cc00640 1 -- 172.21.15.133:0/672667646 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70803e5d0 con 0x7fe7100cf9b0 2024-03-30T01:51:44.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.914+0000 7fe70cc00640 1 -- 172.21.15.133:0/672667646 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70803e980 con 0x7fe7100cf9b0 2024-03-30T01:51:44.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.914+0000 7fe717600640 1 -- 172.21.15.133:0/672667646 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe710154d00 con 0x7fe7100cf9b0 2024-03-30T01:51:44.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.914+0000 7fe717600640 1 -- 172.21.15.133:0/672667646 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe710150510 con 0x7fe7100cf9b0 2024-03-30T01:51:44.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.915+0000 7f03bb400640 1 -- 172.21.15.133:0/2962745910 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f03b0054170 con 0x7f03c415cc40 2024-03-30T01:51:44.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.915+0000 7efc16a00640 1 --2- 172.21.15.133:0/3740274124 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efbf806acd0 0x7efbf806d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efc08009d80 tx=0x7efc08009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.915+0000 7fdf72000640 1 --2- 172.21.15.133:0/2743262604 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdf5c06ac50 0x7fdf5c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.915+0000 7fdf72000640 1 -- 172.21.15.133:0/2743262604 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf68089150 con 0x7fdf7c06b0b0 2024-03-30T01:51:44.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.916+0000 7ff356a00640 1 -- 172.21.15.133:0/3966587682 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35000c8e0 con 0x7ff3600cf9b0 2024-03-30T01:51:44.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.916+0000 7ff356a00640 1 -- 172.21.15.133:0/3966587682 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35000ca40 con 0x7ff3600cf9b0 2024-03-30T01:51:44.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.916+0000 7ff356a00640 1 -- 172.21.15.133:0/3966587682 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35000cdf0 con 0x7ff3600cf9b0 2024-03-30T01:51:44.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.917+0000 7fdf79e00640 1 --2- 172.21.15.133:0/2743262604 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdf5c06ac50 0x7fdf5c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.917+0000 7fe717600640 1 -- 172.21.15.133:0/672667646 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe710066d80 con 0x7fe7100cf9b0 2024-03-30T01:51:44.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.917+0000 7ff365a00640 1 -- 172.21.15.133:0/3966587682 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3600cb3e0 con 0x7ff3600cf9b0 2024-03-30T01:51:44.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.918+0000 7ff365a00640 1 -- 172.21.15.133:0/3966587682 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff36015a510 con 0x7ff3600cf9b0 2024-03-30T01:51:44.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.919+0000 7fdf79e00640 1 --2- 172.21.15.133:0/2743262604 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdf5c06ac50 0x7fdf5c06d110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c004150 tx=0x7fdf6c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.920+0000 7ff365a00640 1 -- 172.21.15.133:0/3966587682 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3600cb900 con 0x7ff3600cf9b0 2024-03-30T01:51:44.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.922+0000 7efc0ea00640 1 -- 172.21.15.133:0/3740274124 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7efc1814ab00 con 0x7efc1815cf90 2024-03-30T01:51:44.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.922+0000 7ff356a00640 1 -- 172.21.15.133:0/3966587682 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ff350013470 con 0x7ff3600cf9b0 2024-03-30T01:51:44.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.923+0000 7ff356a00640 1 --2- 172.21.15.133:0/3966587682 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff34006ac50 0x7ff34006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.922+0000 7fe70cc00640 1 -- 172.21.15.133:0/672667646 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe70803eae0 con 0x7fe7100cf9b0 2024-03-30T01:51:44.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.923+0000 7fe70cc00640 1 --2- 172.21.15.133:0/672667646 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe6f006ac00 0x7fe6f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:44.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.923+0000 7fe70cc00640 1 -- 172.21.15.133:0/672667646 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7080ac4e0 con 0x7fe7100cf9b0 2024-03-30T01:51:44.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.924+0000 7fe70fe00640 1 --2- 172.21.15.133:0/672667646 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe6f006ac00 0x7fe6f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.924+0000 7ff35e000640 1 --2- 172.21.15.133:0/3966587682 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff34006ac50 0x7ff34006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:44.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.925+0000 7fe70fe00640 1 --2- 172.21.15.133:0/672667646 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe6f006ac00 0x7fe6f006d0c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe7100cbf40 tx=0x7fe6fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.926+0000 7ff35e000640 1 --2- 172.21.15.133:0/3966587682 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff34006ac50 0x7ff34006d110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff34c036000 tx=0x7ff34c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:44.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.932+0000 7ff356a00640 1 -- 172.21.15.133:0/3966587682 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff3500582f0 con 0x7ff3600cf9b0 2024-03-30T01:51:44.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.932+0000 7fdf72000640 1 -- 172.21.15.133:0/2743262604 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fdf7c137390 con 0x7fdf7c06b0b0 2024-03-30T01:51:44.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.932+0000 7fe70cc00640 1 -- 172.21.15.133:0/672667646 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fe708077750 con 0x7fe7100cf9b0 2024-03-30T01:51:44.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:44.945+0000 7ff356a00640 1 -- 172.21.15.133:0/3966587682 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7ff3600cb900 con 0x7ff3600cf9b0 2024-03-30T01:51:45.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.297+0000 7f1589600640 1 -- 172.21.15.133:0/3578557368 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f158416be20 con 0x7f158416df50 2024-03-30T01:51:45.306 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2024-03-30T01:51:45.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.298+0000 7f157aa00640 1 -- 172.21.15.133:0/3578557368 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f158416be20 con 0x7f158416df50 2024-03-30T01:51:45.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.302+0000 7f1589600640 1 -- 172.21.15.133:0/3578557368 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f156406acd0 msgr2=0x7f156406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:45.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.302+0000 7f1589600640 1 --2- 172.21.15.133:0/3578557368 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f156406acd0 0x7f156406d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f157c001560 tx=0x7f157c005b70 comp rx=0 tx=0).stop 2024-03-30T01:51:45.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.302+0000 7f1589600640 1 -- 172.21.15.133:0/3578557368 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f158416df50 msgr2=0x7f158406e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:45.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.302+0000 7f1589600640 1 --2- 172.21.15.133:0/3578557368 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f158416df50 0x7f158406e150 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1570032000 tx=0x7f15700046c0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.303+0000 7f1589600640 1 -- 172.21.15.133:0/3578557368 shutdown_connections 2024-03-30T01:51:45.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.303+0000 7f1589600640 1 --2- 172.21.15.133:0/3578557368 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f156406acd0 0x7f156406d190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.303+0000 7f1589600640 1 --2- 172.21.15.133:0/3578557368 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f158416df50 0x7f158406e150 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.303+0000 7f1589600640 1 --2- 172.21.15.133:0/3578557368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f158416d460 0x7f158406dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.303+0000 7f1589600640 1 --2- 172.21.15.133:0/3578557368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15840adc60 0x7f1584161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.303+0000 7f1589600640 1 -- 172.21.15.133:0/3578557368 >> 172.21.15.133:0/3578557368 conn(0x7f15840b0da0 msgr2=0x7f15841692d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:45.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.304+0000 7f1589600640 1 -- 172.21.15.133:0/3578557368 shutdown_connections 2024-03-30T01:51:45.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.304+0000 7f1589600640 1 -- 172.21.15.133:0/3578557368 wait complete. 2024-03-30T01:51:45.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.309+0000 7fba67600640 1 -- 172.21.15.133:0/3904253090 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fba580e97f0 con 0x7fba58009150 2024-03-30T01:51:45.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.310+0000 7fba5cc00640 1 -- 172.21.15.133:0/3904253090 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fba580e97f0 con 0x7fba58009150 2024-03-30T01:51:45.319 INFO:teuthology.orchestra.run.smithi133.stdout:55834574855 2024-03-30T01:51:45.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.315+0000 7f03c9000640 1 -- 172.21.15.133:0/2962745910 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f039c0057d0 con 0x7f03c415cc40 2024-03-30T01:51:45.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.315+0000 7fba67600640 1 -- 172.21.15.133:0/3904253090 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fba4006ac00 msgr2=0x7fba4006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:45.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.315+0000 7fba67600640 1 --2- 172.21.15.133:0/3904253090 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fba4006ac00 0x7fba4006d0c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba54036000 tx=0x7fba5403d040 comp rx=0 tx=0).stop 2024-03-30T01:51:45.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.315+0000 7fba67600640 1 -- 172.21.15.133:0/3904253090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba58009150 msgr2=0x7fba580ea4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:45.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.315+0000 7fba67600640 1 --2- 172.21.15.133:0/3904253090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba58009150 0x7fba580ea4c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fba6002c880 tx=0x7fba60073350 comp rx=0 tx=0).stop 2024-03-30T01:51:45.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.316+0000 7fba67600640 1 -- 172.21.15.133:0/3904253090 shutdown_connections 2024-03-30T01:51:45.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.316+0000 7fba67600640 1 --2- 172.21.15.133:0/3904253090 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fba4006ac00 0x7fba4006d0c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.316+0000 7fba67600640 1 --2- 172.21.15.133:0/3904253090 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba58048c00 0x7fba580e4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.316+0000 7fba67600640 1 --2- 172.21.15.133:0/3904253090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba5803a9e0 0x7fba580e4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.316+0000 7fba67600640 1 --2- 172.21.15.133:0/3904253090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba58009150 0x7fba580ea4c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.316+0000 7fba67600640 1 -- 172.21.15.133:0/3904253090 >> 172.21.15.133:0/3904253090 conn(0x7fba5801ef00 msgr2=0x7fba580eb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:45.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.316+0000 7f03bb400640 1 -- 172.21.15.133:0/2962745910 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f03b0018070 con 0x7f03c415cc40 2024-03-30T01:51:45.323 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2024-03-30T01:51:45.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.319+0000 7fba67600640 1 -- 172.21.15.133:0/3904253090 shutdown_connections 2024-03-30T01:51:45.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.319+0000 7fba67600640 1 -- 172.21.15.133:0/3904253090 wait complete. 2024-03-30T01:51:45.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.319+0000 7f03c9000640 1 -- 172.21.15.133:0/2962745910 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f03a406acd0 msgr2=0x7f03a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:45.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.319+0000 7f03c9000640 1 --2- 172.21.15.133:0/2962745910 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f03a406acd0 0x7f03a406d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00b450 tx=0x7f03bc00d040 comp rx=0 tx=0).stop 2024-03-30T01:51:45.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.319+0000 7f03c9000640 1 -- 172.21.15.133:0/2962745910 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03c415cc40 msgr2=0x7f03c406d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:45.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.319+0000 7f03c9000640 1 --2- 172.21.15.133:0/2962745910 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03c415cc40 0x7f03c406d000 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f03b000c780 tx=0x7f03b000cc40 comp rx=0 tx=0).stop 2024-03-30T01:51:45.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.320+0000 7f03c9000640 1 -- 172.21.15.133:0/2962745910 shutdown_connections 2024-03-30T01:51:45.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.320+0000 7f03c9000640 1 --2- 172.21.15.133:0/2962745910 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f03a406acd0 0x7f03a406d190 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00b450 tx=0x7f03bc00d040 comp rx=0 tx=0).stop 2024-03-30T01:51:45.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.320+0000 7f03c9000640 1 --2- 172.21.15.133:0/2962745910 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03c415cc40 0x7f03c406d000 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.320+0000 7f03c9000640 1 --2- 172.21.15.133:0/2962745910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03c40d2490 0x7f03c406ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.320+0000 7f03c9000640 1 --2- 172.21.15.133:0/2962745910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03c40b8580 0x7f03c40caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.320+0000 7f03c9000640 1 -- 172.21.15.133:0/2962745910 >> 172.21.15.133:0/2962745910 conn(0x7f03c40cf740 msgr2=0x7f03c40b7310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:45.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.320+0000 7f03c9000640 1 -- 172.21.15.133:0/2962745910 shutdown_connections 2024-03-30T01:51:45.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.320+0000 7f03c9000640 1 -- 172.21.15.133:0/2962745910 wait complete. 2024-03-30T01:51:45.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2024-03-30T01:51:45.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.337+0000 7f62dd000640 1 -- 172.21.15.133:0/1199683715 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f62d8140180 con 0x7f62d806dc10 2024-03-30T01:51:45.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.338+0000 7f62ce000640 1 -- 172.21.15.133:0/1199683715 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f62d8140180 con 0x7f62d806dc10 2024-03-30T01:51:45.345 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2024-03-30T01:51:45.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.339+0000 7fe717600640 1 -- 172.21.15.133:0/672667646 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe7100b63c0 con 0x7fe7100cf9b0 2024-03-30T01:51:45.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.340+0000 7fe70cc00640 1 -- 172.21.15.133:0/672667646 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe70807ad70 con 0x7fe7100cf9b0 2024-03-30T01:51:45.347 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2024-03-30T01:51:45.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.342+0000 7f62dd000640 1 -- 172.21.15.133:0/1199683715 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f62b806ac50 msgr2=0x7f62b806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:45.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.342+0000 7f62dd000640 1 --2- 172.21.15.133:0/1199683715 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f62b806ac50 0x7f62b806d110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f62d0039000 tx=0x7f62d0034000 comp rx=0 tx=0).stop 2024-03-30T01:51:45.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.342+0000 7f62dd000640 1 -- 172.21.15.133:0/1199683715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62d806dc10 msgr2=0x7f62d81e5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:45.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.342+0000 7f62dd000640 1 --2- 172.21.15.133:0/1199683715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62d806dc10 0x7f62d81e5ee0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f62c400c430 tx=0x7f62c400c8f0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.342+0000 7f62dd000640 1 -- 172.21.15.133:0/1199683715 shutdown_connections 2024-03-30T01:51:45.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.342+0000 7f62dd000640 1 --2- 172.21.15.133:0/1199683715 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f62b806ac50 0x7f62b806d110 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.342+0000 7f62dd000640 1 --2- 172.21.15.133:0/1199683715 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62d8152fa0 0x7f62d80a7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.342+0000 7f62dd000640 1 --2- 172.21.15.133:0/1199683715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62d806dc10 0x7f62d81e5ee0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.342+0000 7f62dd000640 1 --2- 172.21.15.133:0/1199683715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62d806d030 0x7f62d80afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.342+0000 7f62dd000640 1 -- 172.21.15.133:0/1199683715 >> 172.21.15.133:0/1199683715 conn(0x7f62d80b0da0 msgr2=0x7f62d80cd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:45.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.342+0000 7f62dd000640 1 -- 172.21.15.133:0/1199683715 shutdown_connections 2024-03-30T01:51:45.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.343+0000 7f62dd000640 1 -- 172.21.15.133:0/1199683715 wait complete. 2024-03-30T01:51:45.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.343+0000 7fe717600640 1 -- 172.21.15.133:0/672667646 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe6f006ac00 msgr2=0x7fe6f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:45.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.343+0000 7fe717600640 1 --2- 172.21.15.133:0/672667646 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe6f006ac00 0x7fe6f006d0c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe7100cbf40 tx=0x7fe6fc008040 comp rx=0 tx=0).stop 2024-03-30T01:51:45.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.343+0000 7fe717600640 1 -- 172.21.15.133:0/672667646 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7100cf9b0 msgr2=0x7fe71014ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:45.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.343+0000 7fe717600640 1 --2- 172.21.15.133:0/672667646 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7100cf9b0 0x7fe71014ffd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe708036040 tx=0x7fe708004a40 comp rx=0 tx=0).stop 2024-03-30T01:51:45.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.344+0000 7fe717600640 1 -- 172.21.15.133:0/672667646 shutdown_connections 2024-03-30T01:51:45.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.344+0000 7fe717600640 1 --2- 172.21.15.133:0/672667646 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe6f006ac00 0x7fe6f006d0c0 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe7100cbf40 tx=0x7fe6fc008040 comp rx=0 tx=0).stop 2024-03-30T01:51:45.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.344+0000 7fe717600640 1 --2- 172.21.15.133:0/672667646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe71015cc50 0x7fe7100cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.344+0000 7fe717600640 1 --2- 172.21.15.133:0/672667646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7100d2240 0x7fe710153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.344+0000 7fe717600640 1 --2- 172.21.15.133:0/672667646 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7100cf9b0 0x7fe71014ffd0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.344+0000 7fe717600640 1 -- 172.21.15.133:0/672667646 >> 172.21.15.133:0/672667646 conn(0x7fe710071a40 msgr2=0x7fe71015e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:45.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.344+0000 7fe717600640 1 -- 172.21.15.133:0/672667646 shutdown_connections 2024-03-30T01:51:45.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-03-30T01:51:45.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2024-03-30T01:51:45.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.347+0000 7fe717600640 1 -- 172.21.15.133:0/672667646 wait complete. 2024-03-30T01:51:45.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.349+0000 7fdf80a00640 1 -- 172.21.15.133:0/2743262604 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fdf7c137d30 con 0x7fdf7c06b0b0 2024-03-30T01:51:45.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.349+0000 7fdf72000640 1 -- 172.21.15.133:0/2743262604 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf7c137d30 con 0x7fdf7c06b0b0 2024-03-30T01:51:45.356 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2024-03-30T01:51:45.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.352+0000 7efc1dc00640 1 -- 172.21.15.133:0/3740274124 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efc1814ab00 con 0x7efc1815cf90 2024-03-30T01:51:45.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.352+0000 7fdf80a00640 1 -- 172.21.15.133:0/2743262604 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdf5c06ac50 msgr2=0x7fdf5c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:45.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.352+0000 7fdf80a00640 1 --2- 172.21.15.133:0/2743262604 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdf5c06ac50 0x7fdf5c06d110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c004150 tx=0x7fdf6c008040 comp rx=0 tx=0).stop 2024-03-30T01:51:45.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.352+0000 7fdf80a00640 1 -- 172.21.15.133:0/2743262604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf7c06b0b0 msgr2=0x7fdf7c133fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:45.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.352+0000 7fdf80a00640 1 --2- 172.21.15.133:0/2743262604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf7c06b0b0 0x7fdf7c133fb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800c430 tx=0x7fdf6800c8f0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.352+0000 7fdf80a00640 1 -- 172.21.15.133:0/2743262604 shutdown_connections 2024-03-30T01:51:45.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.352+0000 7fdf80a00640 1 --2- 172.21.15.133:0/2743262604 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdf5c06ac50 0x7fdf5c06d110 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.352+0000 7fdf80a00640 1 --2- 172.21.15.133:0/2743262604 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdf7c0cc200 0x7fdf7c1f1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.352+0000 7fdf80a00640 1 --2- 172.21.15.133:0/2743262604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf7c06b0b0 0x7fdf7c133fb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.352+0000 7fdf80a00640 1 --2- 172.21.15.133:0/2743262604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf7c065ea0 0x7fdf7c138010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.352+0000 7fdf80a00640 1 -- 172.21.15.133:0/2743262604 >> 172.21.15.133:0/2743262604 conn(0x7fdf7c070d50 msgr2=0x7fdf7c152fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:45.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.352+0000 7efc0ea00640 1 -- 172.21.15.133:0/3740274124 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efc1814ab00 con 0x7efc1815cf90 2024-03-30T01:51:45.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.352+0000 7fdf80a00640 1 -- 172.21.15.133:0/2743262604 shutdown_connections 2024-03-30T01:51:45.360 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2024-03-30T01:51:45.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.352+0000 7fdf80a00640 1 -- 172.21.15.133:0/2743262604 wait complete. 2024-03-30T01:51:45.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.355+0000 7efc1dc00640 1 -- 172.21.15.133:0/3740274124 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efbf806acd0 msgr2=0x7efbf806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:45.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.355+0000 7efc1dc00640 1 --2- 172.21.15.133:0/3740274124 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efbf806acd0 0x7efbf806d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efc08009d80 tx=0x7efc08009240 comp rx=0 tx=0).stop 2024-03-30T01:51:45.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.355+0000 7efc1dc00640 1 -- 172.21.15.133:0/3740274124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc1815cf90 msgr2=0x7efc180b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:45.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.355+0000 7efc1dc00640 1 --2- 172.21.15.133:0/3740274124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc1815cf90 0x7efc180b3820 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efc10033000 tx=0x7efc10004a40 comp rx=0 tx=0).stop 2024-03-30T01:51:45.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.355+0000 7efc1dc00640 1 -- 172.21.15.133:0/3740274124 shutdown_connections 2024-03-30T01:51:45.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.355+0000 7efc1dc00640 1 --2- 172.21.15.133:0/3740274124 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efbf806acd0 0x7efbf806d190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.355+0000 7efc1dc00640 1 --2- 172.21.15.133:0/3740274124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc1815cf90 0x7efc180b3820 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.355+0000 7efc1dc00640 1 --2- 172.21.15.133:0/3740274124 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc180d1010 0x7efc180b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.355+0000 7efc1dc00640 1 --2- 172.21.15.133:0/3740274124 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc180cfca0 0x7efc180cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.355+0000 7efc1dc00640 1 -- 172.21.15.133:0/3740274124 >> 172.21.15.133:0/3740274124 conn(0x7efc18071a40 msgr2=0x7efc180b7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:45.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.356+0000 7efc1dc00640 1 -- 172.21.15.133:0/3740274124 shutdown_connections 2024-03-30T01:51:45.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.356+0000 7efc1dc00640 1 -- 172.21.15.133:0/3740274124 wait complete. 2024-03-30T01:51:45.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.358+0000 7ff365a00640 1 -- 172.21.15.133:0/3966587682 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff3600cb900 con 0x7ff3600cf9b0 2024-03-30T01:51:45.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.359+0000 7ff356a00640 1 -- 172.21.15.133:0/3966587682 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff3600cb900 con 0x7ff3600cf9b0 2024-03-30T01:51:45.365 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2024-03-30T01:51:45.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.361+0000 7ff365a00640 1 -- 172.21.15.133:0/3966587682 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff34006ac50 msgr2=0x7ff34006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:45.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.361+0000 7ff365a00640 1 --2- 172.21.15.133:0/3966587682 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff34006ac50 0x7ff34006d110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff34c036000 tx=0x7ff34c03c040 comp rx=0 tx=0).stop 2024-03-30T01:51:45.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.361+0000 7ff365a00640 1 -- 172.21.15.133:0/3966587682 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3600cf9b0 msgr2=0x7ff3600b8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:45.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.361+0000 7ff365a00640 1 --2- 172.21.15.133:0/3966587682 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3600cf9b0 0x7ff3600b8470 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff35000e840 tx=0x7ff35000ed00 comp rx=0 tx=0).stop 2024-03-30T01:51:45.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.362+0000 7ff365a00640 1 -- 172.21.15.133:0/3966587682 shutdown_connections 2024-03-30T01:51:45.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.362+0000 7ff365a00640 1 --2- 172.21.15.133:0/3966587682 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff34006ac50 0x7ff34006d110 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.362+0000 7ff365a00640 1 --2- 172.21.15.133:0/3966587682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff36015cc50 0x7ff36014ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.362+0000 7ff365a00640 1 --2- 172.21.15.133:0/3966587682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3600d2240 0x7ff3601f6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.362+0000 7ff365a00640 1 --2- 172.21.15.133:0/3966587682 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3600cf9b0 0x7ff3600b8470 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:45.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.362+0000 7ff365a00640 1 -- 172.21.15.133:0/3966587682 >> 172.21.15.133:0/3966587682 conn(0x7ff360071a40 msgr2=0x7ff36015dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:45.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.362+0000 7ff365a00640 1 -- 172.21.15.133:0/3966587682 shutdown_connections 2024-03-30T01:51:45.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:45.362+0000 7ff365a00640 1 -- 172.21.15.133:0/3966587682 wait complete. 2024-03-30T01:51:45.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2024-03-30T01:51:45.376 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2024-03-30T01:51:45.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2024-03-30T01:51:45.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-03-30T01:51:45.389 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-03-30T01:51:46.338 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-30T01:51:46.354 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-30T01:51:46.355 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-30T01:51:46.373 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-30T01:51:46.378 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-30T01:51:46.387 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-30T01:51:46.389 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-30T01:51:46.389 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-30T01:51:46.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.610+0000 7f4d9ee00640 1 Processor -- start 2024-03-30T01:51:46.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.610+0000 7f4d9ee00640 1 -- start start 2024-03-30T01:51:46.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.613+0000 7f4d9ee00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4d980ce090 0x7f4d98159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.614+0000 7f4d9ee00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d980b1e00 con 0x7f4d980b1640 2024-03-30T01:51:46.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.614+0000 7f4d9ee00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d980b20e0 con 0x7f4d980b2960 2024-03-30T01:51:46.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.614+0000 7f4d9ce00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4d980b2960 0x7f4d980702b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.133:35392/0 (socket says 172.21.15.133:35392) 2024-03-30T01:51:46.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.614+0000 7f4d9ce00640 1 -- 172.21.15.133:0/3254045924 learned_addr learned my addr 172.21.15.133:0/3254045924 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:46.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.615+0000 7f4d9ee00640 1 -- 172.21.15.133:0/3254045924 --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d9806c2d0 con 0x7f4d980ce090 2024-03-30T01:51:46.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.615+0000 7f4d96a00640 1 -- 172.21.15.133:0/3254045924 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1643481197 0 0) 0x7f4d980b20e0 con 0x7f4d980b2960 2024-03-30T01:51:46.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.615+0000 7f4d96a00640 1 -- 172.21.15.133:0/3254045924 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d7c003520 con 0x7f4d980b2960 2024-03-30T01:51:46.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.616+0000 7f4d97e00640 1 --2- 172.21.15.133:0/3254045924 >> v2:172.21.15.137:3300/0 conn(0x7f4d980ce090 0x7f4d98159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.616+0000 7f4d96a00640 1 -- 172.21.15.133:0/3254045924 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2126917141 0 0) 0x7f4d7c003520 con 0x7f4d980b2960 2024-03-30T01:51:46.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.616+0000 7f4d96a00640 1 -- 172.21.15.133:0/3254045924 >> v2:172.21.15.137:3300/0 conn(0x7f4d980ce090 msgr2=0x7f4d98159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:46.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.616+0000 7f4d96a00640 1 --2- 172.21.15.133:0/3254045924 >> v2:172.21.15.137:3300/0 conn(0x7f4d980ce090 0x7f4d98159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.616+0000 7f4d96a00640 1 -- 172.21.15.133:0/3254045924 >> v1:172.21.15.133:6789/0 conn(0x7f4d980b1640 legacy=0x7f4d9806ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.616+0000 7f4d96a00640 1 -- 172.21.15.133:0/3254045924 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d980b23c0 con 0x7f4d980b2960 2024-03-30T01:51:46.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.617+0000 7f4d96a00640 1 -- 172.21.15.133:0/3254045924 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f4d84001670 con 0x7f4d980b2960 2024-03-30T01:51:46.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.617+0000 7f4d96a00640 1 -- 172.21.15.133:0/3254045924 >> v1:172.21.15.137:6789/0 conn(0x7f4d980b2960 legacy=0x7f4d980702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.617+0000 7f4d96a00640 1 --2- 172.21.15.133:0/3254045924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d7c003760 0x7f4d7c003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.617+0000 7f4d96a00640 1 --2- 172.21.15.133:0/3254045924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d7c0040e0 0x7f4d7c00b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.618+0000 7f4d96a00640 1 --2- 172.21.15.133:0/3254045924 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d7c00b600 0x7f4d7c00dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.618+0000 7f4d96a00640 1 -- 172.21.15.133:0/3254045924 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9806c2d0 con 0x7f4d7c0040e0 2024-03-30T01:51:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.618+0000 7f4d96a00640 1 -- 172.21.15.133:0/3254045924 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c00e3a0 con 0x7f4d7c003760 2024-03-30T01:51:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.618+0000 7f4d96a00640 1 -- 172.21.15.133:0/3254045924 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c00e560 con 0x7f4d7c00b600 2024-03-30T01:51:46.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.619+0000 7f4d9ce00640 1 --2- 172.21.15.133:0/3254045924 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d7c00b600 0x7f4d7c00dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.619+0000 7f4d97e00640 1 --2- 172.21.15.133:0/3254045924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d7c003760 0x7f4d7c003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.620+0000 7f4d97400640 1 --2- 172.21.15.133:0/3254045924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d7c0040e0 0x7f4d7c00b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.620+0000 7f4d9ce00640 1 -- 172.21.15.133:0/3254045924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d7c003760 msgr2=0x7f4d7c003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.620+0000 7f4d9ce00640 1 --2- 172.21.15.133:0/3254045924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d7c003760 0x7f4d7c003ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.620+0000 7f4d9ce00640 1 -- 172.21.15.133:0/3254045924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d7c0040e0 msgr2=0x7f4d7c00b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.620+0000 7f4d9ce00640 1 --2- 172.21.15.133:0/3254045924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d7c0040e0 0x7f4d7c00b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.620+0000 7f4d9ce00640 1 -- 172.21.15.133:0/3254045924 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d980b23c0 con 0x7f4d7c00b600 2024-03-30T01:51:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.621+0000 7f4d9ce00640 1 -- 172.21.15.133:0/3254045924 reap_dead start 2024-03-30T01:51:46.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.623+0000 7f4d9ce00640 1 --2- 172.21.15.133:0/3254045924 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d7c00b600 0x7f4d7c00dac0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4d8400c2f0 tx=0x7f4d7c0047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8757e5931a1c0e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.623+0000 7f4d96a00640 1 -- 172.21.15.133:0/3254045924 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8402cbf0 con 0x7f4d7c00b600 2024-03-30T01:51:46.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.624+0000 7f4d96a00640 1 -- 172.21.15.133:0/3254045924 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8402cd50 con 0x7f4d7c00b600 2024-03-30T01:51:46.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.625+0000 7f4d96a00640 1 -- 172.21.15.133:0/3254045924 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d840072b0 con 0x7f4d7c00b600 2024-03-30T01:51:46.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.625+0000 7f4d9ee00640 1 -- 172.21.15.133:0/3254045924 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d7c00b600 msgr2=0x7f4d7c00dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.625+0000 7f4d9ee00640 1 --2- 172.21.15.133:0/3254045924 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d7c00b600 0x7f4d7c00dac0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4d8400c2f0 tx=0x7f4d7c0047e0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.626+0000 7f4d9ee00640 1 -- 172.21.15.133:0/3254045924 shutdown_connections 2024-03-30T01:51:46.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.626+0000 7f4d9ee00640 1 --2- 172.21.15.133:0/3254045924 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d7c00b600 0x7f4d7c00dac0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.626+0000 7f4d9ee00640 1 -- 172.21.15.133:0/3254045924 >> 172.21.15.133:0/3254045924 conn(0x7f4d98065e70 msgr2=0x7f4d98069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:46.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.626+0000 7f4d9ee00640 1 -- 172.21.15.133:0/3254045924 shutdown_connections 2024-03-30T01:51:46.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.626+0000 7f4d9ee00640 1 -- 172.21.15.133:0/3254045924 wait complete. 2024-03-30T01:51:46.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.630+0000 7f4d9ee00640 1 Processor -- start 2024-03-30T01:51:46.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.631+0000 7f4d9ee00640 1 -- start start 2024-03-30T01:51:46.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.632+0000 7f4d9ee00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d7c00b600 0x7f4d9813bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.633+0000 7f4d9ee00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d980ccc40 0x7f4d980cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.633+0000 7f4d9ee00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d9814f5b0 0x7f4d9814fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.633+0000 7f4d9ee00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d980cd600 con 0x7f4d980ccc40 2024-03-30T01:51:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.633+0000 7f4d9ee00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d98150f30 con 0x7f4d7c00b600 2024-03-30T01:51:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.633+0000 7f4d9ee00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d98150320 con 0x7f4d9814f5b0 2024-03-30T01:51:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.634+0000 7f4d97400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d980ccc40 0x7f4d980cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.634+0000 7f4d97400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d980ccc40 0x7f4d980cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60226/0 (socket says 172.21.15.133:60226) 2024-03-30T01:51:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.634+0000 7f4d97400640 1 -- 172.21.15.133:0/1089579030 learned_addr learned my addr 172.21.15.133:0/1089579030 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:46.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.635+0000 7f4d97400640 1 -- 172.21.15.133:0/1089579030 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d9814f5b0 msgr2=0x7f4d9814fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.635+0000 7f4d97400640 1 --2- 172.21.15.133:0/1089579030 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d9814f5b0 0x7f4d9814fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.635+0000 7f4d97400640 1 -- 172.21.15.133:0/1089579030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d7c00b600 msgr2=0x7f4d9813bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.635+0000 7f4d97400640 1 --2- 172.21.15.133:0/1089579030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d7c00b600 0x7f4d9813bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.635+0000 7f4d97400640 1 -- 172.21.15.133:0/1089579030 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d98150600 con 0x7f4d980ccc40 2024-03-30T01:51:46.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.636+0000 7f4d97400640 1 --2- 172.21.15.133:0/1089579030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d980ccc40 0x7f4d980cd0c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4d880015e0 tx=0x7f4d88001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.637+0000 7f4d8fe00640 1 -- 172.21.15.133:0/1089579030 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d88001cf0 con 0x7f4d980ccc40 2024-03-30T01:51:46.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.637+0000 7f4d8fe00640 1 -- 172.21.15.133:0/1089579030 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d88014040 con 0x7f4d980ccc40 2024-03-30T01:51:46.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.637+0000 7f4d8fe00640 1 -- 172.21.15.133:0/1089579030 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d880128d0 con 0x7f4d980ccc40 2024-03-30T01:51:46.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.639+0000 7f4d9ee00640 1 -- 172.21.15.133:0/1089579030 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d981508e0 con 0x7f4d980ccc40 2024-03-30T01:51:46.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.640+0000 7f4d9ee00640 1 -- 172.21.15.133:0/1089579030 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d9813c300 con 0x7f4d980ccc40 2024-03-30T01:51:46.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.643+0000 7f4d8d600640 1 -- 172.21.15.133:0/1089579030 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6c005250 con 0x7f4d980ccc40 2024-03-30T01:51:46.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.645+0000 7f4d8fe00640 1 -- 172.21.15.133:0/1089579030 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f4d88012a30 con 0x7f4d980ccc40 2024-03-30T01:51:46.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.646+0000 7f4d8fe00640 1 --2- 172.21.15.133:0/1089579030 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4d7806ac30 0x7f4d7806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.647+0000 7f4d97e00640 1 --2- 172.21.15.133:0/1089579030 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4d7806ac30 0x7f4d7806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.648+0000 7f4d8fe00640 1 -- 172.21.15.133:0/1089579030 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d8805bf50 con 0x7f4d980ccc40 2024-03-30T01:51:46.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.649+0000 7f4d97e00640 1 --2- 172.21.15.133:0/1089579030 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4d7806ac30 0x7f4d7806d0f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4d90007130 tx=0x7f4d90008380 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.658+0000 7f4d8fe00640 1 -- 172.21.15.133:0/1089579030 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f4d88058320 con 0x7f4d980ccc40 2024-03-30T01:51:46.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.664+0000 7fbe8be00640 1 Processor -- start 2024-03-30T01:51:46.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.665+0000 7fbe8be00640 1 -- start start 2024-03-30T01:51:46.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.666+0000 7fbe8be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe8c15cac0 0x7fbe8c160670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.667+0000 7fbe8be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbe8c160bb0 0x7fbe8c0cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.667+0000 7fbe8be00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe8c0ce030 con 0x7fbe8c0cdbe0 2024-03-30T01:51:46.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.667+0000 7fbe8be00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe8c0d1020 con 0x7fbe8c160bb0 2024-03-30T01:51:46.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.667+0000 7fbe8be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c0b5b50 con 0x7fbe8c15cac0 2024-03-30T01:51:46.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.667+0000 7fbe8aa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe8c15cac0 0x7fbe8c160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.667+0000 7fbe8b400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbe8c0cdbe0 0x7fbe8c06b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48746/0 (socket says 172.21.15.133:48746) 2024-03-30T01:51:46.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.667+0000 7fbe8b400640 1 -- 172.21.15.133:0/2073288407 learned_addr learned my addr 172.21.15.133:0/2073288407 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:46.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.668+0000 7fbe8a000640 1 --2- 172.21.15.133:0/2073288407 >> v2:172.21.15.137:3300/0 conn(0x7fbe8c160bb0 0x7fbe8c0cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.669+0000 7fbe89600640 1 -- 172.21.15.133:0/2073288407 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107639347 0 0) 0x7fbe84001490 con 0x7fbe8c0cdbe0 2024-03-30T01:51:46.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.669+0000 7fbe89600640 1 -- 172.21.15.133:0/2073288407 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe70003520 con 0x7fbe8c0cdbe0 2024-03-30T01:51:46.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.670+0000 7fbe89600640 1 -- 172.21.15.133:0/2073288407 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1208841674 0 0) 0x7fbe70003520 con 0x7fbe8c0cdbe0 2024-03-30T01:51:46.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.670+0000 7fbe89600640 1 -- 172.21.15.133:0/2073288407 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe8c15cac0 msgr2=0x7fbe8c160670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:46.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.670+0000 7fbe89600640 1 --2- 172.21.15.133:0/2073288407 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe8c15cac0 0x7fbe8c160670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.670+0000 7fbe89600640 1 -- 172.21.15.133:0/2073288407 >> v2:172.21.15.137:3300/0 conn(0x7fbe8c160bb0 msgr2=0x7fbe8c0cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:46.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.670+0000 7fbe89600640 1 --2- 172.21.15.133:0/2073288407 >> v2:172.21.15.137:3300/0 conn(0x7fbe8c160bb0 0x7fbe8c0cd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.670+0000 7fbe89600640 1 -- 172.21.15.133:0/2073288407 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8c161100 con 0x7fbe8c0cdbe0 2024-03-30T01:51:46.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.670+0000 7fbe89600640 1 -- 172.21.15.133:0/2073288407 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fbe84001b80 con 0x7fbe8c0cdbe0 2024-03-30T01:51:46.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.671+0000 7f327d600640 1 Processor -- start 2024-03-30T01:51:46.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.671+0000 7fbe89600640 1 -- 172.21.15.133:0/2073288407 >> v1:172.21.15.133:6789/0 conn(0x7fbe8c0cdbe0 legacy=0x7fbe8c06b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.671+0000 7fbe89600640 1 --2- 172.21.15.133:0/2073288407 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe8c15cac0 0x7fbe70003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.671+0000 7fbe89600640 1 --2- 172.21.15.133:0/2073288407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe70003eb0 0x7fbe700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.671+0000 7fbe89600640 1 --2- 172.21.15.133:0/2073288407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe70004d00 0x7fbe70005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.671+0000 7fbe89600640 1 -- 172.21.15.133:0/2073288407 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c0d1020 con 0x7fbe70004d00 2024-03-30T01:51:46.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.671+0000 7f3fa3c00640 1 Processor -- start 2024-03-30T01:51:46.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.671+0000 7f327d600640 1 -- start start 2024-03-30T01:51:46.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.672+0000 7f3fa3c00640 1 -- start start 2024-03-30T01:51:46.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.672+0000 7fbe8a000640 1 --2- 172.21.15.133:0/2073288407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe70003eb0 0x7fbe700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.671+0000 7fbe89600640 1 -- 172.21.15.133:0/2073288407 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c0b5b50 con 0x7fbe70003eb0 2024-03-30T01:51:46.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.672+0000 7fbe89600640 1 -- 172.21.15.133:0/2073288407 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700141c0 con 0x7fbe8c15cac0 2024-03-30T01:51:46.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.672+0000 7fbe8b400640 1 --2- 172.21.15.133:0/2073288407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe70004d00 0x7fbe70005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.673+0000 7fbe8aa00640 1 --2- 172.21.15.133:0/2073288407 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe8c15cac0 0x7fbe70003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.673+0000 7fbe8a000640 1 -- 172.21.15.133:0/2073288407 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe8c15cac0 msgr2=0x7fbe70003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:46.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.673+0000 7fbe8a000640 1 --2- 172.21.15.133:0/2073288407 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe8c15cac0 0x7fbe70003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.673+0000 7fbe8a000640 1 -- 172.21.15.133:0/2073288407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe70004d00 msgr2=0x7fbe70005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:46.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.673+0000 7fbe8a000640 1 --2- 172.21.15.133:0/2073288407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe70004d00 0x7fbe70005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.673+0000 7fbe8a000640 1 -- 172.21.15.133:0/2073288407 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe70003520 con 0x7fbe70003eb0 2024-03-30T01:51:46.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.673+0000 7f327d600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f327815cf90 0x7f32780ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.673+0000 7f3fa3c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f9c0d0af0 0x7f3f9c0cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.673+0000 7f3fa3c00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f9c15d030 con 0x7f3f9c0cf9b0 2024-03-30T01:51:46.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.673+0000 7f3fa3c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f9c0cfe40 con 0x7f3f9c15cc50 2024-03-30T01:51:46.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.674+0000 7f3fa3c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c0d1c50 con 0x7f3f9c0d0af0 2024-03-30T01:51:46.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.674+0000 7f3f9be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f9c0d0af0 0x7f3f9c0cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.674+0000 7f3f9be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f9c0d0af0 0x7f3f9c0cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.133:41010/0 (socket says 172.21.15.133:41010) 2024-03-30T01:51:46.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.674+0000 7f3f9be00640 1 -- 172.21.15.133:0/155777135 learned_addr learned my addr 172.21.15.133:0/155777135 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:46.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.673+0000 7fbe8b400640 1 --2- 172.21.15.133:0/2073288407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe70004d00 0x7fbe70005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T01:51:46.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.673+0000 7f327d600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f32780cfca0 0x7f32780b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.673+0000 7f327d600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32780d15d0 con 0x7f32780d1010 2024-03-30T01:51:46.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.673+0000 7f327d600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32780d18b0 con 0x7f32780cfca0 2024-03-30T01:51:46.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.673+0000 7f327d600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32780d1b90 con 0x7f327815cf90 2024-03-30T01:51:46.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.674+0000 7f3276a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f327815cf90 0x7f32780ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.674+0000 7f3276a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f327815cf90 0x7f32780ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.133:58978/0 (socket says 172.21.15.133:58978) 2024-03-30T01:51:46.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.674+0000 7f3276a00640 1 -- 172.21.15.133:0/2931463240 learned_addr learned my addr 172.21.15.133:0/2931463240 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:46.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.675+0000 7f3277400640 1 --2- 172.21.15.133:0/2931463240 >> v2:172.21.15.133:3300/0 conn(0x7f32780cfca0 0x7f32780b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.675+0000 7f3276a00640 1 -- 172.21.15.133:0/2931463240 >> v2:172.21.15.133:3300/0 conn(0x7f32780cfca0 msgr2=0x7f32780b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:46.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.675+0000 7f3276a00640 1 --2- 172.21.15.133:0/2931463240 >> v2:172.21.15.133:3300/0 conn(0x7f32780cfca0 0x7f32780b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.675+0000 7f3276a00640 1 -- 172.21.15.133:0/2931463240 >> v1:172.21.15.133:6789/0 conn(0x7f32780d1010 legacy=0x7f32780cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.676+0000 7f3276a00640 1 -- 172.21.15.133:0/2931463240 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32780d1e70 con 0x7f327815cf90 2024-03-30T01:51:46.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.675+0000 7f3f9be00640 1 -- 172.21.15.133:0/155777135 >> v1:172.21.15.137:6789/0 conn(0x7f3f9c15cc50 legacy=0x7f3f9c0d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:46.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.675+0000 7f3f9be00640 1 -- 172.21.15.133:0/155777135 >> v1:172.21.15.133:6789/0 conn(0x7f3f9c0cf9b0 legacy=0x7f3f9c0b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:46.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.675+0000 7f3f9be00640 1 -- 172.21.15.133:0/155777135 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c0b5af0 con 0x7f3f9c0d0af0 2024-03-30T01:51:46.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.676+0000 7fbe8a000640 1 --2- 172.21.15.133:0/2073288407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe70003eb0 0x7fbe700047c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbe78009ac0 tx=0x7fbe700057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c4b0ddc35cb4ceb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.676+0000 7fdf72e00640 1 Processor -- start 2024-03-30T01:51:46.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.677+0000 7fbe89600640 1 -- 172.21.15.133:0/2073288407 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7802c710 con 0x7fbe70003eb0 2024-03-30T01:51:46.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.677+0000 7fbe40400640 1 Processor -- start 2024-03-30T01:51:46.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.677+0000 7fdf72e00640 1 -- start start 2024-03-30T01:51:46.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.677+0000 7fbe89600640 1 -- 172.21.15.133:0/2073288407 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7802c870 con 0x7fbe70003eb0 2024-03-30T01:51:46.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.677+0000 7fbe89600640 1 -- 172.21.15.133:0/2073288407 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7802cc00 con 0x7fbe70003eb0 2024-03-30T01:51:46.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.677+0000 7fbe40400640 1 -- start start 2024-03-30T01:51:46.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.678+0000 7f3f9be00640 1 --2- 172.21.15.133:0/155777135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f9c0d0af0 0x7f3f9c0cf470 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3f940098a0 tx=0x7f3f9402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4d9430cf41fcf74 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.677+0000 7f3276a00640 1 --2- 172.21.15.133:0/2931463240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f327815cf90 0x7f32780ce160 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f32780b56a0 tx=0x7f326802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1993f6ac1c2d94b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.678+0000 7f3f9b400640 1 -- 172.21.15.133:0/155777135 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94030840 con 0x7f3f9c0d0af0 2024-03-30T01:51:46.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.678+0000 7f3f9b400640 1 -- 172.21.15.133:0/155777135 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f940309a0 con 0x7f3f9c0d0af0 2024-03-30T01:51:46.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.678+0000 7f3f9b400640 1 -- 172.21.15.133:0/155777135 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94030d30 con 0x7f3f9c0d0af0 2024-03-30T01:51:46.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.678+0000 7fbe8be00640 1 -- 172.21.15.133:0/2073288407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe70003eb0 msgr2=0x7fbe700047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.678+0000 7fbe8be00640 1 --2- 172.21.15.133:0/2073288407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe70003eb0 0x7fbe700047c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbe78009ac0 tx=0x7fbe700057f0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.678+0000 7fbe8b400640 1 -- 172.21.15.133:0/2073288407 reap_dead start 2024-03-30T01:51:46.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.679+0000 7fbe8be00640 1 -- 172.21.15.133:0/2073288407 shutdown_connections 2024-03-30T01:51:46.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.679+0000 7fbe8be00640 1 -- 172.21.15.133:0/2073288407 >> 172.21.15.133:0/2073288407 conn(0x7fbe8c0cf770 msgr2=0x7fbe8c0cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:46.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.679+0000 7fbe8be00640 1 -- 172.21.15.133:0/2073288407 shutdown_connections 2024-03-30T01:51:46.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.679+0000 7fdf72e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdf6c06c920 0x7fdf6c06cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.679+0000 7fdf72e00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf6c06ed50 con 0x7fdf6c071510 2024-03-30T01:51:46.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.679+0000 7fdf72e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf6c06e140 con 0x7fdf6c06dc10 2024-03-30T01:51:46.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.679+0000 7fdf72e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6c06d2f0 con 0x7fdf6c06c920 2024-03-30T01:51:46.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.678+0000 7fbe40400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbe3815cc50 0x7fbe380d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.679+0000 7fbe40400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe380cfb80 0x7fbe380b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.679+0000 7fbe40400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe3815d030 con 0x7fbe380d2240 2024-03-30T01:51:46.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.679+0000 7fbe40400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe380d1c50 con 0x7fbe3815cc50 2024-03-30T01:51:46.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.679+0000 7fbe40400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe380b5af0 con 0x7fbe380cfb80 2024-03-30T01:51:46.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.679+0000 7fdf70e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdf6c06c920 0x7fdf6c06cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.680+0000 7fdf6b400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fdf6c06dc10 0x7fdf6c152fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.133:35430/0 (socket says 172.21.15.133:35430) 2024-03-30T01:51:46.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.680+0000 7fdf6b400640 1 -- 172.21.15.133:0/1462724499 learned_addr learned my addr 172.21.15.133:0/1462724499 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:46.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.679+0000 7f3275600640 1 -- 172.21.15.133:0/2931463240 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3268031870 con 0x7f327815cf90 2024-03-30T01:51:46.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.679+0000 7f3275600640 1 -- 172.21.15.133:0/2931463240 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32680319d0 con 0x7f327815cf90 2024-03-30T01:51:46.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.679+0000 7f3275600640 1 -- 172.21.15.133:0/2931463240 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3268031d60 con 0x7f327815cf90 2024-03-30T01:51:46.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.680+0000 7fbe3e400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe380cfb80 0x7fbe380b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.680+0000 7fbe3da00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbe3815cc50 0x7fbe380d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.680+0000 7fbe3e400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe380cfb80 0x7fbe380b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.133:41024/0 (socket says 172.21.15.133:41024) 2024-03-30T01:51:46.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.680+0000 7fbe3e400640 1 -- 172.21.15.133:0/2430996254 learned_addr learned my addr 172.21.15.133:0/2430996254 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:46.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.680+0000 7f327d600640 1 -- 172.21.15.133:0/2931463240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f327815cf90 msgr2=0x7f32780ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.680+0000 7f327d600640 1 --2- 172.21.15.133:0/2931463240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f327815cf90 0x7f32780ce160 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f32780b56a0 tx=0x7f326802b910 comp rx=0 tx=0).stop 2024-03-30T01:51:46.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.680+0000 7f327d600640 1 -- 172.21.15.133:0/2931463240 shutdown_connections 2024-03-30T01:51:46.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.680+0000 7f327d600640 1 --2- 172.21.15.133:0/2931463240 >> v2:172.21.15.133:3300/0 conn(0x7f32780cfca0 0x7f32780b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.680+0000 7f327d600640 1 --2- 172.21.15.133:0/2931463240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f327815cf90 0x7f32780ce160 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.680+0000 7f327d600640 1 -- 172.21.15.133:0/2931463240 >> 172.21.15.133:0/2931463240 conn(0x7f3278071a40 msgr2=0x7f327806b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:46.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.681+0000 7fdf70e00640 1 -- 172.21.15.133:0/1462724499 >> v1:172.21.15.137:6789/0 conn(0x7fdf6c06dc10 legacy=0x7fdf6c152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.681+0000 7fbe3e400640 1 -- 172.21.15.133:0/2430996254 >> v2:172.21.15.137:3300/0 conn(0x7fbe3815cc50 msgr2=0x7fbe380d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:46.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.681+0000 7fbe3e400640 1 --2- 172.21.15.133:0/2430996254 >> v2:172.21.15.137:3300/0 conn(0x7fbe3815cc50 0x7fbe380d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.681+0000 7fbe3e400640 1 -- 172.21.15.133:0/2430996254 >> v1:172.21.15.137:6789/0 conn(0x7fbe380d2240 legacy=0x7fbe380cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.681+0000 7f327d600640 1 -- 172.21.15.133:0/2931463240 shutdown_connections 2024-03-30T01:51:46.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.681+0000 7fbe3e400640 1 -- 172.21.15.133:0/2430996254 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe380d10d0 con 0x7fbe380cfb80 2024-03-30T01:51:46.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.681+0000 7fbe3da00640 1 --2- 172.21.15.133:0/2430996254 >> v2:172.21.15.137:3300/0 conn(0x7fbe3815cc50 0x7fbe380d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:51:46.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.681+0000 7f3fa3c00640 1 -- 172.21.15.133:0/155777135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f9c0d0af0 msgr2=0x7f3f9c0cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.681+0000 7f3fa3c00640 1 --2- 172.21.15.133:0/155777135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f9c0d0af0 0x7f3f9c0cf470 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3f940098a0 tx=0x7f3f9402b980 comp rx=0 tx=0).stop 2024-03-30T01:51:46.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.679+0000 7fbe8be00640 1 -- 172.21.15.133:0/2073288407 wait complete. 2024-03-30T01:51:46.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.681+0000 7fdf70e00640 1 -- 172.21.15.133:0/1462724499 >> v1:172.21.15.133:6789/0 conn(0x7fdf6c071510 legacy=0x7fdf6c159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.681+0000 7f327d600640 1 -- 172.21.15.133:0/2931463240 wait complete. 2024-03-30T01:51:46.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.682+0000 7fbe8be00640 1 Processor -- start 2024-03-30T01:51:46.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.682+0000 7fbe8be00640 1 -- start start 2024-03-30T01:51:46.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.682+0000 7f3fa3c00640 1 -- 172.21.15.133:0/155777135 shutdown_connections 2024-03-30T01:51:46.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.682+0000 7f3fa3c00640 1 --2- 172.21.15.133:0/155777135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f9c0d0af0 0x7f3f9c0cf470 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.682+0000 7f3fa3c00640 1 -- 172.21.15.133:0/155777135 >> 172.21.15.133:0/155777135 conn(0x7f3f9c071a40 msgr2=0x7f3f9c06b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:46.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.682+0000 7f3fa3c00640 1 -- 172.21.15.133:0/155777135 shutdown_connections 2024-03-30T01:51:46.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.682+0000 7f3fa3c00640 1 -- 172.21.15.133:0/155777135 wait complete. 2024-03-30T01:51:46.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.683+0000 7fbe8be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe70003eb0 0x7fbe8c0c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.681+0000 7fdf70e00640 1 -- 172.21.15.133:0/1462724499 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c06e420 con 0x7fdf6c06c920 2024-03-30T01:51:46.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.683+0000 7fbe8be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8c1557f0 0x7fbe8c15d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.683+0000 7fbe8be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe8c15da90 0x7fbe8c157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.683+0000 7fbe8be00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c14d6f0 con 0x7fbe8c1557f0 2024-03-30T01:51:46.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.683+0000 7fbe8be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c14d3a0 con 0x7fbe8c15da90 2024-03-30T01:51:46.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.683+0000 7fbe8be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c0c8620 con 0x7fbe70003eb0 2024-03-30T01:51:46.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.683+0000 7fdf70e00640 1 --2- 172.21.15.133:0/1462724499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf6c06c920 0x7fdf6c06cdb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c009980 tx=0x7fdf5c02b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1681e95cfc300a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.684+0000 7fbe8a000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8c1557f0 0x7fbe8c15d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.684+0000 7f327d600640 1 Processor -- start 2024-03-30T01:51:46.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.684+0000 7fbe8aa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe70003eb0 0x7fbe8c0c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.684+0000 7fbe3e400640 1 --2- 172.21.15.133:0/2430996254 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe380cfb80 0x7fbe380b14f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbe30009e50 tx=0x7fbe3002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0f9cfc7fd8c2a89 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.684+0000 7fbe8b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe8c15da90 0x7fbe8c157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.684+0000 7fbe8b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe8c15da90 0x7fbe8c157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.133:59000/0 (socket says 172.21.15.133:59000) 2024-03-30T01:51:46.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.684+0000 7fdf6aa00640 1 -- 172.21.15.133:0/1462724499 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c030640 con 0x7fdf6c06c920 2024-03-30T01:51:46.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.684+0000 7fbe8b400640 1 -- 172.21.15.133:0/1042012606 learned_addr learned my addr 172.21.15.133:0/1042012606 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:46.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.684+0000 7fbe8aa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe70003eb0 0x7fbe8c0c80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.133:41026/0 (socket says 172.21.15.133:41026) 2024-03-30T01:51:46.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.685+0000 7fdf6aa00640 1 -- 172.21.15.133:0/1462724499 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5c0307a0 con 0x7fdf6c06c920 2024-03-30T01:51:46.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.685+0000 7fdf6aa00640 1 -- 172.21.15.133:0/1462724499 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c030b30 con 0x7fdf6c06c920 2024-03-30T01:51:46.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.684+0000 7f327d600640 1 -- start start 2024-03-30T01:51:46.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.685+0000 7fbe8a000640 1 -- 172.21.15.133:0/1042012606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe70003eb0 msgr2=0x7fbe8c0c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.685+0000 7fbe8a000640 1 --2- 172.21.15.133:0/1042012606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe70003eb0 0x7fbe8c0c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.685+0000 7fbe8a000640 1 -- 172.21.15.133:0/1042012606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe8c15da90 msgr2=0x7fbe8c157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.685+0000 7fbe8a000640 1 --2- 172.21.15.133:0/1042012606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe8c15da90 0x7fbe8c157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.685+0000 7fbe8a000640 1 -- 172.21.15.133:0/1042012606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8c15d020 con 0x7fbe8c1557f0 2024-03-30T01:51:46.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.685+0000 7fbe8a000640 1 --2- 172.21.15.133:0/1042012606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8c1557f0 0x7fbe8c15d550 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbe78033000 tx=0x7fbe78004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.686+0000 7fbe37e00640 1 -- 172.21.15.133:0/2430996254 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3002cb00 con 0x7fbe380cfb80 2024-03-30T01:51:46.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.686+0000 7fbe82a00640 1 -- 172.21.15.133:0/1042012606 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7802c710 con 0x7fbe8c1557f0 2024-03-30T01:51:46.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.686+0000 7fbe37e00640 1 -- 172.21.15.133:0/2430996254 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3002cc60 con 0x7fbe380cfb80 2024-03-30T01:51:46.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.686+0000 7fbe37e00640 1 -- 172.21.15.133:0/2430996254 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe300343f0 con 0x7fbe380cfb80 2024-03-30T01:51:46.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.686+0000 7fdf72e00640 1 -- 172.21.15.133:0/1462724499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf6c06c920 msgr2=0x7fdf6c06cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.686+0000 7fdf72e00640 1 --2- 172.21.15.133:0/1462724499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf6c06c920 0x7fdf6c06cdb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c009980 tx=0x7fdf5c02b990 comp rx=0 tx=0).stop 2024-03-30T01:51:46.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.686+0000 7f3fa3c00640 1 Processor -- start 2024-03-30T01:51:46.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.686+0000 7fbe82a00640 1 -- 172.21.15.133:0/1042012606 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe78003a20 con 0x7fbe8c1557f0 2024-03-30T01:51:46.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.686+0000 7fbe82a00640 1 -- 172.21.15.133:0/1042012606 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe78003dd0 con 0x7fbe8c1557f0 2024-03-30T01:51:46.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.686+0000 7fdf72e00640 1 -- 172.21.15.133:0/1462724499 shutdown_connections 2024-03-30T01:51:46.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.686+0000 7fdf72e00640 1 --2- 172.21.15.133:0/1462724499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf6c06c920 0x7fdf6c06cdb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.686+0000 7f3fa3c00640 1 -- start start 2024-03-30T01:51:46.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.686+0000 7fdf72e00640 1 -- 172.21.15.133:0/1462724499 >> 172.21.15.133:0/1462724499 conn(0x7fdf6c0b0da0 msgr2=0x7fdf6c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:46.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.686+0000 7fbe8be00640 1 -- 172.21.15.133:0/1042012606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe8c15e010 con 0x7fbe8c1557f0 2024-03-30T01:51:46.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.686+0000 7fbe8be00640 1 -- 172.21.15.133:0/1042012606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8c15e5d0 con 0x7fbe8c1557f0 2024-03-30T01:51:46.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.687+0000 7fdf72e00640 1 -- 172.21.15.133:0/1462724499 shutdown_connections 2024-03-30T01:51:46.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.687+0000 7fbe40400640 1 -- 172.21.15.133:0/2430996254 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe380cfb80 msgr2=0x7fbe380b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.687+0000 7fbe40400640 1 --2- 172.21.15.133:0/2430996254 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe380cfb80 0x7fbe380b14f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbe30009e50 tx=0x7fbe3002bf60 comp rx=0 tx=0).stop 2024-03-30T01:51:46.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.687+0000 7f327d600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32780cfca0 0x7f32780c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.687+0000 7f327d600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32780d1010 0x7f3278070050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.687+0000 7f327d600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f327815cf90 0x7f3278070590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.687+0000 7f327d600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32780b4c10 con 0x7f327815cf90 2024-03-30T01:51:46.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.687+0000 7f327d600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32780b4930 con 0x7f32780d1010 2024-03-30T01:51:46.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.687+0000 7f327d600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327814fe10 con 0x7f32780cfca0 2024-03-30T01:51:46.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.687+0000 7fbe40400640 1 -- 172.21.15.133:0/2430996254 shutdown_connections 2024-03-30T01:51:46.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.687+0000 7fbe40400640 1 --2- 172.21.15.133:0/2430996254 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe380cfb80 0x7fbe380b14f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.687+0000 7fbe40400640 1 --2- 172.21.15.133:0/2430996254 >> v2:172.21.15.137:3300/0 conn(0x7fbe3815cc50 0x7fbe380d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.687+0000 7fbe40400640 1 -- 172.21.15.133:0/2430996254 >> 172.21.15.133:0/2430996254 conn(0x7fbe38071a40 msgr2=0x7fbe3806b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:46.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.688+0000 7fbe8be00640 1 -- 172.21.15.133:0/1042012606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8c14d830 con 0x7fbe8c1557f0 2024-03-30T01:51:46.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.688+0000 7fbe40400640 1 -- 172.21.15.133:0/2430996254 shutdown_connections 2024-03-30T01:51:46.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.688+0000 7f3276a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32780cfca0 0x7f32780c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.689+0000 7f3276000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32780d1010 0x7f3278070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.689+0000 7f3276a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32780cfca0 0x7f32780c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.133:41032/0 (socket says 172.21.15.133:41032) 2024-03-30T01:51:46.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.689+0000 7f3276a00640 1 -- 172.21.15.133:0/1495250034 learned_addr learned my addr 172.21.15.133:0/1495250034 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:46.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.688+0000 7fbe40400640 1 -- 172.21.15.133:0/2430996254 wait complete. 2024-03-30T01:51:46.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.688+0000 7f3fa3c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f9c0cf9b0 0x7f3f9c0c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.688+0000 7f3fa3c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f9c0d0af0 0x7f3f9c0b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.688+0000 7f3fa3c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f9c15cc50 0x7f3f9c06f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.688+0000 7f3fa3c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c06f460 con 0x7f3f9c15cc50 2024-03-30T01:51:46.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.688+0000 7f3fa3c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c0c8c80 con 0x7f3f9c0cf9b0 2024-03-30T01:51:46.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.688+0000 7f3fa3c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c0c8f00 con 0x7f3f9c0d0af0 2024-03-30T01:51:46.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.689+0000 7f3fa1c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f9c15cc50 0x7f3f9c06f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.689+0000 7f3fa1200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f9c0cf9b0 0x7f3f9c0c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.689+0000 7f3fa1c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f9c15cc50 0x7f3f9c06f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60284/0 (socket says 172.21.15.133:60284) 2024-03-30T01:51:46.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.689+0000 7f3fa1c00640 1 -- 172.21.15.133:0/1559590600 learned_addr learned my addr 172.21.15.133:0/1559590600 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:46.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.689+0000 7f3f9be00640 1 --2- 172.21.15.133:0/1559590600 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f9c0d0af0 0x7f3f9c0b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.689+0000 7fdf72e00640 1 -- 172.21.15.133:0/1462724499 wait complete. 2024-03-30T01:51:46.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.689+0000 7f3277400640 1 --2- 172.21.15.133:0/1495250034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f327815cf90 0x7f3278070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.690+0000 7f3276000640 1 -- 172.21.15.133:0/1495250034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32780cfca0 msgr2=0x7f32780c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.690+0000 7f3276000640 1 --2- 172.21.15.133:0/1495250034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32780cfca0 0x7f32780c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.690+0000 7f3276000640 1 -- 172.21.15.133:0/1495250034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f327815cf90 msgr2=0x7f3278070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.690+0000 7f3fa1200640 1 -- 172.21.15.133:0/1559590600 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f9c0d0af0 msgr2=0x7f3f9c0b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.690+0000 7f3fa1200640 1 --2- 172.21.15.133:0/1559590600 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f9c0d0af0 0x7f3f9c0b1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.690+0000 7f3fa1200640 1 -- 172.21.15.133:0/1559590600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f9c15cc50 msgr2=0x7f3f9c06f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.690+0000 7f3fa1200640 1 --2- 172.21.15.133:0/1559590600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f9c15cc50 0x7f3f9c06f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.690+0000 7f3fa1200640 1 -- 172.21.15.133:0/1559590600 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f940094d0 con 0x7f3f9c0cf9b0 2024-03-30T01:51:46.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.691+0000 7fbe40400640 1 Processor -- start 2024-03-30T01:51:46.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.691+0000 7fbe40400640 1 -- start start 2024-03-30T01:51:46.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.690+0000 7f3276000640 1 --2- 172.21.15.133:0/1495250034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f327815cf90 0x7f3278070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.690+0000 7f3276000640 1 -- 172.21.15.133:0/1495250034 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32680094d0 con 0x7f32780d1010 2024-03-30T01:51:46.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.691+0000 7f3277400640 1 --2- 172.21.15.133:0/1495250034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f327815cf90 0x7f3278070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:46.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.690+0000 7fbe82a00640 1 -- 172.21.15.133:0/1042012606 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fbe78040450 con 0x7fbe8c1557f0 2024-03-30T01:51:46.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.691+0000 7fbe82a00640 1 --2- 172.21.15.133:0/1042012606 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbe6c06acd0 0x7fbe6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.692+0000 7fbe82a00640 1 -- 172.21.15.133:0/1042012606 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe780ab450 con 0x7fbe8c1557f0 2024-03-30T01:51:46.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.692+0000 7f3276000640 1 --2- 172.21.15.133:0/1495250034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32780d1010 0x7f3278070050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f326400c390 tx=0x7f326400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.692+0000 7fdf72e00640 1 Processor -- start 2024-03-30T01:51:46.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.692+0000 7fbe8aa00640 1 --2- 172.21.15.133:0/1042012606 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbe6c06acd0 0x7fbe6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.692+0000 7fdf72e00640 1 -- start start 2024-03-30T01:51:46.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.693+0000 7f326ea00640 1 -- 172.21.15.133:0/1495250034 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32640052d0 con 0x7f32780d1010 2024-03-30T01:51:46.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.693+0000 7f326ea00640 1 -- 172.21.15.133:0/1495250034 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3264005430 con 0x7f32780d1010 2024-03-30T01:51:46.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.693+0000 7f326ea00640 1 -- 172.21.15.133:0/1495250034 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3264003830 con 0x7f32780d1010 2024-03-30T01:51:46.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.693+0000 7f3fa1200640 1 --2- 172.21.15.133:0/1559590600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f9c0cf9b0 0x7f3f9c0c8740 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00bd50 tx=0x7f3f8c00be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.694+0000 7f3f98c00640 1 -- 172.21.15.133:0/1559590600 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c00ce90 con 0x7f3f9c0cf9b0 2024-03-30T01:51:46.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.694+0000 7f3f98c00640 1 -- 172.21.15.133:0/1559590600 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c00ce90 con 0x7f3f9c0cf9b0 2024-03-30T01:51:46.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.694+0000 7f3f98c00640 1 -- 172.21.15.133:0/1559590600 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c014440 con 0x7f3f9c0cf9b0 2024-03-30T01:51:46.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.694+0000 7fbe8aa00640 1 --2- 172.21.15.133:0/1042012606 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbe6c06acd0 0x7fbe6c06d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c006fd0 tx=0x7fbe7c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.693+0000 7f327d600640 1 -- 172.21.15.133:0/1495250034 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32781500f0 con 0x7f32780d1010 2024-03-30T01:51:46.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.693+0000 7f327d600640 1 -- 172.21.15.133:0/1495250034 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32780c5ae0 con 0x7f32780d1010 2024-03-30T01:51:46.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.693+0000 7fbe40400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe380cfb80 0x7fbe3815ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.693+0000 7fbe40400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe380d2240 0x7fbe3815f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.694+0000 7fbe40400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe3815cc50 0x7fbe38073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.694+0000 7fbe3e400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe3815cc50 0x7fbe38073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.694+0000 7fbe3e400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe3815cc50 0x7fbe38073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60286/0 (socket says 172.21.15.133:60286) 2024-03-30T01:51:46.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.694+0000 7fbe3e400640 1 -- 172.21.15.133:0/483091277 learned_addr learned my addr 172.21.15.133:0/483091277 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:46.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.694+0000 7fbe40400640 1 -- 172.21.15.133:0/483091277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3815b050 con 0x7fbe3815cc50 2024-03-30T01:51:46.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.694+0000 7fbe40400640 1 -- 172.21.15.133:0/483091277 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3806d490 con 0x7fbe380d2240 2024-03-30T01:51:46.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.694+0000 7fbe40400640 1 -- 172.21.15.133:0/483091277 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3806d770 con 0x7fbe380cfb80 2024-03-30T01:51:46.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.694+0000 7fbe3da00640 1 --2- 172.21.15.133:0/483091277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe380cfb80 0x7fbe3815ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.695+0000 7fbe3d000640 1 --2- 172.21.15.133:0/483091277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe380d2240 0x7fbe3815f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.695+0000 7f3fa3c00640 1 -- 172.21.15.133:0/1559590600 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9c0c91e0 con 0x7f3f9c0cf9b0 2024-03-30T01:51:46.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.695+0000 7f3fa3c00640 1 -- 172.21.15.133:0/1559590600 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9c0b21c0 con 0x7f3f9c0cf9b0 2024-03-30T01:51:46.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.696+0000 7fdf72e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdf6c06c920 0x7fdf6c14b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.696+0000 7fdf72e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf6c06dc10 0x7fdf6c1497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.696+0000 7fdf72e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf6c071510 0x7fdf6c155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.696+0000 7fdf72e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c14a7e0 con 0x7fdf6c06dc10 2024-03-30T01:51:46.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.696+0000 7fdf72e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c14cf20 con 0x7fdf6c071510 2024-03-30T01:51:46.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.696+0000 7fdf72e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c15a430 con 0x7fdf6c06c920 2024-03-30T01:51:46.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.696+0000 7fdf6b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf6c06dc10 0x7fdf6c1497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.696+0000 7fdf6b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf6c06dc10 0x7fdf6c1497f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60300/0 (socket says 172.21.15.133:60300) 2024-03-30T01:51:46.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.696+0000 7fdf6b400640 1 -- 172.21.15.133:0/3803170025 learned_addr learned my addr 172.21.15.133:0/3803170025 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:46.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.696+0000 7fbe3e400640 1 -- 172.21.15.133:0/483091277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe380cfb80 msgr2=0x7fbe3815ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.696+0000 7fbe3e400640 1 --2- 172.21.15.133:0/483091277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe380cfb80 0x7fbe3815ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.696+0000 7fbe3e400640 1 -- 172.21.15.133:0/483091277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe380d2240 msgr2=0x7fbe3815f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.696+0000 7fbe3e400640 1 --2- 172.21.15.133:0/483091277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe380d2240 0x7fbe3815f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.696+0000 7fbe3e400640 1 -- 172.21.15.133:0/483091277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe30009b30 con 0x7fbe3815cc50 2024-03-30T01:51:46.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.697+0000 7fdf70e00640 1 --2- 172.21.15.133:0/3803170025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf6c071510 0x7fdf6c155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.697+0000 7f327d600640 1 -- 172.21.15.133:0/1495250034 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3278150610 con 0x7f32780d1010 2024-03-30T01:51:46.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.697+0000 7fdf6b400640 1 -- 172.21.15.133:0/3803170025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdf6c06c920 msgr2=0x7fdf6c14b2d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-30T01:51:46.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.697+0000 7fdf6b400640 1 --2- 172.21.15.133:0/3803170025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdf6c06c920 0x7fdf6c14b2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.697+0000 7fdf6b400640 1 -- 172.21.15.133:0/3803170025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf6c071510 msgr2=0x7fdf6c155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.697+0000 7fdf6b400640 1 --2- 172.21.15.133:0/3803170025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf6c071510 0x7fdf6c155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.697+0000 7fdf6b400640 1 -- 172.21.15.133:0/3803170025 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5c009400 con 0x7fdf6c06dc10 2024-03-30T01:51:46.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.697+0000 7fbe3da00640 1 --2- 172.21.15.133:0/483091277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe380cfb80 0x7fbe3815ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T01:51:46.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.697+0000 7fbe3e400640 1 --2- 172.21.15.133:0/483091277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe3815cc50 0x7fbe38073030 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbe30009e50 tx=0x7fbe30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.697+0000 7fdf6b400640 1 --2- 172.21.15.133:0/3803170025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf6c06dc10 0x7fdf6c1497f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdf54001df0 tx=0x7fdf5400cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.698+0000 7f3fa3c00640 1 -- 172.21.15.133:0/1559590600 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9c0b2410 con 0x7f3f9c0cf9b0 2024-03-30T01:51:46.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.698+0000 7f326ea00640 1 -- 172.21.15.133:0/1495250034 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f3264003990 con 0x7f32780d1010 2024-03-30T01:51:46.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.699+0000 7f326ea00640 1 --2- 172.21.15.133:0/1495250034 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f325806ac50 0x7f325806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.699+0000 7f326ea00640 1 -- 172.21.15.133:0/1495250034 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3264088760 con 0x7f32780d1010 2024-03-30T01:51:46.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.700+0000 7f3276a00640 1 --2- 172.21.15.133:0/1495250034 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f325806ac50 0x7f325806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.699+0000 7f3f98c00640 1 -- 172.21.15.133:0/1559590600 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f3f8c003970 con 0x7f3f9c0cf9b0 2024-03-30T01:51:46.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.700+0000 7fdf63e00640 1 -- 172.21.15.133:0/3803170025 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf540072d0 con 0x7fdf6c06dc10 2024-03-30T01:51:46.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.700+0000 7fdf63e00640 1 -- 172.21.15.133:0/3803170025 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf54007450 con 0x7fdf6c06dc10 2024-03-30T01:51:46.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.700+0000 7fdf63e00640 1 -- 172.21.15.133:0/3803170025 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf540047e0 con 0x7fdf6c06dc10 2024-03-30T01:51:46.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.701+0000 7fdf72e00640 1 -- 172.21.15.133:0/3803170025 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf6c14cbf0 con 0x7fdf6c06dc10 2024-03-30T01:51:46.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.701+0000 7f3276a00640 1 --2- 172.21.15.133:0/1495250034 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f325806ac50 0x7f325806d110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f326802b950 tx=0x7f326803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.701+0000 7fdf72e00640 1 -- 172.21.15.133:0/3803170025 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf6c14ad10 con 0x7fdf6c06dc10 2024-03-30T01:51:46.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.701+0000 7f3f98c00640 1 --2- 172.21.15.133:0/1559590600 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3f7c06ac60 0x7f3f7c06d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.701+0000 7f3f98c00640 1 -- 172.21.15.133:0/1559590600 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f8c089620 con 0x7f3f9c0cf9b0 2024-03-30T01:51:46.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.701+0000 7f3f9be00640 1 --2- 172.21.15.133:0/1559590600 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3f7c06ac60 0x7f3f7c06d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.701+0000 7fbe35600640 1 -- 172.21.15.133:0/483091277 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3003e450 con 0x7fbe3815cc50 2024-03-30T01:51:46.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.701+0000 7fbe35600640 1 -- 172.21.15.133:0/483091277 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3003e5b0 con 0x7fbe3815cc50 2024-03-30T01:51:46.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.701+0000 7fbe35600640 1 -- 172.21.15.133:0/483091277 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3003e960 con 0x7fbe3815cc50 2024-03-30T01:51:46.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.701+0000 7fbe40400640 1 -- 172.21.15.133:0/483091277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe3806da50 con 0x7fbe3815cc50 2024-03-30T01:51:46.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.702+0000 7fbe40400640 1 -- 172.21.15.133:0/483091277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3806e010 con 0x7fbe3815cc50 2024-03-30T01:51:46.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.702+0000 7f3f9be00640 1 --2- 172.21.15.133:0/1559590600 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3f7c06ac60 0x7f3f7c06d120 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3f94036000 tx=0x7f3f94008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.703+0000 7fbe82a00640 1 -- 172.21.15.133:0/1042012606 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fbe8c14d830 con 0x7fbe8c1557f0 2024-03-30T01:51:46.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.702+0000 7fdf61600640 1 -- 172.21.15.133:0/3803170025 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf3c005250 con 0x7fdf6c06dc10 2024-03-30T01:51:46.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.703+0000 7fbe40400640 1 -- 172.21.15.133:0/483091277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe14005250 con 0x7fbe3815cc50 2024-03-30T01:51:46.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.705+0000 7fdf63e00640 1 -- 172.21.15.133:0/3803170025 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fdf54017020 con 0x7fdf6c06dc10 2024-03-30T01:51:46.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.705+0000 7fbe35600640 1 -- 172.21.15.133:0/483091277 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fbe3003eac0 con 0x7fbe3815cc50 2024-03-30T01:51:46.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.706+0000 7fdf63e00640 1 --2- 172.21.15.133:0/3803170025 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdf4806acd0 0x7fdf4806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.707+0000 7fdf63e00640 1 -- 172.21.15.133:0/3803170025 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf5408cdf0 con 0x7fdf6c06dc10 2024-03-30T01:51:46.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.707+0000 7fdf6be00640 1 --2- 172.21.15.133:0/3803170025 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdf4806acd0 0x7fdf4806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.707+0000 7fbe35600640 1 --2- 172.21.15.133:0/483091277 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbe1806ac50 0x7fbe1806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.707+0000 7fbe35600640 1 -- 172.21.15.133:0/483091277 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe300ac2e0 con 0x7fbe3815cc50 2024-03-30T01:51:46.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.708+0000 7fdf6be00640 1 --2- 172.21.15.133:0/3803170025 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdf4806acd0 0x7fdf4806d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdf640012e0 tx=0x7fdf64007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.708+0000 7fbe3da00640 1 --2- 172.21.15.133:0/483091277 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbe1806ac50 0x7fbe1806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.709+0000 7fbe3da00640 1 --2- 172.21.15.133:0/483091277 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbe1806ac50 0x7fbe1806d110 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbe380b4f20 tx=0x7fbe2c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.715+0000 7f3f98c00640 1 -- 172.21.15.133:0/1559590600 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f3f8c054890 con 0x7f3f9c0cf9b0 2024-03-30T01:51:46.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.717+0000 7fbe35600640 1 -- 172.21.15.133:0/483091277 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fbe300775e0 con 0x7fbe3815cc50 2024-03-30T01:51:46.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.725+0000 7fdf63e00640 1 -- 172.21.15.133:0/3803170025 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fdf54058040 con 0x7fdf6c06dc10 2024-03-30T01:51:46.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.728+0000 7f326ea00640 1 -- 172.21.15.133:0/1495250034 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f3278150610 con 0x7f32780d1010 2024-03-30T01:51:46.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.732+0000 7f6c4ca00640 1 Processor -- start 2024-03-30T01:51:46.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.732+0000 7f6c4ca00640 1 -- start start 2024-03-30T01:51:46.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.734+0000 7f9746400640 1 Processor -- start 2024-03-30T01:51:46.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.734+0000 7f9746400640 1 -- start start 2024-03-30T01:51:46.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.734+0000 7f6c4ca00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6c4815cc50 0x7f6c480d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.734+0000 7f6c4ca00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6c480d2240 0x7f6c480cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.734+0000 7f6c4ca00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c4815d030 con 0x7f6c480cf9b0 2024-03-30T01:51:46.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.734+0000 7f6c4ca00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c480d1c50 con 0x7f6c480d2240 2024-03-30T01:51:46.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.734+0000 7f6c4ca00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c480cfe20 con 0x7f6c4815cc50 2024-03-30T01:51:46.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.735+0000 7f6c45400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6c480d2240 0x7f6c480cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.736+0000 7f9746400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9740145580 0x7f97400b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.736+0000 7f9746400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9740145960 0x7f974006e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.736+0000 7f9746400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97400ac1d0 con 0x7f9740146310 2024-03-30T01:51:46.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.736+0000 7f9746400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97400b1e00 con 0x7f9740145580 2024-03-30T01:51:46.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.736+0000 7f9746400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974006eda0 con 0x7f9740145960 2024-03-30T01:51:46.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.737+0000 7f973fe00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f9740146310 0x7f97400ad9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.133:35438/0 (socket says 172.21.15.133:35438) 2024-03-30T01:51:46.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.737+0000 7f973fe00640 1 -- 172.21.15.133:0/626095737 learned_addr learned my addr 172.21.15.133:0/626095737 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:46.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.735+0000 7f6c45400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6c480d2240 0x7f6c480cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60316/0 (socket says 172.21.15.133:60316) 2024-03-30T01:51:46.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.735+0000 7f6c45400640 1 -- 172.21.15.133:0/3283208022 learned_addr learned my addr 172.21.15.133:0/3283208022 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:46.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.735+0000 7f6c45400640 1 -- 172.21.15.133:0/3283208022 >> v2:172.21.15.137:3300/0 conn(0x7f6c4815cc50 msgr2=0x7f6c480d0af0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-30T01:51:46.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.735+0000 7f6c45400640 1 --2- 172.21.15.133:0/3283208022 >> v2:172.21.15.137:3300/0 conn(0x7f6c4815cc50 0x7f6c480d0af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.735+0000 7f6c45400640 1 -- 172.21.15.133:0/3283208022 >> v1:172.21.15.137:6789/0 conn(0x7f6c480cf9b0 legacy=0x7f6c480b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:46.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.735+0000 7f6c45400640 1 -- 172.21.15.133:0/3283208022 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c480b5af0 con 0x7f6c480d2240 2024-03-30T01:51:46.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.737+0000 7f6c45400640 1 --2- 172.21.15.133:0/3283208022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c480d2240 0x7f6c480cf470 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6c4806c150 tx=0x7f6c3802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50d9ee64e42a909 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.738+0000 7f973f400640 1 --2- 172.21.15.133:0/626095737 >> v2:172.21.15.133:3300/0 conn(0x7f9740145580 0x7f97400b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.738+0000 7f973e000640 1 -- 172.21.15.133:0/626095737 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4233336234 0 0) 0x7f97400ac1d0 con 0x7f9740146310 2024-03-30T01:51:46.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.738+0000 7f973e000640 1 -- 172.21.15.133:0/626095737 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9724003520 con 0x7f9740146310 2024-03-30T01:51:46.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.738+0000 7f973ea00640 1 --2- 172.21.15.133:0/626095737 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9740145960 0x7f974006e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.739+0000 7f973f400640 1 -- 172.21.15.133:0/626095737 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9740145960 msgr2=0x7f974006e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:46.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.739+0000 7f973f400640 1 --2- 172.21.15.133:0/626095737 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9740145960 0x7f974006e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.739+0000 7f973f400640 1 -- 172.21.15.133:0/626095737 >> v1:172.21.15.137:6789/0 conn(0x7f9740146310 legacy=0x7f97400ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.739+0000 7f973f400640 1 -- 172.21.15.133:0/626095737 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97400ab8a0 con 0x7f9740145580 2024-03-30T01:51:46.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.740+0000 7f6c44a00640 1 -- 172.21.15.133:0/3283208022 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3802ca80 con 0x7f6c480d2240 2024-03-30T01:51:46.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.741+0000 7f6c44a00640 1 -- 172.21.15.133:0/3283208022 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3802cbe0 con 0x7f6c480d2240 2024-03-30T01:51:46.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.741+0000 7f6c44a00640 1 -- 172.21.15.133:0/3283208022 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3802ca80 con 0x7f6c480d2240 2024-03-30T01:51:46.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.741+0000 7f973f400640 1 --2- 172.21.15.133:0/626095737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9740145580 0x7f97400b18c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f972c0097a0 tx=0x7f972c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a26aa1c183a80b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.741+0000 7f973e000640 1 -- 172.21.15.133:0/626095737 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c031830 con 0x7f9740145580 2024-03-30T01:51:46.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.741+0000 7f973e000640 1 -- 172.21.15.133:0/626095737 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c031990 con 0x7f9740145580 2024-03-30T01:51:46.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.742+0000 7f6c4ca00640 1 -- 172.21.15.133:0/3283208022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c480d2240 msgr2=0x7f6c480cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.742+0000 7f6c4ca00640 1 --2- 172.21.15.133:0/3283208022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c480d2240 0x7f6c480cf470 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6c4806c150 tx=0x7f6c3802bee0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.741+0000 7f973e000640 1 -- 172.21.15.133:0/626095737 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c031d60 con 0x7f9740145580 2024-03-30T01:51:46.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.742+0000 7f6c4ca00640 1 -- 172.21.15.133:0/3283208022 shutdown_connections 2024-03-30T01:51:46.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.742+0000 7f6c4ca00640 1 --2- 172.21.15.133:0/3283208022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c480d2240 0x7f6c480cf470 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.742+0000 7f6c4ca00640 1 --2- 172.21.15.133:0/3283208022 >> v2:172.21.15.137:3300/0 conn(0x7f6c4815cc50 0x7f6c480d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.742+0000 7f6c4ca00640 1 -- 172.21.15.133:0/3283208022 >> 172.21.15.133:0/3283208022 conn(0x7f6c48071a40 msgr2=0x7f6c4806b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:46.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.742+0000 7f6c4ca00640 1 -- 172.21.15.133:0/3283208022 shutdown_connections 2024-03-30T01:51:46.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.743+0000 7f9746400640 1 -- 172.21.15.133:0/626095737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9740145580 msgr2=0x7f97400b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.743+0000 7f9746400640 1 --2- 172.21.15.133:0/626095737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9740145580 0x7f97400b18c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f972c0097a0 tx=0x7f972c02b8d0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.743+0000 7f6c4ca00640 1 -- 172.21.15.133:0/3283208022 wait complete. 2024-03-30T01:51:46.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.743+0000 7f9746400640 1 -- 172.21.15.133:0/626095737 shutdown_connections 2024-03-30T01:51:46.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.743+0000 7f9746400640 1 --2- 172.21.15.133:0/626095737 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9740145960 0x7f974006e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.743+0000 7f9746400640 1 --2- 172.21.15.133:0/626095737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9740145580 0x7f97400b18c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.743+0000 7f9746400640 1 -- 172.21.15.133:0/626095737 >> 172.21.15.133:0/626095737 conn(0x7f97400b0da0 msgr2=0x7f9740069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:46.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.743+0000 7f9746400640 1 -- 172.21.15.133:0/626095737 shutdown_connections 2024-03-30T01:51:46.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.743+0000 7f9746400640 1 -- 172.21.15.133:0/626095737 wait complete. 2024-03-30T01:51:46.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.747+0000 7f9746400640 1 Processor -- start 2024-03-30T01:51:46.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.747+0000 7f9746400640 1 -- start start 2024-03-30T01:51:46.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.749+0000 7f9746400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9740145580 0x7f97400cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.749+0000 7f9746400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9740145960 0x7f974013f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.749+0000 7f9746400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9740146310 0x7f974015c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.749+0000 7f9746400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97400cd9c0 con 0x7f9740145960 2024-03-30T01:51:46.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.749+0000 7f9746400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9740142b00 con 0x7f9740145580 2024-03-30T01:51:46.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.749+0000 7f9746400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9740142de0 con 0x7f9740146310 2024-03-30T01:51:46.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.750+0000 7f973fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9740146310 0x7f974015c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.750+0000 7f6c4ca00640 1 Processor -- start 2024-03-30T01:51:46.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.750+0000 7f973ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9740145960 0x7f974013f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.750+0000 7f973fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9740146310 0x7f974015c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.133:41062/0 (socket says 172.21.15.133:41062) 2024-03-30T01:51:46.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.750+0000 7f973ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9740145960 0x7f974013f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60336/0 (socket says 172.21.15.133:60336) 2024-03-30T01:51:46.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.750+0000 7f973fe00640 1 -- 172.21.15.133:0/2749581993 learned_addr learned my addr 172.21.15.133:0/2749581993 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:46.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.750+0000 7f6c4ca00640 1 -- start start 2024-03-30T01:51:46.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.750+0000 7f973ea00640 1 -- 172.21.15.133:0/2749581993 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9740146310 msgr2=0x7f974015c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.750+0000 7f973ea00640 1 --2- 172.21.15.133:0/2749581993 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9740146310 0x7f974015c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.750+0000 7f973ea00640 1 -- 172.21.15.133:0/2749581993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9740145580 msgr2=0x7f97400cca50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-30T01:51:46.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.750+0000 7f973ea00640 1 --2- 172.21.15.133:0/2749581993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9740145580 0x7f97400cca50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.750+0000 7f973ea00640 1 -- 172.21.15.133:0/2749581993 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c009400 con 0x7f9740145960 2024-03-30T01:51:46.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.751+0000 7f973ea00640 1 --2- 172.21.15.133:0/2749581993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9740145960 0x7f974013f7f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f973000e850 tx=0x7f973000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.752+0000 7f9737400640 1 -- 172.21.15.133:0/2749581993 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97300095b0 con 0x7f9740145960 2024-03-30T01:51:46.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.752+0000 7f9737400640 1 -- 172.21.15.133:0/2749581993 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973000c940 con 0x7f9740145960 2024-03-30T01:51:46.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.752+0000 7f9737400640 1 -- 172.21.15.133:0/2749581993 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973000ccd0 con 0x7f9740145960 2024-03-30T01:51:46.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.752+0000 7f9746400640 1 -- 172.21.15.133:0/2749581993 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97401430c0 con 0x7f9740145960 2024-03-30T01:51:46.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.752+0000 7f9746400640 1 -- 172.21.15.133:0/2749581993 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9740143680 con 0x7f9740145960 2024-03-30T01:51:46.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.754+0000 7f9734c00640 1 -- 172.21.15.133:0/2749581993 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9718005250 con 0x7f9740145960 2024-03-30T01:51:46.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.755+0000 7f6c4ca00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c480cf9b0 0x7f6c4806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.758+0000 7f6c4ca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c480d2240 0x7f6c4815e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.758+0000 7f6c4ca00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c4815cc50 0x7f6c4815e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.758+0000 7f6c4ca00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4806e5e0 con 0x7f6c4815cc50 2024-03-30T01:51:46.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.758+0000 7f6c4ca00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4806d9d0 con 0x7f6c480d2240 2024-03-30T01:51:46.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.758+0000 7f6c4ca00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4806dcb0 con 0x7f6c480cf9b0 2024-03-30T01:51:46.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.757+0000 7f9737400640 1 -- 172.21.15.133:0/2749581993 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9730013470 con 0x7f9740145960 2024-03-30T01:51:46.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.759+0000 7f6c45e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c480cf9b0 0x7f6c4806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.758+0000 7f9737400640 1 --2- 172.21.15.133:0/2749581993 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f972006ac50 0x7f972006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.758+0000 7f9737400640 1 -- 172.21.15.133:0/2749581993 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f973000ce30 con 0x7f9740145960 2024-03-30T01:51:46.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.760+0000 7f6c45400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c480d2240 0x7f6c4815e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.760+0000 7f6c46800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c4815cc50 0x7f6c4815e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.760+0000 7f6c45400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c480d2240 0x7f6c4815e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.133:59044/0 (socket says 172.21.15.133:59044) 2024-03-30T01:51:46.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.760+0000 7f6c45400640 1 -- 172.21.15.133:0/64020309 learned_addr learned my addr 172.21.15.133:0/64020309 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:46.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.761+0000 7f6c46800640 1 -- 172.21.15.133:0/64020309 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c480cf9b0 msgr2=0x7f6c4806f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.761+0000 7f6c46800640 1 --2- 172.21.15.133:0/64020309 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c480cf9b0 0x7f6c4806f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.761+0000 7f6c46800640 1 -- 172.21.15.133:0/64020309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c480d2240 msgr2=0x7f6c4815e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:46.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.761+0000 7f6c46800640 1 --2- 172.21.15.133:0/64020309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c480d2240 0x7f6c4815e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:46.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.761+0000 7f6c46800640 1 -- 172.21.15.133:0/64020309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c38009b30 con 0x7f6c4815cc50 2024-03-30T01:51:46.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.763+0000 7f6c46800640 1 --2- 172.21.15.133:0/64020309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c4815cc50 0x7f6c4815e8b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400c410 tx=0x7f6c3400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.763+0000 7f973f400640 1 --2- 172.21.15.133:0/2749581993 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f972006ac50 0x7f972006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.764+0000 7f973f400640 1 --2- 172.21.15.133:0/2749581993 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f972006ac50 0x7f972006d110 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f972c036000 tx=0x7f972c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.767+0000 7f9737400640 1 -- 172.21.15.133:0/2749581993 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f973008e060 con 0x7f9740145960 2024-03-30T01:51:46.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.767+0000 7f6c3e000640 1 -- 172.21.15.133:0/64020309 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c34011790 con 0x7f6c4815cc50 2024-03-30T01:51:46.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.767+0000 7f6c3e000640 1 -- 172.21.15.133:0/64020309 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c340118f0 con 0x7f6c4815cc50 2024-03-30T01:51:46.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.767+0000 7f6c4ca00640 1 -- 172.21.15.133:0/64020309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4806df90 con 0x7f6c4815cc50 2024-03-30T01:51:46.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.767+0000 7f6c3e000640 1 -- 172.21.15.133:0/64020309 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c34011ce0 con 0x7f6c4815cc50 2024-03-30T01:51:46.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.767+0000 7f6c4ca00640 1 -- 172.21.15.133:0/64020309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4815b4e0 con 0x7f6c4815cc50 2024-03-30T01:51:46.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.768+0000 7f6c4ca00640 1 -- 172.21.15.133:0/64020309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4814b530 con 0x7f6c4815cc50 2024-03-30T01:51:46.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.771+0000 7f6c3e000640 1 -- 172.21.15.133:0/64020309 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f6c34007020 con 0x7f6c4815cc50 2024-03-30T01:51:46.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.772+0000 7f6c3e000640 1 --2- 172.21.15.133:0/64020309 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6c2806ac50 0x7f6c2806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:46.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.772+0000 7f6c3e000640 1 -- 172.21.15.133:0/64020309 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c34089220 con 0x7f6c4815cc50 2024-03-30T01:51:46.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.773+0000 7f6c45e00640 1 --2- 172.21.15.133:0/64020309 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6c2806ac50 0x7f6c2806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:46.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.775+0000 7f6c45e00640 1 --2- 172.21.15.133:0/64020309 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6c2806ac50 0x7f6c2806d110 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000a730 tx=0x7f6c40008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:46.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:46.781+0000 7f6c3e000640 1 -- 172.21.15.133:0/64020309 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f6c340543e0 con 0x7f6c4815cc50 2024-03-30T01:51:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.069+0000 7f4d8d600640 1 -- 172.21.15.133:0/1089579030 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4d6c0057d0 con 0x7f4d980ccc40 2024-03-30T01:51:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.070+0000 7f4d8fe00640 1 -- 172.21.15.133:0/1089579030 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4d8801d020 con 0x7f4d980ccc40 2024-03-30T01:51:47.077 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2024-03-30T01:51:47.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.073+0000 7f4d8d600640 1 -- 172.21.15.133:0/1089579030 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4d7806ac30 msgr2=0x7f4d7806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.074+0000 7f4d8d600640 1 --2- 172.21.15.133:0/1089579030 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4d7806ac30 0x7f4d7806d0f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4d90007130 tx=0x7f4d90008380 comp rx=0 tx=0).stop 2024-03-30T01:51:47.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.074+0000 7f4d8d600640 1 -- 172.21.15.133:0/1089579030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d980ccc40 msgr2=0x7f4d980cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.074+0000 7f4d8d600640 1 --2- 172.21.15.133:0/1089579030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d980ccc40 0x7f4d980cd0c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4d880015e0 tx=0x7f4d88001aa0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.074+0000 7f4d8d600640 1 -- 172.21.15.133:0/1089579030 shutdown_connections 2024-03-30T01:51:47.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.075+0000 7f4d8d600640 1 --2- 172.21.15.133:0/1089579030 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4d7806ac30 0x7f4d7806d0f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.075+0000 7f4d8d600640 1 --2- 172.21.15.133:0/1089579030 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d9814f5b0 0x7f4d9814fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.075+0000 7f4d8d600640 1 --2- 172.21.15.133:0/1089579030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d980ccc40 0x7f4d980cd0c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.075+0000 7f4d8d600640 1 --2- 172.21.15.133:0/1089579030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d7c00b600 0x7f4d9813bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.075+0000 7f4d8d600640 1 -- 172.21.15.133:0/1089579030 >> 172.21.15.133:0/1089579030 conn(0x7f4d98065e70 msgr2=0x7f4d981584a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:47.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.075+0000 7f4d8d600640 1 -- 172.21.15.133:0/1089579030 shutdown_connections 2024-03-30T01:51:47.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.076+0000 7f4d8d600640 1 -- 172.21.15.133:0/1089579030 wait complete. 2024-03-30T01:51:47.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.077+0000 7fbe8be00640 1 -- 172.21.15.133:0/1042012606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbe8c14d830 con 0x7fbe8c1557f0 2024-03-30T01:51:47.087 INFO:teuthology.orchestra.run.smithi133.stdout:55834574856 2024-03-30T01:51:47.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.078+0000 7fbe82a00640 1 -- 172.21.15.133:0/1042012606 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbe8c14d830 con 0x7fbe8c1557f0 2024-03-30T01:51:47.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.082+0000 7fbe77e00640 1 -- 172.21.15.133:0/1042012606 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbe6c06acd0 msgr2=0x7fbe6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.082+0000 7fbe77e00640 1 --2- 172.21.15.133:0/1042012606 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbe6c06acd0 0x7fbe6c06d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c006fd0 tx=0x7fbe7c008040 comp rx=0 tx=0).stop 2024-03-30T01:51:47.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.082+0000 7fbe77e00640 1 -- 172.21.15.133:0/1042012606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8c1557f0 msgr2=0x7fbe8c15d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.082+0000 7fbe77e00640 1 --2- 172.21.15.133:0/1042012606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8c1557f0 0x7fbe8c15d550 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbe78033000 tx=0x7fbe78004730 comp rx=0 tx=0).stop 2024-03-30T01:51:47.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.083+0000 7fbe77e00640 1 -- 172.21.15.133:0/1042012606 shutdown_connections 2024-03-30T01:51:47.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.083+0000 7fbe77e00640 1 --2- 172.21.15.133:0/1042012606 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbe6c06acd0 0x7fbe6c06d190 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c006fd0 tx=0x7fbe7c008040 comp rx=0 tx=0).stop 2024-03-30T01:51:47.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.083+0000 7fbe77e00640 1 --2- 172.21.15.133:0/1042012606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe8c15da90 0x7fbe8c157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.083+0000 7fbe77e00640 1 --2- 172.21.15.133:0/1042012606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8c1557f0 0x7fbe8c15d550 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.083+0000 7fbe77e00640 1 --2- 172.21.15.133:0/1042012606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe70003eb0 0x7fbe8c0c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.083+0000 7fbe77e00640 1 -- 172.21.15.133:0/1042012606 >> 172.21.15.133:0/1042012606 conn(0x7fbe8c0cf770 msgr2=0x7fbe8c0c99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:47.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.085+0000 7fbe77e00640 1 -- 172.21.15.133:0/1042012606 shutdown_connections 2024-03-30T01:51:47.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.085+0000 7fbe77e00640 1 -- 172.21.15.133:0/1042012606 wait complete. 2024-03-30T01:51:47.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-03-30T01:51:47.110 DEBUG:teuthology.parallel:result is None 2024-03-30T01:51:47.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2024-03-30T01:51:47.117 DEBUG:teuthology.parallel:result is None 2024-03-30T01:51:47.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.138+0000 7f3fa3c00640 1 -- 172.21.15.133:0/1559590600 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3f9c066d80 con 0x7f3f9c0cf9b0 2024-03-30T01:51:47.145 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2024-03-30T01:51:47.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.139+0000 7f3f98c00640 1 -- 172.21.15.133:0/1559590600 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f8c023020 con 0x7f3f9c0cf9b0 2024-03-30T01:51:47.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.142+0000 7f3fa3c00640 1 -- 172.21.15.133:0/1559590600 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3f7c06ac60 msgr2=0x7f3f7c06d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.142+0000 7f3fa3c00640 1 --2- 172.21.15.133:0/1559590600 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3f7c06ac60 0x7f3f7c06d120 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3f94036000 tx=0x7f3f94008030 comp rx=0 tx=0).stop 2024-03-30T01:51:47.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.142+0000 7f3fa3c00640 1 -- 172.21.15.133:0/1559590600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f9c0cf9b0 msgr2=0x7f3f9c0c8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.142+0000 7f3fa3c00640 1 --2- 172.21.15.133:0/1559590600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f9c0cf9b0 0x7f3f9c0c8740 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00bd50 tx=0x7f3f8c00be40 comp rx=0 tx=0).stop 2024-03-30T01:51:47.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.142+0000 7f3fa3c00640 1 -- 172.21.15.133:0/1559590600 shutdown_connections 2024-03-30T01:51:47.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.142+0000 7f3fa3c00640 1 --2- 172.21.15.133:0/1559590600 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3f7c06ac60 0x7f3f7c06d120 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3f94036000 tx=0x7f3f94008030 comp rx=0 tx=0).stop 2024-03-30T01:51:47.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.142+0000 7f3fa3c00640 1 --2- 172.21.15.133:0/1559590600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f9c15cc50 0x7f3f9c06f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.142+0000 7f3fa3c00640 1 --2- 172.21.15.133:0/1559590600 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f9c0d0af0 0x7f3f9c0b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.142+0000 7f3fa3c00640 1 --2- 172.21.15.133:0/1559590600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f9c0cf9b0 0x7f3f9c0c8740 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.142+0000 7f3fa3c00640 1 -- 172.21.15.133:0/1559590600 >> 172.21.15.133:0/1559590600 conn(0x7f3f9c071a40 msgr2=0x7f3f9c15d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:47.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.142+0000 7f6c4ca00640 1 -- 172.21.15.133:0/64020309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6c4814b530 con 0x7f6c4815cc50 2024-03-30T01:51:47.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.143+0000 7f3fa3c00640 1 -- 172.21.15.133:0/1559590600 shutdown_connections 2024-03-30T01:51:47.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.143+0000 7f6c3e000640 1 -- 172.21.15.133:0/64020309 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6c4814b530 con 0x7f6c4815cc50 2024-03-30T01:51:47.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.143+0000 7f3fa3c00640 1 -- 172.21.15.133:0/1559590600 wait complete. 2024-03-30T01:51:47.150 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2024-03-30T01:51:47.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.144+0000 7fbe40400640 1 -- 172.21.15.133:0/483091277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fbe140057d0 con 0x7fbe3815cc50 2024-03-30T01:51:47.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.144+0000 7fbe35600640 1 -- 172.21.15.133:0/483091277 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbe3007ac00 con 0x7fbe3815cc50 2024-03-30T01:51:47.151 INFO:teuthology.orchestra.run.smithi133.stdout:55834574855 2024-03-30T01:51:47.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.147+0000 7f9734c00640 1 -- 172.21.15.133:0/2749581993 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f97180057d0 con 0x7f9740145960 2024-03-30T01:51:47.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.147+0000 7f6c4ca00640 1 -- 172.21.15.133:0/64020309 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6c2806ac50 msgr2=0x7f6c2806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.147+0000 7f6c4ca00640 1 --2- 172.21.15.133:0/64020309 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6c2806ac50 0x7f6c2806d110 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000a730 tx=0x7f6c40008040 comp rx=0 tx=0).stop 2024-03-30T01:51:47.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.147+0000 7f9737400640 1 -- 172.21.15.133:0/2749581993 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9730017090 con 0x7f9740145960 2024-03-30T01:51:47.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.147+0000 7f6c4ca00640 1 -- 172.21.15.133:0/64020309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c4815cc50 msgr2=0x7f6c4815e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.154 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2024-03-30T01:51:47.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.147+0000 7f6c4ca00640 1 --2- 172.21.15.133:0/64020309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c4815cc50 0x7f6c4815e8b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400c410 tx=0x7f6c3400c8d0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.148+0000 7fbe40400640 1 -- 172.21.15.133:0/483091277 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbe1806ac50 msgr2=0x7fbe1806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.148+0000 7fbe40400640 1 --2- 172.21.15.133:0/483091277 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbe1806ac50 0x7fbe1806d110 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbe380b4f20 tx=0x7fbe2c008040 comp rx=0 tx=0).stop 2024-03-30T01:51:47.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.148+0000 7fbe40400640 1 -- 172.21.15.133:0/483091277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe3815cc50 msgr2=0x7fbe38073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.148+0000 7fbe40400640 1 --2- 172.21.15.133:0/483091277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe3815cc50 0x7fbe38073030 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbe30009e50 tx=0x7fbe30004a40 comp rx=0 tx=0).stop 2024-03-30T01:51:47.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.148+0000 7f6c4ca00640 1 -- 172.21.15.133:0/64020309 shutdown_connections 2024-03-30T01:51:47.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.148+0000 7f6c4ca00640 1 --2- 172.21.15.133:0/64020309 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6c2806ac50 0x7f6c2806d110 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.148+0000 7f6c4ca00640 1 --2- 172.21.15.133:0/64020309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c4815cc50 0x7f6c4815e8b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.148+0000 7f6c4ca00640 1 --2- 172.21.15.133:0/64020309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c480d2240 0x7f6c4815e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.148+0000 7f6c4ca00640 1 --2- 172.21.15.133:0/64020309 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c480cf9b0 0x7f6c4806f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.148+0000 7f6c4ca00640 1 -- 172.21.15.133:0/64020309 >> 172.21.15.133:0/64020309 conn(0x7f6c48071a40 msgr2=0x7f6c4815dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:47.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.148+0000 7f6c4ca00640 1 -- 172.21.15.133:0/64020309 shutdown_connections 2024-03-30T01:51:47.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.148+0000 7f6c4ca00640 1 -- 172.21.15.133:0/64020309 wait complete. 2024-03-30T01:51:47.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.148+0000 7fdf61600640 1 -- 172.21.15.133:0/3803170025 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdf3c005500 con 0x7fdf6c06dc10 2024-03-30T01:51:47.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.148+0000 7fbe40400640 1 -- 172.21.15.133:0/483091277 shutdown_connections 2024-03-30T01:51:47.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.148+0000 7fbe40400640 1 --2- 172.21.15.133:0/483091277 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbe1806ac50 0x7fbe1806d110 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.148+0000 7fbe40400640 1 --2- 172.21.15.133:0/483091277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe3815cc50 0x7fbe38073030 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.148+0000 7fbe40400640 1 --2- 172.21.15.133:0/483091277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe380d2240 0x7fbe3815f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.148+0000 7fbe40400640 1 --2- 172.21.15.133:0/483091277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe380cfb80 0x7fbe3815ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.148+0000 7fbe40400640 1 -- 172.21.15.133:0/483091277 >> 172.21.15.133:0/483091277 conn(0x7fbe38071a40 msgr2=0x7fbe3815e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:47.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.149+0000 7fbe40400640 1 -- 172.21.15.133:0/483091277 shutdown_connections 2024-03-30T01:51:47.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.149+0000 7fbe40400640 1 -- 172.21.15.133:0/483091277 wait complete. 2024-03-30T01:51:47.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.149+0000 7fdf63e00640 1 -- 172.21.15.133:0/3803170025 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf54020070 con 0x7fdf6c06dc10 2024-03-30T01:51:47.158 INFO:teuthology.orchestra.run.smithi133.stdout:55834574855 2024-03-30T01:51:47.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.150+0000 7f9734c00640 1 -- 172.21.15.133:0/2749581993 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f972006ac50 msgr2=0x7f972006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.150+0000 7f9734c00640 1 --2- 172.21.15.133:0/2749581993 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f972006ac50 0x7f972006d110 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f972c036000 tx=0x7f972c008030 comp rx=0 tx=0).stop 2024-03-30T01:51:47.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.150+0000 7f9734c00640 1 -- 172.21.15.133:0/2749581993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9740145960 msgr2=0x7f974013f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.150+0000 7f9734c00640 1 --2- 172.21.15.133:0/2749581993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9740145960 0x7f974013f7f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f973000e850 tx=0x7f973000ed10 comp rx=0 tx=0).stop 2024-03-30T01:51:47.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.151+0000 7f9734c00640 1 -- 172.21.15.133:0/2749581993 shutdown_connections 2024-03-30T01:51:47.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.151+0000 7f9734c00640 1 --2- 172.21.15.133:0/2749581993 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f972006ac50 0x7f972006d110 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.151+0000 7f9734c00640 1 --2- 172.21.15.133:0/2749581993 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9740146310 0x7f974015c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.151+0000 7f9734c00640 1 --2- 172.21.15.133:0/2749581993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9740145960 0x7f974013f7f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.151+0000 7f9734c00640 1 --2- 172.21.15.133:0/2749581993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9740145580 0x7f97400cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.151+0000 7f9734c00640 1 -- 172.21.15.133:0/2749581993 >> 172.21.15.133:0/2749581993 conn(0x7f97400b0da0 msgr2=0x7f974013e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:47.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.151+0000 7f9734c00640 1 -- 172.21.15.133:0/2749581993 shutdown_connections 2024-03-30T01:51:47.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.151+0000 7f9734c00640 1 -- 172.21.15.133:0/2749581993 wait complete. 2024-03-30T01:51:47.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.152+0000 7fdf61600640 1 -- 172.21.15.133:0/3803170025 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdf4806acd0 msgr2=0x7fdf4806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.152+0000 7fdf61600640 1 --2- 172.21.15.133:0/3803170025 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdf4806acd0 0x7fdf4806d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdf640012e0 tx=0x7fdf64007d30 comp rx=0 tx=0).stop 2024-03-30T01:51:47.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.152+0000 7fdf61600640 1 -- 172.21.15.133:0/3803170025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf6c06dc10 msgr2=0x7fdf6c1497f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.152+0000 7fdf61600640 1 --2- 172.21.15.133:0/3803170025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf6c06dc10 0x7fdf6c1497f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdf54001df0 tx=0x7fdf5400cb50 comp rx=0 tx=0).stop 2024-03-30T01:51:47.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.152+0000 7fdf61600640 1 -- 172.21.15.133:0/3803170025 shutdown_connections 2024-03-30T01:51:47.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.152+0000 7fdf61600640 1 --2- 172.21.15.133:0/3803170025 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdf4806acd0 0x7fdf4806d190 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdf640012e0 tx=0x7fdf64007d30 comp rx=0 tx=0).stop 2024-03-30T01:51:47.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.153+0000 7fdf61600640 1 --2- 172.21.15.133:0/3803170025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf6c071510 0x7fdf6c155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.153+0000 7fdf61600640 1 --2- 172.21.15.133:0/3803170025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf6c06dc10 0x7fdf6c1497f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.153+0000 7fdf61600640 1 --2- 172.21.15.133:0/3803170025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdf6c06c920 0x7fdf6c14b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.153+0000 7fdf61600640 1 -- 172.21.15.133:0/3803170025 >> 172.21.15.133:0/3803170025 conn(0x7fdf6c0b0da0 msgr2=0x7fdf6c0cdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:47.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.154+0000 7fdf61600640 1 -- 172.21.15.133:0/3803170025 shutdown_connections 2024-03-30T01:51:47.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.154+0000 7fdf61600640 1 -- 172.21.15.133:0/3803170025 wait complete. 2024-03-30T01:51:47.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.161+0000 7f327d600640 1 -- 172.21.15.133:0/1495250034 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3278150610 con 0x7f32780d1010 2024-03-30T01:51:47.169 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2024-03-30T01:51:47.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.162+0000 7f326ea00640 1 -- 172.21.15.133:0/1495250034 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3278150610 con 0x7f32780d1010 2024-03-30T01:51:47.174 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-03-30T01:51:47.174 DEBUG:teuthology.parallel:result is None 2024-03-30T01:51:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.167+0000 7f327d600640 1 -- 172.21.15.133:0/1495250034 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f325806ac50 msgr2=0x7f325806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.167+0000 7f327d600640 1 --2- 172.21.15.133:0/1495250034 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f325806ac50 0x7f325806d110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f326802b950 tx=0x7f326803c040 comp rx=0 tx=0).stop 2024-03-30T01:51:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.167+0000 7f327d600640 1 -- 172.21.15.133:0/1495250034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32780d1010 msgr2=0x7f3278070050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.167+0000 7f327d600640 1 --2- 172.21.15.133:0/1495250034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32780d1010 0x7f3278070050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f326400c390 tx=0x7f326400c850 comp rx=0 tx=0).stop 2024-03-30T01:51:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.167+0000 7f327d600640 1 -- 172.21.15.133:0/1495250034 shutdown_connections 2024-03-30T01:51:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.167+0000 7f327d600640 1 --2- 172.21.15.133:0/1495250034 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f325806ac50 0x7f325806d110 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.167+0000 7f327d600640 1 --2- 172.21.15.133:0/1495250034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f327815cf90 0x7f3278070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.167+0000 7f327d600640 1 --2- 172.21.15.133:0/1495250034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32780d1010 0x7f3278070050 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.167+0000 7f327d600640 1 --2- 172.21.15.133:0/1495250034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32780cfca0 0x7f32780c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.167+0000 7f327d600640 1 -- 172.21.15.133:0/1495250034 >> 172.21.15.133:0/1495250034 conn(0x7f3278071a40 msgr2=0x7f32780c66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.167+0000 7f327d600640 1 -- 172.21.15.133:0/1495250034 shutdown_connections 2024-03-30T01:51:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.167+0000 7f327d600640 1 -- 172.21.15.133:0/1495250034 wait complete. 2024-03-30T01:51:47.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-03-30T01:51:47.178 DEBUG:teuthology.parallel:result is None 2024-03-30T01:51:47.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-03-30T01:51:47.183 DEBUG:teuthology.parallel:result is None 2024-03-30T01:51:47.184 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-03-30T01:51:47.184 DEBUG:teuthology.parallel:result is None 2024-03-30T01:51:47.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-03-30T01:51:47.186 DEBUG:teuthology.parallel:result is None 2024-03-30T01:51:47.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-03-30T01:51:47.191 DEBUG:teuthology.parallel:result is None 2024-03-30T01:51:47.191 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-30T01:51:47.191 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T01:51:47.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.427+0000 7f9219000640 1 Processor -- start 2024-03-30T01:51:47.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.427+0000 7f9219000640 1 -- start start 2024-03-30T01:51:47.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.428+0000 7f9219000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f921415cc50 0x7f92140d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:47.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.428+0000 7f9219000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f92140d2240 0x7f92140cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:47.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.428+0000 7f9219000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f921415d030 con 0x7f92140cf9b0 2024-03-30T01:51:47.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.429+0000 7f9219000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92140d1c50 con 0x7f921415cc50 2024-03-30T01:51:47.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.429+0000 7f9219000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92140cfe20 con 0x7f92140d2240 2024-03-30T01:51:47.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.429+0000 7f9211e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f921415cc50 0x7f92140d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:47.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.429+0000 7f9212800640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f92140cf9b0 0x7f92140b14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48786/0 (socket says 172.21.15.133:48786) 2024-03-30T01:51:47.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.429+0000 7f9212800640 1 -- 172.21.15.133:0/2873707014 learned_addr learned my addr 172.21.15.133:0/2873707014 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:47.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.429+0000 7f920be00640 1 --2- 172.21.15.133:0/2873707014 >> v2:172.21.15.137:3300/0 conn(0x7f92140d2240 0x7f92140cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:47.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.429+0000 7f9211e00640 1 -- 172.21.15.133:0/2873707014 >> v2:172.21.15.137:3300/0 conn(0x7f92140d2240 msgr2=0x7f92140cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:47.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.429+0000 7f9211e00640 1 --2- 172.21.15.133:0/2873707014 >> v2:172.21.15.137:3300/0 conn(0x7f92140d2240 0x7f92140cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.429+0000 7f9211400640 1 -- 172.21.15.133:0/2873707014 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1914089172 0 0) 0x7f921415d030 con 0x7f92140cf9b0 2024-03-30T01:51:47.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.429+0000 7f9211e00640 1 -- 172.21.15.133:0/2873707014 >> v1:172.21.15.133:6789/0 conn(0x7f92140cf9b0 legacy=0x7f92140b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.429+0000 7f9211e00640 1 -- 172.21.15.133:0/2873707014 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92140b5af0 con 0x7f921415cc50 2024-03-30T01:51:47.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.431+0000 7f9211e00640 1 --2- 172.21.15.133:0/2873707014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f921415cc50 0x7f92140d0af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f921406c150 tx=0x7f920402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcc561e1923e514 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:47.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.431+0000 7f9211400640 1 -- 172.21.15.133:0/2873707014 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204031830 con 0x7f921415cc50 2024-03-30T01:51:47.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.431+0000 7f9211400640 1 -- 172.21.15.133:0/2873707014 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9204031990 con 0x7f921415cc50 2024-03-30T01:51:47.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.431+0000 7f9211400640 1 -- 172.21.15.133:0/2873707014 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204031d20 con 0x7f921415cc50 2024-03-30T01:51:47.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.432+0000 7f9219000640 1 -- 172.21.15.133:0/2873707014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f921415cc50 msgr2=0x7f92140d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.432+0000 7f9219000640 1 --2- 172.21.15.133:0/2873707014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f921415cc50 0x7f92140d0af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f921406c150 tx=0x7f920402b8d0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.432+0000 7f9219000640 1 -- 172.21.15.133:0/2873707014 shutdown_connections 2024-03-30T01:51:47.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.432+0000 7f9219000640 1 --2- 172.21.15.133:0/2873707014 >> v2:172.21.15.137:3300/0 conn(0x7f92140d2240 0x7f92140cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.432+0000 7f9219000640 1 --2- 172.21.15.133:0/2873707014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f921415cc50 0x7f92140d0af0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.432+0000 7f9219000640 1 -- 172.21.15.133:0/2873707014 >> 172.21.15.133:0/2873707014 conn(0x7f9214071a40 msgr2=0x7f921406b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:47.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.432+0000 7f9219000640 1 -- 172.21.15.133:0/2873707014 shutdown_connections 2024-03-30T01:51:47.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.432+0000 7f9219000640 1 -- 172.21.15.133:0/2873707014 wait complete. 2024-03-30T01:51:47.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.433+0000 7f9219000640 1 Processor -- start 2024-03-30T01:51:47.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.434+0000 7f9219000640 1 -- start start 2024-03-30T01:51:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.434+0000 7f9219000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92140cf9b0 0x7f92140acab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.434+0000 7f9219000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92140d2240 0x7f92140c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.434+0000 7f9219000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f921415cc50 0x7f92141f53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.434+0000 7f9219000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921415aa50 con 0x7f92140d2240 2024-03-30T01:51:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.434+0000 7f9219000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92140acff0 con 0x7f92140cf9b0 2024-03-30T01:51:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.434+0000 7f9219000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92140c9900 con 0x7f921415cc50 2024-03-30T01:51:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.435+0000 7f920be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92140d2240 0x7f92140c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.435+0000 7f920be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92140d2240 0x7f92140c93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60346/0 (socket says 172.21.15.133:60346) 2024-03-30T01:51:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.435+0000 7f920be00640 1 -- 172.21.15.133:0/4023347196 learned_addr learned my addr 172.21.15.133:0/4023347196 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.435+0000 7f920be00640 1 -- 172.21.15.133:0/4023347196 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f921415cc50 msgr2=0x7f92141f53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.435+0000 7f920be00640 1 --2- 172.21.15.133:0/4023347196 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f921415cc50 0x7f92141f53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.435+0000 7f920be00640 1 -- 172.21.15.133:0/4023347196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92140cf9b0 msgr2=0x7f92140acab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.435+0000 7f920be00640 1 --2- 172.21.15.133:0/4023347196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92140cf9b0 0x7f92140acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.435+0000 7f920be00640 1 -- 172.21.15.133:0/4023347196 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9204009400 con 0x7f92140d2240 2024-03-30T01:51:47.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.435+0000 7f920be00640 1 --2- 172.21.15.133:0/4023347196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92140d2240 0x7f92140c93c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f91fc00d800 tx=0x7f91fc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:47.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.435+0000 7f920a000640 1 -- 172.21.15.133:0/4023347196 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc00b6c0 con 0x7f92140d2240 2024-03-30T01:51:47.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.435+0000 7f920a000640 1 -- 172.21.15.133:0/4023347196 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91fc00b820 con 0x7f92140d2240 2024-03-30T01:51:47.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.435+0000 7f920a000640 1 -- 172.21.15.133:0/4023347196 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc00bbb0 con 0x7f92140d2240 2024-03-30T01:51:47.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.435+0000 7f9219000640 1 -- 172.21.15.133:0/4023347196 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92140ad220 con 0x7f92140d2240 2024-03-30T01:51:47.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.436+0000 7f9219000640 1 -- 172.21.15.133:0/4023347196 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92140ad7e0 con 0x7f92140d2240 2024-03-30T01:51:47.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.437+0000 7f9219000640 1 -- 172.21.15.133:0/4023347196 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9214066d80 con 0x7f92140d2240 2024-03-30T01:51:47.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.437+0000 7f920a000640 1 -- 172.21.15.133:0/4023347196 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f91fc00bd10 con 0x7f92140d2240 2024-03-30T01:51:47.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.438+0000 7f920a000640 1 --2- 172.21.15.133:0/4023347196 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f91f006ac00 0x7f91f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:47.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.438+0000 7f920a000640 1 -- 172.21.15.133:0/4023347196 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91fc089910 con 0x7f92140d2240 2024-03-30T01:51:47.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.438+0000 7f9211e00640 1 --2- 172.21.15.133:0/4023347196 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f91f006ac00 0x7f91f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:47.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.439+0000 7f9211e00640 1 --2- 172.21.15.133:0/4023347196 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f91f006ac00 0x7f91f006d0c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9204036000 tx=0x7f9204030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:47.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.443+0000 7f920a000640 1 -- 172.21.15.133:0/4023347196 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f91fc054ae0 con 0x7f92140d2240 2024-03-30T01:51:47.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.619+0000 7f9219000640 1 -- 172.21.15.133:0/4023347196 --> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f92140d1690 con 0x7f91f006ac00 2024-03-30T01:51:47.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.627+0000 7f920a000640 1 -- 172.21.15.133:0/4023347196 <== mgr.4105 v2:172.21.15.133:6832/37234 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264398 (secure 0 0 0) 0x7f920403a420 con 0x7f91f006ac00 2024-03-30T01:51:47.637 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:47.639 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-03-30T01:51:47.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.632+0000 7f9219000640 1 -- 172.21.15.133:0/4023347196 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f91f006ac00 msgr2=0x7f91f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.632+0000 7f9219000640 1 --2- 172.21.15.133:0/4023347196 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f91f006ac00 0x7f91f006d0c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9204036000 tx=0x7f9204030000 comp rx=0 tx=0).stop 2024-03-30T01:51:47.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.632+0000 7f9219000640 1 -- 172.21.15.133:0/4023347196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92140d2240 msgr2=0x7f92140c93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.632+0000 7f9219000640 1 --2- 172.21.15.133:0/4023347196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92140d2240 0x7f92140c93c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f91fc00d800 tx=0x7f91fc00dcc0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.632+0000 7f9219000640 1 -- 172.21.15.133:0/4023347196 shutdown_connections 2024-03-30T01:51:47.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.632+0000 7f9219000640 1 --2- 172.21.15.133:0/4023347196 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f91f006ac00 0x7f91f006d0c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.632+0000 7f9219000640 1 --2- 172.21.15.133:0/4023347196 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f921415cc50 0x7f92141f53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.632+0000 7f9219000640 1 --2- 172.21.15.133:0/4023347196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92140d2240 0x7f92140c93c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.632+0000 7f9219000640 1 --2- 172.21.15.133:0/4023347196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92140cf9b0 0x7f92140acab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.632+0000 7f9219000640 1 -- 172.21.15.133:0/4023347196 >> 172.21.15.133:0/4023347196 conn(0x7f9214071a40 msgr2=0x7f92140b8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:47.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.632+0000 7f9219000640 1 -- 172.21.15.133:0/4023347196 shutdown_connections 2024-03-30T01:51:47.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.633+0000 7f9219000640 1 -- 172.21.15.133:0/4023347196 wait complete. 2024-03-30T01:51:47.656 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-03-30T01:51:45.700820+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218976,"kb_used_data":2816,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755744,"statfs":{"total":773094113280,"available":772869881856,"internally_reserved":0,"allocated":2883584,"data_stored":1750606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.913181"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.351409+0000","last_change":"2024-03-30T01:51:32.812760+0000","last_active":"2024-03-30T01:51:34.351409+0000","last_peered":"2024-03-30T01:51:34.351409+0000","last_clean":"2024-03-30T01:51:34.351409+0000","last_became_active":"2024-03-30T01:51:32.812445+0000","last_became_peered":"2024-03-30T01:51:32.812445+0000","last_unstale":"2024-03-30T01:51:34.351409+0000","last_undegraded":"2024-03-30T01:51:34.351409+0000","last_fullsized":"2024-03-30T01:51:34.351409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:43.327711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791881+0000","last_change":"2024-03-30T01:51:32.811824+0000","last_active":"2024-03-30T01:51:33.791881+0000","last_peered":"2024-03-30T01:51:33.791881+0000","last_clean":"2024-03-30T01:51:33.791881+0000","last_became_active":"2024-03-30T01:51:32.811515+0000","last_became_peered":"2024-03-30T01:51:32.811515+0000","last_unstale":"2024-03-30T01:51:33.791881+0000","last_undegraded":"2024-03-30T01:51:33.791881+0000","last_fullsized":"2024-03-30T01:51:33.791881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951932+0000","last_change":"2024-03-30T01:51:32.799724+0000","last_active":"2024-03-30T01:51:33.951932+0000","last_peered":"2024-03-30T01:51:33.951932+0000","last_clean":"2024-03-30T01:51:33.951932+0000","last_became_active":"2024-03-30T01:51:32.799212+0000","last_became_peered":"2024-03-30T01:51:32.799212+0000","last_unstale":"2024-03-30T01:51:33.951932+0000","last_undegraded":"2024-03-30T01:51:33.951932+0000","last_fullsized":"2024-03-30T01:51:33.951932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:56:56.891377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792368+0000","last_change":"2024-03-30T01:51:32.806655+0000","last_active":"2024-03-30T01:51:33.792368+0000","last_peered":"2024-03-30T01:51:33.792368+0000","last_clean":"2024-03-30T01:51:33.792368+0000","last_became_active":"2024-03-30T01:51:32.806055+0000","last_became_peered":"2024-03-30T01:51:32.806055+0000","last_unstale":"2024-03-30T01:51:33.792368+0000","last_undegraded":"2024-03-30T01:51:33.792368+0000","last_fullsized":"2024-03-30T01:51:33.792368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:16:38.980879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350701+0000","last_change":"2024-03-30T01:51:32.820075+0000","last_active":"2024-03-30T01:51:34.350701+0000","last_peered":"2024-03-30T01:51:34.350701+0000","last_clean":"2024-03-30T01:51:34.350701+0000","last_became_active":"2024-03-30T01:51:32.819814+0000","last_became_peered":"2024-03-30T01:51:32.819814+0000","last_unstale":"2024-03-30T01:51:34.350701+0000","last_undegraded":"2024-03-30T01:51:34.350701+0000","last_fullsized":"2024-03-30T01:51:34.350701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:38:15.645425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793528+0000","last_change":"2024-03-30T01:51:32.803089+0000","last_active":"2024-03-30T01:51:33.793528+0000","last_peered":"2024-03-30T01:51:33.793528+0000","last_clean":"2024-03-30T01:51:33.793528+0000","last_became_active":"2024-03-30T01:51:32.802757+0000","last_became_peered":"2024-03-30T01:51:32.802757+0000","last_unstale":"2024-03-30T01:51:33.793528+0000","last_undegraded":"2024-03-30T01:51:33.793528+0000","last_fullsized":"2024-03-30T01:51:33.793528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:38:15.645425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350340+0000","last_change":"2024-03-30T01:51:32.818444+0000","last_active":"2024-03-30T01:51:34.350340+0000","last_peered":"2024-03-30T01:51:34.350340+0000","last_clean":"2024-03-30T01:51:34.350340+0000","last_became_active":"2024-03-30T01:51:32.818124+0000","last_became_peered":"2024-03-30T01:51:32.818124+0000","last_unstale":"2024-03-30T01:51:34.350340+0000","last_undegraded":"2024-03-30T01:51:34.350340+0000","last_fullsized":"2024-03-30T01:51:34.350340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:13:11.318115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357046+0000","last_change":"2024-03-30T01:51:32.821461+0000","last_active":"2024-03-30T01:51:36.357046+0000","last_peered":"2024-03-30T01:51:36.357046+0000","last_clean":"2024-03-30T01:51:36.357046+0000","last_became_active":"2024-03-30T01:51:32.821281+0000","last_became_peered":"2024-03-30T01:51:32.821281+0000","last_unstale":"2024-03-30T01:51:36.357046+0000","last_undegraded":"2024-03-30T01:51:36.357046+0000","last_fullsized":"2024-03-30T01:51:36.357046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.351614+0000","last_change":"2024-03-30T01:51:32.829942+0000","last_active":"2024-03-30T01:51:34.351614+0000","last_peered":"2024-03-30T01:51:34.351614+0000","last_clean":"2024-03-30T01:51:34.351614+0000","last_became_active":"2024-03-30T01:51:32.829594+0000","last_became_peered":"2024-03-30T01:51:32.829594+0000","last_unstale":"2024-03-30T01:51:34.351614+0000","last_undegraded":"2024-03-30T01:51:34.351614+0000","last_fullsized":"2024-03-30T01:51:34.351614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:43:22.251326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359569+0000","last_change":"2024-03-30T01:51:32.812680+0000","last_active":"2024-03-30T01:51:36.359569+0000","last_peered":"2024-03-30T01:51:36.359569+0000","last_clean":"2024-03-30T01:51:36.359569+0000","last_became_active":"2024-03-30T01:51:32.812333+0000","last_became_peered":"2024-03-30T01:51:32.812333+0000","last_unstale":"2024-03-30T01:51:36.359569+0000","last_undegraded":"2024-03-30T01:51:36.359569+0000","last_fullsized":"2024-03-30T01:51:36.359569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:13:08.942873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359121+0000","last_change":"2024-03-30T01:51:32.826749+0000","last_active":"2024-03-30T01:51:36.359121+0000","last_peered":"2024-03-30T01:51:36.359121+0000","last_clean":"2024-03-30T01:51:36.359121+0000","last_became_active":"2024-03-30T01:51:32.824642+0000","last_became_peered":"2024-03-30T01:51:32.824642+0000","last_unstale":"2024-03-30T01:51:36.359121+0000","last_undegraded":"2024-03-30T01:51:36.359121+0000","last_fullsized":"2024-03-30T01:51:36.359121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794544+0000","last_change":"2024-03-30T01:51:32.816597+0000","last_active":"2024-03-30T01:51:33.794544+0000","last_peered":"2024-03-30T01:51:33.794544+0000","last_clean":"2024-03-30T01:51:33.794544+0000","last_became_active":"2024-03-30T01:51:32.816310+0000","last_became_peered":"2024-03-30T01:51:32.816310+0000","last_unstale":"2024-03-30T01:51:33.794544+0000","last_undegraded":"2024-03-30T01:51:33.794544+0000","last_fullsized":"2024-03-30T01:51:33.794544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:42:27.229045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356973+0000","last_change":"2024-03-30T01:51:32.816094+0000","last_active":"2024-03-30T01:51:36.356973+0000","last_peered":"2024-03-30T01:51:36.356973+0000","last_clean":"2024-03-30T01:51:36.356973+0000","last_became_active":"2024-03-30T01:51:32.815841+0000","last_became_peered":"2024-03-30T01:51:32.815841+0000","last_unstale":"2024-03-30T01:51:36.356973+0000","last_undegraded":"2024-03-30T01:51:36.356973+0000","last_fullsized":"2024-03-30T01:51:36.356973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:08:35.439480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951373+0000","last_change":"2024-03-30T01:51:32.808528+0000","last_active":"2024-03-30T01:51:33.951373+0000","last_peered":"2024-03-30T01:51:33.951373+0000","last_clean":"2024-03-30T01:51:33.951373+0000","last_became_active":"2024-03-30T01:51:32.808290+0000","last_became_peered":"2024-03-30T01:51:32.808290+0000","last_unstale":"2024-03-30T01:51:33.951373+0000","last_undegraded":"2024-03-30T01:51:33.951373+0000","last_fullsized":"2024-03-30T01:51:33.951373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:16:16.111272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791232+0000","last_change":"2024-03-30T01:51:32.818830+0000","last_active":"2024-03-30T01:51:33.791232+0000","last_peered":"2024-03-30T01:51:33.791232+0000","last_clean":"2024-03-30T01:51:33.791232+0000","last_became_active":"2024-03-30T01:51:32.818684+0000","last_became_peered":"2024-03-30T01:51:32.818684+0000","last_unstale":"2024-03-30T01:51:33.791232+0000","last_undegraded":"2024-03-30T01:51:33.791232+0000","last_fullsized":"2024-03-30T01:51:33.791232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:12:19.249116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793142+0000","last_change":"2024-03-30T01:51:32.810544+0000","last_active":"2024-03-30T01:51:33.793142+0000","last_peered":"2024-03-30T01:51:33.793142+0000","last_clean":"2024-03-30T01:51:33.793142+0000","last_became_active":"2024-03-30T01:51:32.809383+0000","last_became_peered":"2024-03-30T01:51:32.809383+0000","last_unstale":"2024-03-30T01:51:33.793142+0000","last_undegraded":"2024-03-30T01:51:33.793142+0000","last_fullsized":"2024-03-30T01:51:33.793142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T04:10:09.271050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794103+0000","last_change":"2024-03-30T01:51:32.814598+0000","last_active":"2024-03-30T01:51:33.794103+0000","last_peered":"2024-03-30T01:51:33.794103+0000","last_clean":"2024-03-30T01:51:33.794103+0000","last_became_active":"2024-03-30T01:51:32.814343+0000","last_became_peered":"2024-03-30T01:51:32.814343+0000","last_unstale":"2024-03-30T01:51:33.794103+0000","last_undegraded":"2024-03-30T01:51:33.794103+0000","last_fullsized":"2024-03-30T01:51:33.794103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:45:46.717709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356214+0000","last_change":"2024-03-30T01:51:32.810030+0000","last_active":"2024-03-30T01:51:36.356214+0000","last_peered":"2024-03-30T01:51:36.356214+0000","last_clean":"2024-03-30T01:51:36.356214+0000","last_became_active":"2024-03-30T01:51:32.809667+0000","last_became_peered":"2024-03-30T01:51:32.809667+0000","last_unstale":"2024-03-30T01:51:36.356214+0000","last_undegraded":"2024-03-30T01:51:36.356214+0000","last_fullsized":"2024-03-30T01:51:36.356214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:43:14.180564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350888+0000","last_change":"2024-03-30T01:51:32.825796+0000","last_active":"2024-03-30T01:51:34.350888+0000","last_peered":"2024-03-30T01:51:34.350888+0000","last_clean":"2024-03-30T01:51:34.350888+0000","last_became_active":"2024-03-30T01:51:32.825501+0000","last_became_peered":"2024-03-30T01:51:32.825501+0000","last_unstale":"2024-03-30T01:51:34.350888+0000","last_undegraded":"2024-03-30T01:51:34.350888+0000","last_fullsized":"2024-03-30T01:51:34.350888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:16:38.980879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359143+0000","last_change":"2024-03-30T01:51:32.816941+0000","last_active":"2024-03-30T01:51:36.359143+0000","last_peered":"2024-03-30T01:51:36.359143+0000","last_clean":"2024-03-30T01:51:36.359143+0000","last_became_active":"2024-03-30T01:51:32.816645+0000","last_became_peered":"2024-03-30T01:51:32.816645+0000","last_unstale":"2024-03-30T01:51:36.359143+0000","last_undegraded":"2024-03-30T01:51:36.359143+0000","last_fullsized":"2024-03-30T01:51:36.359143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:42:27.229045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951735+0000","last_change":"2024-03-30T01:51:32.807172+0000","last_active":"2024-03-30T01:51:33.951735+0000","last_peered":"2024-03-30T01:51:33.951735+0000","last_clean":"2024-03-30T01:51:33.951735+0000","last_became_active":"2024-03-30T01:51:32.805878+0000","last_became_peered":"2024-03-30T01:51:32.805878+0000","last_unstale":"2024-03-30T01:51:33.951735+0000","last_undegraded":"2024-03-30T01:51:33.951735+0000","last_fullsized":"2024-03-30T01:51:33.951735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:04:01.115269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793786+0000","last_change":"2024-03-30T01:51:32.814459+0000","last_active":"2024-03-30T01:51:33.793786+0000","last_peered":"2024-03-30T01:51:33.793786+0000","last_clean":"2024-03-30T01:51:33.793786+0000","last_became_active":"2024-03-30T01:51:32.814174+0000","last_became_peered":"2024-03-30T01:51:32.814174+0000","last_unstale":"2024-03-30T01:51:33.793786+0000","last_undegraded":"2024-03-30T01:51:33.793786+0000","last_fullsized":"2024-03-30T01:51:33.793786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:50.171426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356748+0000","last_change":"2024-03-30T01:51:32.822182+0000","last_active":"2024-03-30T01:51:36.356748+0000","last_peered":"2024-03-30T01:51:36.356748+0000","last_clean":"2024-03-30T01:51:36.356748+0000","last_became_active":"2024-03-30T01:51:32.821907+0000","last_became_peered":"2024-03-30T01:51:32.821907+0000","last_unstale":"2024-03-30T01:51:36.356748+0000","last_undegraded":"2024-03-30T01:51:36.356748+0000","last_fullsized":"2024-03-30T01:51:36.356748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T07:15:13.311008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793836+0000","last_change":"2024-03-30T01:51:32.810773+0000","last_active":"2024-03-30T01:51:33.793836+0000","last_peered":"2024-03-30T01:51:33.793836+0000","last_clean":"2024-03-30T01:51:33.793836+0000","last_became_active":"2024-03-30T01:51:32.810446+0000","last_became_peered":"2024-03-30T01:51:32.810446+0000","last_unstale":"2024-03-30T01:51:33.793836+0000","last_undegraded":"2024-03-30T01:51:33.793836+0000","last_fullsized":"2024-03-30T01:51:33.793836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357256+0000","last_change":"2024-03-30T01:51:32.824519+0000","last_active":"2024-03-30T01:51:36.357256+0000","last_peered":"2024-03-30T01:51:36.357256+0000","last_clean":"2024-03-30T01:51:36.357256+0000","last_became_active":"2024-03-30T01:51:32.824210+0000","last_became_peered":"2024-03-30T01:51:32.824210+0000","last_unstale":"2024-03-30T01:51:36.357256+0000","last_undegraded":"2024-03-30T01:51:36.357256+0000","last_fullsized":"2024-03-30T01:51:36.357256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:16:16.111272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359568+0000","last_change":"2024-03-30T01:51:32.823849+0000","last_active":"2024-03-30T01:51:36.359568+0000","last_peered":"2024-03-30T01:51:36.359568+0000","last_clean":"2024-03-30T01:51:36.359568+0000","last_became_active":"2024-03-30T01:51:32.823467+0000","last_became_peered":"2024-03-30T01:51:32.823467+0000","last_unstale":"2024-03-30T01:51:36.359568+0000","last_undegraded":"2024-03-30T01:51:36.359568+0000","last_fullsized":"2024-03-30T01:51:36.359568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792289+0000","last_change":"2024-03-30T01:51:32.815312+0000","last_active":"2024-03-30T01:51:33.792289+0000","last_peered":"2024-03-30T01:51:33.792289+0000","last_clean":"2024-03-30T01:51:33.792289+0000","last_became_active":"2024-03-30T01:51:32.814565+0000","last_became_peered":"2024-03-30T01:51:32.814565+0000","last_unstale":"2024-03-30T01:51:33.792289+0000","last_undegraded":"2024-03-30T01:51:33.792289+0000","last_fullsized":"2024-03-30T01:51:33.792289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:31:32.555378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357196+0000","last_change":"2024-03-30T01:51:32.821245+0000","last_active":"2024-03-30T01:51:36.357196+0000","last_peered":"2024-03-30T01:51:36.357196+0000","last_clean":"2024-03-30T01:51:36.357196+0000","last_became_active":"2024-03-30T01:51:32.821080+0000","last_became_peered":"2024-03-30T01:51:32.821080+0000","last_unstale":"2024-03-30T01:51:36.357196+0000","last_undegraded":"2024-03-30T01:51:36.357196+0000","last_fullsized":"2024-03-30T01:51:36.357196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:48.498455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951866+0000","last_change":"2024-03-30T01:51:32.795415+0000","last_active":"2024-03-30T01:51:33.951866+0000","last_peered":"2024-03-30T01:51:33.951866+0000","last_clean":"2024-03-30T01:51:33.951866+0000","last_became_active":"2024-03-30T01:51:32.795077+0000","last_became_peered":"2024-03-30T01:51:32.795077+0000","last_unstale":"2024-03-30T01:51:33.951866+0000","last_undegraded":"2024-03-30T01:51:33.951866+0000","last_fullsized":"2024-03-30T01:51:33.951866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794033+0000","last_change":"2024-03-30T01:51:32.809765+0000","last_active":"2024-03-30T01:51:33.794033+0000","last_peered":"2024-03-30T01:51:33.794033+0000","last_clean":"2024-03-30T01:51:33.794033+0000","last_became_active":"2024-03-30T01:51:32.809483+0000","last_became_peered":"2024-03-30T01:51:32.809483+0000","last_unstale":"2024-03-30T01:51:33.794033+0000","last_undegraded":"2024-03-30T01:51:33.794033+0000","last_fullsized":"2024-03-30T01:51:33.794033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:12:19.249116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356211+0000","last_change":"2024-03-30T01:51:32.802662+0000","last_active":"2024-03-30T01:51:36.356211+0000","last_peered":"2024-03-30T01:51:36.356211+0000","last_clean":"2024-03-30T01:51:36.356211+0000","last_became_active":"2024-03-30T01:51:32.802418+0000","last_became_peered":"2024-03-30T01:51:32.802418+0000","last_unstale":"2024-03-30T01:51:36.356211+0000","last_undegraded":"2024-03-30T01:51:36.356211+0000","last_fullsized":"2024-03-30T01:51:36.356211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:29.404661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.358729+0000","last_change":"2024-03-30T01:51:32.825195+0000","last_active":"2024-03-30T01:51:36.358729+0000","last_peered":"2024-03-30T01:51:36.358729+0000","last_clean":"2024-03-30T01:51:36.358729+0000","last_became_active":"2024-03-30T01:51:32.824918+0000","last_became_peered":"2024-03-30T01:51:32.824918+0000","last_unstale":"2024-03-30T01:51:36.358729+0000","last_undegraded":"2024-03-30T01:51:36.358729+0000","last_fullsized":"2024-03-30T01:51:36.358729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:16:16.111272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793866+0000","last_change":"2024-03-30T01:51:32.818991+0000","last_active":"2024-03-30T01:51:33.793866+0000","last_peered":"2024-03-30T01:51:33.793866+0000","last_clean":"2024-03-30T01:51:33.793866+0000","last_became_active":"2024-03-30T01:51:32.818661+0000","last_became_peered":"2024-03-30T01:51:32.818661+0000","last_unstale":"2024-03-30T01:51:33.793866+0000","last_undegraded":"2024-03-30T01:51:33.793866+0000","last_fullsized":"2024-03-30T01:51:33.793866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:16:48.714780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.827029+0000","last_change":"2024-03-30T01:51:32.334786+0000","last_active":"2024-03-30T01:51:32.827029+0000","last_peered":"2024-03-30T01:51:32.827029+0000","last_clean":"2024-03-30T01:51:32.827029+0000","last_became_active":"2024-03-30T01:51:32.334439+0000","last_became_peered":"2024-03-30T01:51:32.334439+0000","last_unstale":"2024-03-30T01:51:32.827029+0000","last_undegraded":"2024-03-30T01:51:32.827029+0000","last_fullsized":"2024-03-30T01:51:32.827029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:16:10.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951993+0000","last_change":"2024-03-30T01:51:32.802436+0000","last_active":"2024-03-30T01:51:33.951993+0000","last_peered":"2024-03-30T01:51:33.951993+0000","last_clean":"2024-03-30T01:51:33.951993+0000","last_became_active":"2024-03-30T01:51:32.802174+0000","last_became_peered":"2024-03-30T01:51:32.802174+0000","last_unstale":"2024-03-30T01:51:33.951993+0000","last_undegraded":"2024-03-30T01:51:33.951993+0000","last_fullsized":"2024-03-30T01:51:33.951993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T07:15:13.311008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.831313+0000","last_change":"2024-03-30T01:51:32.333125+0000","last_active":"2024-03-30T01:51:32.831313+0000","last_peered":"2024-03-30T01:51:32.831313+0000","last_clean":"2024-03-30T01:51:32.831313+0000","last_became_active":"2024-03-30T01:51:32.332556+0000","last_became_peered":"2024-03-30T01:51:32.332556+0000","last_unstale":"2024-03-30T01:51:32.831313+0000","last_undegraded":"2024-03-30T01:51:32.831313+0000","last_fullsized":"2024-03-30T01:51:32.831313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.801373+0000","last_change":"2024-03-30T01:51:32.339115+0000","last_active":"2024-03-30T01:51:32.801373+0000","last_peered":"2024-03-30T01:51:32.801373+0000","last_clean":"2024-03-30T01:51:32.801373+0000","last_became_active":"2024-03-30T01:51:32.338822+0000","last_became_peered":"2024-03-30T01:51:32.338822+0000","last_unstale":"2024-03-30T01:51:32.801373+0000","last_undegraded":"2024-03-30T01:51:32.801373+0000","last_fullsized":"2024-03-30T01:51:32.801373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356877+0000","last_change":"2024-03-30T01:51:32.800804+0000","last_active":"2024-03-30T01:51:36.356877+0000","last_peered":"2024-03-30T01:51:36.356877+0000","last_clean":"2024-03-30T01:51:36.356877+0000","last_became_active":"2024-03-30T01:51:32.800357+0000","last_became_peered":"2024-03-30T01:51:32.800357+0000","last_unstale":"2024-03-30T01:51:36.356877+0000","last_undegraded":"2024-03-30T01:51:36.356877+0000","last_fullsized":"2024-03-30T01:51:36.356877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:12:19.249116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.789786+0000","last_change":"2024-03-30T01:51:32.324045+0000","last_active":"2024-03-30T01:51:32.789786+0000","last_peered":"2024-03-30T01:51:32.789786+0000","last_clean":"2024-03-30T01:51:32.789786+0000","last_became_active":"2024-03-30T01:51:32.323466+0000","last_became_peered":"2024-03-30T01:51:32.323466+0000","last_unstale":"2024-03-30T01:51:32.789786+0000","last_undegraded":"2024-03-30T01:51:32.789786+0000","last_fullsized":"2024-03-30T01:51:32.789786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:16.099108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791017+0000","last_change":"2024-03-30T01:51:32.809356+0000","last_active":"2024-03-30T01:51:33.791017+0000","last_peered":"2024-03-30T01:51:33.791017+0000","last_clean":"2024-03-30T01:51:33.791017+0000","last_became_active":"2024-03-30T01:51:32.809059+0000","last_became_peered":"2024-03-30T01:51:32.809059+0000","last_unstale":"2024-03-30T01:51:33.791017+0000","last_undegraded":"2024-03-30T01:51:33.791017+0000","last_fullsized":"2024-03-30T01:51:33.791017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.809422+0000","last_change":"2024-03-30T01:51:32.339350+0000","last_active":"2024-03-30T01:51:32.809422+0000","last_peered":"2024-03-30T01:51:32.809422+0000","last_clean":"2024-03-30T01:51:32.809422+0000","last_became_active":"2024-03-30T01:51:32.338514+0000","last_became_peered":"2024-03-30T01:51:32.338514+0000","last_unstale":"2024-03-30T01:51:32.809422+0000","last_undegraded":"2024-03-30T01:51:32.809422+0000","last_fullsized":"2024-03-30T01:51:32.809422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:49:06.802141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792834+0000","last_change":"2024-03-30T01:51:32.816915+0000","last_active":"2024-03-30T01:51:33.792834+0000","last_peered":"2024-03-30T01:51:33.792834+0000","last_clean":"2024-03-30T01:51:33.792834+0000","last_became_active":"2024-03-30T01:51:32.814653+0000","last_became_peered":"2024-03-30T01:51:32.814653+0000","last_unstale":"2024-03-30T01:51:33.792834+0000","last_undegraded":"2024-03-30T01:51:33.792834+0000","last_fullsized":"2024-03-30T01:51:33.792834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:08:35.439480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.791633+0000","last_change":"2024-03-30T01:51:32.341633+0000","last_active":"2024-03-30T01:51:32.791633+0000","last_peered":"2024-03-30T01:51:32.791633+0000","last_clean":"2024-03-30T01:51:32.791633+0000","last_became_active":"2024-03-30T01:51:32.341346+0000","last_became_peered":"2024-03-30T01:51:32.341346+0000","last_unstale":"2024-03-30T01:51:32.791633+0000","last_undegraded":"2024-03-30T01:51:32.791633+0000","last_fullsized":"2024-03-30T01:51:32.791633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.952480+0000","last_change":"2024-03-30T01:51:32.798259+0000","last_active":"2024-03-30T01:51:33.952480+0000","last_peered":"2024-03-30T01:51:33.952480+0000","last_clean":"2024-03-30T01:51:33.952480+0000","last_became_active":"2024-03-30T01:51:32.797868+0000","last_became_peered":"2024-03-30T01:51:32.797868+0000","last_unstale":"2024-03-30T01:51:33.952480+0000","last_undegraded":"2024-03-30T01:51:33.952480+0000","last_fullsized":"2024-03-30T01:51:33.952480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.829577+0000","last_change":"2024-03-30T01:51:32.335884+0000","last_active":"2024-03-30T01:51:32.829577+0000","last_peered":"2024-03-30T01:51:32.829577+0000","last_clean":"2024-03-30T01:51:32.829577+0000","last_became_active":"2024-03-30T01:51:32.335615+0000","last_became_peered":"2024-03-30T01:51:32.335615+0000","last_unstale":"2024-03-30T01:51:32.829577+0000","last_undegraded":"2024-03-30T01:51:32.829577+0000","last_fullsized":"2024-03-30T01:51:32.829577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794581+0000","last_change":"2024-03-30T01:51:32.817329+0000","last_active":"2024-03-30T01:51:33.794581+0000","last_peered":"2024-03-30T01:51:33.794581+0000","last_clean":"2024-03-30T01:51:33.794581+0000","last_became_active":"2024-03-30T01:51:32.817034+0000","last_became_peered":"2024-03-30T01:51:32.817034+0000","last_unstale":"2024-03-30T01:51:33.794581+0000","last_undegraded":"2024-03-30T01:51:33.794581+0000","last_fullsized":"2024-03-30T01:51:33.794581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:29.404661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.838419+0000","last_change":"2024-03-30T01:51:32.344369+0000","last_active":"2024-03-30T01:51:32.838419+0000","last_peered":"2024-03-30T01:51:32.838419+0000","last_clean":"2024-03-30T01:51:32.838419+0000","last_became_active":"2024-03-30T01:51:32.344031+0000","last_became_peered":"2024-03-30T01:51:32.344031+0000","last_unstale":"2024-03-30T01:51:32.838419+0000","last_undegraded":"2024-03-30T01:51:32.838419+0000","last_fullsized":"2024-03-30T01:51:32.838419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:16:10.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350569+0000","last_change":"2024-03-30T01:51:32.822087+0000","last_active":"2024-03-30T01:51:34.350569+0000","last_peered":"2024-03-30T01:51:34.350569+0000","last_clean":"2024-03-30T01:51:34.350569+0000","last_became_active":"2024-03-30T01:51:32.821664+0000","last_became_peered":"2024-03-30T01:51:32.821664+0000","last_unstale":"2024-03-30T01:51:34.350569+0000","last_undegraded":"2024-03-30T01:51:34.350569+0000","last_fullsized":"2024-03-30T01:51:34.350569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:45:46.717709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.833595+0000","last_change":"2024-03-30T01:51:32.328895+0000","last_active":"2024-03-30T01:51:32.833595+0000","last_peered":"2024-03-30T01:51:32.833595+0000","last_clean":"2024-03-30T01:51:32.833595+0000","last_became_active":"2024-03-30T01:51:32.327604+0000","last_became_peered":"2024-03-30T01:51:32.327604+0000","last_unstale":"2024-03-30T01:51:32.833595+0000","last_undegraded":"2024-03-30T01:51:32.833595+0000","last_fullsized":"2024-03-30T01:51:32.833595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:18.328608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951478+0000","last_change":"2024-03-30T01:51:32.813992+0000","last_active":"2024-03-30T01:51:33.951478+0000","last_peered":"2024-03-30T01:51:33.951478+0000","last_clean":"2024-03-30T01:51:33.951478+0000","last_became_active":"2024-03-30T01:51:32.813751+0000","last_became_peered":"2024-03-30T01:51:32.813751+0000","last_unstale":"2024-03-30T01:51:33.951478+0000","last_undegraded":"2024-03-30T01:51:33.951478+0000","last_fullsized":"2024-03-30T01:51:33.951478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:48.498455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.794977+0000","last_change":"2024-03-30T01:51:32.326767+0000","last_active":"2024-03-30T01:51:32.794977+0000","last_peered":"2024-03-30T01:51:32.794977+0000","last_clean":"2024-03-30T01:51:32.794977+0000","last_became_active":"2024-03-30T01:51:32.326514+0000","last_became_peered":"2024-03-30T01:51:32.326514+0000","last_unstale":"2024-03-30T01:51:32.794977+0000","last_undegraded":"2024-03-30T01:51:32.794977+0000","last_fullsized":"2024-03-30T01:51:32.794977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:49:06.802141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350753+0000","last_change":"2024-03-30T01:51:32.831620+0000","last_active":"2024-03-30T01:51:34.350753+0000","last_peered":"2024-03-30T01:51:34.350753+0000","last_clean":"2024-03-30T01:51:34.350753+0000","last_became_active":"2024-03-30T01:51:32.829086+0000","last_became_peered":"2024-03-30T01:51:32.829086+0000","last_unstale":"2024-03-30T01:51:34.350753+0000","last_undegraded":"2024-03-30T01:51:34.350753+0000","last_fullsized":"2024-03-30T01:51:34.350753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:48:32.312063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.808536+0000","last_change":"2024-03-30T01:51:32.333519+0000","last_active":"2024-03-30T01:51:32.808536+0000","last_peered":"2024-03-30T01:51:32.808536+0000","last_clean":"2024-03-30T01:51:32.808536+0000","last_became_active":"2024-03-30T01:51:32.332785+0000","last_became_peered":"2024-03-30T01:51:32.332785+0000","last_unstale":"2024-03-30T01:51:32.808536+0000","last_undegraded":"2024-03-30T01:51:32.808536+0000","last_fullsized":"2024-03-30T01:51:32.808536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.358827+0000","last_change":"2024-03-30T01:51:32.820310+0000","last_active":"2024-03-30T01:51:36.358827+0000","last_peered":"2024-03-30T01:51:36.358827+0000","last_clean":"2024-03-30T01:51:36.358827+0000","last_became_active":"2024-03-30T01:51:32.819632+0000","last_became_peered":"2024-03-30T01:51:32.819632+0000","last_unstale":"2024-03-30T01:51:36.358827+0000","last_undegraded":"2024-03-30T01:51:36.358827+0000","last_fullsized":"2024-03-30T01:51:36.358827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:24:14.776848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.816543+0000","last_change":"2024-03-30T01:51:32.320300+0000","last_active":"2024-03-30T01:51:32.816543+0000","last_peered":"2024-03-30T01:51:32.816543+0000","last_clean":"2024-03-30T01:51:32.816543+0000","last_became_active":"2024-03-30T01:51:32.319459+0000","last_became_peered":"2024-03-30T01:51:32.319459+0000","last_unstale":"2024-03-30T01:51:32.816543+0000","last_undegraded":"2024-03-30T01:51:32.816543+0000","last_fullsized":"2024-03-30T01:51:32.816543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:16:10.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350739+0000","last_change":"2024-03-30T01:51:32.824724+0000","last_active":"2024-03-30T01:51:34.350739+0000","last_peered":"2024-03-30T01:51:34.350739+0000","last_clean":"2024-03-30T01:51:34.350739+0000","last_became_active":"2024-03-30T01:51:32.824435+0000","last_became_peered":"2024-03-30T01:51:32.824435+0000","last_unstale":"2024-03-30T01:51:34.350739+0000","last_undegraded":"2024-03-30T01:51:34.350739+0000","last_fullsized":"2024-03-30T01:51:34.350739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T04:10:09.271050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.830672+0000","last_change":"2024-03-30T01:51:32.324209+0000","last_active":"2024-03-30T01:51:32.830672+0000","last_peered":"2024-03-30T01:51:32.830672+0000","last_clean":"2024-03-30T01:51:32.830672+0000","last_became_active":"2024-03-30T01:51:32.323909+0000","last_became_peered":"2024-03-30T01:51:32.323909+0000","last_unstale":"2024-03-30T01:51:32.830672+0000","last_undegraded":"2024-03-30T01:51:32.830672+0000","last_fullsized":"2024-03-30T01:51:32.830672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:29:54.309497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.351210+0000","last_change":"2024-03-30T01:51:32.829602+0000","last_active":"2024-03-30T01:51:34.351210+0000","last_peered":"2024-03-30T01:51:34.351210+0000","last_clean":"2024-03-30T01:51:34.351210+0000","last_became_active":"2024-03-30T01:51:32.829279+0000","last_became_peered":"2024-03-30T01:51:32.829279+0000","last_unstale":"2024-03-30T01:51:34.351210+0000","last_undegraded":"2024-03-30T01:51:34.351210+0000","last_fullsized":"2024-03-30T01:51:34.351210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:15:59.657625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.819729+0000","last_change":"2024-03-30T01:51:32.329496+0000","last_active":"2024-03-30T01:51:32.819729+0000","last_peered":"2024-03-30T01:51:32.819729+0000","last_clean":"2024-03-30T01:51:32.819729+0000","last_became_active":"2024-03-30T01:51:32.329197+0000","last_became_peered":"2024-03-30T01:51:32.329197+0000","last_unstale":"2024-03-30T01:51:32.819729+0000","last_undegraded":"2024-03-30T01:51:32.819729+0000","last_fullsized":"2024-03-30T01:51:32.819729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.351541+0000","last_change":"2024-03-30T01:51:32.829567+0000","last_active":"2024-03-30T01:51:34.351541+0000","last_peered":"2024-03-30T01:51:34.351541+0000","last_clean":"2024-03-30T01:51:34.351541+0000","last_became_active":"2024-03-30T01:51:32.829295+0000","last_became_peered":"2024-03-30T01:51:32.829295+0000","last_unstale":"2024-03-30T01:51:34.351541+0000","last_undegraded":"2024-03-30T01:51:34.351541+0000","last_fullsized":"2024-03-30T01:51:34.351541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:50.171426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.830796+0000","last_change":"2024-03-30T01:51:32.331167+0000","last_active":"2024-03-30T01:51:32.830796+0000","last_peered":"2024-03-30T01:51:32.830796+0000","last_clean":"2024-03-30T01:51:32.830796+0000","last_became_active":"2024-03-30T01:51:32.330851+0000","last_became_peered":"2024-03-30T01:51:32.330851+0000","last_unstale":"2024-03-30T01:51:32.830796+0000","last_undegraded":"2024-03-30T01:51:32.830796+0000","last_fullsized":"2024-03-30T01:51:32.830796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:43:13.165559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792872+0000","last_change":"2024-03-30T01:51:32.806466+0000","last_active":"2024-03-30T01:51:33.792872+0000","last_peered":"2024-03-30T01:51:33.792872+0000","last_clean":"2024-03-30T01:51:33.792872+0000","last_became_active":"2024-03-30T01:51:32.800403+0000","last_became_peered":"2024-03-30T01:51:32.800403+0000","last_unstale":"2024-03-30T01:51:33.792872+0000","last_undegraded":"2024-03-30T01:51:33.792872+0000","last_fullsized":"2024-03-30T01:51:33.792872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.801178+0000","last_change":"2024-03-30T01:51:32.328539+0000","last_active":"2024-03-30T01:51:32.801178+0000","last_peered":"2024-03-30T01:51:32.801178+0000","last_clean":"2024-03-30T01:51:32.801178+0000","last_became_active":"2024-03-30T01:51:32.328066+0000","last_became_peered":"2024-03-30T01:51:32.328066+0000","last_unstale":"2024-03-30T01:51:32.801178+0000","last_undegraded":"2024-03-30T01:51:32.801178+0000","last_fullsized":"2024-03-30T01:51:32.801178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:18.328608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350589+0000","last_change":"2024-03-30T01:51:32.831571+0000","last_active":"2024-03-30T01:51:34.350589+0000","last_peered":"2024-03-30T01:51:34.350589+0000","last_clean":"2024-03-30T01:51:34.350589+0000","last_became_active":"2024-03-30T01:51:32.830419+0000","last_became_peered":"2024-03-30T01:51:32.830419+0000","last_unstale":"2024-03-30T01:51:34.350589+0000","last_undegraded":"2024-03-30T01:51:34.350589+0000","last_fullsized":"2024-03-30T01:51:34.350589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:43:58.638314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.804265+0000","last_change":"2024-03-30T01:51:23.358245+0000","last_active":"2024-03-30T01:51:32.804265+0000","last_peered":"2024-03-30T01:51:32.804265+0000","last_clean":"2024-03-30T01:51:32.804265+0000","last_became_active":"2024-03-30T01:51:23.355914+0000","last_became_peered":"2024-03-30T01:51:23.355914+0000","last_unstale":"2024-03-30T01:51:32.804265+0000","last_undegraded":"2024-03-30T01:51:32.804265+0000","last_fullsized":"2024-03-30T01:51:32.804265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_clean_scrub_stamp":"2024-03-30T01:51:21.990253+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:21:19.291194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.789893+0000","last_change":"2024-03-30T01:51:32.328546+0000","last_active":"2024-03-30T01:51:32.789893+0000","last_peered":"2024-03-30T01:51:32.789893+0000","last_clean":"2024-03-30T01:51:32.789893+0000","last_became_active":"2024-03-30T01:51:32.328108+0000","last_became_peered":"2024-03-30T01:51:32.328108+0000","last_unstale":"2024-03-30T01:51:32.789893+0000","last_undegraded":"2024-03-30T01:51:32.789893+0000","last_fullsized":"2024-03-30T01:51:32.789893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356791+0000","last_change":"2024-03-30T01:51:32.817812+0000","last_active":"2024-03-30T01:51:36.356791+0000","last_peered":"2024-03-30T01:51:36.356791+0000","last_clean":"2024-03-30T01:51:36.356791+0000","last_became_active":"2024-03-30T01:51:32.816217+0000","last_became_peered":"2024-03-30T01:51:32.816217+0000","last_unstale":"2024-03-30T01:51:36.356791+0000","last_undegraded":"2024-03-30T01:51:36.356791+0000","last_fullsized":"2024-03-30T01:51:36.356791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.804176+0000","last_change":"2024-03-30T01:51:32.340288+0000","last_active":"2024-03-30T01:51:32.804176+0000","last_peered":"2024-03-30T01:51:32.804176+0000","last_clean":"2024-03-30T01:51:32.804176+0000","last_became_active":"2024-03-30T01:51:32.339870+0000","last_became_peered":"2024-03-30T01:51:32.339870+0000","last_unstale":"2024-03-30T01:51:32.804176+0000","last_undegraded":"2024-03-30T01:51:32.804176+0000","last_fullsized":"2024-03-30T01:51:32.804176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:28.389656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951417+0000","last_change":"2024-03-30T01:51:32.795840+0000","last_active":"2024-03-30T01:51:33.951417+0000","last_peered":"2024-03-30T01:51:33.951417+0000","last_clean":"2024-03-30T01:51:33.951417+0000","last_became_active":"2024-03-30T01:51:32.795458+0000","last_became_peered":"2024-03-30T01:51:32.795458+0000","last_unstale":"2024-03-30T01:51:33.951417+0000","last_undegraded":"2024-03-30T01:51:33.951417+0000","last_fullsized":"2024-03-30T01:51:33.951417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:24:14.776848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.798439+0000","last_change":"2024-03-30T01:51:32.332992+0000","last_active":"2024-03-30T01:51:32.798439+0000","last_peered":"2024-03-30T01:51:32.798439+0000","last_clean":"2024-03-30T01:51:32.798439+0000","last_became_active":"2024-03-30T01:51:32.332735+0000","last_became_peered":"2024-03-30T01:51:32.332735+0000","last_unstale":"2024-03-30T01:51:32.798439+0000","last_undegraded":"2024-03-30T01:51:32.798439+0000","last_fullsized":"2024-03-30T01:51:32.798439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:49:06.802141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791299+0000","last_change":"2024-03-30T01:51:32.812474+0000","last_active":"2024-03-30T01:51:33.791299+0000","last_peered":"2024-03-30T01:51:33.791299+0000","last_clean":"2024-03-30T01:51:33.791299+0000","last_became_active":"2024-03-30T01:51:32.812149+0000","last_became_peered":"2024-03-30T01:51:32.812149+0000","last_unstale":"2024-03-30T01:51:33.791299+0000","last_undegraded":"2024-03-30T01:51:33.791299+0000","last_fullsized":"2024-03-30T01:51:33.791299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:48.498455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.794770+0000","last_change":"2024-03-30T01:51:32.331651+0000","last_active":"2024-03-30T01:51:32.794770+0000","last_peered":"2024-03-30T01:51:32.794770+0000","last_clean":"2024-03-30T01:51:32.794770+0000","last_became_active":"2024-03-30T01:51:32.331150+0000","last_became_peered":"2024-03-30T01:51:32.331150+0000","last_unstale":"2024-03-30T01:51:32.794770+0000","last_undegraded":"2024-03-30T01:51:32.794770+0000","last_fullsized":"2024-03-30T01:51:32.794770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794329+0000","last_change":"2024-03-30T01:51:32.808411+0000","last_active":"2024-03-30T01:51:33.794329+0000","last_peered":"2024-03-30T01:51:33.794329+0000","last_clean":"2024-03-30T01:51:33.794329+0000","last_became_active":"2024-03-30T01:51:32.807032+0000","last_became_peered":"2024-03-30T01:51:32.807032+0000","last_unstale":"2024-03-30T01:51:33.794329+0000","last_undegraded":"2024-03-30T01:51:33.794329+0000","last_fullsized":"2024-03-30T01:51:33.794329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:43:14.180564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.805618+0000","last_change":"2024-03-30T01:51:32.332641+0000","last_active":"2024-03-30T01:51:32.805618+0000","last_peered":"2024-03-30T01:51:32.805618+0000","last_clean":"2024-03-30T01:51:32.805618+0000","last_became_active":"2024-03-30T01:51:32.332372+0000","last_became_peered":"2024-03-30T01:51:32.332372+0000","last_unstale":"2024-03-30T01:51:32.805618+0000","last_undegraded":"2024-03-30T01:51:32.805618+0000","last_fullsized":"2024-03-30T01:51:32.805618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:16.099108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793089+0000","last_change":"2024-03-30T01:51:32.801706+0000","last_active":"2024-03-30T01:51:33.793089+0000","last_peered":"2024-03-30T01:51:33.793089+0000","last_clean":"2024-03-30T01:51:33.793089+0000","last_became_active":"2024-03-30T01:51:32.799681+0000","last_became_peered":"2024-03-30T01:51:32.799681+0000","last_unstale":"2024-03-30T01:51:33.793089+0000","last_undegraded":"2024-03-30T01:51:33.793089+0000","last_fullsized":"2024-03-30T01:51:33.793089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:26:47.924608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.811947+0000","last_change":"2024-03-30T01:51:32.340251+0000","last_active":"2024-03-30T01:51:32.811947+0000","last_peered":"2024-03-30T01:51:32.811947+0000","last_clean":"2024-03-30T01:51:32.811947+0000","last_became_active":"2024-03-30T01:51:32.339947+0000","last_became_peered":"2024-03-30T01:51:32.339947+0000","last_unstale":"2024-03-30T01:51:32.811947+0000","last_undegraded":"2024-03-30T01:51:32.811947+0000","last_fullsized":"2024-03-30T01:51:32.811947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:16:47.699775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791546+0000","last_change":"2024-03-30T01:51:32.806047+0000","last_active":"2024-03-30T01:51:33.791546+0000","last_peered":"2024-03-30T01:51:33.791546+0000","last_clean":"2024-03-30T01:51:33.791546+0000","last_became_active":"2024-03-30T01:51:32.805805+0000","last_became_peered":"2024-03-30T01:51:32.805805+0000","last_unstale":"2024-03-30T01:51:33.791546+0000","last_undegraded":"2024-03-30T01:51:33.791546+0000","last_fullsized":"2024-03-30T01:51:33.791546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:13:08.942873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791935+0000","last_change":"2024-03-30T01:51:32.342956+0000","last_active":"2024-03-30T01:51:33.791935+0000","last_peered":"2024-03-30T01:51:33.791935+0000","last_clean":"2024-03-30T01:51:33.791935+0000","last_became_active":"2024-03-30T01:51:32.342396+0000","last_became_peered":"2024-03-30T01:51:32.342396+0000","last_unstale":"2024-03-30T01:51:33.791935+0000","last_undegraded":"2024-03-30T01:51:33.791935+0000","last_fullsized":"2024-03-30T01:51:33.791935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:28.389656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357308+0000","last_change":"2024-03-30T01:51:32.821007+0000","last_active":"2024-03-30T01:51:36.357308+0000","last_peered":"2024-03-30T01:51:36.357308+0000","last_clean":"2024-03-30T01:51:36.357308+0000","last_became_active":"2024-03-30T01:51:32.820784+0000","last_became_peered":"2024-03-30T01:51:32.820784+0000","last_unstale":"2024-03-30T01:51:36.357308+0000","last_undegraded":"2024-03-30T01:51:36.357308+0000","last_fullsized":"2024-03-30T01:51:36.357308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:26:47.924608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.830948+0000","last_change":"2024-03-30T01:51:32.340196+0000","last_active":"2024-03-30T01:51:32.830948+0000","last_peered":"2024-03-30T01:51:32.830948+0000","last_clean":"2024-03-30T01:51:32.830948+0000","last_became_active":"2024-03-30T01:51:32.338419+0000","last_became_peered":"2024-03-30T01:51:32.338419+0000","last_unstale":"2024-03-30T01:51:32.830948+0000","last_undegraded":"2024-03-30T01:51:32.830948+0000","last_fullsized":"2024-03-30T01:51:32.830948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951714+0000","last_change":"2024-03-30T01:51:32.814179+0000","last_active":"2024-03-30T01:51:33.951714+0000","last_peered":"2024-03-30T01:51:33.951714+0000","last_clean":"2024-03-30T01:51:33.951714+0000","last_became_active":"2024-03-30T01:51:32.813873+0000","last_became_peered":"2024-03-30T01:51:32.813873+0000","last_unstale":"2024-03-30T01:51:33.951714+0000","last_undegraded":"2024-03-30T01:51:33.951714+0000","last_fullsized":"2024-03-30T01:51:33.951714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:13:08.942873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.804043+0000","last_change":"2024-03-30T01:51:32.339346+0000","last_active":"2024-03-30T01:51:32.804043+0000","last_peered":"2024-03-30T01:51:32.804043+0000","last_clean":"2024-03-30T01:51:32.804043+0000","last_became_active":"2024-03-30T01:51:32.339038+0000","last_became_peered":"2024-03-30T01:51:32.339038+0000","last_unstale":"2024-03-30T01:51:32.804043+0000","last_undegraded":"2024-03-30T01:51:32.804043+0000","last_fullsized":"2024-03-30T01:51:32.804043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793437+0000","last_change":"2024-03-30T01:51:32.803943+0000","last_active":"2024-03-30T01:51:33.793437+0000","last_peered":"2024-03-30T01:51:33.793437+0000","last_clean":"2024-03-30T01:51:33.793437+0000","last_became_active":"2024-03-30T01:51:32.802118+0000","last_became_peered":"2024-03-30T01:51:32.802118+0000","last_unstale":"2024-03-30T01:51:33.793437+0000","last_undegraded":"2024-03-30T01:51:33.793437+0000","last_fullsized":"2024-03-30T01:51:33.793437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:17.114113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.804568+0000","last_change":"2024-03-30T01:51:32.336889+0000","last_active":"2024-03-30T01:51:32.804568+0000","last_peered":"2024-03-30T01:51:32.804568+0000","last_clean":"2024-03-30T01:51:32.804568+0000","last_became_active":"2024-03-30T01:51:32.336560+0000","last_became_peered":"2024-03-30T01:51:32.336560+0000","last_unstale":"2024-03-30T01:51:32.804568+0000","last_undegraded":"2024-03-30T01:51:32.804568+0000","last_fullsized":"2024-03-30T01:51:32.804568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356993+0000","last_change":"2024-03-30T01:51:32.816142+0000","last_active":"2024-03-30T01:51:36.356993+0000","last_peered":"2024-03-30T01:51:36.356993+0000","last_clean":"2024-03-30T01:51:36.356993+0000","last_became_active":"2024-03-30T01:51:32.814782+0000","last_became_peered":"2024-03-30T01:51:32.814782+0000","last_unstale":"2024-03-30T01:51:36.356993+0000","last_undegraded":"2024-03-30T01:51:36.356993+0000","last_fullsized":"2024-03-30T01:51:36.356993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:13:08.942873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.805047+0000","last_change":"2024-03-30T01:51:32.334063+0000","last_active":"2024-03-30T01:51:32.805047+0000","last_peered":"2024-03-30T01:51:32.805047+0000","last_clean":"2024-03-30T01:51:32.805047+0000","last_became_active":"2024-03-30T01:51:32.332760+0000","last_became_peered":"2024-03-30T01:51:32.332760+0000","last_unstale":"2024-03-30T01:51:32.805047+0000","last_undegraded":"2024-03-30T01:51:32.805047+0000","last_fullsized":"2024-03-30T01:51:32.805047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357089+0000","last_change":"2024-03-30T01:51:32.808609+0000","last_active":"2024-03-30T01:51:36.357089+0000","last_peered":"2024-03-30T01:51:36.357089+0000","last_clean":"2024-03-30T01:51:36.357089+0000","last_became_active":"2024-03-30T01:51:32.803595+0000","last_became_peered":"2024-03-30T01:51:32.803595+0000","last_unstale":"2024-03-30T01:51:36.357089+0000","last_undegraded":"2024-03-30T01:51:36.357089+0000","last_fullsized":"2024-03-30T01:51:36.357089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:31:32.555378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.832173+0000","last_change":"2024-03-30T01:51:32.340790+0000","last_active":"2024-03-30T01:51:32.832173+0000","last_peered":"2024-03-30T01:51:32.832173+0000","last_clean":"2024-03-30T01:51:32.832173+0000","last_became_active":"2024-03-30T01:51:32.340490+0000","last_became_peered":"2024-03-30T01:51:32.340490+0000","last_unstale":"2024-03-30T01:51:32.832173+0000","last_undegraded":"2024-03-30T01:51:32.832173+0000","last_fullsized":"2024-03-30T01:51:32.832173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:30:14.002651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359197+0000","last_change":"2024-03-30T01:51:32.827543+0000","last_active":"2024-03-30T01:51:36.359197+0000","last_peered":"2024-03-30T01:51:36.359197+0000","last_clean":"2024-03-30T01:51:36.359197+0000","last_became_active":"2024-03-30T01:51:32.827208+0000","last_became_peered":"2024-03-30T01:51:32.827208+0000","last_unstale":"2024-03-30T01:51:36.359197+0000","last_undegraded":"2024-03-30T01:51:36.359197+0000","last_fullsized":"2024-03-30T01:51:36.359197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:56:56.891377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792948+0000","last_change":"2024-03-30T01:51:32.796699+0000","last_active":"2024-03-30T01:51:33.792948+0000","last_peered":"2024-03-30T01:51:33.792948+0000","last_clean":"2024-03-30T01:51:33.792948+0000","last_became_active":"2024-03-30T01:51:32.796427+0000","last_became_peered":"2024-03-30T01:51:32.796427+0000","last_unstale":"2024-03-30T01:51:33.792948+0000","last_undegraded":"2024-03-30T01:51:33.792948+0000","last_fullsized":"2024-03-30T01:51:33.792948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:48:32.312063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.831028+0000","last_change":"2024-03-30T01:51:32.340270+0000","last_active":"2024-03-30T01:51:32.831028+0000","last_peered":"2024-03-30T01:51:32.831028+0000","last_clean":"2024-03-30T01:51:32.831028+0000","last_became_active":"2024-03-30T01:51:32.339869+0000","last_became_peered":"2024-03-30T01:51:32.339869+0000","last_unstale":"2024-03-30T01:51:32.831028+0000","last_undegraded":"2024-03-30T01:51:32.831028+0000","last_fullsized":"2024-03-30T01:51:32.831028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792626+0000","last_change":"2024-03-30T01:51:32.806687+0000","last_active":"2024-03-30T01:51:33.792626+0000","last_peered":"2024-03-30T01:51:33.792626+0000","last_clean":"2024-03-30T01:51:33.792626+0000","last_became_active":"2024-03-30T01:51:32.806461+0000","last_became_peered":"2024-03-30T01:51:32.806461+0000","last_unstale":"2024-03-30T01:51:33.792626+0000","last_undegraded":"2024-03-30T01:51:33.792626+0000","last_fullsized":"2024-03-30T01:51:33.792626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:15:59.657625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.833260+0000","last_change":"2024-03-30T01:51:32.343222+0000","last_active":"2024-03-30T01:51:32.833260+0000","last_peered":"2024-03-30T01:51:32.833260+0000","last_clean":"2024-03-30T01:51:32.833260+0000","last_became_active":"2024-03-30T01:51:32.342933+0000","last_became_peered":"2024-03-30T01:51:32.342933+0000","last_unstale":"2024-03-30T01:51:32.833260+0000","last_undegraded":"2024-03-30T01:51:32.833260+0000","last_fullsized":"2024-03-30T01:51:32.833260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:42:26.214040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.952250+0000","last_change":"2024-03-30T01:51:32.798373+0000","last_active":"2024-03-30T01:51:33.952250+0000","last_peered":"2024-03-30T01:51:33.952250+0000","last_clean":"2024-03-30T01:51:33.952250+0000","last_became_active":"2024-03-30T01:51:32.798184+0000","last_became_peered":"2024-03-30T01:51:32.798184+0000","last_unstale":"2024-03-30T01:51:33.952250+0000","last_undegraded":"2024-03-30T01:51:33.952250+0000","last_fullsized":"2024-03-30T01:51:33.952250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:12:19.249116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.826599+0000","last_change":"2024-03-30T01:51:32.336950+0000","last_active":"2024-03-30T01:51:32.826599+0000","last_peered":"2024-03-30T01:51:32.826599+0000","last_clean":"2024-03-30T01:51:32.826599+0000","last_became_active":"2024-03-30T01:51:32.336685+0000","last_became_peered":"2024-03-30T01:51:32.336685+0000","last_unstale":"2024-03-30T01:51:32.826599+0000","last_undegraded":"2024-03-30T01:51:32.826599+0000","last_fullsized":"2024-03-30T01:51:32.826599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:18.328608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357072+0000","last_change":"2024-03-30T01:51:32.818072+0000","last_active":"2024-03-30T01:51:36.357072+0000","last_peered":"2024-03-30T01:51:36.357072+0000","last_clean":"2024-03-30T01:51:36.357072+0000","last_became_active":"2024-03-30T01:51:32.816795+0000","last_became_peered":"2024-03-30T01:51:32.816795+0000","last_unstale":"2024-03-30T01:51:36.357072+0000","last_undegraded":"2024-03-30T01:51:36.357072+0000","last_fullsized":"2024-03-30T01:51:36.357072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:16:38.980879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.834008+0000","last_change":"2024-03-30T01:51:32.336309+0000","last_active":"2024-03-30T01:51:32.834008+0000","last_peered":"2024-03-30T01:51:32.834008+0000","last_clean":"2024-03-30T01:51:32.834008+0000","last_became_active":"2024-03-30T01:51:32.335769+0000","last_became_peered":"2024-03-30T01:51:32.335769+0000","last_unstale":"2024-03-30T01:51:32.834008+0000","last_undegraded":"2024-03-30T01:51:32.834008+0000","last_fullsized":"2024-03-30T01:51:32.834008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T07:39:05.794505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4650000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.589}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.375}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.47}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5169999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1070000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3250000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1280000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":69879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5609999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4810000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8540000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":660885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T01:51:47.660 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T01:51:47.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.894+0000 7f14c9600640 1 Processor -- start 2024-03-30T01:51:47.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.894+0000 7f14c9600640 1 -- start start 2024-03-30T01:51:47.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.896+0000 7f14c9600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f14c406e2e0 0x7f14c4070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:47.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.896+0000 7f14c9600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14c4070a40 0x7f14c415d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:47.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.896+0000 7f14c9600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c4070e90 con 0x7f14c4143220 2024-03-30T01:51:47.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.896+0000 7f14c9600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c40cc5c0 con 0x7f14c406e2e0 2024-03-30T01:51:47.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.896+0000 7f14c9600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c40ce400 con 0x7f14c4070a40 2024-03-30T01:51:47.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.896+0000 7f14c2a00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f14c4143220 0x7f14c40cd990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48798/0 (socket says 172.21.15.133:48798) 2024-03-30T01:51:47.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.896+0000 7f14c2a00640 1 -- 172.21.15.133:0/1609214067 learned_addr learned my addr 172.21.15.133:0/1609214067 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:47.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.896+0000 7f14c3400640 1 --2- 172.21.15.133:0/1609214067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14c4070a40 0x7f14c415d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:47.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.897+0000 7f14c2000640 1 --2- 172.21.15.133:0/1609214067 >> v2:172.21.15.137:3300/0 conn(0x7f14c406e2e0 0x7f14c4070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:47.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.897+0000 7f14c1600640 1 -- 172.21.15.133:0/1609214067 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326737585 0 0) 0x7f14b4001110 con 0x7f14c4143220 2024-03-30T01:51:47.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.897+0000 7f14c1600640 1 -- 172.21.15.133:0/1609214067 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14a8003520 con 0x7f14c4143220 2024-03-30T01:51:47.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.897+0000 7f14c1600640 1 -- 172.21.15.133:0/1609214067 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2849435154 0 0) 0x7f14a8003520 con 0x7f14c4143220 2024-03-30T01:51:47.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.897+0000 7f14c1600640 1 -- 172.21.15.133:0/1609214067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14c4070a40 msgr2=0x7f14c415d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:47.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.897+0000 7f14c1600640 1 --2- 172.21.15.133:0/1609214067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14c4070a40 0x7f14c415d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.897+0000 7f14c1600640 1 -- 172.21.15.133:0/1609214067 >> v2:172.21.15.137:3300/0 conn(0x7f14c406e2e0 msgr2=0x7f14c4070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:47.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.897+0000 7f14c1600640 1 --2- 172.21.15.133:0/1609214067 >> v2:172.21.15.137:3300/0 conn(0x7f14c406e2e0 0x7f14c4070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.897+0000 7f14c1600640 1 -- 172.21.15.133:0/1609214067 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c406d0e0 con 0x7f14c4143220 2024-03-30T01:51:47.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.897+0000 7f14c1600640 1 -- 172.21.15.133:0/1609214067 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f14b4001800 con 0x7f14c4143220 2024-03-30T01:51:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.897+0000 7f14c3400640 1 --2- 172.21.15.133:0/1609214067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14c4070a40 0x7f14c415d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T01:51:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.897+0000 7f14c1600640 1 -- 172.21.15.133:0/1609214067 >> v1:172.21.15.133:6789/0 conn(0x7f14c4143220 legacy=0x7f14c40cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.897+0000 7f14c1600640 1 --2- 172.21.15.133:0/1609214067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14c4070a40 0x7f14a8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.897+0000 7f14c1600640 1 --2- 172.21.15.133:0/1609214067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14a8003eb0 0x7f14a80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.897+0000 7f14c1600640 1 --2- 172.21.15.133:0/1609214067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14a8004d00 0x7f14a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.897+0000 7f14c1600640 1 -- 172.21.15.133:0/1609214067 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c40ce400 con 0x7f14a8004d00 2024-03-30T01:51:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.897+0000 7f14c1600640 1 -- 172.21.15.133:0/1609214067 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a800b980 con 0x7f14a8003eb0 2024-03-30T01:51:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.897+0000 7f14c1600640 1 -- 172.21.15.133:0/1609214067 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a800bac0 con 0x7f14c4070a40 2024-03-30T01:51:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.898+0000 7f14c3400640 1 --2- 172.21.15.133:0/1609214067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14a8004d00 0x7f14a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.898+0000 7f14c2000640 1 --2- 172.21.15.133:0/1609214067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14a8003eb0 0x7f14a80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.898+0000 7f14c2a00640 1 --2- 172.21.15.133:0/1609214067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14c4070a40 0x7f14a8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.898+0000 7f14c3400640 1 -- 172.21.15.133:0/1609214067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14c4070a40 msgr2=0x7f14a8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.898+0000 7f14c3400640 1 --2- 172.21.15.133:0/1609214067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14c4070a40 0x7f14a8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.898+0000 7f14c3400640 1 -- 172.21.15.133:0/1609214067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14a8003eb0 msgr2=0x7f14a80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:47.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.898+0000 7f14c3400640 1 --2- 172.21.15.133:0/1609214067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14a8003eb0 0x7f14a80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.898+0000 7f14c3400640 1 -- 172.21.15.133:0/1609214067 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc009a70 con 0x7f14a8004d00 2024-03-30T01:51:47.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.898+0000 7f14c2000640 1 --2- 172.21.15.133:0/1609214067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14a8003eb0 0x7f14a80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:51:47.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.899+0000 7f14c3400640 1 --2- 172.21.15.133:0/1609214067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14a8004d00 0x7f14a8005180 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f14bc00e350 tx=0x7f14a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef26e4ca088ced9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:47.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.899+0000 7f14c1600640 1 -- 172.21.15.133:0/1609214067 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc02cd70 con 0x7f14a8004d00 2024-03-30T01:51:47.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.899+0000 7f14c1600640 1 -- 172.21.15.133:0/1609214067 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14bc00f040 con 0x7f14a8004d00 2024-03-30T01:51:47.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.899+0000 7f14c1600640 1 -- 172.21.15.133:0/1609214067 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc034640 con 0x7f14a8004d00 2024-03-30T01:51:47.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.900+0000 7f14c9600640 1 -- 172.21.15.133:0/1609214067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14a8004d00 msgr2=0x7f14a8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.900+0000 7f14c9600640 1 --2- 172.21.15.133:0/1609214067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14a8004d00 0x7f14a8005180 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f14bc00e350 tx=0x7f14a80057f0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.900+0000 7f14c3400640 1 -- 172.21.15.133:0/1609214067 reap_dead start 2024-03-30T01:51:47.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.900+0000 7f14c9600640 1 -- 172.21.15.133:0/1609214067 shutdown_connections 2024-03-30T01:51:47.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.900+0000 7f14c9600640 1 -- 172.21.15.133:0/1609214067 >> 172.21.15.133:0/1609214067 conn(0x7f14c40b07a0 msgr2=0x7f14c40b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:47.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.900+0000 7f14c9600640 1 -- 172.21.15.133:0/1609214067 shutdown_connections 2024-03-30T01:51:47.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.900+0000 7f14c9600640 1 -- 172.21.15.133:0/1609214067 wait complete. 2024-03-30T01:51:47.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.902+0000 7f14c9600640 1 Processor -- start 2024-03-30T01:51:47.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.902+0000 7f14c9600640 1 -- start start 2024-03-30T01:51:47.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.903+0000 7f14c9600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14a8004d00 0x7f14c4133c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:47.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.903+0000 7f14c9600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14c41565d0 0x7f14c4158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:47.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.903+0000 7f14c9600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14c4159500 0x7f14c4138d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:47.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.903+0000 7f14c9600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c414f8d0 con 0x7f14c41565d0 2024-03-30T01:51:47.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.903+0000 7f14c9600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c414f000 con 0x7f14a8004d00 2024-03-30T01:51:47.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.903+0000 7f14c9600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c4134140 con 0x7f14c4159500 2024-03-30T01:51:47.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.903+0000 7f14c2000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14c41565d0 0x7f14c4158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:47.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.903+0000 7f14c2000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14c41565d0 0x7f14c4158fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60354/0 (socket says 172.21.15.133:60354) 2024-03-30T01:51:47.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.903+0000 7f14c2000640 1 -- 172.21.15.133:0/43511384 learned_addr learned my addr 172.21.15.133:0/43511384 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:47.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.903+0000 7f14c2a00640 1 --2- 172.21.15.133:0/43511384 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14a8004d00 0x7f14c4133c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:47.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.903+0000 7f14c3400640 1 --2- 172.21.15.133:0/43511384 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14c4159500 0x7f14c4138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:47.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.903+0000 7f14c2000640 1 -- 172.21.15.133:0/43511384 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14c4159500 msgr2=0x7f14c4138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.903+0000 7f14c2000640 1 --2- 172.21.15.133:0/43511384 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14c4159500 0x7f14c4138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.903+0000 7f14c2000640 1 -- 172.21.15.133:0/43511384 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14a8004d00 msgr2=0x7f14c4133c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:47.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.903+0000 7f14c2000640 1 --2- 172.21.15.133:0/43511384 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14a8004d00 0x7f14c4133c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:47.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.903+0000 7f14c2000640 1 -- 172.21.15.133:0/43511384 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c40b2d80 con 0x7f14c41565d0 2024-03-30T01:51:47.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.903+0000 7f14c2000640 1 --2- 172.21.15.133:0/43511384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14c41565d0 0x7f14c4158fc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f14b00115d0 tx=0x7f14b0011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:47.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.904+0000 7f14baa00640 1 -- 172.21.15.133:0/43511384 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b000f8f0 con 0x7f14c41565d0 2024-03-30T01:51:47.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.904+0000 7f14baa00640 1 -- 172.21.15.133:0/43511384 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b000fa50 con 0x7f14c41565d0 2024-03-30T01:51:47.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.904+0000 7f14baa00640 1 -- 172.21.15.133:0/43511384 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b000fde0 con 0x7f14c41565d0 2024-03-30T01:51:47.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.904+0000 7f14c9600640 1 -- 172.21.15.133:0/43511384 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c414f210 con 0x7f14c41565d0 2024-03-30T01:51:47.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.904+0000 7f14c9600640 1 -- 172.21.15.133:0/43511384 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c415a700 con 0x7f14c41565d0 2024-03-30T01:51:47.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.905+0000 7f14c9600640 1 -- 172.21.15.133:0/43511384 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c40ccfb0 con 0x7f14c41565d0 2024-03-30T01:51:47.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.906+0000 7f14baa00640 1 -- 172.21.15.133:0/43511384 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f14b0015460 con 0x7f14c41565d0 2024-03-30T01:51:47.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.907+0000 7f14baa00640 1 --2- 172.21.15.133:0/43511384 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f14a406ac30 0x7f14a406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:47.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.907+0000 7f14baa00640 1 -- 172.21.15.133:0/43511384 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14b0089c50 con 0x7f14c41565d0 2024-03-30T01:51:47.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.907+0000 7f14c2a00640 1 --2- 172.21.15.133:0/43511384 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f14a406ac30 0x7f14a406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:47.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.908+0000 7f14c2a00640 1 --2- 172.21.15.133:0/43511384 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f14a406ac30 0x7f14a406d0f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f14b4001eb0 tx=0x7f14b4000ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:47.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:47.911+0000 7f14baa00640 1 -- 172.21.15.133:0/43511384 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f14b0054d90 con 0x7f14c41565d0 2024-03-30T01:51:48.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.089+0000 7f14c9600640 1 -- 172.21.15.133:0/43511384 --> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f14c4143600 con 0x7f14a406ac30 2024-03-30T01:51:48.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.109+0000 7f14baa00640 1 -- 172.21.15.133:0/43511384 <== mgr.4105 v2:172.21.15.133:6832/37234 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264409 (secure 0 0 0) 0x7f14b4001780 con 0x7f14a406ac30 2024-03-30T01:51:48.119 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:48.120 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-03-30T01:51:48.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.113+0000 7f14c9600640 1 -- 172.21.15.133:0/43511384 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f14a406ac30 msgr2=0x7f14a406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:48.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.113+0000 7f14c9600640 1 --2- 172.21.15.133:0/43511384 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f14a406ac30 0x7f14a406d0f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f14b4001eb0 tx=0x7f14b4000ed0 comp rx=0 tx=0).stop 2024-03-30T01:51:48.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.114+0000 7f14c9600640 1 -- 172.21.15.133:0/43511384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14c41565d0 msgr2=0x7f14c4158fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:48.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.114+0000 7f14c9600640 1 --2- 172.21.15.133:0/43511384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14c41565d0 0x7f14c4158fc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f14b00115d0 tx=0x7f14b0011a90 comp rx=0 tx=0).stop 2024-03-30T01:51:48.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.114+0000 7f14c9600640 1 -- 172.21.15.133:0/43511384 shutdown_connections 2024-03-30T01:51:48.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.114+0000 7f14c9600640 1 --2- 172.21.15.133:0/43511384 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f14a406ac30 0x7f14a406d0f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:48.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.114+0000 7f14c9600640 1 --2- 172.21.15.133:0/43511384 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14c4159500 0x7f14c4138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:48.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.114+0000 7f14c9600640 1 --2- 172.21.15.133:0/43511384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14c41565d0 0x7f14c4158fc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:48.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.114+0000 7f14c9600640 1 --2- 172.21.15.133:0/43511384 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14a8004d00 0x7f14c4133c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:48.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.114+0000 7f14c9600640 1 -- 172.21.15.133:0/43511384 >> 172.21.15.133:0/43511384 conn(0x7f14c40b07a0 msgr2=0x7f14c415ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:48.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.114+0000 7f14c9600640 1 -- 172.21.15.133:0/43511384 shutdown_connections 2024-03-30T01:51:48.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.114+0000 7f14c9600640 1 -- 172.21.15.133:0/43511384 wait complete. 2024-03-30T01:51:48.138 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-03-30T01:51:47.701756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218976,"kb_used_data":2816,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755744,"statfs":{"total":773094113280,"available":772869881856,"internally_reserved":0,"allocated":2883584,"data_stored":1750606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004364"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.351409+0000","last_change":"2024-03-30T01:51:32.812760+0000","last_active":"2024-03-30T01:51:34.351409+0000","last_peered":"2024-03-30T01:51:34.351409+0000","last_clean":"2024-03-30T01:51:34.351409+0000","last_became_active":"2024-03-30T01:51:32.812445+0000","last_became_peered":"2024-03-30T01:51:32.812445+0000","last_unstale":"2024-03-30T01:51:34.351409+0000","last_undegraded":"2024-03-30T01:51:34.351409+0000","last_fullsized":"2024-03-30T01:51:34.351409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:43.327711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791881+0000","last_change":"2024-03-30T01:51:32.811824+0000","last_active":"2024-03-30T01:51:33.791881+0000","last_peered":"2024-03-30T01:51:33.791881+0000","last_clean":"2024-03-30T01:51:33.791881+0000","last_became_active":"2024-03-30T01:51:32.811515+0000","last_became_peered":"2024-03-30T01:51:32.811515+0000","last_unstale":"2024-03-30T01:51:33.791881+0000","last_undegraded":"2024-03-30T01:51:33.791881+0000","last_fullsized":"2024-03-30T01:51:33.791881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951932+0000","last_change":"2024-03-30T01:51:32.799724+0000","last_active":"2024-03-30T01:51:33.951932+0000","last_peered":"2024-03-30T01:51:33.951932+0000","last_clean":"2024-03-30T01:51:33.951932+0000","last_became_active":"2024-03-30T01:51:32.799212+0000","last_became_peered":"2024-03-30T01:51:32.799212+0000","last_unstale":"2024-03-30T01:51:33.951932+0000","last_undegraded":"2024-03-30T01:51:33.951932+0000","last_fullsized":"2024-03-30T01:51:33.951932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:56:56.891377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792368+0000","last_change":"2024-03-30T01:51:32.806655+0000","last_active":"2024-03-30T01:51:33.792368+0000","last_peered":"2024-03-30T01:51:33.792368+0000","last_clean":"2024-03-30T01:51:33.792368+0000","last_became_active":"2024-03-30T01:51:32.806055+0000","last_became_peered":"2024-03-30T01:51:32.806055+0000","last_unstale":"2024-03-30T01:51:33.792368+0000","last_undegraded":"2024-03-30T01:51:33.792368+0000","last_fullsized":"2024-03-30T01:51:33.792368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:16:38.980879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350701+0000","last_change":"2024-03-30T01:51:32.820075+0000","last_active":"2024-03-30T01:51:34.350701+0000","last_peered":"2024-03-30T01:51:34.350701+0000","last_clean":"2024-03-30T01:51:34.350701+0000","last_became_active":"2024-03-30T01:51:32.819814+0000","last_became_peered":"2024-03-30T01:51:32.819814+0000","last_unstale":"2024-03-30T01:51:34.350701+0000","last_undegraded":"2024-03-30T01:51:34.350701+0000","last_fullsized":"2024-03-30T01:51:34.350701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:38:15.645425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793528+0000","last_change":"2024-03-30T01:51:32.803089+0000","last_active":"2024-03-30T01:51:33.793528+0000","last_peered":"2024-03-30T01:51:33.793528+0000","last_clean":"2024-03-30T01:51:33.793528+0000","last_became_active":"2024-03-30T01:51:32.802757+0000","last_became_peered":"2024-03-30T01:51:32.802757+0000","last_unstale":"2024-03-30T01:51:33.793528+0000","last_undegraded":"2024-03-30T01:51:33.793528+0000","last_fullsized":"2024-03-30T01:51:33.793528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:38:15.645425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350340+0000","last_change":"2024-03-30T01:51:32.818444+0000","last_active":"2024-03-30T01:51:34.350340+0000","last_peered":"2024-03-30T01:51:34.350340+0000","last_clean":"2024-03-30T01:51:34.350340+0000","last_became_active":"2024-03-30T01:51:32.818124+0000","last_became_peered":"2024-03-30T01:51:32.818124+0000","last_unstale":"2024-03-30T01:51:34.350340+0000","last_undegraded":"2024-03-30T01:51:34.350340+0000","last_fullsized":"2024-03-30T01:51:34.350340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:13:11.318115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357046+0000","last_change":"2024-03-30T01:51:32.821461+0000","last_active":"2024-03-30T01:51:36.357046+0000","last_peered":"2024-03-30T01:51:36.357046+0000","last_clean":"2024-03-30T01:51:36.357046+0000","last_became_active":"2024-03-30T01:51:32.821281+0000","last_became_peered":"2024-03-30T01:51:32.821281+0000","last_unstale":"2024-03-30T01:51:36.357046+0000","last_undegraded":"2024-03-30T01:51:36.357046+0000","last_fullsized":"2024-03-30T01:51:36.357046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.351614+0000","last_change":"2024-03-30T01:51:32.829942+0000","last_active":"2024-03-30T01:51:34.351614+0000","last_peered":"2024-03-30T01:51:34.351614+0000","last_clean":"2024-03-30T01:51:34.351614+0000","last_became_active":"2024-03-30T01:51:32.829594+0000","last_became_peered":"2024-03-30T01:51:32.829594+0000","last_unstale":"2024-03-30T01:51:34.351614+0000","last_undegraded":"2024-03-30T01:51:34.351614+0000","last_fullsized":"2024-03-30T01:51:34.351614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:43:22.251326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359569+0000","last_change":"2024-03-30T01:51:32.812680+0000","last_active":"2024-03-30T01:51:36.359569+0000","last_peered":"2024-03-30T01:51:36.359569+0000","last_clean":"2024-03-30T01:51:36.359569+0000","last_became_active":"2024-03-30T01:51:32.812333+0000","last_became_peered":"2024-03-30T01:51:32.812333+0000","last_unstale":"2024-03-30T01:51:36.359569+0000","last_undegraded":"2024-03-30T01:51:36.359569+0000","last_fullsized":"2024-03-30T01:51:36.359569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:13:08.942873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359121+0000","last_change":"2024-03-30T01:51:32.826749+0000","last_active":"2024-03-30T01:51:36.359121+0000","last_peered":"2024-03-30T01:51:36.359121+0000","last_clean":"2024-03-30T01:51:36.359121+0000","last_became_active":"2024-03-30T01:51:32.824642+0000","last_became_peered":"2024-03-30T01:51:32.824642+0000","last_unstale":"2024-03-30T01:51:36.359121+0000","last_undegraded":"2024-03-30T01:51:36.359121+0000","last_fullsized":"2024-03-30T01:51:36.359121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794544+0000","last_change":"2024-03-30T01:51:32.816597+0000","last_active":"2024-03-30T01:51:33.794544+0000","last_peered":"2024-03-30T01:51:33.794544+0000","last_clean":"2024-03-30T01:51:33.794544+0000","last_became_active":"2024-03-30T01:51:32.816310+0000","last_became_peered":"2024-03-30T01:51:32.816310+0000","last_unstale":"2024-03-30T01:51:33.794544+0000","last_undegraded":"2024-03-30T01:51:33.794544+0000","last_fullsized":"2024-03-30T01:51:33.794544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:42:27.229045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356973+0000","last_change":"2024-03-30T01:51:32.816094+0000","last_active":"2024-03-30T01:51:36.356973+0000","last_peered":"2024-03-30T01:51:36.356973+0000","last_clean":"2024-03-30T01:51:36.356973+0000","last_became_active":"2024-03-30T01:51:32.815841+0000","last_became_peered":"2024-03-30T01:51:32.815841+0000","last_unstale":"2024-03-30T01:51:36.356973+0000","last_undegraded":"2024-03-30T01:51:36.356973+0000","last_fullsized":"2024-03-30T01:51:36.356973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:08:35.439480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951373+0000","last_change":"2024-03-30T01:51:32.808528+0000","last_active":"2024-03-30T01:51:33.951373+0000","last_peered":"2024-03-30T01:51:33.951373+0000","last_clean":"2024-03-30T01:51:33.951373+0000","last_became_active":"2024-03-30T01:51:32.808290+0000","last_became_peered":"2024-03-30T01:51:32.808290+0000","last_unstale":"2024-03-30T01:51:33.951373+0000","last_undegraded":"2024-03-30T01:51:33.951373+0000","last_fullsized":"2024-03-30T01:51:33.951373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:16:16.111272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791232+0000","last_change":"2024-03-30T01:51:32.818830+0000","last_active":"2024-03-30T01:51:33.791232+0000","last_peered":"2024-03-30T01:51:33.791232+0000","last_clean":"2024-03-30T01:51:33.791232+0000","last_became_active":"2024-03-30T01:51:32.818684+0000","last_became_peered":"2024-03-30T01:51:32.818684+0000","last_unstale":"2024-03-30T01:51:33.791232+0000","last_undegraded":"2024-03-30T01:51:33.791232+0000","last_fullsized":"2024-03-30T01:51:33.791232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:12:19.249116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793142+0000","last_change":"2024-03-30T01:51:32.810544+0000","last_active":"2024-03-30T01:51:33.793142+0000","last_peered":"2024-03-30T01:51:33.793142+0000","last_clean":"2024-03-30T01:51:33.793142+0000","last_became_active":"2024-03-30T01:51:32.809383+0000","last_became_peered":"2024-03-30T01:51:32.809383+0000","last_unstale":"2024-03-30T01:51:33.793142+0000","last_undegraded":"2024-03-30T01:51:33.793142+0000","last_fullsized":"2024-03-30T01:51:33.793142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T04:10:09.271050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794103+0000","last_change":"2024-03-30T01:51:32.814598+0000","last_active":"2024-03-30T01:51:33.794103+0000","last_peered":"2024-03-30T01:51:33.794103+0000","last_clean":"2024-03-30T01:51:33.794103+0000","last_became_active":"2024-03-30T01:51:32.814343+0000","last_became_peered":"2024-03-30T01:51:32.814343+0000","last_unstale":"2024-03-30T01:51:33.794103+0000","last_undegraded":"2024-03-30T01:51:33.794103+0000","last_fullsized":"2024-03-30T01:51:33.794103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:45:46.717709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356214+0000","last_change":"2024-03-30T01:51:32.810030+0000","last_active":"2024-03-30T01:51:36.356214+0000","last_peered":"2024-03-30T01:51:36.356214+0000","last_clean":"2024-03-30T01:51:36.356214+0000","last_became_active":"2024-03-30T01:51:32.809667+0000","last_became_peered":"2024-03-30T01:51:32.809667+0000","last_unstale":"2024-03-30T01:51:36.356214+0000","last_undegraded":"2024-03-30T01:51:36.356214+0000","last_fullsized":"2024-03-30T01:51:36.356214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:43:14.180564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350888+0000","last_change":"2024-03-30T01:51:32.825796+0000","last_active":"2024-03-30T01:51:34.350888+0000","last_peered":"2024-03-30T01:51:34.350888+0000","last_clean":"2024-03-30T01:51:34.350888+0000","last_became_active":"2024-03-30T01:51:32.825501+0000","last_became_peered":"2024-03-30T01:51:32.825501+0000","last_unstale":"2024-03-30T01:51:34.350888+0000","last_undegraded":"2024-03-30T01:51:34.350888+0000","last_fullsized":"2024-03-30T01:51:34.350888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:16:38.980879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359143+0000","last_change":"2024-03-30T01:51:32.816941+0000","last_active":"2024-03-30T01:51:36.359143+0000","last_peered":"2024-03-30T01:51:36.359143+0000","last_clean":"2024-03-30T01:51:36.359143+0000","last_became_active":"2024-03-30T01:51:32.816645+0000","last_became_peered":"2024-03-30T01:51:32.816645+0000","last_unstale":"2024-03-30T01:51:36.359143+0000","last_undegraded":"2024-03-30T01:51:36.359143+0000","last_fullsized":"2024-03-30T01:51:36.359143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:42:27.229045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951735+0000","last_change":"2024-03-30T01:51:32.807172+0000","last_active":"2024-03-30T01:51:33.951735+0000","last_peered":"2024-03-30T01:51:33.951735+0000","last_clean":"2024-03-30T01:51:33.951735+0000","last_became_active":"2024-03-30T01:51:32.805878+0000","last_became_peered":"2024-03-30T01:51:32.805878+0000","last_unstale":"2024-03-30T01:51:33.951735+0000","last_undegraded":"2024-03-30T01:51:33.951735+0000","last_fullsized":"2024-03-30T01:51:33.951735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:04:01.115269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793786+0000","last_change":"2024-03-30T01:51:32.814459+0000","last_active":"2024-03-30T01:51:33.793786+0000","last_peered":"2024-03-30T01:51:33.793786+0000","last_clean":"2024-03-30T01:51:33.793786+0000","last_became_active":"2024-03-30T01:51:32.814174+0000","last_became_peered":"2024-03-30T01:51:32.814174+0000","last_unstale":"2024-03-30T01:51:33.793786+0000","last_undegraded":"2024-03-30T01:51:33.793786+0000","last_fullsized":"2024-03-30T01:51:33.793786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:50.171426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356748+0000","last_change":"2024-03-30T01:51:32.822182+0000","last_active":"2024-03-30T01:51:36.356748+0000","last_peered":"2024-03-30T01:51:36.356748+0000","last_clean":"2024-03-30T01:51:36.356748+0000","last_became_active":"2024-03-30T01:51:32.821907+0000","last_became_peered":"2024-03-30T01:51:32.821907+0000","last_unstale":"2024-03-30T01:51:36.356748+0000","last_undegraded":"2024-03-30T01:51:36.356748+0000","last_fullsized":"2024-03-30T01:51:36.356748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T07:15:13.311008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793836+0000","last_change":"2024-03-30T01:51:32.810773+0000","last_active":"2024-03-30T01:51:33.793836+0000","last_peered":"2024-03-30T01:51:33.793836+0000","last_clean":"2024-03-30T01:51:33.793836+0000","last_became_active":"2024-03-30T01:51:32.810446+0000","last_became_peered":"2024-03-30T01:51:32.810446+0000","last_unstale":"2024-03-30T01:51:33.793836+0000","last_undegraded":"2024-03-30T01:51:33.793836+0000","last_fullsized":"2024-03-30T01:51:33.793836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357256+0000","last_change":"2024-03-30T01:51:32.824519+0000","last_active":"2024-03-30T01:51:36.357256+0000","last_peered":"2024-03-30T01:51:36.357256+0000","last_clean":"2024-03-30T01:51:36.357256+0000","last_became_active":"2024-03-30T01:51:32.824210+0000","last_became_peered":"2024-03-30T01:51:32.824210+0000","last_unstale":"2024-03-30T01:51:36.357256+0000","last_undegraded":"2024-03-30T01:51:36.357256+0000","last_fullsized":"2024-03-30T01:51:36.357256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:16:16.111272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359568+0000","last_change":"2024-03-30T01:51:32.823849+0000","last_active":"2024-03-30T01:51:36.359568+0000","last_peered":"2024-03-30T01:51:36.359568+0000","last_clean":"2024-03-30T01:51:36.359568+0000","last_became_active":"2024-03-30T01:51:32.823467+0000","last_became_peered":"2024-03-30T01:51:32.823467+0000","last_unstale":"2024-03-30T01:51:36.359568+0000","last_undegraded":"2024-03-30T01:51:36.359568+0000","last_fullsized":"2024-03-30T01:51:36.359568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792289+0000","last_change":"2024-03-30T01:51:32.815312+0000","last_active":"2024-03-30T01:51:33.792289+0000","last_peered":"2024-03-30T01:51:33.792289+0000","last_clean":"2024-03-30T01:51:33.792289+0000","last_became_active":"2024-03-30T01:51:32.814565+0000","last_became_peered":"2024-03-30T01:51:32.814565+0000","last_unstale":"2024-03-30T01:51:33.792289+0000","last_undegraded":"2024-03-30T01:51:33.792289+0000","last_fullsized":"2024-03-30T01:51:33.792289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:31:32.555378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357196+0000","last_change":"2024-03-30T01:51:32.821245+0000","last_active":"2024-03-30T01:51:36.357196+0000","last_peered":"2024-03-30T01:51:36.357196+0000","last_clean":"2024-03-30T01:51:36.357196+0000","last_became_active":"2024-03-30T01:51:32.821080+0000","last_became_peered":"2024-03-30T01:51:32.821080+0000","last_unstale":"2024-03-30T01:51:36.357196+0000","last_undegraded":"2024-03-30T01:51:36.357196+0000","last_fullsized":"2024-03-30T01:51:36.357196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:48.498455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951866+0000","last_change":"2024-03-30T01:51:32.795415+0000","last_active":"2024-03-30T01:51:33.951866+0000","last_peered":"2024-03-30T01:51:33.951866+0000","last_clean":"2024-03-30T01:51:33.951866+0000","last_became_active":"2024-03-30T01:51:32.795077+0000","last_became_peered":"2024-03-30T01:51:32.795077+0000","last_unstale":"2024-03-30T01:51:33.951866+0000","last_undegraded":"2024-03-30T01:51:33.951866+0000","last_fullsized":"2024-03-30T01:51:33.951866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794033+0000","last_change":"2024-03-30T01:51:32.809765+0000","last_active":"2024-03-30T01:51:33.794033+0000","last_peered":"2024-03-30T01:51:33.794033+0000","last_clean":"2024-03-30T01:51:33.794033+0000","last_became_active":"2024-03-30T01:51:32.809483+0000","last_became_peered":"2024-03-30T01:51:32.809483+0000","last_unstale":"2024-03-30T01:51:33.794033+0000","last_undegraded":"2024-03-30T01:51:33.794033+0000","last_fullsized":"2024-03-30T01:51:33.794033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:12:19.249116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356211+0000","last_change":"2024-03-30T01:51:32.802662+0000","last_active":"2024-03-30T01:51:36.356211+0000","last_peered":"2024-03-30T01:51:36.356211+0000","last_clean":"2024-03-30T01:51:36.356211+0000","last_became_active":"2024-03-30T01:51:32.802418+0000","last_became_peered":"2024-03-30T01:51:32.802418+0000","last_unstale":"2024-03-30T01:51:36.356211+0000","last_undegraded":"2024-03-30T01:51:36.356211+0000","last_fullsized":"2024-03-30T01:51:36.356211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:29.404661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.358729+0000","last_change":"2024-03-30T01:51:32.825195+0000","last_active":"2024-03-30T01:51:36.358729+0000","last_peered":"2024-03-30T01:51:36.358729+0000","last_clean":"2024-03-30T01:51:36.358729+0000","last_became_active":"2024-03-30T01:51:32.824918+0000","last_became_peered":"2024-03-30T01:51:32.824918+0000","last_unstale":"2024-03-30T01:51:36.358729+0000","last_undegraded":"2024-03-30T01:51:36.358729+0000","last_fullsized":"2024-03-30T01:51:36.358729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:16:16.111272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793866+0000","last_change":"2024-03-30T01:51:32.818991+0000","last_active":"2024-03-30T01:51:33.793866+0000","last_peered":"2024-03-30T01:51:33.793866+0000","last_clean":"2024-03-30T01:51:33.793866+0000","last_became_active":"2024-03-30T01:51:32.818661+0000","last_became_peered":"2024-03-30T01:51:32.818661+0000","last_unstale":"2024-03-30T01:51:33.793866+0000","last_undegraded":"2024-03-30T01:51:33.793866+0000","last_fullsized":"2024-03-30T01:51:33.793866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:16:48.714780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.827029+0000","last_change":"2024-03-30T01:51:32.334786+0000","last_active":"2024-03-30T01:51:32.827029+0000","last_peered":"2024-03-30T01:51:32.827029+0000","last_clean":"2024-03-30T01:51:32.827029+0000","last_became_active":"2024-03-30T01:51:32.334439+0000","last_became_peered":"2024-03-30T01:51:32.334439+0000","last_unstale":"2024-03-30T01:51:32.827029+0000","last_undegraded":"2024-03-30T01:51:32.827029+0000","last_fullsized":"2024-03-30T01:51:32.827029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:16:10.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951993+0000","last_change":"2024-03-30T01:51:32.802436+0000","last_active":"2024-03-30T01:51:33.951993+0000","last_peered":"2024-03-30T01:51:33.951993+0000","last_clean":"2024-03-30T01:51:33.951993+0000","last_became_active":"2024-03-30T01:51:32.802174+0000","last_became_peered":"2024-03-30T01:51:32.802174+0000","last_unstale":"2024-03-30T01:51:33.951993+0000","last_undegraded":"2024-03-30T01:51:33.951993+0000","last_fullsized":"2024-03-30T01:51:33.951993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T07:15:13.311008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.831313+0000","last_change":"2024-03-30T01:51:32.333125+0000","last_active":"2024-03-30T01:51:32.831313+0000","last_peered":"2024-03-30T01:51:32.831313+0000","last_clean":"2024-03-30T01:51:32.831313+0000","last_became_active":"2024-03-30T01:51:32.332556+0000","last_became_peered":"2024-03-30T01:51:32.332556+0000","last_unstale":"2024-03-30T01:51:32.831313+0000","last_undegraded":"2024-03-30T01:51:32.831313+0000","last_fullsized":"2024-03-30T01:51:32.831313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.801373+0000","last_change":"2024-03-30T01:51:32.339115+0000","last_active":"2024-03-30T01:51:32.801373+0000","last_peered":"2024-03-30T01:51:32.801373+0000","last_clean":"2024-03-30T01:51:32.801373+0000","last_became_active":"2024-03-30T01:51:32.338822+0000","last_became_peered":"2024-03-30T01:51:32.338822+0000","last_unstale":"2024-03-30T01:51:32.801373+0000","last_undegraded":"2024-03-30T01:51:32.801373+0000","last_fullsized":"2024-03-30T01:51:32.801373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356877+0000","last_change":"2024-03-30T01:51:32.800804+0000","last_active":"2024-03-30T01:51:36.356877+0000","last_peered":"2024-03-30T01:51:36.356877+0000","last_clean":"2024-03-30T01:51:36.356877+0000","last_became_active":"2024-03-30T01:51:32.800357+0000","last_became_peered":"2024-03-30T01:51:32.800357+0000","last_unstale":"2024-03-30T01:51:36.356877+0000","last_undegraded":"2024-03-30T01:51:36.356877+0000","last_fullsized":"2024-03-30T01:51:36.356877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:12:19.249116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.789786+0000","last_change":"2024-03-30T01:51:32.324045+0000","last_active":"2024-03-30T01:51:32.789786+0000","last_peered":"2024-03-30T01:51:32.789786+0000","last_clean":"2024-03-30T01:51:32.789786+0000","last_became_active":"2024-03-30T01:51:32.323466+0000","last_became_peered":"2024-03-30T01:51:32.323466+0000","last_unstale":"2024-03-30T01:51:32.789786+0000","last_undegraded":"2024-03-30T01:51:32.789786+0000","last_fullsized":"2024-03-30T01:51:32.789786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:16.099108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791017+0000","last_change":"2024-03-30T01:51:32.809356+0000","last_active":"2024-03-30T01:51:33.791017+0000","last_peered":"2024-03-30T01:51:33.791017+0000","last_clean":"2024-03-30T01:51:33.791017+0000","last_became_active":"2024-03-30T01:51:32.809059+0000","last_became_peered":"2024-03-30T01:51:32.809059+0000","last_unstale":"2024-03-30T01:51:33.791017+0000","last_undegraded":"2024-03-30T01:51:33.791017+0000","last_fullsized":"2024-03-30T01:51:33.791017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.809422+0000","last_change":"2024-03-30T01:51:32.339350+0000","last_active":"2024-03-30T01:51:32.809422+0000","last_peered":"2024-03-30T01:51:32.809422+0000","last_clean":"2024-03-30T01:51:32.809422+0000","last_became_active":"2024-03-30T01:51:32.338514+0000","last_became_peered":"2024-03-30T01:51:32.338514+0000","last_unstale":"2024-03-30T01:51:32.809422+0000","last_undegraded":"2024-03-30T01:51:32.809422+0000","last_fullsized":"2024-03-30T01:51:32.809422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:49:06.802141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792834+0000","last_change":"2024-03-30T01:51:32.816915+0000","last_active":"2024-03-30T01:51:33.792834+0000","last_peered":"2024-03-30T01:51:33.792834+0000","last_clean":"2024-03-30T01:51:33.792834+0000","last_became_active":"2024-03-30T01:51:32.814653+0000","last_became_peered":"2024-03-30T01:51:32.814653+0000","last_unstale":"2024-03-30T01:51:33.792834+0000","last_undegraded":"2024-03-30T01:51:33.792834+0000","last_fullsized":"2024-03-30T01:51:33.792834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:08:35.439480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.791633+0000","last_change":"2024-03-30T01:51:32.341633+0000","last_active":"2024-03-30T01:51:32.791633+0000","last_peered":"2024-03-30T01:51:32.791633+0000","last_clean":"2024-03-30T01:51:32.791633+0000","last_became_active":"2024-03-30T01:51:32.341346+0000","last_became_peered":"2024-03-30T01:51:32.341346+0000","last_unstale":"2024-03-30T01:51:32.791633+0000","last_undegraded":"2024-03-30T01:51:32.791633+0000","last_fullsized":"2024-03-30T01:51:32.791633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.952480+0000","last_change":"2024-03-30T01:51:32.798259+0000","last_active":"2024-03-30T01:51:33.952480+0000","last_peered":"2024-03-30T01:51:33.952480+0000","last_clean":"2024-03-30T01:51:33.952480+0000","last_became_active":"2024-03-30T01:51:32.797868+0000","last_became_peered":"2024-03-30T01:51:32.797868+0000","last_unstale":"2024-03-30T01:51:33.952480+0000","last_undegraded":"2024-03-30T01:51:33.952480+0000","last_fullsized":"2024-03-30T01:51:33.952480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.829577+0000","last_change":"2024-03-30T01:51:32.335884+0000","last_active":"2024-03-30T01:51:32.829577+0000","last_peered":"2024-03-30T01:51:32.829577+0000","last_clean":"2024-03-30T01:51:32.829577+0000","last_became_active":"2024-03-30T01:51:32.335615+0000","last_became_peered":"2024-03-30T01:51:32.335615+0000","last_unstale":"2024-03-30T01:51:32.829577+0000","last_undegraded":"2024-03-30T01:51:32.829577+0000","last_fullsized":"2024-03-30T01:51:32.829577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794581+0000","last_change":"2024-03-30T01:51:32.817329+0000","last_active":"2024-03-30T01:51:33.794581+0000","last_peered":"2024-03-30T01:51:33.794581+0000","last_clean":"2024-03-30T01:51:33.794581+0000","last_became_active":"2024-03-30T01:51:32.817034+0000","last_became_peered":"2024-03-30T01:51:32.817034+0000","last_unstale":"2024-03-30T01:51:33.794581+0000","last_undegraded":"2024-03-30T01:51:33.794581+0000","last_fullsized":"2024-03-30T01:51:33.794581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:29.404661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.838419+0000","last_change":"2024-03-30T01:51:32.344369+0000","last_active":"2024-03-30T01:51:32.838419+0000","last_peered":"2024-03-30T01:51:32.838419+0000","last_clean":"2024-03-30T01:51:32.838419+0000","last_became_active":"2024-03-30T01:51:32.344031+0000","last_became_peered":"2024-03-30T01:51:32.344031+0000","last_unstale":"2024-03-30T01:51:32.838419+0000","last_undegraded":"2024-03-30T01:51:32.838419+0000","last_fullsized":"2024-03-30T01:51:32.838419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:16:10.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350569+0000","last_change":"2024-03-30T01:51:32.822087+0000","last_active":"2024-03-30T01:51:34.350569+0000","last_peered":"2024-03-30T01:51:34.350569+0000","last_clean":"2024-03-30T01:51:34.350569+0000","last_became_active":"2024-03-30T01:51:32.821664+0000","last_became_peered":"2024-03-30T01:51:32.821664+0000","last_unstale":"2024-03-30T01:51:34.350569+0000","last_undegraded":"2024-03-30T01:51:34.350569+0000","last_fullsized":"2024-03-30T01:51:34.350569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:45:46.717709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.833595+0000","last_change":"2024-03-30T01:51:32.328895+0000","last_active":"2024-03-30T01:51:32.833595+0000","last_peered":"2024-03-30T01:51:32.833595+0000","last_clean":"2024-03-30T01:51:32.833595+0000","last_became_active":"2024-03-30T01:51:32.327604+0000","last_became_peered":"2024-03-30T01:51:32.327604+0000","last_unstale":"2024-03-30T01:51:32.833595+0000","last_undegraded":"2024-03-30T01:51:32.833595+0000","last_fullsized":"2024-03-30T01:51:32.833595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:18.328608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951478+0000","last_change":"2024-03-30T01:51:32.813992+0000","last_active":"2024-03-30T01:51:33.951478+0000","last_peered":"2024-03-30T01:51:33.951478+0000","last_clean":"2024-03-30T01:51:33.951478+0000","last_became_active":"2024-03-30T01:51:32.813751+0000","last_became_peered":"2024-03-30T01:51:32.813751+0000","last_unstale":"2024-03-30T01:51:33.951478+0000","last_undegraded":"2024-03-30T01:51:33.951478+0000","last_fullsized":"2024-03-30T01:51:33.951478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:48.498455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.794977+0000","last_change":"2024-03-30T01:51:32.326767+0000","last_active":"2024-03-30T01:51:32.794977+0000","last_peered":"2024-03-30T01:51:32.794977+0000","last_clean":"2024-03-30T01:51:32.794977+0000","last_became_active":"2024-03-30T01:51:32.326514+0000","last_became_peered":"2024-03-30T01:51:32.326514+0000","last_unstale":"2024-03-30T01:51:32.794977+0000","last_undegraded":"2024-03-30T01:51:32.794977+0000","last_fullsized":"2024-03-30T01:51:32.794977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:49:06.802141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350753+0000","last_change":"2024-03-30T01:51:32.831620+0000","last_active":"2024-03-30T01:51:34.350753+0000","last_peered":"2024-03-30T01:51:34.350753+0000","last_clean":"2024-03-30T01:51:34.350753+0000","last_became_active":"2024-03-30T01:51:32.829086+0000","last_became_peered":"2024-03-30T01:51:32.829086+0000","last_unstale":"2024-03-30T01:51:34.350753+0000","last_undegraded":"2024-03-30T01:51:34.350753+0000","last_fullsized":"2024-03-30T01:51:34.350753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:48:32.312063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.808536+0000","last_change":"2024-03-30T01:51:32.333519+0000","last_active":"2024-03-30T01:51:32.808536+0000","last_peered":"2024-03-30T01:51:32.808536+0000","last_clean":"2024-03-30T01:51:32.808536+0000","last_became_active":"2024-03-30T01:51:32.332785+0000","last_became_peered":"2024-03-30T01:51:32.332785+0000","last_unstale":"2024-03-30T01:51:32.808536+0000","last_undegraded":"2024-03-30T01:51:32.808536+0000","last_fullsized":"2024-03-30T01:51:32.808536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.358827+0000","last_change":"2024-03-30T01:51:32.820310+0000","last_active":"2024-03-30T01:51:36.358827+0000","last_peered":"2024-03-30T01:51:36.358827+0000","last_clean":"2024-03-30T01:51:36.358827+0000","last_became_active":"2024-03-30T01:51:32.819632+0000","last_became_peered":"2024-03-30T01:51:32.819632+0000","last_unstale":"2024-03-30T01:51:36.358827+0000","last_undegraded":"2024-03-30T01:51:36.358827+0000","last_fullsized":"2024-03-30T01:51:36.358827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:24:14.776848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.816543+0000","last_change":"2024-03-30T01:51:32.320300+0000","last_active":"2024-03-30T01:51:32.816543+0000","last_peered":"2024-03-30T01:51:32.816543+0000","last_clean":"2024-03-30T01:51:32.816543+0000","last_became_active":"2024-03-30T01:51:32.319459+0000","last_became_peered":"2024-03-30T01:51:32.319459+0000","last_unstale":"2024-03-30T01:51:32.816543+0000","last_undegraded":"2024-03-30T01:51:32.816543+0000","last_fullsized":"2024-03-30T01:51:32.816543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:16:10.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350739+0000","last_change":"2024-03-30T01:51:32.824724+0000","last_active":"2024-03-30T01:51:34.350739+0000","last_peered":"2024-03-30T01:51:34.350739+0000","last_clean":"2024-03-30T01:51:34.350739+0000","last_became_active":"2024-03-30T01:51:32.824435+0000","last_became_peered":"2024-03-30T01:51:32.824435+0000","last_unstale":"2024-03-30T01:51:34.350739+0000","last_undegraded":"2024-03-30T01:51:34.350739+0000","last_fullsized":"2024-03-30T01:51:34.350739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T04:10:09.271050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.830672+0000","last_change":"2024-03-30T01:51:32.324209+0000","last_active":"2024-03-30T01:51:32.830672+0000","last_peered":"2024-03-30T01:51:32.830672+0000","last_clean":"2024-03-30T01:51:32.830672+0000","last_became_active":"2024-03-30T01:51:32.323909+0000","last_became_peered":"2024-03-30T01:51:32.323909+0000","last_unstale":"2024-03-30T01:51:32.830672+0000","last_undegraded":"2024-03-30T01:51:32.830672+0000","last_fullsized":"2024-03-30T01:51:32.830672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:29:54.309497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.351210+0000","last_change":"2024-03-30T01:51:32.829602+0000","last_active":"2024-03-30T01:51:34.351210+0000","last_peered":"2024-03-30T01:51:34.351210+0000","last_clean":"2024-03-30T01:51:34.351210+0000","last_became_active":"2024-03-30T01:51:32.829279+0000","last_became_peered":"2024-03-30T01:51:32.829279+0000","last_unstale":"2024-03-30T01:51:34.351210+0000","last_undegraded":"2024-03-30T01:51:34.351210+0000","last_fullsized":"2024-03-30T01:51:34.351210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:15:59.657625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.819729+0000","last_change":"2024-03-30T01:51:32.329496+0000","last_active":"2024-03-30T01:51:32.819729+0000","last_peered":"2024-03-30T01:51:32.819729+0000","last_clean":"2024-03-30T01:51:32.819729+0000","last_became_active":"2024-03-30T01:51:32.329197+0000","last_became_peered":"2024-03-30T01:51:32.329197+0000","last_unstale":"2024-03-30T01:51:32.819729+0000","last_undegraded":"2024-03-30T01:51:32.819729+0000","last_fullsized":"2024-03-30T01:51:32.819729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.351541+0000","last_change":"2024-03-30T01:51:32.829567+0000","last_active":"2024-03-30T01:51:34.351541+0000","last_peered":"2024-03-30T01:51:34.351541+0000","last_clean":"2024-03-30T01:51:34.351541+0000","last_became_active":"2024-03-30T01:51:32.829295+0000","last_became_peered":"2024-03-30T01:51:32.829295+0000","last_unstale":"2024-03-30T01:51:34.351541+0000","last_undegraded":"2024-03-30T01:51:34.351541+0000","last_fullsized":"2024-03-30T01:51:34.351541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:50.171426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.830796+0000","last_change":"2024-03-30T01:51:32.331167+0000","last_active":"2024-03-30T01:51:32.830796+0000","last_peered":"2024-03-30T01:51:32.830796+0000","last_clean":"2024-03-30T01:51:32.830796+0000","last_became_active":"2024-03-30T01:51:32.330851+0000","last_became_peered":"2024-03-30T01:51:32.330851+0000","last_unstale":"2024-03-30T01:51:32.830796+0000","last_undegraded":"2024-03-30T01:51:32.830796+0000","last_fullsized":"2024-03-30T01:51:32.830796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:43:13.165559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792872+0000","last_change":"2024-03-30T01:51:32.806466+0000","last_active":"2024-03-30T01:51:33.792872+0000","last_peered":"2024-03-30T01:51:33.792872+0000","last_clean":"2024-03-30T01:51:33.792872+0000","last_became_active":"2024-03-30T01:51:32.800403+0000","last_became_peered":"2024-03-30T01:51:32.800403+0000","last_unstale":"2024-03-30T01:51:33.792872+0000","last_undegraded":"2024-03-30T01:51:33.792872+0000","last_fullsized":"2024-03-30T01:51:33.792872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:30:52.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.801178+0000","last_change":"2024-03-30T01:51:32.328539+0000","last_active":"2024-03-30T01:51:32.801178+0000","last_peered":"2024-03-30T01:51:32.801178+0000","last_clean":"2024-03-30T01:51:32.801178+0000","last_became_active":"2024-03-30T01:51:32.328066+0000","last_became_peered":"2024-03-30T01:51:32.328066+0000","last_unstale":"2024-03-30T01:51:32.801178+0000","last_undegraded":"2024-03-30T01:51:32.801178+0000","last_fullsized":"2024-03-30T01:51:32.801178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:18.328608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:34.350589+0000","last_change":"2024-03-30T01:51:32.831571+0000","last_active":"2024-03-30T01:51:34.350589+0000","last_peered":"2024-03-30T01:51:34.350589+0000","last_clean":"2024-03-30T01:51:34.350589+0000","last_became_active":"2024-03-30T01:51:32.830419+0000","last_became_peered":"2024-03-30T01:51:32.830419+0000","last_unstale":"2024-03-30T01:51:34.350589+0000","last_undegraded":"2024-03-30T01:51:34.350589+0000","last_fullsized":"2024-03-30T01:51:34.350589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:43:58.638314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.804265+0000","last_change":"2024-03-30T01:51:23.358245+0000","last_active":"2024-03-30T01:51:32.804265+0000","last_peered":"2024-03-30T01:51:32.804265+0000","last_clean":"2024-03-30T01:51:32.804265+0000","last_became_active":"2024-03-30T01:51:23.355914+0000","last_became_peered":"2024-03-30T01:51:23.355914+0000","last_unstale":"2024-03-30T01:51:32.804265+0000","last_undegraded":"2024-03-30T01:51:32.804265+0000","last_fullsized":"2024-03-30T01:51:32.804265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_clean_scrub_stamp":"2024-03-30T01:51:21.990253+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:21:19.291194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.789893+0000","last_change":"2024-03-30T01:51:32.328546+0000","last_active":"2024-03-30T01:51:32.789893+0000","last_peered":"2024-03-30T01:51:32.789893+0000","last_clean":"2024-03-30T01:51:32.789893+0000","last_became_active":"2024-03-30T01:51:32.328108+0000","last_became_peered":"2024-03-30T01:51:32.328108+0000","last_unstale":"2024-03-30T01:51:32.789893+0000","last_undegraded":"2024-03-30T01:51:32.789893+0000","last_fullsized":"2024-03-30T01:51:32.789893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356791+0000","last_change":"2024-03-30T01:51:32.817812+0000","last_active":"2024-03-30T01:51:36.356791+0000","last_peered":"2024-03-30T01:51:36.356791+0000","last_clean":"2024-03-30T01:51:36.356791+0000","last_became_active":"2024-03-30T01:51:32.816217+0000","last_became_peered":"2024-03-30T01:51:32.816217+0000","last_unstale":"2024-03-30T01:51:36.356791+0000","last_undegraded":"2024-03-30T01:51:36.356791+0000","last_fullsized":"2024-03-30T01:51:36.356791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:45:10.611928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.804176+0000","last_change":"2024-03-30T01:51:32.340288+0000","last_active":"2024-03-30T01:51:32.804176+0000","last_peered":"2024-03-30T01:51:32.804176+0000","last_clean":"2024-03-30T01:51:32.804176+0000","last_became_active":"2024-03-30T01:51:32.339870+0000","last_became_peered":"2024-03-30T01:51:32.339870+0000","last_unstale":"2024-03-30T01:51:32.804176+0000","last_undegraded":"2024-03-30T01:51:32.804176+0000","last_fullsized":"2024-03-30T01:51:32.804176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:28.389656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951417+0000","last_change":"2024-03-30T01:51:32.795840+0000","last_active":"2024-03-30T01:51:33.951417+0000","last_peered":"2024-03-30T01:51:33.951417+0000","last_clean":"2024-03-30T01:51:33.951417+0000","last_became_active":"2024-03-30T01:51:32.795458+0000","last_became_peered":"2024-03-30T01:51:32.795458+0000","last_unstale":"2024-03-30T01:51:33.951417+0000","last_undegraded":"2024-03-30T01:51:33.951417+0000","last_fullsized":"2024-03-30T01:51:33.951417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:24:14.776848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.798439+0000","last_change":"2024-03-30T01:51:32.332992+0000","last_active":"2024-03-30T01:51:32.798439+0000","last_peered":"2024-03-30T01:51:32.798439+0000","last_clean":"2024-03-30T01:51:32.798439+0000","last_became_active":"2024-03-30T01:51:32.332735+0000","last_became_peered":"2024-03-30T01:51:32.332735+0000","last_unstale":"2024-03-30T01:51:32.798439+0000","last_undegraded":"2024-03-30T01:51:32.798439+0000","last_fullsized":"2024-03-30T01:51:32.798439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:49:06.802141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791299+0000","last_change":"2024-03-30T01:51:32.812474+0000","last_active":"2024-03-30T01:51:33.791299+0000","last_peered":"2024-03-30T01:51:33.791299+0000","last_clean":"2024-03-30T01:51:33.791299+0000","last_became_active":"2024-03-30T01:51:32.812149+0000","last_became_peered":"2024-03-30T01:51:32.812149+0000","last_unstale":"2024-03-30T01:51:33.791299+0000","last_undegraded":"2024-03-30T01:51:33.791299+0000","last_fullsized":"2024-03-30T01:51:33.791299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:48.498455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.794770+0000","last_change":"2024-03-30T01:51:32.331651+0000","last_active":"2024-03-30T01:51:32.794770+0000","last_peered":"2024-03-30T01:51:32.794770+0000","last_clean":"2024-03-30T01:51:32.794770+0000","last_became_active":"2024-03-30T01:51:32.331150+0000","last_became_peered":"2024-03-30T01:51:32.331150+0000","last_unstale":"2024-03-30T01:51:32.794770+0000","last_undegraded":"2024-03-30T01:51:32.794770+0000","last_fullsized":"2024-03-30T01:51:32.794770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.794329+0000","last_change":"2024-03-30T01:51:32.808411+0000","last_active":"2024-03-30T01:51:33.794329+0000","last_peered":"2024-03-30T01:51:33.794329+0000","last_clean":"2024-03-30T01:51:33.794329+0000","last_became_active":"2024-03-30T01:51:32.807032+0000","last_became_peered":"2024-03-30T01:51:32.807032+0000","last_unstale":"2024-03-30T01:51:33.794329+0000","last_undegraded":"2024-03-30T01:51:33.794329+0000","last_fullsized":"2024-03-30T01:51:33.794329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:43:14.180564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.805618+0000","last_change":"2024-03-30T01:51:32.332641+0000","last_active":"2024-03-30T01:51:32.805618+0000","last_peered":"2024-03-30T01:51:32.805618+0000","last_clean":"2024-03-30T01:51:32.805618+0000","last_became_active":"2024-03-30T01:51:32.332372+0000","last_became_peered":"2024-03-30T01:51:32.332372+0000","last_unstale":"2024-03-30T01:51:32.805618+0000","last_undegraded":"2024-03-30T01:51:32.805618+0000","last_fullsized":"2024-03-30T01:51:32.805618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:16.099108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793089+0000","last_change":"2024-03-30T01:51:32.801706+0000","last_active":"2024-03-30T01:51:33.793089+0000","last_peered":"2024-03-30T01:51:33.793089+0000","last_clean":"2024-03-30T01:51:33.793089+0000","last_became_active":"2024-03-30T01:51:32.799681+0000","last_became_peered":"2024-03-30T01:51:32.799681+0000","last_unstale":"2024-03-30T01:51:33.793089+0000","last_undegraded":"2024-03-30T01:51:33.793089+0000","last_fullsized":"2024-03-30T01:51:33.793089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:26:47.924608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.811947+0000","last_change":"2024-03-30T01:51:32.340251+0000","last_active":"2024-03-30T01:51:32.811947+0000","last_peered":"2024-03-30T01:51:32.811947+0000","last_clean":"2024-03-30T01:51:32.811947+0000","last_became_active":"2024-03-30T01:51:32.339947+0000","last_became_peered":"2024-03-30T01:51:32.339947+0000","last_unstale":"2024-03-30T01:51:32.811947+0000","last_undegraded":"2024-03-30T01:51:32.811947+0000","last_fullsized":"2024-03-30T01:51:32.811947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:16:47.699775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791546+0000","last_change":"2024-03-30T01:51:32.806047+0000","last_active":"2024-03-30T01:51:33.791546+0000","last_peered":"2024-03-30T01:51:33.791546+0000","last_clean":"2024-03-30T01:51:33.791546+0000","last_became_active":"2024-03-30T01:51:32.805805+0000","last_became_peered":"2024-03-30T01:51:32.805805+0000","last_unstale":"2024-03-30T01:51:33.791546+0000","last_undegraded":"2024-03-30T01:51:33.791546+0000","last_fullsized":"2024-03-30T01:51:33.791546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:13:08.942873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.791935+0000","last_change":"2024-03-30T01:51:32.342956+0000","last_active":"2024-03-30T01:51:33.791935+0000","last_peered":"2024-03-30T01:51:33.791935+0000","last_clean":"2024-03-30T01:51:33.791935+0000","last_became_active":"2024-03-30T01:51:32.342396+0000","last_became_peered":"2024-03-30T01:51:32.342396+0000","last_unstale":"2024-03-30T01:51:33.791935+0000","last_undegraded":"2024-03-30T01:51:33.791935+0000","last_fullsized":"2024-03-30T01:51:33.791935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:48:28.389656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357308+0000","last_change":"2024-03-30T01:51:32.821007+0000","last_active":"2024-03-30T01:51:36.357308+0000","last_peered":"2024-03-30T01:51:36.357308+0000","last_clean":"2024-03-30T01:51:36.357308+0000","last_became_active":"2024-03-30T01:51:32.820784+0000","last_became_peered":"2024-03-30T01:51:32.820784+0000","last_unstale":"2024-03-30T01:51:36.357308+0000","last_undegraded":"2024-03-30T01:51:36.357308+0000","last_fullsized":"2024-03-30T01:51:36.357308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:26:47.924608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.830948+0000","last_change":"2024-03-30T01:51:32.340196+0000","last_active":"2024-03-30T01:51:32.830948+0000","last_peered":"2024-03-30T01:51:32.830948+0000","last_clean":"2024-03-30T01:51:32.830948+0000","last_became_active":"2024-03-30T01:51:32.338419+0000","last_became_peered":"2024-03-30T01:51:32.338419+0000","last_unstale":"2024-03-30T01:51:32.830948+0000","last_undegraded":"2024-03-30T01:51:32.830948+0000","last_fullsized":"2024-03-30T01:51:32.830948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.951714+0000","last_change":"2024-03-30T01:51:32.814179+0000","last_active":"2024-03-30T01:51:33.951714+0000","last_peered":"2024-03-30T01:51:33.951714+0000","last_clean":"2024-03-30T01:51:33.951714+0000","last_became_active":"2024-03-30T01:51:32.813873+0000","last_became_peered":"2024-03-30T01:51:32.813873+0000","last_unstale":"2024-03-30T01:51:33.951714+0000","last_undegraded":"2024-03-30T01:51:33.951714+0000","last_fullsized":"2024-03-30T01:51:33.951714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:13:08.942873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.804043+0000","last_change":"2024-03-30T01:51:32.339346+0000","last_active":"2024-03-30T01:51:32.804043+0000","last_peered":"2024-03-30T01:51:32.804043+0000","last_clean":"2024-03-30T01:51:32.804043+0000","last_became_active":"2024-03-30T01:51:32.339038+0000","last_became_peered":"2024-03-30T01:51:32.339038+0000","last_unstale":"2024-03-30T01:51:32.804043+0000","last_undegraded":"2024-03-30T01:51:32.804043+0000","last_fullsized":"2024-03-30T01:51:32.804043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.793437+0000","last_change":"2024-03-30T01:51:32.803943+0000","last_active":"2024-03-30T01:51:33.793437+0000","last_peered":"2024-03-30T01:51:33.793437+0000","last_clean":"2024-03-30T01:51:33.793437+0000","last_became_active":"2024-03-30T01:51:32.802118+0000","last_became_peered":"2024-03-30T01:51:32.802118+0000","last_unstale":"2024-03-30T01:51:33.793437+0000","last_undegraded":"2024-03-30T01:51:33.793437+0000","last_fullsized":"2024-03-30T01:51:33.793437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:25:17.114113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.804568+0000","last_change":"2024-03-30T01:51:32.336889+0000","last_active":"2024-03-30T01:51:32.804568+0000","last_peered":"2024-03-30T01:51:32.804568+0000","last_clean":"2024-03-30T01:51:32.804568+0000","last_became_active":"2024-03-30T01:51:32.336560+0000","last_became_peered":"2024-03-30T01:51:32.336560+0000","last_unstale":"2024-03-30T01:51:32.804568+0000","last_undegraded":"2024-03-30T01:51:32.804568+0000","last_fullsized":"2024-03-30T01:51:32.804568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:04:03.278120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.356993+0000","last_change":"2024-03-30T01:51:32.816142+0000","last_active":"2024-03-30T01:51:36.356993+0000","last_peered":"2024-03-30T01:51:36.356993+0000","last_clean":"2024-03-30T01:51:36.356993+0000","last_became_active":"2024-03-30T01:51:32.814782+0000","last_became_peered":"2024-03-30T01:51:32.814782+0000","last_unstale":"2024-03-30T01:51:36.356993+0000","last_undegraded":"2024-03-30T01:51:36.356993+0000","last_fullsized":"2024-03-30T01:51:36.356993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:13:08.942873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.805047+0000","last_change":"2024-03-30T01:51:32.334063+0000","last_active":"2024-03-30T01:51:32.805047+0000","last_peered":"2024-03-30T01:51:32.805047+0000","last_clean":"2024-03-30T01:51:32.805047+0000","last_became_active":"2024-03-30T01:51:32.332760+0000","last_became_peered":"2024-03-30T01:51:32.332760+0000","last_unstale":"2024-03-30T01:51:32.805047+0000","last_undegraded":"2024-03-30T01:51:32.805047+0000","last_fullsized":"2024-03-30T01:51:32.805047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:09:39.735393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357089+0000","last_change":"2024-03-30T01:51:32.808609+0000","last_active":"2024-03-30T01:51:36.357089+0000","last_peered":"2024-03-30T01:51:36.357089+0000","last_clean":"2024-03-30T01:51:36.357089+0000","last_became_active":"2024-03-30T01:51:32.803595+0000","last_became_peered":"2024-03-30T01:51:32.803595+0000","last_unstale":"2024-03-30T01:51:36.357089+0000","last_undegraded":"2024-03-30T01:51:36.357089+0000","last_fullsized":"2024-03-30T01:51:36.357089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:31:32.555378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.832173+0000","last_change":"2024-03-30T01:51:32.340790+0000","last_active":"2024-03-30T01:51:32.832173+0000","last_peered":"2024-03-30T01:51:32.832173+0000","last_clean":"2024-03-30T01:51:32.832173+0000","last_became_active":"2024-03-30T01:51:32.340490+0000","last_became_peered":"2024-03-30T01:51:32.340490+0000","last_unstale":"2024-03-30T01:51:32.832173+0000","last_undegraded":"2024-03-30T01:51:32.832173+0000","last_fullsized":"2024-03-30T01:51:32.832173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:30:14.002651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.359197+0000","last_change":"2024-03-30T01:51:32.827543+0000","last_active":"2024-03-30T01:51:36.359197+0000","last_peered":"2024-03-30T01:51:36.359197+0000","last_clean":"2024-03-30T01:51:36.359197+0000","last_became_active":"2024-03-30T01:51:32.827208+0000","last_became_peered":"2024-03-30T01:51:32.827208+0000","last_unstale":"2024-03-30T01:51:36.359197+0000","last_undegraded":"2024-03-30T01:51:36.359197+0000","last_fullsized":"2024-03-30T01:51:36.359197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:56:56.891377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792948+0000","last_change":"2024-03-30T01:51:32.796699+0000","last_active":"2024-03-30T01:51:33.792948+0000","last_peered":"2024-03-30T01:51:33.792948+0000","last_clean":"2024-03-30T01:51:33.792948+0000","last_became_active":"2024-03-30T01:51:32.796427+0000","last_became_peered":"2024-03-30T01:51:32.796427+0000","last_unstale":"2024-03-30T01:51:33.792948+0000","last_undegraded":"2024-03-30T01:51:33.792948+0000","last_fullsized":"2024-03-30T01:51:33.792948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:48:32.312063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.831028+0000","last_change":"2024-03-30T01:51:32.340270+0000","last_active":"2024-03-30T01:51:32.831028+0000","last_peered":"2024-03-30T01:51:32.831028+0000","last_clean":"2024-03-30T01:51:32.831028+0000","last_became_active":"2024-03-30T01:51:32.339869+0000","last_became_peered":"2024-03-30T01:51:32.339869+0000","last_unstale":"2024-03-30T01:51:32.831028+0000","last_undegraded":"2024-03-30T01:51:32.831028+0000","last_fullsized":"2024-03-30T01:51:32.831028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:24:59.200397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.792626+0000","last_change":"2024-03-30T01:51:32.806687+0000","last_active":"2024-03-30T01:51:33.792626+0000","last_peered":"2024-03-30T01:51:33.792626+0000","last_clean":"2024-03-30T01:51:33.792626+0000","last_became_active":"2024-03-30T01:51:32.806461+0000","last_became_peered":"2024-03-30T01:51:32.806461+0000","last_unstale":"2024-03-30T01:51:33.792626+0000","last_undegraded":"2024-03-30T01:51:33.792626+0000","last_fullsized":"2024-03-30T01:51:33.792626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:15:59.657625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.833260+0000","last_change":"2024-03-30T01:51:32.343222+0000","last_active":"2024-03-30T01:51:32.833260+0000","last_peered":"2024-03-30T01:51:32.833260+0000","last_clean":"2024-03-30T01:51:32.833260+0000","last_became_active":"2024-03-30T01:51:32.342933+0000","last_became_peered":"2024-03-30T01:51:32.342933+0000","last_unstale":"2024-03-30T01:51:32.833260+0000","last_undegraded":"2024-03-30T01:51:32.833260+0000","last_fullsized":"2024-03-30T01:51:32.833260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:42:26.214040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:33.952250+0000","last_change":"2024-03-30T01:51:32.798373+0000","last_active":"2024-03-30T01:51:33.952250+0000","last_peered":"2024-03-30T01:51:33.952250+0000","last_clean":"2024-03-30T01:51:33.952250+0000","last_became_active":"2024-03-30T01:51:32.798184+0000","last_became_peered":"2024-03-30T01:51:32.798184+0000","last_unstale":"2024-03-30T01:51:33.952250+0000","last_undegraded":"2024-03-30T01:51:33.952250+0000","last_fullsized":"2024-03-30T01:51:33.952250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:12:19.249116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.826599+0000","last_change":"2024-03-30T01:51:32.336950+0000","last_active":"2024-03-30T01:51:32.826599+0000","last_peered":"2024-03-30T01:51:32.826599+0000","last_clean":"2024-03-30T01:51:32.826599+0000","last_became_active":"2024-03-30T01:51:32.336685+0000","last_became_peered":"2024-03-30T01:51:32.336685+0000","last_unstale":"2024-03-30T01:51:32.826599+0000","last_undegraded":"2024-03-30T01:51:32.826599+0000","last_fullsized":"2024-03-30T01:51:32.826599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:18.328608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-30T01:51:36.357072+0000","last_change":"2024-03-30T01:51:32.818072+0000","last_active":"2024-03-30T01:51:36.357072+0000","last_peered":"2024-03-30T01:51:36.357072+0000","last_clean":"2024-03-30T01:51:36.357072+0000","last_became_active":"2024-03-30T01:51:32.816795+0000","last_became_peered":"2024-03-30T01:51:32.816795+0000","last_unstale":"2024-03-30T01:51:36.357072+0000","last_undegraded":"2024-03-30T01:51:36.357072+0000","last_fullsized":"2024-03-30T01:51:36.357072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:32.283509+0000","last_clean_scrub_stamp":"2024-03-30T01:51:32.283509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:16:38.980879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T01:51:32.834008+0000","last_change":"2024-03-30T01:51:32.336309+0000","last_active":"2024-03-30T01:51:32.834008+0000","last_peered":"2024-03-30T01:51:32.834008+0000","last_clean":"2024-03-30T01:51:32.834008+0000","last_became_active":"2024-03-30T01:51:32.335769+0000","last_became_peered":"2024-03-30T01:51:32.335769+0000","last_unstale":"2024-03-30T01:51:32.834008+0000","last_undegraded":"2024-03-30T01:51:32.834008+0000","last_fullsized":"2024-03-30T01:51:32.834008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:31.268504+0000","last_clean_scrub_stamp":"2024-03-30T01:51:31.268504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T07:39:05.794505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4650000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.589}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3129999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5449999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.52}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3919999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1070000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3250000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1280000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":69879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5609999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1549999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":660885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T01:51:48.145 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-30T01:51:48.145 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-30T01:51:48.145 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-30T01:51:48.145 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-30T01:51:48.350 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T01:51:48.357 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T01:51:48.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.367+0000 7f91f4a00640 1 Processor -- start 2024-03-30T01:51:48.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.367+0000 7f91f4a00640 1 -- start start 2024-03-30T01:51:48.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.369+0000 7f91f4a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f91f0159730 0x7f91f00adc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:48.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.369+0000 7f91f4a00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f00ad000 con 0x7f91f0159b10 2024-03-30T01:51:48.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.369+0000 7f91f4a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f00ae7f0 con 0x7f91f00b39d0 2024-03-30T01:51:48.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.369+0000 7f91f4a00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f00aead0 con 0x7f91f0159730 2024-03-30T01:51:48.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.370+0000 7f91ee800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f91f0159730 0x7f91f00adc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:48.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.370+0000 7f91ee800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f91f0159730 0x7f91f00adc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60360/0 (socket says 172.21.15.133:60360) 2024-03-30T01:51:48.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.370+0000 7f91ee800640 1 -- 172.21.15.133:0/2330585686 learned_addr learned my addr 172.21.15.133:0/2330585686 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:48.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.370+0000 7f91ede00640 1 --1- 172.21.15.133:0/2330585686 >> v1:172.21.15.133:6789/0 conn(0x7f91f0159b10 0x7f91f00b32c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48812/0 (socket says 172.21.15.133:48812) 2024-03-30T01:51:48.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.370+0000 7f91ee800640 1 -- 172.21.15.133:0/2330585686 >> v1:172.21.15.137:6789/0 conn(0x7f91f00b39d0 legacy=0x7f91f00af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:48.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.370+0000 7f91ee800640 1 -- 172.21.15.133:0/2330585686 >> v1:172.21.15.133:6789/0 conn(0x7f91f0159b10 legacy=0x7f91f00b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:48.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.370+0000 7f91ee800640 1 -- 172.21.15.133:0/2330585686 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f00af070 con 0x7f91f0159730 2024-03-30T01:51:48.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.371+0000 7f91ee800640 1 --2- 172.21.15.133:0/2330585686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91f0159730 0x7f91f00adc50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009870 tx=0x7f91e002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3b4f6f58cdc190 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:48.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.371+0000 7f91ed400640 1 -- 172.21.15.133:0/2330585686 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e002f840 con 0x7f91f0159730 2024-03-30T01:51:48.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.371+0000 7f91ed400640 1 -- 172.21.15.133:0/2330585686 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e002f9a0 con 0x7f91f0159730 2024-03-30T01:51:48.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.371+0000 7f91ed400640 1 -- 172.21.15.133:0/2330585686 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e002fd30 con 0x7f91f0159730 2024-03-30T01:51:48.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.372+0000 7f91f4a00640 1 -- 172.21.15.133:0/2330585686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91f0159730 msgr2=0x7f91f00adc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:48.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.372+0000 7f91f4a00640 1 --2- 172.21.15.133:0/2330585686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91f0159730 0x7f91f00adc50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009870 tx=0x7f91e002ba20 comp rx=0 tx=0).stop 2024-03-30T01:51:48.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.372+0000 7f91f4a00640 1 -- 172.21.15.133:0/2330585686 shutdown_connections 2024-03-30T01:51:48.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.372+0000 7f91f4a00640 1 --2- 172.21.15.133:0/2330585686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91f0159730 0x7f91f00adc50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:48.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.372+0000 7f91f4a00640 1 -- 172.21.15.133:0/2330585686 >> 172.21.15.133:0/2330585686 conn(0x7f91f00719b0 msgr2=0x7f91f0098a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:48.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.372+0000 7f91f4a00640 1 -- 172.21.15.133:0/2330585686 shutdown_connections 2024-03-30T01:51:48.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.372+0000 7f91f4a00640 1 -- 172.21.15.133:0/2330585686 wait complete. 2024-03-30T01:51:48.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.374+0000 7f91f4a00640 1 Processor -- start 2024-03-30T01:51:48.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.374+0000 7f91f4a00640 1 -- start start 2024-03-30T01:51:48.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.375+0000 7f91f4a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91f00b39d0 0x7f91f0099770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:48.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.375+0000 7f91f4a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91f0159730 0x7f91f00cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:48.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.375+0000 7f91f4a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91f0159b10 0x7f91f0152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:48.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.375+0000 7f91f4a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f009d790 con 0x7f91f0159b10 2024-03-30T01:51:48.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.375+0000 7f91f4a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f0155a80 con 0x7f91f00b39d0 2024-03-30T01:51:48.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.375+0000 7f91f4a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f0155d60 con 0x7f91f0159730 2024-03-30T01:51:48.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.375+0000 7f91ef200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91f0159b10 0x7f91f0152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:48.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.375+0000 7f91ef200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91f0159b10 0x7f91f0152090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60366/0 (socket says 172.21.15.133:60366) 2024-03-30T01:51:48.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.375+0000 7f91ef200640 1 -- 172.21.15.133:0/1801916401 learned_addr learned my addr 172.21.15.133:0/1801916401 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:48.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.375+0000 7f91ee800640 1 --2- 172.21.15.133:0/1801916401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91f00b39d0 0x7f91f0099770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:48.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.375+0000 7f91ede00640 1 --2- 172.21.15.133:0/1801916401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91f0159730 0x7f91f00cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:48.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.375+0000 7f91ef200640 1 -- 172.21.15.133:0/1801916401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91f0159730 msgr2=0x7f91f00cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:48.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.375+0000 7f91ef200640 1 --2- 172.21.15.133:0/1801916401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91f0159730 0x7f91f00cdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:48.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.375+0000 7f91ef200640 1 -- 172.21.15.133:0/1801916401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91f00b39d0 msgr2=0x7f91f0099770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:48.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.375+0000 7f91ef200640 1 --2- 172.21.15.133:0/1801916401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91f00b39d0 0x7f91f0099770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:48.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.375+0000 7f91ef200640 1 -- 172.21.15.133:0/1801916401 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e00094d0 con 0x7f91f0159b10 2024-03-30T01:51:48.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.376+0000 7f91ef200640 1 --2- 172.21.15.133:0/1801916401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91f0159b10 0x7f91f0152090 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f91e800c7a0 tx=0x7f91e800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:48.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.376+0000 7f91e6a00640 1 -- 172.21.15.133:0/1801916401 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e8003b70 con 0x7f91f0159b10 2024-03-30T01:51:48.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.376+0000 7f91e6a00640 1 -- 172.21.15.133:0/1801916401 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e8003cf0 con 0x7f91f0159b10 2024-03-30T01:51:48.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.376+0000 7f91f4a00640 1 -- 172.21.15.133:0/1801916401 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f0156040 con 0x7f91f0159b10 2024-03-30T01:51:48.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.376+0000 7f91e6a00640 1 -- 172.21.15.133:0/1801916401 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e8003ea0 con 0x7f91f0159b10 2024-03-30T01:51:48.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.376+0000 7f91f4a00640 1 -- 172.21.15.133:0/1801916401 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f009d3d0 con 0x7f91f0159b10 2024-03-30T01:51:48.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.377+0000 7f91f4a00640 1 -- 172.21.15.133:0/1801916401 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f009d560 con 0x7f91f0159b10 2024-03-30T01:51:48.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.378+0000 7f91e6a00640 1 -- 172.21.15.133:0/1801916401 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f91e800aa90 con 0x7f91f0159b10 2024-03-30T01:51:48.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.379+0000 7f91e6a00640 1 --2- 172.21.15.133:0/1801916401 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f91d006ac00 0x7f91d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:48.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.380+0000 7f91e6a00640 1 -- 172.21.15.133:0/1801916401 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91e8089130 con 0x7f91f0159b10 2024-03-30T01:51:48.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.380+0000 7f91ee800640 1 --2- 172.21.15.133:0/1801916401 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f91d006ac00 0x7f91d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:48.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.380+0000 7f91ee800640 1 --2- 172.21.15.133:0/1801916401 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f91d006ac00 0x7f91d006d0c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f91e0036000 tx=0x7f91e0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:48.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.384+0000 7f91e6a00640 1 -- 172.21.15.133:0/1801916401 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f91e8054300 con 0x7f91f0159b10 2024-03-30T01:51:48.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.604+0000 7f91f4a00640 1 -- 172.21.15.133:0/1801916401 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f91f0156560 con 0x7f91f0159b10 2024-03-30T01:51:48.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.605+0000 7f91e6a00640 1 -- 172.21.15.133:0/1801916401 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f91f0156560 con 0x7f91f0159b10 2024-03-30T01:51:48.611 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:48.611 INFO:teuthology.orchestra.run.smithi133.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-30T01:51:48.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.607+0000 7f91f4a00640 1 -- 172.21.15.133:0/1801916401 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f91d006ac00 msgr2=0x7f91d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:48.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.607+0000 7f91f4a00640 1 --2- 172.21.15.133:0/1801916401 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f91d006ac00 0x7f91d006d0c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f91e0036000 tx=0x7f91e0008030 comp rx=0 tx=0).stop 2024-03-30T01:51:48.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.607+0000 7f91f4a00640 1 -- 172.21.15.133:0/1801916401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91f0159b10 msgr2=0x7f91f0152090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:48.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.607+0000 7f91f4a00640 1 --2- 172.21.15.133:0/1801916401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91f0159b10 0x7f91f0152090 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f91e800c7a0 tx=0x7f91e800cc60 comp rx=0 tx=0).stop 2024-03-30T01:51:48.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.607+0000 7f91f4a00640 1 -- 172.21.15.133:0/1801916401 shutdown_connections 2024-03-30T01:51:48.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.607+0000 7f91f4a00640 1 --2- 172.21.15.133:0/1801916401 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f91d006ac00 0x7f91d006d0c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:48.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.607+0000 7f91f4a00640 1 --2- 172.21.15.133:0/1801916401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91f0159b10 0x7f91f0152090 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:48.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.607+0000 7f91f4a00640 1 --2- 172.21.15.133:0/1801916401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91f0159730 0x7f91f00cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:48.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.607+0000 7f91f4a00640 1 --2- 172.21.15.133:0/1801916401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91f00b39d0 0x7f91f0099770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:48.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.607+0000 7f91f4a00640 1 -- 172.21.15.133:0/1801916401 >> 172.21.15.133:0/1801916401 conn(0x7f91f00719b0 msgr2=0x7f91f0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:48.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.607+0000 7f91f4a00640 1 -- 172.21.15.133:0/1801916401 shutdown_connections 2024-03-30T01:51:48.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.608+0000 7f91f4a00640 1 -- 172.21.15.133:0/1801916401 wait complete. 2024-03-30T01:51:48.631 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-30T01:51:48.631 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:51:48.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.830+0000 7f5e3fe00640 1 Processor -- start 2024-03-30T01:51:48.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.830+0000 7f5e3fe00640 1 -- start start 2024-03-30T01:51:48.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.831+0000 7f5e3fe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5e40159680 0x7f5e400cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:48.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.831+0000 7f5e3fe00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5e400ce2c0 0x7f5e4006da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:48.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.831+0000 7f5e3fe00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e400b2200 con 0x7f5e4006dfa0 2024-03-30T01:51:48.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.831+0000 7f5e3fe00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e4006e410 con 0x7f5e400ce2c0 2024-03-30T01:51:48.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.831+0000 7f5e3fe00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e400b1940 con 0x7f5e40159680 2024-03-30T01:51:48.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.831+0000 7f5e3e000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5e400ce2c0 0x7f5e4006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:48.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.832+0000 7f5e3e000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5e400ce2c0 0x7f5e4006da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60376/0 (socket says 172.21.15.133:60376) 2024-03-30T01:51:48.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.832+0000 7f5e3e000640 1 -- 172.21.15.133:0/2987354684 learned_addr learned my addr 172.21.15.133:0/2987354684 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:48.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.832+0000 7f5e3f400640 1 --1- 172.21.15.133:0/2987354684 >> v1:172.21.15.133:6789/0 conn(0x7f5e4006dfa0 0x7f5e400b2ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48814/0 (socket says 172.21.15.133:48814) 2024-03-30T01:51:48.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.832+0000 7f5e3ea00640 1 --2- 172.21.15.133:0/2987354684 >> v2:172.21.15.137:3300/0 conn(0x7f5e40159680 0x7f5e400cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:48.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.832+0000 7f5e3e000640 1 -- 172.21.15.133:0/2987354684 >> v2:172.21.15.137:3300/0 conn(0x7f5e40159680 msgr2=0x7f5e400cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:48.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.832+0000 7f5e3e000640 1 --2- 172.21.15.133:0/2987354684 >> v2:172.21.15.137:3300/0 conn(0x7f5e40159680 0x7f5e400cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:48.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.832+0000 7f5e3e000640 1 -- 172.21.15.133:0/2987354684 >> v1:172.21.15.133:6789/0 conn(0x7f5e4006dfa0 legacy=0x7f5e400b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:48.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.832+0000 7f5e3e000640 1 -- 172.21.15.133:0/2987354684 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e400b47e0 con 0x7f5e400ce2c0 2024-03-30T01:51:48.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.833+0000 7f5e3e000640 1 --2- 172.21.15.133:0/2987354684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e400ce2c0 0x7f5e4006da60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5e4006c920 tx=0x7f5e2c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579c32e5c133c8f3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:48.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.833+0000 7f5e3d600640 1 -- 172.21.15.133:0/2987354684 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c031870 con 0x7f5e400ce2c0 2024-03-30T01:51:48.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.833+0000 7f5e3d600640 1 -- 172.21.15.133:0/2987354684 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c0319d0 con 0x7f5e400ce2c0 2024-03-30T01:51:48.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.833+0000 7f5e3d600640 1 -- 172.21.15.133:0/2987354684 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c031d60 con 0x7f5e400ce2c0 2024-03-30T01:51:48.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.834+0000 7f5e3fe00640 1 -- 172.21.15.133:0/2987354684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e400ce2c0 msgr2=0x7f5e4006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:48.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.834+0000 7f5e3fe00640 1 --2- 172.21.15.133:0/2987354684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e400ce2c0 0x7f5e4006da60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5e4006c920 tx=0x7f5e2c02b910 comp rx=0 tx=0).stop 2024-03-30T01:51:48.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.834+0000 7f5e3fe00640 1 -- 172.21.15.133:0/2987354684 shutdown_connections 2024-03-30T01:51:48.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.834+0000 7f5e3fe00640 1 --2- 172.21.15.133:0/2987354684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e400ce2c0 0x7f5e4006da60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:48.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.834+0000 7f5e3fe00640 1 --2- 172.21.15.133:0/2987354684 >> v2:172.21.15.137:3300/0 conn(0x7f5e40159680 0x7f5e400cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:48.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.834+0000 7f5e3fe00640 1 -- 172.21.15.133:0/2987354684 >> 172.21.15.133:0/2987354684 conn(0x7f5e400b05a0 msgr2=0x7f5e400b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:48.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.834+0000 7f5e3fe00640 1 -- 172.21.15.133:0/2987354684 shutdown_connections 2024-03-30T01:51:48.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.834+0000 7f5e3fe00640 1 -- 172.21.15.133:0/2987354684 wait complete. 2024-03-30T01:51:48.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.836+0000 7f5e3fe00640 1 Processor -- start 2024-03-30T01:51:48.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.836+0000 7f5e3fe00640 1 -- start start 2024-03-30T01:51:48.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.837+0000 7f5e3fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e4006dfa0 0x7f5e4014e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:48.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.837+0000 7f5e3fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e400ce2c0 0x7f5e401f3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:48.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.837+0000 7f5e3fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e40159680 0x7f5e40157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:48.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.837+0000 7f5e3fe00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e401f44d0 con 0x7f5e40159680 2024-03-30T01:51:48.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.837+0000 7f5e3fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4014e920 con 0x7f5e4006dfa0 2024-03-30T01:51:48.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.837+0000 7f5e3fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4014ec00 con 0x7f5e400ce2c0 2024-03-30T01:51:48.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.837+0000 7f5e3f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e40159680 0x7f5e40157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:48.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.837+0000 7f5e3f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e40159680 0x7f5e40157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60388/0 (socket says 172.21.15.133:60388) 2024-03-30T01:51:48.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.837+0000 7f5e3f400640 1 -- 172.21.15.133:0/3082955665 learned_addr learned my addr 172.21.15.133:0/3082955665 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:48.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.837+0000 7f5e3ea00640 1 --2- 172.21.15.133:0/3082955665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e4006dfa0 0x7f5e4014e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:48.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.837+0000 7f5e3f400640 1 -- 172.21.15.133:0/3082955665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e400ce2c0 msgr2=0x7f5e401f3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:48.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.837+0000 7f5e3e000640 1 --2- 172.21.15.133:0/3082955665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e400ce2c0 0x7f5e401f3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:48.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.837+0000 7f5e3f400640 1 --2- 172.21.15.133:0/3082955665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e400ce2c0 0x7f5e401f3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:48.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.837+0000 7f5e3f400640 1 -- 172.21.15.133:0/3082955665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e4006dfa0 msgr2=0x7f5e4014e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:48.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.837+0000 7f5e3f400640 1 --2- 172.21.15.133:0/3082955665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e4006dfa0 0x7f5e4014e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:48.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.837+0000 7f5e3f400640 1 -- 172.21.15.133:0/3082955665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2c0094d0 con 0x7f5e40159680 2024-03-30T01:51:48.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.837+0000 7f5e3ea00640 1 --2- 172.21.15.133:0/3082955665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e4006dfa0 0x7f5e4014e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:48.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.838+0000 7f5e3f400640 1 --2- 172.21.15.133:0/3082955665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e40159680 0x7f5e40157500 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800c730 tx=0x7f5e3800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:48.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.838+0000 7f5e36a00640 1 -- 172.21.15.133:0/3082955665 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3800ce40 con 0x7f5e40159680 2024-03-30T01:51:48.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.838+0000 7f5e36a00640 1 -- 172.21.15.133:0/3082955665 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3800a640 con 0x7f5e40159680 2024-03-30T01:51:48.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.838+0000 7f5e36a00640 1 -- 172.21.15.133:0/3082955665 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3800a9f0 con 0x7f5e40159680 2024-03-30T01:51:48.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.838+0000 7f5e3fe00640 1 -- 172.21.15.133:0/3082955665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e40138be0 con 0x7f5e40159680 2024-03-30T01:51:48.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.838+0000 7f5e3fe00640 1 -- 172.21.15.133:0/3082955665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e401391a0 con 0x7f5e40159680 2024-03-30T01:51:48.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.839+0000 7f5e3fe00640 1 -- 172.21.15.133:0/3082955665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e40073750 con 0x7f5e40159680 2024-03-30T01:51:48.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.840+0000 7f5e36a00640 1 -- 172.21.15.133:0/3082955665 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f5e3800ab50 con 0x7f5e40159680 2024-03-30T01:51:48.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.841+0000 7f5e36a00640 1 --2- 172.21.15.133:0/3082955665 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f5e2006ac00 0x7f5e2006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:48.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.841+0000 7f5e36a00640 1 -- 172.21.15.133:0/3082955665 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e38088950 con 0x7f5e40159680 2024-03-30T01:51:48.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.841+0000 7f5e3ea00640 1 --2- 172.21.15.133:0/3082955665 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f5e2006ac00 0x7f5e2006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:48.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.841+0000 7f5e3ea00640 1 --2- 172.21.15.133:0/3082955665 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f5e2006ac00 0x7f5e2006d0c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5e30006fd0 tx=0x7f5e30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:48.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:48.845+0000 7f5e36a00640 1 -- 172.21.15.133:0/3082955665 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f5e38057700 con 0x7f5e40159680 2024-03-30T01:51:49.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.042+0000 7f5e3fe00640 1 -- 172.21.15.133:0/3082955665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e40070d80 con 0x7f5e40159680 2024-03-30T01:51:49.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.043+0000 7f5e36a00640 1 -- 172.21.15.133:0/3082955665 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f5e38017020 con 0x7f5e40159680 2024-03-30T01:51:49.050 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:49.050 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:51:33.780665+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:51:31.245378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T01:51:31.774247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:51:49.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.046+0000 7f5e3fe00640 1 -- 172.21.15.133:0/3082955665 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f5e2006ac00 msgr2=0x7f5e2006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:49.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.046+0000 7f5e3fe00640 1 --2- 172.21.15.133:0/3082955665 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f5e2006ac00 0x7f5e2006d0c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5e30006fd0 tx=0x7f5e30008040 comp rx=0 tx=0).stop 2024-03-30T01:51:49.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.046+0000 7f5e3fe00640 1 -- 172.21.15.133:0/3082955665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e40159680 msgr2=0x7f5e40157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:49.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.046+0000 7f5e3fe00640 1 --2- 172.21.15.133:0/3082955665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e40159680 0x7f5e40157500 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800c730 tx=0x7f5e3800cbf0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.046+0000 7f5e3fe00640 1 -- 172.21.15.133:0/3082955665 shutdown_connections 2024-03-30T01:51:49.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.046+0000 7f5e3fe00640 1 --2- 172.21.15.133:0/3082955665 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f5e2006ac00 0x7f5e2006d0c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.046+0000 7f5e3fe00640 1 --2- 172.21.15.133:0/3082955665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e40159680 0x7f5e40157500 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.046+0000 7f5e3fe00640 1 --2- 172.21.15.133:0/3082955665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e400ce2c0 0x7f5e401f3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.046+0000 7f5e3fe00640 1 --2- 172.21.15.133:0/3082955665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e4006dfa0 0x7f5e4014e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.046+0000 7f5e3fe00640 1 -- 172.21.15.133:0/3082955665 >> 172.21.15.133:0/3082955665 conn(0x7f5e400b05a0 msgr2=0x7f5e40156330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:49.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.046+0000 7f5e3fe00640 1 -- 172.21.15.133:0/3082955665 shutdown_connections 2024-03-30T01:51:49.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.046+0000 7f5e3fe00640 1 -- 172.21.15.133:0/3082955665 wait complete. 2024-03-30T01:51:49.071 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T01:51:21.771393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T01:51:31.245378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T01:51:31.774247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T01:51:49.072 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T01:51:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.275+0000 7f3735e00640 1 Processor -- start 2024-03-30T01:51:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.275+0000 7f3735e00640 1 -- start start 2024-03-30T01:51:49.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.276+0000 7f3735e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f37300b42c0 0x7f37300cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:49.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.276+0000 7f3735e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37300ccb30 0x7f373015e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:49.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.276+0000 7f3735e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f373013dba0 con 0x7f373015b9c0 2024-03-30T01:51:49.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.276+0000 7f3735e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f373015bda0 con 0x7f37300b42c0 2024-03-30T01:51:49.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.276+0000 7f3735e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37301408b0 con 0x7f37300ccb30 2024-03-30T01:51:49.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.277+0000 7f372fe00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f37300b42c0 0x7f37300cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:49.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.277+0000 7f372fe00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f37300b42c0 0x7f37300cc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60394/0 (socket says 172.21.15.133:60394) 2024-03-30T01:51:49.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.277+0000 7f372fe00640 1 -- 172.21.15.133:0/2901190524 learned_addr learned my addr 172.21.15.133:0/2901190524 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:49.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.277+0000 7f3735400640 1 --2- 172.21.15.133:0/2901190524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37300ccb30 0x7f373015e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:49.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.277+0000 7f372fe00640 1 -- 172.21.15.133:0/2901190524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37300ccb30 msgr2=0x7f373015e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:49.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.277+0000 7f372fe00640 1 --2- 172.21.15.133:0/2901190524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37300ccb30 0x7f373015e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.277+0000 7f372fe00640 1 -- 172.21.15.133:0/2901190524 >> v1:172.21.15.137:6789/0 conn(0x7f373015b9c0 legacy=0x7f37300b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:49.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.277+0000 7f372fe00640 1 -- 172.21.15.133:0/2901190524 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373015ad40 con 0x7f37300b42c0 2024-03-30T01:51:49.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.278+0000 7f372fe00640 1 --2- 172.21.15.133:0/2901190524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37300b42c0 0x7f37300cc5f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f371c009870 tx=0x7f371c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0afc208631ae053 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:49.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.279+0000 7f372f400640 1 -- 172.21.15.133:0/2901190524 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c030840 con 0x7f37300b42c0 2024-03-30T01:51:49.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.279+0000 7f372f400640 1 -- 172.21.15.133:0/2901190524 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371c0309a0 con 0x7f37300b42c0 2024-03-30T01:51:49.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.279+0000 7f372f400640 1 -- 172.21.15.133:0/2901190524 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c030d30 con 0x7f37300b42c0 2024-03-30T01:51:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.279+0000 7f3735e00640 1 -- 172.21.15.133:0/2901190524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37300b42c0 msgr2=0x7f37300cc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.279+0000 7f3735e00640 1 --2- 172.21.15.133:0/2901190524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37300b42c0 0x7f37300cc5f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f371c009870 tx=0x7f371c02b980 comp rx=0 tx=0).stop 2024-03-30T01:51:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.279+0000 7f3735e00640 1 -- 172.21.15.133:0/2901190524 shutdown_connections 2024-03-30T01:51:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.279+0000 7f3735e00640 1 --2- 172.21.15.133:0/2901190524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37300ccb30 0x7f373015e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.279+0000 7f3735e00640 1 --2- 172.21.15.133:0/2901190524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37300b42c0 0x7f37300cc5f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.279+0000 7f3735e00640 1 -- 172.21.15.133:0/2901190524 >> 172.21.15.133:0/2901190524 conn(0x7f37300b05a0 msgr2=0x7f37300b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.279+0000 7f3735e00640 1 -- 172.21.15.133:0/2901190524 shutdown_connections 2024-03-30T01:51:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.279+0000 7f3735e00640 1 -- 172.21.15.133:0/2901190524 wait complete. 2024-03-30T01:51:49.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.281+0000 7f3735e00640 1 Processor -- start 2024-03-30T01:51:49.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.281+0000 7f3735e00640 1 -- start start 2024-03-30T01:51:49.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.282+0000 7f3735e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37300b42c0 0x7f37301ef980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:49.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.282+0000 7f3735e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37300ccb30 0x7f3730152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:49.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.282+0000 7f3735e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f373015b9c0 0x7f3730158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:49.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.282+0000 7f3735e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3730139930 con 0x7f373015b9c0 2024-03-30T01:51:49.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.282+0000 7f3735e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3730155d00 con 0x7f37300b42c0 2024-03-30T01:51:49.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.282+0000 7f3735e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3730155fe0 con 0x7f37300ccb30 2024-03-30T01:51:49.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.282+0000 7f3735400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f373015b9c0 0x7f3730158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:49.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.282+0000 7f3735400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f373015b9c0 0x7f3730158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60400/0 (socket says 172.21.15.133:60400) 2024-03-30T01:51:49.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.282+0000 7f3735400640 1 -- 172.21.15.133:0/172108065 learned_addr learned my addr 172.21.15.133:0/172108065 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:49.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.283+0000 7f3735400640 1 -- 172.21.15.133:0/172108065 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37300ccb30 msgr2=0x7f3730152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:49.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.283+0000 7f3735400640 1 --2- 172.21.15.133:0/172108065 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37300ccb30 0x7f3730152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.283+0000 7f3735400640 1 -- 172.21.15.133:0/172108065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37300b42c0 msgr2=0x7f37301ef980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:49.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.283+0000 7f3735400640 1 --2- 172.21.15.133:0/172108065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37300b42c0 0x7f37301ef980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.283+0000 7f3735400640 1 -- 172.21.15.133:0/172108065 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c0094d0 con 0x7f373015b9c0 2024-03-30T01:51:49.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.283+0000 7f3735400640 1 --2- 172.21.15.133:0/172108065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f373015b9c0 0x7f3730158360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3728007e40 tx=0x7f372800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:49.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.283+0000 7f372cc00640 1 -- 172.21.15.133:0/172108065 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3728014620 con 0x7f373015b9c0 2024-03-30T01:51:49.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.283+0000 7f372cc00640 1 -- 172.21.15.133:0/172108065 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372800ee90 con 0x7f373015b9c0 2024-03-30T01:51:49.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.283+0000 7f372cc00640 1 -- 172.21.15.133:0/172108065 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37280149e0 con 0x7f373015b9c0 2024-03-30T01:51:49.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.283+0000 7f3735e00640 1 -- 172.21.15.133:0/172108065 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37301562c0 con 0x7f373015b9c0 2024-03-30T01:51:49.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.283+0000 7f3735e00640 1 -- 172.21.15.133:0/172108065 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37301f0e30 con 0x7f373015b9c0 2024-03-30T01:51:49.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.285+0000 7f3735e00640 1 -- 172.21.15.133:0/172108065 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37301567e0 con 0x7f373015b9c0 2024-03-30T01:51:49.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.285+0000 7f372cc00640 1 -- 172.21.15.133:0/172108065 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f3728014b40 con 0x7f373015b9c0 2024-03-30T01:51:49.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.287+0000 7f372cc00640 1 --2- 172.21.15.133:0/172108065 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f371006ac00 0x7f371006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:49.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.287+0000 7f372cc00640 1 -- 172.21.15.133:0/172108065 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3728089dd0 con 0x7f373015b9c0 2024-03-30T01:51:49.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.287+0000 7f3734a00640 1 --2- 172.21.15.133:0/172108065 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f371006ac00 0x7f371006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:49.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.287+0000 7f3734a00640 1 --2- 172.21.15.133:0/172108065 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f371006ac00 0x7f371006d0c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3724000f60 tx=0x7f37240079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:49.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.291+0000 7f372cc00640 1 -- 172.21.15.133:0/172108065 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f37301567e0 con 0x7f373015b9c0 2024-03-30T01:51:49.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.487+0000 7f3735e00640 1 -- 172.21.15.133:0/172108065 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f37301567e0 con 0x7f373015b9c0 2024-03-30T01:51:49.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.487+0000 7f372cc00640 1 -- 172.21.15.133:0/172108065 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f37301567e0 con 0x7f373015b9c0 2024-03-30T01:51:49.494 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-03-30T01:51:49.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.490+0000 7f3735e00640 1 -- 172.21.15.133:0/172108065 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f371006ac00 msgr2=0x7f371006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:49.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.490+0000 7f3735e00640 1 --2- 172.21.15.133:0/172108065 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f371006ac00 0x7f371006d0c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3724000f60 tx=0x7f37240079b0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.490+0000 7f3735e00640 1 -- 172.21.15.133:0/172108065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f373015b9c0 msgr2=0x7f3730158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:49.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.490+0000 7f3735e00640 1 --2- 172.21.15.133:0/172108065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f373015b9c0 0x7f3730158360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3728007e40 tx=0x7f372800e4b0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.490+0000 7f3735e00640 1 -- 172.21.15.133:0/172108065 shutdown_connections 2024-03-30T01:51:49.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.490+0000 7f3735e00640 1 --2- 172.21.15.133:0/172108065 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f371006ac00 0x7f371006d0c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.490+0000 7f3735e00640 1 --2- 172.21.15.133:0/172108065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f373015b9c0 0x7f3730158360 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.490+0000 7f3735e00640 1 --2- 172.21.15.133:0/172108065 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37300ccb30 0x7f3730152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.490+0000 7f3735e00640 1 --2- 172.21.15.133:0/172108065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37300b42c0 0x7f37301ef980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.490+0000 7f3735e00640 1 -- 172.21.15.133:0/172108065 >> 172.21.15.133:0/172108065 conn(0x7f37300b05a0 msgr2=0x7f37300b3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:49.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.491+0000 7f3735e00640 1 -- 172.21.15.133:0/172108065 shutdown_connections 2024-03-30T01:51:49.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.491+0000 7f3735e00640 1 -- 172.21.15.133:0/172108065 wait complete. 2024-03-30T01:51:49.517 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T01:51:49.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.725+0000 7f936ea00640 1 Processor -- start 2024-03-30T01:51:49.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.725+0000 7f936ea00640 1 -- start start 2024-03-30T01:51:49.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.727+0000 7f936ea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93680cfb80 0x7f93680b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:49.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.727+0000 7f936ea00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f936815d030 con 0x7f93680d0af0 2024-03-30T01:51:49.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.727+0000 7f936ea00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93680b5af0 con 0x7f936815cc50 2024-03-30T01:51:49.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.727+0000 7f936ea00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93680d1c50 con 0x7f93680cfb80 2024-03-30T01:51:49.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.727+0000 7f935fe00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f93680d0af0 0x7f93680cf470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48824/0 (socket says 172.21.15.133:48824) 2024-03-30T01:51:49.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.727+0000 7f935fe00640 1 -- 172.21.15.133:0/39787328 learned_addr learned my addr 172.21.15.133:0/39787328 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:49.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.727+0000 7f936ca00640 1 --2- 172.21.15.133:0/39787328 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93680cfb80 0x7f93680b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:49.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.727+0000 7f9367400640 1 -- 172.21.15.133:0/39787328 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4075644483 0 0) 0x7f936815d030 con 0x7f93680d0af0 2024-03-30T01:51:49.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.728+0000 7f9367400640 1 -- 172.21.15.133:0/39787328 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f934c003520 con 0x7f93680d0af0 2024-03-30T01:51:49.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.728+0000 7f9367400640 1 -- 172.21.15.133:0/39787328 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1959421977 0 0) 0x7f934c003520 con 0x7f93680d0af0 2024-03-30T01:51:49.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.728+0000 7f9367400640 1 -- 172.21.15.133:0/39787328 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93680cfb80 msgr2=0x7f93680b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:49.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.728+0000 7f9367400640 1 --2- 172.21.15.133:0/39787328 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93680cfb80 0x7f93680b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.728+0000 7f9367400640 1 -- 172.21.15.133:0/39787328 >> v1:172.21.15.137:6789/0 conn(0x7f936815cc50 legacy=0x7f93680d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:49.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.728+0000 7f9367400640 1 -- 172.21.15.133:0/39787328 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93680d10d0 con 0x7f93680d0af0 2024-03-30T01:51:49.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.728+0000 7f9367400640 1 -- 172.21.15.133:0/39787328 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f9350001670 con 0x7f93680d0af0 2024-03-30T01:51:49.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.728+0000 7f9367400640 1 -- 172.21.15.133:0/39787328 >> v1:172.21.15.133:6789/0 conn(0x7f93680d0af0 legacy=0x7f93680cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:49.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.728+0000 7f9367400640 1 --2- 172.21.15.133:0/39787328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f934c0039a0 0x7f934c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:49.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.728+0000 7f9367400640 1 --2- 172.21.15.133:0/39787328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f934c004350 0x7f934c004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:49.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.728+0000 7f9367400640 1 --2- 172.21.15.133:0/39787328 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93680cfb80 0x7f934c005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:49.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.728+0000 7f9367400640 1 -- 172.21.15.133:0/39787328 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93680d1c50 con 0x7f934c004350 2024-03-30T01:51:49.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.728+0000 7f9367400640 1 -- 172.21.15.133:0/39787328 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c00b980 con 0x7f934c0039a0 2024-03-30T01:51:49.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.728+0000 7f9367400640 1 -- 172.21.15.133:0/39787328 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934c00bb40 con 0x7f93680cfb80 2024-03-30T01:51:49.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.728+0000 7f935fe00640 1 --2- 172.21.15.133:0/39787328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f934c004350 0x7f934c004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:49.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.729+0000 7f9367e00640 1 --2- 172.21.15.133:0/39787328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f934c0039a0 0x7f934c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:49.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.729+0000 7f936ca00640 1 --2- 172.21.15.133:0/39787328 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93680cfb80 0x7f934c005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:49.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.729+0000 7f935fe00640 1 -- 172.21.15.133:0/39787328 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93680cfb80 msgr2=0x7f934c005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:49.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.729+0000 7f935fe00640 1 --2- 172.21.15.133:0/39787328 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93680cfb80 0x7f934c005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.729+0000 7f935fe00640 1 -- 172.21.15.133:0/39787328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f934c0039a0 msgr2=0x7f934c003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:49.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.729+0000 7f935fe00640 1 --2- 172.21.15.133:0/39787328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f934c0039a0 0x7f934c003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.729+0000 7f935fe00640 1 -- 172.21.15.133:0/39787328 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c003520 con 0x7f934c004350 2024-03-30T01:51:49.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.729+0000 7f936ca00640 1 --2- 172.21.15.133:0/39787328 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93680cfb80 0x7f934c005080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:51:49.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.729+0000 7f9367e00640 1 --2- 172.21.15.133:0/39787328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f934c0039a0 0x7f934c003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:51:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.730+0000 7f935fe00640 1 --2- 172.21.15.133:0/39787328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f934c004350 0x7f934c004820 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f935000c210 tx=0x7f934c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fea8b99df3cdcf7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.731+0000 7f9367400640 1 -- 172.21.15.133:0/39787328 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9350005ad0 con 0x7f934c004350 2024-03-30T01:51:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.731+0000 7f9367400640 1 -- 172.21.15.133:0/39787328 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9350005c50 con 0x7f934c004350 2024-03-30T01:51:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.731+0000 7f9367400640 1 -- 172.21.15.133:0/39787328 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935002c8d0 con 0x7f934c004350 2024-03-30T01:51:49.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.731+0000 7f936ea00640 1 -- 172.21.15.133:0/39787328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f934c004350 msgr2=0x7f934c004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:49.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.731+0000 7f936ea00640 1 --2- 172.21.15.133:0/39787328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f934c004350 0x7f934c004820 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f935000c210 tx=0x7f934c0057f0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.731+0000 7f936ca00640 1 -- 172.21.15.133:0/39787328 reap_dead start 2024-03-30T01:51:49.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.732+0000 7f936ea00640 1 -- 172.21.15.133:0/39787328 shutdown_connections 2024-03-30T01:51:49.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.732+0000 7f936ea00640 1 -- 172.21.15.133:0/39787328 >> 172.21.15.133:0/39787328 conn(0x7f9368071a40 msgr2=0x7f936806b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:49.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.732+0000 7f936ea00640 1 -- 172.21.15.133:0/39787328 shutdown_connections 2024-03-30T01:51:49.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.732+0000 7f936ea00640 1 -- 172.21.15.133:0/39787328 wait complete. 2024-03-30T01:51:49.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.733+0000 7f936ea00640 1 Processor -- start 2024-03-30T01:51:49.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.734+0000 7f936ea00640 1 -- start start 2024-03-30T01:51:49.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.734+0000 7f936ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f934c004350 0x7f936815ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:49.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.734+0000 7f936ea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93680c8410 0x7f93681f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:49.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.734+0000 7f936ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93681f30e0 0x7f9368072ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:49.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.734+0000 7f936ea00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936815de70 con 0x7f93681f30e0 2024-03-30T01:51:49.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.734+0000 7f936ea00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936815e150 con 0x7f934c004350 2024-03-30T01:51:49.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.734+0000 7f936ea00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936815e430 con 0x7f93680c8410 2024-03-30T01:51:49.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.735+0000 7f936ca00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93681f30e0 0x7f9368072ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:49.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.735+0000 7f936ca00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93681f30e0 0x7f9368072ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60412/0 (socket says 172.21.15.133:60412) 2024-03-30T01:51:49.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.735+0000 7f936ca00640 1 -- 172.21.15.133:0/2607571197 learned_addr learned my addr 172.21.15.133:0/2607571197 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:49.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.735+0000 7f9367e00640 1 --2- 172.21.15.133:0/2607571197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f934c004350 0x7f936815ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:49.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.735+0000 7f935fe00640 1 --2- 172.21.15.133:0/2607571197 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93680c8410 0x7f93681f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:49.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.735+0000 7f936ca00640 1 -- 172.21.15.133:0/2607571197 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93680c8410 msgr2=0x7f93681f2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:49.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.735+0000 7f936ca00640 1 --2- 172.21.15.133:0/2607571197 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93680c8410 0x7f93681f2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.735+0000 7f936ca00640 1 -- 172.21.15.133:0/2607571197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f934c004350 msgr2=0x7f936815ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:49.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.735+0000 7f936ca00640 1 --2- 172.21.15.133:0/2607571197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f934c004350 0x7f936815ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.735+0000 7f936ca00640 1 -- 172.21.15.133:0/2607571197 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936815e710 con 0x7f93681f30e0 2024-03-30T01:51:49.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.735+0000 7f935fe00640 1 --2- 172.21.15.133:0/2607571197 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93680c8410 0x7f93681f2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:49.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.735+0000 7f936ca00640 1 --2- 172.21.15.133:0/2607571197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93681f30e0 0x7f9368072ec0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f93680723f0 tx=0x7f9360009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:49.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.736+0000 7f9364c00640 1 -- 172.21.15.133:0/2607571197 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936001b070 con 0x7f93681f30e0 2024-03-30T01:51:49.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.736+0000 7f9364c00640 1 -- 172.21.15.133:0/2607571197 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936000f040 con 0x7f93681f30e0 2024-03-30T01:51:49.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.736+0000 7f9364c00640 1 -- 172.21.15.133:0/2607571197 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936000e050 con 0x7f93681f30e0 2024-03-30T01:51:49.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.736+0000 7f936ea00640 1 -- 172.21.15.133:0/2607571197 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f936815e9f0 con 0x7f93681f30e0 2024-03-30T01:51:49.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.736+0000 7f936ea00640 1 -- 172.21.15.133:0/2607571197 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93681f26e0 con 0x7f93681f30e0 2024-03-30T01:51:49.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.737+0000 7f936ea00640 1 -- 172.21.15.133:0/2607571197 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9368066d80 con 0x7f93681f30e0 2024-03-30T01:51:49.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.738+0000 7f9364c00640 1 -- 172.21.15.133:0/2607571197 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9360015440 con 0x7f93681f30e0 2024-03-30T01:51:49.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.739+0000 7f9364c00640 1 --2- 172.21.15.133:0/2607571197 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f934406ac30 0x7f934406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:49.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.739+0000 7f9364c00640 1 -- 172.21.15.133:0/2607571197 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93600899d0 con 0x7f93681f30e0 2024-03-30T01:51:49.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.739+0000 7f9367e00640 1 --2- 172.21.15.133:0/2607571197 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f934406ac30 0x7f934406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:49.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.740+0000 7f9367e00640 1 --2- 172.21.15.133:0/2607571197 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f934406ac30 0x7f934406d0f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9368152500 tx=0x7f9358009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:49.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.743+0000 7f9364c00640 1 -- 172.21.15.133:0/2607571197 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f9360054b10 con 0x7f93681f30e0 2024-03-30T01:51:49.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.935+0000 7f936ea00640 1 -- 172.21.15.133:0/2607571197 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f93680b7860 con 0x7f93681f30e0 2024-03-30T01:51:49.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.936+0000 7f9364c00640 1 -- 172.21.15.133:0/2607571197 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9360058130 con 0x7f93681f30e0 2024-03-30T01:51:49.942 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-03-30T01:51:49.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.938+0000 7f936ea00640 1 -- 172.21.15.133:0/2607571197 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f934406ac30 msgr2=0x7f934406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:49.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.938+0000 7f936ea00640 1 --2- 172.21.15.133:0/2607571197 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f934406ac30 0x7f934406d0f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9368152500 tx=0x7f9358009040 comp rx=0 tx=0).stop 2024-03-30T01:51:49.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.938+0000 7f936ea00640 1 -- 172.21.15.133:0/2607571197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93681f30e0 msgr2=0x7f9368072ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:49.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.938+0000 7f936ea00640 1 --2- 172.21.15.133:0/2607571197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93681f30e0 0x7f9368072ec0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f93680723f0 tx=0x7f9360009f90 comp rx=0 tx=0).stop 2024-03-30T01:51:49.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.939+0000 7f936ea00640 1 -- 172.21.15.133:0/2607571197 shutdown_connections 2024-03-30T01:51:49.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.939+0000 7f936ea00640 1 --2- 172.21.15.133:0/2607571197 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f934406ac30 0x7f934406d0f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.939+0000 7f936ea00640 1 --2- 172.21.15.133:0/2607571197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93681f30e0 0x7f9368072ec0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.939+0000 7f936ea00640 1 --2- 172.21.15.133:0/2607571197 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93680c8410 0x7f93681f2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.939+0000 7f936ea00640 1 --2- 172.21.15.133:0/2607571197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f934c004350 0x7f936815ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:49.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.939+0000 7f936ea00640 1 -- 172.21.15.133:0/2607571197 >> 172.21.15.133:0/2607571197 conn(0x7f9368071a40 msgr2=0x7f93680c9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:49.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.939+0000 7f936ea00640 1 -- 172.21.15.133:0/2607571197 shutdown_connections 2024-03-30T01:51:49.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:49.939+0000 7f936ea00640 1 -- 172.21.15.133:0/2607571197 wait complete. 2024-03-30T01:51:49.964 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T01:51:50.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.166+0000 7f0ce6400640 1 Processor -- start 2024-03-30T01:51:50.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.166+0000 7f0ce6400640 1 -- start start 2024-03-30T01:51:50.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.168+0000 7f0ce6400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ce015cc50 0x7f0ce00d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:50.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.168+0000 7f0ce6400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0ce00cfb80 0x7f0ce00b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:50.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.168+0000 7f0ce6400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce015d030 con 0x7f0ce00d2240 2024-03-30T01:51:50.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.168+0000 7f0ce6400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce00d1c50 con 0x7f0ce00cfb80 2024-03-30T01:51:50.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.168+0000 7f0ce6400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00b5af0 con 0x7f0ce015cc50 2024-03-30T01:51:50.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.168+0000 7f0cdfe00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0ce00cfb80 0x7f0ce00b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:50.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.168+0000 7f0cdfe00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0ce00cfb80 0x7f0ce00b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60414/0 (socket says 172.21.15.133:60414) 2024-03-30T01:51:50.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.168+0000 7f0cdfe00640 1 -- 172.21.15.133:0/1501394887 learned_addr learned my addr 172.21.15.133:0/1501394887 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:50.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.168+0000 7f0cdf400640 1 --2- 172.21.15.133:0/1501394887 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ce015cc50 0x7f0ce00d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:50.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.168+0000 7f0cdfe00640 1 -- 172.21.15.133:0/1501394887 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ce015cc50 msgr2=0x7f0ce00d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:50.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.168+0000 7f0cdfe00640 1 --2- 172.21.15.133:0/1501394887 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ce015cc50 0x7f0ce00d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:50.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.168+0000 7f0cdfe00640 1 -- 172.21.15.133:0/1501394887 >> v1:172.21.15.137:6789/0 conn(0x7f0ce00d2240 legacy=0x7f0ce00cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:50.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.168+0000 7f0cdfe00640 1 -- 172.21.15.133:0/1501394887 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce00d10d0 con 0x7f0ce00cfb80 2024-03-30T01:51:50.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.168+0000 7f0cdf400640 1 --2- 172.21.15.133:0/1501394887 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ce015cc50 0x7f0ce00d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:50.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.169+0000 7f0cdfe00640 1 --2- 172.21.15.133:0/1501394887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ce00cfb80 0x7f0ce00b14f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8009870 tx=0x7f0cd802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af17002b61cfbb1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.170+0000 7f0cde000640 1 -- 172.21.15.133:0/1501394887 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8031640 con 0x7f0ce00cfb80 2024-03-30T01:51:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.170+0000 7f0cde000640 1 -- 172.21.15.133:0/1501394887 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd80317a0 con 0x7f0ce00cfb80 2024-03-30T01:51:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.170+0000 7f0cde000640 1 -- 172.21.15.133:0/1501394887 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8031b30 con 0x7f0ce00cfb80 2024-03-30T01:51:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.170+0000 7f0ce6400640 1 -- 172.21.15.133:0/1501394887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ce00cfb80 msgr2=0x7f0ce00b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.170+0000 7f0ce6400640 1 --2- 172.21.15.133:0/1501394887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ce00cfb80 0x7f0ce00b14f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8009870 tx=0x7f0cd802b8f0 comp rx=0 tx=0).stop 2024-03-30T01:51:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.170+0000 7f0ce6400640 1 -- 172.21.15.133:0/1501394887 shutdown_connections 2024-03-30T01:51:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.170+0000 7f0ce6400640 1 --2- 172.21.15.133:0/1501394887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ce00cfb80 0x7f0ce00b14f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.170+0000 7f0ce6400640 1 --2- 172.21.15.133:0/1501394887 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ce015cc50 0x7f0ce00d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.170+0000 7f0ce6400640 1 -- 172.21.15.133:0/1501394887 >> 172.21.15.133:0/1501394887 conn(0x7f0ce0071a40 msgr2=0x7f0ce006b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.170+0000 7f0ce6400640 1 -- 172.21.15.133:0/1501394887 shutdown_connections 2024-03-30T01:51:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.171+0000 7f0ce6400640 1 -- 172.21.15.133:0/1501394887 wait complete. 2024-03-30T01:51:50.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.172+0000 7f0ce6400640 1 Processor -- start 2024-03-30T01:51:50.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.173+0000 7f0ce6400640 1 -- start start 2024-03-30T01:51:50.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.173+0000 7f0ce6400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ce00cfb80 0x7f0ce01554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:50.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.173+0000 7f0ce6400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ce00d2240 0x7f0ce00c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:50.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.173+0000 7f0ce6400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ce015cc50 0x7f0ce015f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.173+0000 7f0ce6400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00a9580 con 0x7f0ce00d2240 2024-03-30T01:51:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.173+0000 7f0ce6400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce01f2820 con 0x7f0ce00cfb80 2024-03-30T01:51:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.173+0000 7f0ce6400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce01f3880 con 0x7f0ce015cc50 2024-03-30T01:51:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.174+0000 7f0cdea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ce00d2240 0x7f0ce00c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.174+0000 7f0cdea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ce00d2240 0x7f0ce00c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60416/0 (socket says 172.21.15.133:60416) 2024-03-30T01:51:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.174+0000 7f0cdea00640 1 -- 172.21.15.133:0/95290836 learned_addr learned my addr 172.21.15.133:0/95290836 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.174+0000 7f0cdf400640 1 --2- 172.21.15.133:0/95290836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ce00cfb80 0x7f0ce01554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.174+0000 7f0cdfe00640 1 --2- 172.21.15.133:0/95290836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ce015cc50 0x7f0ce015f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.174+0000 7f0cdea00640 1 -- 172.21.15.133:0/95290836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ce015cc50 msgr2=0x7f0ce015f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.174+0000 7f0cdea00640 1 --2- 172.21.15.133:0/95290836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ce015cc50 0x7f0ce015f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.174+0000 7f0cdea00640 1 -- 172.21.15.133:0/95290836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ce00cfb80 msgr2=0x7f0ce01554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.174+0000 7f0cdea00640 1 --2- 172.21.15.133:0/95290836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ce00cfb80 0x7f0ce01554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.174+0000 7f0cdea00640 1 -- 172.21.15.133:0/95290836 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd80094d0 con 0x7f0ce00d2240 2024-03-30T01:51:50.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.175+0000 7f0cdea00640 1 --2- 172.21.15.133:0/95290836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ce00d2240 0x7f0ce00c8290 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800c430 tx=0x7f0cc800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:50.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.175+0000 7f0cd7400640 1 -- 172.21.15.133:0/95290836 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8011790 con 0x7f0ce00d2240 2024-03-30T01:51:50.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.175+0000 7f0cd7400640 1 -- 172.21.15.133:0/95290836 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc80118f0 con 0x7f0ce00d2240 2024-03-30T01:51:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.175+0000 7f0cd7400640 1 -- 172.21.15.133:0/95290836 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8011ce0 con 0x7f0ce00d2240 2024-03-30T01:51:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.175+0000 7f0ce6400640 1 -- 172.21.15.133:0/95290836 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce01f2ac0 con 0x7f0ce00d2240 2024-03-30T01:51:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.175+0000 7f0ce6400640 1 -- 172.21.15.133:0/95290836 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce01f3080 con 0x7f0ce00d2240 2024-03-30T01:51:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.176+0000 7f0ce6400640 1 -- 172.21.15.133:0/95290836 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce0066d80 con 0x7f0ce00d2240 2024-03-30T01:51:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.177+0000 7f0cd7400640 1 -- 172.21.15.133:0/95290836 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0cc801c460 con 0x7f0ce00d2240 2024-03-30T01:51:50.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.178+0000 7f0cd7400640 1 --2- 172.21.15.133:0/95290836 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0cbc06ac00 0x7f0cbc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:50.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.178+0000 7f0cd7400640 1 -- 172.21.15.133:0/95290836 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cc80892f0 con 0x7f0ce00d2240 2024-03-30T01:51:50.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.178+0000 7f0cdf400640 1 --2- 172.21.15.133:0/95290836 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0cbc06ac00 0x7f0cbc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:50.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.179+0000 7f0cdf400640 1 --2- 172.21.15.133:0/95290836 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0cbc06ac00 0x7f0cbc06d0c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0007510 tx=0x7f0cd00074a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:50.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.182+0000 7f0cd7400640 1 -- 172.21.15.133:0/95290836 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f0cc80544d0 con 0x7f0ce00d2240 2024-03-30T01:51:50.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.375+0000 7f0ce6400640 1 -- 172.21.15.133:0/95290836 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0ce00cc840 con 0x7f0ce00d2240 2024-03-30T01:51:50.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.376+0000 7f0cd7400640 1 -- 172.21.15.133:0/95290836 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0cc8057af0 con 0x7f0ce00d2240 2024-03-30T01:51:50.383 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-03-30T01:51:50.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.378+0000 7f0ce6400640 1 -- 172.21.15.133:0/95290836 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0cbc06ac00 msgr2=0x7f0cbc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:50.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.378+0000 7f0ce6400640 1 --2- 172.21.15.133:0/95290836 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0cbc06ac00 0x7f0cbc06d0c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0007510 tx=0x7f0cd00074a0 comp rx=0 tx=0).stop 2024-03-30T01:51:50.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.378+0000 7f0ce6400640 1 -- 172.21.15.133:0/95290836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ce00d2240 msgr2=0x7f0ce00c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:50.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.378+0000 7f0ce6400640 1 --2- 172.21.15.133:0/95290836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ce00d2240 0x7f0ce00c8290 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800c430 tx=0x7f0cc800c8f0 comp rx=0 tx=0).stop 2024-03-30T01:51:50.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.378+0000 7f0ce6400640 1 -- 172.21.15.133:0/95290836 shutdown_connections 2024-03-30T01:51:50.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.378+0000 7f0ce6400640 1 --2- 172.21.15.133:0/95290836 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0cbc06ac00 0x7f0cbc06d0c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:50.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.378+0000 7f0ce6400640 1 --2- 172.21.15.133:0/95290836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ce015cc50 0x7f0ce015f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:50.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.378+0000 7f0ce6400640 1 --2- 172.21.15.133:0/95290836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ce00d2240 0x7f0ce00c8290 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:50.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.378+0000 7f0ce6400640 1 --2- 172.21.15.133:0/95290836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ce00cfb80 0x7f0ce01554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:50.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.378+0000 7f0ce6400640 1 -- 172.21.15.133:0/95290836 >> 172.21.15.133:0/95290836 conn(0x7f0ce0071a40 msgr2=0x7f0ce0072ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:50.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.378+0000 7f0ce6400640 1 -- 172.21.15.133:0/95290836 shutdown_connections 2024-03-30T01:51:50.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.378+0000 7f0ce6400640 1 -- 172.21.15.133:0/95290836 wait complete. 2024-03-30T01:51:50.402 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T01:51:50.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.604+0000 7f3967800640 1 Processor -- start 2024-03-30T01:51:50.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.604+0000 7f3967800640 1 -- start start 2024-03-30T01:51:50.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.606+0000 7f3967800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3960143220 0x7f39600cd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:50.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.606+0000 7f3967800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39600ce400 con 0x7f396006e2e0 2024-03-30T01:51:50.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.606+0000 7f3967800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f396006d0e0 con 0x7f3960070c10 2024-03-30T01:51:50.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.606+0000 7f3967800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39600cc5c0 con 0x7f3960143220 2024-03-30T01:51:50.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.606+0000 7f395fe00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f396006e2e0 0x7f3960070500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48836/0 (socket says 172.21.15.133:48836) 2024-03-30T01:51:50.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.606+0000 7f395fe00640 1 -- 172.21.15.133:0/4118059548 learned_addr learned my addr 172.21.15.133:0/4118059548 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:50.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.606+0000 7f3964e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3960143220 0x7f39600cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:50.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.606+0000 7f395f400640 1 -- 172.21.15.133:0/4118059548 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366248452 0 0) 0x7f39600ce400 con 0x7f396006e2e0 2024-03-30T01:51:50.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.606+0000 7f395f400640 1 -- 172.21.15.133:0/4118059548 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3948005730 con 0x7f396006e2e0 2024-03-30T01:51:50.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.607+0000 7f3964e00640 1 -- 172.21.15.133:0/4118059548 >> v1:172.21.15.137:6789/0 conn(0x7f3960070c10 legacy=0x7f396015d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:50.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.607+0000 7f3964e00640 1 -- 172.21.15.133:0/4118059548 >> v1:172.21.15.133:6789/0 conn(0x7f396006e2e0 legacy=0x7f3960070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:50.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.607+0000 7f3964e00640 1 -- 172.21.15.133:0/4118059548 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396006d3c0 con 0x7f3960143220 2024-03-30T01:51:50.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.608+0000 7f3964e00640 1 --2- 172.21.15.133:0/4118059548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3960143220 0x7f39600cd990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f39540097a0 tx=0x7f395402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0d55bf8cbccd7a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:50.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.608+0000 7f395f400640 1 -- 172.21.15.133:0/4118059548 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3954030610 con 0x7f3960143220 2024-03-30T01:51:50.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.608+0000 7f395f400640 1 -- 172.21.15.133:0/4118059548 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3954030770 con 0x7f3960143220 2024-03-30T01:51:50.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.608+0000 7f395f400640 1 -- 172.21.15.133:0/4118059548 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3954030b00 con 0x7f3960143220 2024-03-30T01:51:50.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.609+0000 7f3967800640 1 -- 172.21.15.133:0/4118059548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3960143220 msgr2=0x7f39600cd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:50.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.609+0000 7f3967800640 1 --2- 172.21.15.133:0/4118059548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3960143220 0x7f39600cd990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f39540097a0 tx=0x7f395402b960 comp rx=0 tx=0).stop 2024-03-30T01:51:50.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.609+0000 7f3967800640 1 -- 172.21.15.133:0/4118059548 shutdown_connections 2024-03-30T01:51:50.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.609+0000 7f3967800640 1 --2- 172.21.15.133:0/4118059548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3960143220 0x7f39600cd990 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:50.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.609+0000 7f3967800640 1 -- 172.21.15.133:0/4118059548 >> 172.21.15.133:0/4118059548 conn(0x7f39600b07a0 msgr2=0x7f39600b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:50.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.609+0000 7f3967800640 1 -- 172.21.15.133:0/4118059548 shutdown_connections 2024-03-30T01:51:50.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.609+0000 7f3967800640 1 -- 172.21.15.133:0/4118059548 wait complete. 2024-03-30T01:51:50.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.611+0000 7f3967800640 1 Processor -- start 2024-03-30T01:51:50.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.611+0000 7f3967800640 1 -- start start 2024-03-30T01:51:50.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.612+0000 7f3967800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f396006e2e0 0x7f3960154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:50.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.612+0000 7f3967800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3960070c10 0x7f3960134690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:50.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.612+0000 7f3967800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3960143220 0x7f39601f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:50.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.612+0000 7f3967800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3960134200 con 0x7f396006e2e0 2024-03-30T01:51:50.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.612+0000 7f3967800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39601f69f0 con 0x7f3960070c10 2024-03-30T01:51:50.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.612+0000 7f3967800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39601f6cd0 con 0x7f3960143220 2024-03-30T01:51:50.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.612+0000 7f3964e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f396006e2e0 0x7f3960154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:50.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.612+0000 7f3964e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f396006e2e0 0x7f3960154dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60430/0 (socket says 172.21.15.133:60430) 2024-03-30T01:51:50.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.612+0000 7f3964e00640 1 -- 172.21.15.133:0/3207394449 learned_addr learned my addr 172.21.15.133:0/3207394449 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:50.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.612+0000 7f3965800640 1 --2- 172.21.15.133:0/3207394449 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3960143220 0x7f39601f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:50.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.612+0000 7f395fe00640 1 --2- 172.21.15.133:0/3207394449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3960070c10 0x7f3960134690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:50.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.612+0000 7f3964e00640 1 -- 172.21.15.133:0/3207394449 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3960143220 msgr2=0x7f39601f5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:50.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.613+0000 7f3964e00640 1 --2- 172.21.15.133:0/3207394449 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3960143220 0x7f39601f5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:50.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.613+0000 7f3964e00640 1 -- 172.21.15.133:0/3207394449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3960070c10 msgr2=0x7f3960134690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:50.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.613+0000 7f3964e00640 1 --2- 172.21.15.133:0/3207394449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3960070c10 0x7f3960134690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:50.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.613+0000 7f3964e00640 1 -- 172.21.15.133:0/3207394449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3954009400 con 0x7f396006e2e0 2024-03-30T01:51:50.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.613+0000 7f3965800640 1 --2- 172.21.15.133:0/3207394449 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3960143220 0x7f39601f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:50.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.613+0000 7f3964e00640 1 --2- 172.21.15.133:0/3207394449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f396006e2e0 0x7f3960154dc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3954000c00 tx=0x7f39540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:50.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.613+0000 7f395cc00640 1 -- 172.21.15.133:0/3207394449 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395403f070 con 0x7f396006e2e0 2024-03-30T01:51:50.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.613+0000 7f395cc00640 1 -- 172.21.15.133:0/3207394449 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3954030e30 con 0x7f396006e2e0 2024-03-30T01:51:50.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.613+0000 7f3967800640 1 -- 172.21.15.133:0/3207394449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3960133bb0 con 0x7f396006e2e0 2024-03-30T01:51:50.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.613+0000 7f395cc00640 1 -- 172.21.15.133:0/3207394449 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3954004250 con 0x7f396006e2e0 2024-03-30T01:51:50.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.613+0000 7f3967800640 1 -- 172.21.15.133:0/3207394449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3960155300 con 0x7f396006e2e0 2024-03-30T01:51:50.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.614+0000 7f3967800640 1 -- 172.21.15.133:0/3207394449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3960066d80 con 0x7f396006e2e0 2024-03-30T01:51:50.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.615+0000 7f395cc00640 1 -- 172.21.15.133:0/3207394449 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f3954043070 con 0x7f396006e2e0 2024-03-30T01:51:50.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.616+0000 7f395cc00640 1 --2- 172.21.15.133:0/3207394449 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f394406ac30 0x7f394406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:50.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.617+0000 7f395cc00640 1 -- 172.21.15.133:0/3207394449 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39540aaea0 con 0x7f396006e2e0 2024-03-30T01:51:50.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.617+0000 7f395fe00640 1 --2- 172.21.15.133:0/3207394449 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f394406ac30 0x7f394406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:50.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.617+0000 7f395fe00640 1 --2- 172.21.15.133:0/3207394449 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f394406ac30 0x7f394406d0f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f39600ca870 tx=0x7f3950009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:50.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.621+0000 7f395cc00640 1 -- 172.21.15.133:0/3207394449 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f3954076190 con 0x7f396006e2e0 2024-03-30T01:51:50.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.850+0000 7f3967800640 1 -- 172.21.15.133:0/3207394449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39601e5e70 con 0x7f396006e2e0 2024-03-30T01:51:50.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.851+0000 7f395cc00640 1 -- 172.21.15.133:0/3207394449 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4737 (secure 0 0 0) 0x7f3954034090 con 0x7f396006e2e0 2024-03-30T01:51:50.858 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:50.858 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2218506023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2218506023},{"type":"v1","addr":"172.21.15.137:6835","nonce":2218506023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2935514153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2935514153},{"type":"v1","addr":"172.21.15.133:6836","nonce":2935514153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2942187095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2942187095},{"type":"v1","addr":"172.21.15.133:6837","nonce":2942187095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T01:51:32.776583+0000","modified":"2024-03-30T01:51:35.787820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/225370013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":225370013},{"type":"v1","addr":"172.21.15.137:6834","nonce":225370013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-30T01:51:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 7 2024-03-30T01:51:50.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.854+0000 7f3967800640 1 -- 172.21.15.133:0/3207394449 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f394406ac30 msgr2=0x7f394406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:50.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.854+0000 7f3967800640 1 --2- 172.21.15.133:0/3207394449 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f394406ac30 0x7f394406d0f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f39600ca870 tx=0x7f3950009040 comp rx=0 tx=0).stop 2024-03-30T01:51:50.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.854+0000 7f3967800640 1 -- 172.21.15.133:0/3207394449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f396006e2e0 msgr2=0x7f3960154dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:50.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.854+0000 7f3967800640 1 --2- 172.21.15.133:0/3207394449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f396006e2e0 0x7f3960154dc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3954000c00 tx=0x7f39540046c0 comp rx=0 tx=0).stop 2024-03-30T01:51:50.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.854+0000 7f3967800640 1 -- 172.21.15.133:0/3207394449 shutdown_connections 2024-03-30T01:51:50.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.854+0000 7f3967800640 1 --2- 172.21.15.133:0/3207394449 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f394406ac30 0x7f394406d0f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:50.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.854+0000 7f3967800640 1 --2- 172.21.15.133:0/3207394449 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3960143220 0x7f39601f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:50.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.854+0000 7f3967800640 1 --2- 172.21.15.133:0/3207394449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3960070c10 0x7f3960134690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:50.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.854+0000 7f3967800640 1 --2- 172.21.15.133:0/3207394449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f396006e2e0 0x7f3960154dc0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:50.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.854+0000 7f3967800640 1 -- 172.21.15.133:0/3207394449 >> 172.21.15.133:0/3207394449 conn(0x7f39600b07a0 msgr2=0x7f3960070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:50.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.854+0000 7f3967800640 1 -- 172.21.15.133:0/3207394449 shutdown_connections 2024-03-30T01:51:50.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:50.854+0000 7f3967800640 1 -- 172.21.15.133:0/3207394449 wait complete. 2024-03-30T01:51:50.880 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:51:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.073+0000 7f10e2400640 1 Processor -- start 2024-03-30T01:51:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.074+0000 7f10e2400640 1 -- start start 2024-03-30T01:51:51.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.075+0000 7f10e2400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f10dc15cc50 0x7f10dc0d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:51.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.075+0000 7f10e2400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f10dc0cfb80 0x7f10dc0b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:51.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.075+0000 7f10e2400640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10dc15d030 con 0x7f10dc0d2240 2024-03-30T01:51:51.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.075+0000 7f10e2400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10dc0d1c50 con 0x7f10dc0cfb80 2024-03-30T01:51:51.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.075+0000 7f10e2400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10dc0b5af0 con 0x7f10dc15cc50 2024-03-30T01:51:51.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.075+0000 7f10dbe00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f10dc0cfb80 0x7f10dc0b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:51.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.075+0000 7f10dbe00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f10dc0cfb80 0x7f10dc0b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60438/0 (socket says 172.21.15.133:60438) 2024-03-30T01:51:51.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.075+0000 7f10dbe00640 1 -- 172.21.15.133:0/1351267136 learned_addr learned my addr 172.21.15.133:0/1351267136 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:51.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.076+0000 7f10db400640 1 --2- 172.21.15.133:0/1351267136 >> v2:172.21.15.137:3300/0 conn(0x7f10dc15cc50 0x7f10dc0d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:51.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.076+0000 7f10dbe00640 1 -- 172.21.15.133:0/1351267136 >> v2:172.21.15.137:3300/0 conn(0x7f10dc15cc50 msgr2=0x7f10dc0d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:51.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.076+0000 7f10dbe00640 1 --2- 172.21.15.133:0/1351267136 >> v2:172.21.15.137:3300/0 conn(0x7f10dc15cc50 0x7f10dc0d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.076+0000 7f10dbe00640 1 -- 172.21.15.133:0/1351267136 >> v1:172.21.15.133:6789/0 conn(0x7f10dc0d2240 legacy=0x7f10dc0cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:51.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.076+0000 7f10dbe00640 1 -- 172.21.15.133:0/1351267136 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc0d10d0 con 0x7f10dc0cfb80 2024-03-30T01:51:51.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.076+0000 7f10da000640 1 -- 172.21.15.133:0/1351267136 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1205149475 0 0) 0x7f10dc15d030 con 0x7f10dc0d2240 2024-03-30T01:51:51.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.077+0000 7f10dbe00640 1 --2- 172.21.15.133:0/1351267136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10dc0cfb80 0x7f10dc0b14f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0b5620 tx=0x7f10d402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43afe43d92a4be4e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:51.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.077+0000 7f10da000640 1 -- 172.21.15.133:0/1351267136 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4030860 con 0x7f10dc0cfb80 2024-03-30T01:51:51.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.077+0000 7f10da000640 1 -- 172.21.15.133:0/1351267136 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d40309c0 con 0x7f10dc0cfb80 2024-03-30T01:51:51.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.077+0000 7f10da000640 1 -- 172.21.15.133:0/1351267136 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4030d50 con 0x7f10dc0cfb80 2024-03-30T01:51:51.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.078+0000 7f10e2400640 1 -- 172.21.15.133:0/1351267136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10dc0cfb80 msgr2=0x7f10dc0b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:51.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.078+0000 7f10e2400640 1 --2- 172.21.15.133:0/1351267136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10dc0cfb80 0x7f10dc0b14f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0b5620 tx=0x7f10d402b9a0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.078+0000 7f10e2400640 1 -- 172.21.15.133:0/1351267136 shutdown_connections 2024-03-30T01:51:51.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.078+0000 7f10e2400640 1 --2- 172.21.15.133:0/1351267136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10dc0cfb80 0x7f10dc0b14f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.078+0000 7f10e2400640 1 --2- 172.21.15.133:0/1351267136 >> v2:172.21.15.137:3300/0 conn(0x7f10dc15cc50 0x7f10dc0d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.078+0000 7f10e2400640 1 -- 172.21.15.133:0/1351267136 >> 172.21.15.133:0/1351267136 conn(0x7f10dc071a40 msgr2=0x7f10dc06b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:51.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.078+0000 7f10e2400640 1 -- 172.21.15.133:0/1351267136 shutdown_connections 2024-03-30T01:51:51.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.078+0000 7f10e2400640 1 -- 172.21.15.133:0/1351267136 wait complete. 2024-03-30T01:51:51.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.080+0000 7f10e2400640 1 Processor -- start 2024-03-30T01:51:51.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.080+0000 7f10e2400640 1 -- start start 2024-03-30T01:51:51.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.080+0000 7f10e2400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10dc0cfb80 0x7f10dc0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:51.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.080+0000 7f10e2400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10dc0d2240 0x7f10dc0af510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:51.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.081+0000 7f10e2400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10dc15cc50 0x7f10dc0afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:51.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.081+0000 7f10e2400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0abc00 con 0x7f10dc0d2240 2024-03-30T01:51:51.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.081+0000 7f10e2400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0abee0 con 0x7f10dc15cc50 2024-03-30T01:51:51.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.081+0000 7f10e2400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0ad4b0 con 0x7f10dc0cfb80 2024-03-30T01:51:51.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.081+0000 7f10daa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10dc0d2240 0x7f10dc0af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:51.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.081+0000 7f10daa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10dc0d2240 0x7f10dc0af510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60444/0 (socket says 172.21.15.133:60444) 2024-03-30T01:51:51.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.081+0000 7f10daa00640 1 -- 172.21.15.133:0/767040874 learned_addr learned my addr 172.21.15.133:0/767040874 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.081+0000 7f10db400640 1 --2- 172.21.15.133:0/767040874 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10dc0cfb80 0x7f10dc0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.081+0000 7f10daa00640 1 -- 172.21.15.133:0/767040874 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10dc0cfb80 msgr2=0x7f10dc0b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.081+0000 7f10daa00640 1 --2- 172.21.15.133:0/767040874 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10dc0cfb80 0x7f10dc0b4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.081+0000 7f10daa00640 1 -- 172.21.15.133:0/767040874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10dc15cc50 msgr2=0x7f10dc0afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.081+0000 7f10dbe00640 1 --2- 172.21.15.133:0/767040874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10dc15cc50 0x7f10dc0afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.081+0000 7f10daa00640 1 --2- 172.21.15.133:0/767040874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10dc15cc50 0x7f10dc0afa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.081+0000 7f10daa00640 1 -- 172.21.15.133:0/767040874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d40094d0 con 0x7f10dc0d2240 2024-03-30T01:51:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.081+0000 7f10daa00640 1 --2- 172.21.15.133:0/767040874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10dc0d2240 0x7f10dc0af510 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f10c400c520 tx=0x7f10c400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.082+0000 7f10d3400640 1 -- 172.21.15.133:0/767040874 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c40052d0 con 0x7f10dc0d2240 2024-03-30T01:51:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.082+0000 7f10d3400640 1 -- 172.21.15.133:0/767040874 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c4005430 con 0x7f10dc0d2240 2024-03-30T01:51:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.082+0000 7f10d3400640 1 -- 172.21.15.133:0/767040874 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4012870 con 0x7f10dc0d2240 2024-03-30T01:51:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.082+0000 7f10e2400640 1 -- 172.21.15.133:0/767040874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10dc0ad790 con 0x7f10dc0d2240 2024-03-30T01:51:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.082+0000 7f10e2400640 1 -- 172.21.15.133:0/767040874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10dc0aaed0 con 0x7f10dc0d2240 2024-03-30T01:51:51.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.083+0000 7f10e2400640 1 -- 172.21.15.133:0/767040874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10dc0adcb0 con 0x7f10dc0d2240 2024-03-30T01:51:51.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.084+0000 7f10d3400640 1 -- 172.21.15.133:0/767040874 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f10c4003610 con 0x7f10dc0d2240 2024-03-30T01:51:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.085+0000 7f10d3400640 1 --2- 172.21.15.133:0/767040874 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f10b806ac00 0x7f10b806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.085+0000 7f10d3400640 1 -- 172.21.15.133:0/767040874 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10c4088990 con 0x7f10dc0d2240 2024-03-30T01:51:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.085+0000 7f10db400640 1 --2- 172.21.15.133:0/767040874 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f10b806ac00 0x7f10b806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.085+0000 7f10db400640 1 --2- 172.21.15.133:0/767040874 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f10b806ac00 0x7f10b806d0c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f10cc009e90 tx=0x7f10cc00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:51.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.089+0000 7f10d3400640 1 -- 172.21.15.133:0/767040874 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f10dc0adcb0 con 0x7f10dc0d2240 2024-03-30T01:51:51.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.287+0000 7f10e2400640 1 -- 172.21.15.133:0/767040874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10dc0adcb0 con 0x7f10dc0d2240 2024-03-30T01:51:51.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.288+0000 7f10d3400640 1 -- 172.21.15.133:0/767040874 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f10dc0adcb0 con 0x7f10dc0d2240 2024-03-30T01:51:51.295 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:51.295 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:51:33.780665+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:51:31.245378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T01:51:31.774247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:51:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.291+0000 7f10e2400640 1 -- 172.21.15.133:0/767040874 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f10b806ac00 msgr2=0x7f10b806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.291+0000 7f10e2400640 1 --2- 172.21.15.133:0/767040874 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f10b806ac00 0x7f10b806d0c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f10cc009e90 tx=0x7f10cc00b040 comp rx=0 tx=0).stop 2024-03-30T01:51:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.291+0000 7f10e2400640 1 -- 172.21.15.133:0/767040874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10dc0d2240 msgr2=0x7f10dc0af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.291+0000 7f10e2400640 1 --2- 172.21.15.133:0/767040874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10dc0d2240 0x7f10dc0af510 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f10c400c520 tx=0x7f10c400c9e0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.291+0000 7f10e2400640 1 -- 172.21.15.133:0/767040874 shutdown_connections 2024-03-30T01:51:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.291+0000 7f10e2400640 1 --2- 172.21.15.133:0/767040874 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f10b806ac00 0x7f10b806d0c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.291+0000 7f10e2400640 1 --2- 172.21.15.133:0/767040874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10dc15cc50 0x7f10dc0afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.291+0000 7f10e2400640 1 --2- 172.21.15.133:0/767040874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10dc0d2240 0x7f10dc0af510 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.291+0000 7f10e2400640 1 --2- 172.21.15.133:0/767040874 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10dc0cfb80 0x7f10dc0b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.291+0000 7f10e2400640 1 -- 172.21.15.133:0/767040874 >> 172.21.15.133:0/767040874 conn(0x7f10dc071a40 msgr2=0x7f10dc0b5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.292+0000 7f10e2400640 1 -- 172.21.15.133:0/767040874 shutdown_connections 2024-03-30T01:51:51.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.292+0000 7f10e2400640 1 -- 172.21.15.133:0/767040874 wait complete. 2024-03-30T01:51:51.317 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T01:51:21.771393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T01:51:31.245378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T01:51:31.774247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T01:51:51.317 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T01:51:51.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.518+0000 7f260d800640 1 Processor -- start 2024-03-30T01:51:51.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.518+0000 7f260d800640 1 -- start start 2024-03-30T01:51:51.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.520+0000 7f260d800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2608145d30 0x7f2608070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:51.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.520+0000 7f260d800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2608070a40 0x7f26080b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:51.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.520+0000 7f260d800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260806c320 con 0x7f26081457b0 2024-03-30T01:51:51.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.520+0000 7f260d800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2608070ed0 con 0x7f2608145d30 2024-03-30T01:51:51.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.520+0000 7f260d800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2608145b90 con 0x7f2608070a40 2024-03-30T01:51:51.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.520+0000 7f25fe000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2608145d30 0x7f2608070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:51.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.520+0000 7f25fe000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2608145d30 0x7f2608070500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60456/0 (socket says 172.21.15.133:60456) 2024-03-30T01:51:51.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.520+0000 7f25fe000640 1 -- 172.21.15.133:0/4060584231 learned_addr learned my addr 172.21.15.133:0/4060584231 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:51.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.521+0000 7f2607400640 1 --2- 172.21.15.133:0/4060584231 >> v2:172.21.15.137:3300/0 conn(0x7f2608070a40 0x7f26080b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:51.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.521+0000 7f25fe000640 1 -- 172.21.15.133:0/4060584231 >> v2:172.21.15.137:3300/0 conn(0x7f2608070a40 msgr2=0x7f26080b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:51.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.521+0000 7f25fe000640 1 --2- 172.21.15.133:0/4060584231 >> v2:172.21.15.137:3300/0 conn(0x7f2608070a40 0x7f26080b18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.521+0000 7f25fe000640 1 -- 172.21.15.133:0/4060584231 >> v1:172.21.15.137:6789/0 conn(0x7f26081457b0 legacy=0x7f26080b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:51.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.521+0000 7f25fe000640 1 -- 172.21.15.133:0/4060584231 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260806c600 con 0x7f2608145d30 2024-03-30T01:51:51.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.522+0000 7f25fe000640 1 --2- 172.21.15.133:0/4060584231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2608145d30 0x7f2608070500 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f260815d030 tx=0x7f25f002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf2780efb89315d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:51.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.522+0000 7f2606000640 1 -- 172.21.15.133:0/4060584231 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f0031870 con 0x7f2608145d30 2024-03-30T01:51:51.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.522+0000 7f2606000640 1 -- 172.21.15.133:0/4060584231 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f00319d0 con 0x7f2608145d30 2024-03-30T01:51:51.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.522+0000 7f2606000640 1 -- 172.21.15.133:0/4060584231 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f0031d60 con 0x7f2608145d30 2024-03-30T01:51:51.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.523+0000 7f260d800640 1 -- 172.21.15.133:0/4060584231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2608145d30 msgr2=0x7f2608070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:51.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.523+0000 7f260d800640 1 --2- 172.21.15.133:0/4060584231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2608145d30 0x7f2608070500 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f260815d030 tx=0x7f25f002b910 comp rx=0 tx=0).stop 2024-03-30T01:51:51.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.523+0000 7f260d800640 1 -- 172.21.15.133:0/4060584231 shutdown_connections 2024-03-30T01:51:51.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.523+0000 7f260d800640 1 --2- 172.21.15.133:0/4060584231 >> v2:172.21.15.137:3300/0 conn(0x7f2608070a40 0x7f26080b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.523+0000 7f260d800640 1 --2- 172.21.15.133:0/4060584231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2608145d30 0x7f2608070500 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.523+0000 7f260d800640 1 -- 172.21.15.133:0/4060584231 >> 172.21.15.133:0/4060584231 conn(0x7f26080b07a0 msgr2=0x7f26080b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:51.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.523+0000 7f260d800640 1 -- 172.21.15.133:0/4060584231 shutdown_connections 2024-03-30T01:51:51.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.523+0000 7f260d800640 1 -- 172.21.15.133:0/4060584231 wait complete. 2024-03-30T01:51:51.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.524+0000 7f260d800640 1 Processor -- start 2024-03-30T01:51:51.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.525+0000 7f260d800640 1 -- start start 2024-03-30T01:51:51.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.525+0000 7f260d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2608070a40 0x7f26080ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:51.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.525+0000 7f260d800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26081457b0 0x7f26080cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:51.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.525+0000 7f260d800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2608145d30 0x7f260815f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:51.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.525+0000 7f260d800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26080cde50 con 0x7f26081457b0 2024-03-30T01:51:51.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.525+0000 7f260d800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26080cd9c0 con 0x7f2608070a40 2024-03-30T01:51:51.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.525+0000 7f260d800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26080ca750 con 0x7f2608145d30 2024-03-30T01:51:51.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.526+0000 7f25fe000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26081457b0 0x7f26080cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:51.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.526+0000 7f25fe000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26081457b0 0x7f26080cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60466/0 (socket says 172.21.15.133:60466) 2024-03-30T01:51:51.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.526+0000 7f25fe000640 1 -- 172.21.15.133:0/2308847884 learned_addr learned my addr 172.21.15.133:0/2308847884 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:51.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.526+0000 7f2606a00640 1 --2- 172.21.15.133:0/2308847884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2608070a40 0x7f26080ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:51.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.526+0000 7f2607400640 1 --2- 172.21.15.133:0/2308847884 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2608145d30 0x7f260815f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:51.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.526+0000 7f25fe000640 1 -- 172.21.15.133:0/2308847884 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2608145d30 msgr2=0x7f260815f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:51.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.526+0000 7f25fe000640 1 --2- 172.21.15.133:0/2308847884 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2608145d30 0x7f260815f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.526+0000 7f25fe000640 1 -- 172.21.15.133:0/2308847884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2608070a40 msgr2=0x7f26080ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:51.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.526+0000 7f25fe000640 1 --2- 172.21.15.133:0/2308847884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2608070a40 0x7f26080ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.526+0000 7f25fe000640 1 -- 172.21.15.133:0/2308847884 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f00094d0 con 0x7f26081457b0 2024-03-30T01:51:51.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.526+0000 7f25fe000640 1 --2- 172.21.15.133:0/2308847884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26081457b0 0x7f26080cc2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f25f0000c00 tx=0x7f25f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:51.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.527+0000 7f25ff400640 1 -- 172.21.15.133:0/2308847884 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f0031820 con 0x7f26081457b0 2024-03-30T01:51:51.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.527+0000 7f25ff400640 1 -- 172.21.15.133:0/2308847884 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f00443f0 con 0x7f26081457b0 2024-03-30T01:51:51.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.527+0000 7f25ff400640 1 -- 172.21.15.133:0/2308847884 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f00447a0 con 0x7f26081457b0 2024-03-30T01:51:51.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.527+0000 7f260d800640 1 -- 172.21.15.133:0/2308847884 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26080ccdb0 con 0x7f26081457b0 2024-03-30T01:51:51.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.527+0000 7f260d800640 1 -- 172.21.15.133:0/2308847884 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26080cd370 con 0x7f26081457b0 2024-03-30T01:51:51.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.528+0000 7f260d800640 1 -- 172.21.15.133:0/2308847884 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26080ca890 con 0x7f26081457b0 2024-03-30T01:51:51.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.529+0000 7f25ff400640 1 -- 172.21.15.133:0/2308847884 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f25f004d450 con 0x7f26081457b0 2024-03-30T01:51:51.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.530+0000 7f25ff400640 1 --2- 172.21.15.133:0/2308847884 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f25e406ac00 0x7f25e406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:51.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.530+0000 7f25ff400640 1 -- 172.21.15.133:0/2308847884 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25f002d040 con 0x7f26081457b0 2024-03-30T01:51:51.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.530+0000 7f2606a00640 1 --2- 172.21.15.133:0/2308847884 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f25e406ac00 0x7f25e406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:51.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.531+0000 7f2606a00640 1 --2- 172.21.15.133:0/2308847884 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f25e406ac00 0x7f25e406d0c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f25f8004ea0 tx=0x7f25f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:51.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.534+0000 7f25ff400640 1 -- 172.21.15.133:0/2308847884 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f26080ca890 con 0x7f26081457b0 2024-03-30T01:51:51.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.715+0000 7f260d800640 1 -- 172.21.15.133:0/2308847884 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f26080ca890 con 0x7f26081457b0 2024-03-30T01:51:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.716+0000 7f25ff400640 1 -- 172.21.15.133:0/2308847884 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f26080ca890 con 0x7f26081457b0 2024-03-30T01:51:51.722 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-03-30T01:51:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.718+0000 7f260d800640 1 -- 172.21.15.133:0/2308847884 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f25e406ac00 msgr2=0x7f25e406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.718+0000 7f260d800640 1 --2- 172.21.15.133:0/2308847884 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f25e406ac00 0x7f25e406d0c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f25f8004ea0 tx=0x7f25f8009040 comp rx=0 tx=0).stop 2024-03-30T01:51:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.718+0000 7f260d800640 1 -- 172.21.15.133:0/2308847884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26081457b0 msgr2=0x7f26080cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.718+0000 7f260d800640 1 --2- 172.21.15.133:0/2308847884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26081457b0 0x7f26080cc2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f25f0000c00 tx=0x7f25f00046c0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.718+0000 7f260d800640 1 -- 172.21.15.133:0/2308847884 shutdown_connections 2024-03-30T01:51:51.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.718+0000 7f260d800640 1 --2- 172.21.15.133:0/2308847884 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f25e406ac00 0x7f25e406d0c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.718+0000 7f260d800640 1 --2- 172.21.15.133:0/2308847884 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2608145d30 0x7f260815f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.718+0000 7f260d800640 1 --2- 172.21.15.133:0/2308847884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26081457b0 0x7f26080cc2f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.718+0000 7f260d800640 1 --2- 172.21.15.133:0/2308847884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2608070a40 0x7f26080ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.718+0000 7f260d800640 1 -- 172.21.15.133:0/2308847884 >> 172.21.15.133:0/2308847884 conn(0x7f26080b07a0 msgr2=0x7f26080adc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:51.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.718+0000 7f260d800640 1 -- 172.21.15.133:0/2308847884 shutdown_connections 2024-03-30T01:51:51.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.718+0000 7f260d800640 1 -- 172.21.15.133:0/2308847884 wait complete. 2024-03-30T01:51:51.741 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T01:51:51.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.936+0000 7ff084200640 1 Processor -- start 2024-03-30T01:51:51.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.936+0000 7ff084200640 1 -- start start 2024-03-30T01:51:51.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.938+0000 7ff084200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff07c1457b0 0x7ff07c0b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:51.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.938+0000 7ff084200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07c06c320 con 0x7ff07c070c10 2024-03-30T01:51:51.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.938+0000 7ff084200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07c06c600 con 0x7ff07c145d30 2024-03-30T01:51:51.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.938+0000 7ff084200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07c145b90 con 0x7ff07c1457b0 2024-03-30T01:51:51.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.938+0000 7ff081800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff07c1457b0 0x7ff07c0b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:51.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.938+0000 7ff081800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff07c1457b0 0x7ff07c0b3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60482/0 (socket says 172.21.15.133:60482) 2024-03-30T01:51:51.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.938+0000 7ff081800640 1 -- 172.21.15.133:0/3185390630 learned_addr learned my addr 172.21.15.133:0/3185390630 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:51.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.938+0000 7ff082200640 1 --1- 172.21.15.133:0/3185390630 >> v1:172.21.15.133:6789/0 conn(0x7ff07c070c10 0x7ff07c0b18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48840/0 (socket says 172.21.15.133:48840) 2024-03-30T01:51:51.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.939+0000 7ff081800640 1 -- 172.21.15.133:0/3185390630 >> v1:172.21.15.137:6789/0 conn(0x7ff07c145d30 legacy=0x7ff07c070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:51.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.939+0000 7ff081800640 1 -- 172.21.15.133:0/3185390630 >> v1:172.21.15.133:6789/0 conn(0x7ff07c070c10 legacy=0x7ff07c0b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:51.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.939+0000 7ff081800640 1 -- 172.21.15.133:0/3185390630 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c06c8e0 con 0x7ff07c1457b0 2024-03-30T01:51:51.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.940+0000 7ff081800640 1 --2- 172.21.15.133:0/3185390630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff07c1457b0 0x7ff07c0b3850 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff070009870 tx=0x7ff07002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89055f455b4fef7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:51.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.940+0000 7ff07be00640 1 -- 172.21.15.133:0/3185390630 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff070030860 con 0x7ff07c1457b0 2024-03-30T01:51:51.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.940+0000 7ff07be00640 1 -- 172.21.15.133:0/3185390630 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0700309c0 con 0x7ff07c1457b0 2024-03-30T01:51:51.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.940+0000 7ff07be00640 1 -- 172.21.15.133:0/3185390630 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff070030d50 con 0x7ff07c1457b0 2024-03-30T01:51:51.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.940+0000 7ff084200640 1 -- 172.21.15.133:0/3185390630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff07c1457b0 msgr2=0x7ff07c0b3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:51.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.940+0000 7ff084200640 1 --2- 172.21.15.133:0/3185390630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff07c1457b0 0x7ff07c0b3850 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff070009870 tx=0x7ff07002b9a0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.941+0000 7ff084200640 1 -- 172.21.15.133:0/3185390630 shutdown_connections 2024-03-30T01:51:51.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.941+0000 7ff084200640 1 --2- 172.21.15.133:0/3185390630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff07c1457b0 0x7ff07c0b3850 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.941+0000 7ff084200640 1 -- 172.21.15.133:0/3185390630 >> 172.21.15.133:0/3185390630 conn(0x7ff07c0b07a0 msgr2=0x7ff07c0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:51.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.941+0000 7ff084200640 1 -- 172.21.15.133:0/3185390630 shutdown_connections 2024-03-30T01:51:51.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.941+0000 7ff084200640 1 -- 172.21.15.133:0/3185390630 wait complete. 2024-03-30T01:51:51.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.942+0000 7ff084200640 1 Processor -- start 2024-03-30T01:51:51.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.943+0000 7ff084200640 1 -- start start 2024-03-30T01:51:51.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.943+0000 7ff084200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff07c070c10 0x7ff07c1f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:51.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.943+0000 7ff084200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff07c1457b0 0x7ff07c133fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:51.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.943+0000 7ff084200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff07c145d30 0x7ff07c15ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:51.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.944+0000 7ff084200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c1344f0 con 0x7ff07c1457b0 2024-03-30T01:51:51.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.944+0000 7ff084200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c15f300 con 0x7ff07c070c10 2024-03-30T01:51:51.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.944+0000 7ff084200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c15f5e0 con 0x7ff07c145d30 2024-03-30T01:51:51.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.944+0000 7ff080e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff07c1457b0 0x7ff07c133fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:51.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.944+0000 7ff080e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff07c1457b0 0x7ff07c133fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60492/0 (socket says 172.21.15.133:60492) 2024-03-30T01:51:51.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.944+0000 7ff080e00640 1 -- 172.21.15.133:0/4266043562 learned_addr learned my addr 172.21.15.133:0/4266043562 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:51.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.944+0000 7ff081800640 1 --2- 172.21.15.133:0/4266043562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff07c070c10 0x7ff07c1f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:51.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.944+0000 7ff082200640 1 --2- 172.21.15.133:0/4266043562 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff07c145d30 0x7ff07c15ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:51.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.944+0000 7ff080e00640 1 -- 172.21.15.133:0/4266043562 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff07c145d30 msgr2=0x7ff07c15ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:51.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.944+0000 7ff080e00640 1 --2- 172.21.15.133:0/4266043562 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff07c145d30 0x7ff07c15ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.944+0000 7ff080e00640 1 -- 172.21.15.133:0/4266043562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff07c070c10 msgr2=0x7ff07c1f35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:51.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.944+0000 7ff080e00640 1 --2- 172.21.15.133:0/4266043562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff07c070c10 0x7ff07c1f35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:51.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.944+0000 7ff080e00640 1 -- 172.21.15.133:0/4266043562 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0700094d0 con 0x7ff07c1457b0 2024-03-30T01:51:51.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.945+0000 7ff080e00640 1 --2- 172.21.15.133:0/4266043562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff07c1457b0 0x7ff07c133fb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff06800b3f0 tx=0x7ff06800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:51.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.945+0000 7ff079600640 1 -- 172.21.15.133:0/4266043562 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff068011830 con 0x7ff07c1457b0 2024-03-30T01:51:51.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.945+0000 7ff079600640 1 -- 172.21.15.133:0/4266043562 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff068011990 con 0x7ff07c1457b0 2024-03-30T01:51:51.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.945+0000 7ff084200640 1 -- 172.21.15.133:0/4266043562 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff07c142ac0 con 0x7ff07c1457b0 2024-03-30T01:51:51.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.945+0000 7ff079600640 1 -- 172.21.15.133:0/4266043562 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff068011d40 con 0x7ff07c1457b0 2024-03-30T01:51:51.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.945+0000 7ff084200640 1 -- 172.21.15.133:0/4266043562 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07c143080 con 0x7ff07c1457b0 2024-03-30T01:51:51.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.946+0000 7ff084200640 1 -- 172.21.15.133:0/4266043562 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff07c0cb110 con 0x7ff07c1457b0 2024-03-30T01:51:51.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.947+0000 7ff079600640 1 -- 172.21.15.133:0/4266043562 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ff06801a400 con 0x7ff07c1457b0 2024-03-30T01:51:51.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.948+0000 7ff079600640 1 --2- 172.21.15.133:0/4266043562 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff05c06ac00 0x7ff05c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:51.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.948+0000 7ff079600640 1 -- 172.21.15.133:0/4266043562 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff068089290 con 0x7ff07c1457b0 2024-03-30T01:51:51.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.948+0000 7ff081800640 1 --2- 172.21.15.133:0/4266043562 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff05c06ac00 0x7ff05c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:51.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.949+0000 7ff081800640 1 --2- 172.21.15.133:0/4266043562 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff05c06ac00 0x7ff05c06d0c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff070036000 tx=0x7ff070008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:51.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:51.952+0000 7ff079600640 1 -- 172.21.15.133:0/4266043562 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7ff0680543d0 con 0x7ff07c1457b0 2024-03-30T01:51:52.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.145+0000 7ff084200640 1 -- 172.21.15.133:0/4266043562 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff07c142920 con 0x7ff07c1457b0 2024-03-30T01:51:52.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.146+0000 7ff079600640 1 -- 172.21.15.133:0/4266043562 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff07c142920 con 0x7ff07c1457b0 2024-03-30T01:51:52.152 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-03-30T01:51:52.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.149+0000 7ff084200640 1 -- 172.21.15.133:0/4266043562 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff05c06ac00 msgr2=0x7ff05c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:52.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.149+0000 7ff084200640 1 --2- 172.21.15.133:0/4266043562 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff05c06ac00 0x7ff05c06d0c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff070036000 tx=0x7ff070008030 comp rx=0 tx=0).stop 2024-03-30T01:51:52.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.149+0000 7ff084200640 1 -- 172.21.15.133:0/4266043562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff07c1457b0 msgr2=0x7ff07c133fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:52.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.149+0000 7ff084200640 1 --2- 172.21.15.133:0/4266043562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff07c1457b0 0x7ff07c133fb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff06800b3f0 tx=0x7ff06800b8b0 comp rx=0 tx=0).stop 2024-03-30T01:51:52.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.149+0000 7ff084200640 1 -- 172.21.15.133:0/4266043562 shutdown_connections 2024-03-30T01:51:52.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.149+0000 7ff084200640 1 --2- 172.21.15.133:0/4266043562 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff05c06ac00 0x7ff05c06d0c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:52.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.149+0000 7ff084200640 1 --2- 172.21.15.133:0/4266043562 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff07c145d30 0x7ff07c15ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:52.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.149+0000 7ff084200640 1 --2- 172.21.15.133:0/4266043562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff07c1457b0 0x7ff07c133fb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:52.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.149+0000 7ff084200640 1 --2- 172.21.15.133:0/4266043562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff07c070c10 0x7ff07c1f35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:52.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.149+0000 7ff084200640 1 -- 172.21.15.133:0/4266043562 >> 172.21.15.133:0/4266043562 conn(0x7ff07c0b07a0 msgr2=0x7ff07c0acda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:52.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.149+0000 7ff084200640 1 -- 172.21.15.133:0/4266043562 shutdown_connections 2024-03-30T01:51:52.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.149+0000 7ff084200640 1 -- 172.21.15.133:0/4266043562 wait complete. 2024-03-30T01:51:52.172 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T01:51:52.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.381+0000 7f0823400640 1 Processor -- start 2024-03-30T01:51:52.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.381+0000 7f0823400640 1 -- start start 2024-03-30T01:51:52.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.382+0000 7f0823400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f081c143790 0x7f081c0cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:52.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.383+0000 7f0823400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f081c0ccc40 0x7f081c070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:52.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.383+0000 7f0823400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f081c0a76a0 con 0x7f081c070500 2024-03-30T01:51:52.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.383+0000 7f0823400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f081c070ed0 con 0x7f081c143790 2024-03-30T01:51:52.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.383+0000 7f0823400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081c0b38e0 con 0x7f081c0ccc40 2024-03-30T01:51:52.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.383+0000 7f0821400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f081c0ccc40 0x7f081c070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:52.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.383+0000 7f0820a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f081c143790 0x7f081c0cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:52.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.383+0000 7f081be00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f081c070500 0x7f081c0cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.133:35522/0 (socket says 172.21.15.133:35522) 2024-03-30T01:51:52.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.383+0000 7f081be00640 1 -- 172.21.15.133:0/2741075054 learned_addr learned my addr 172.21.15.133:0/2741075054 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:52.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.384+0000 7f0820a00640 1 -- 172.21.15.133:0/2741075054 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f081c0ccc40 msgr2=0x7f081c070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:52.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.384+0000 7f0820a00640 1 --2- 172.21.15.133:0/2741075054 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f081c0ccc40 0x7f081c070990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:52.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.384+0000 7f0820a00640 1 -- 172.21.15.133:0/2741075054 >> v1:172.21.15.137:6789/0 conn(0x7f081c070500 legacy=0x7f081c0cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:52.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.384+0000 7f0820a00640 1 -- 172.21.15.133:0/2741075054 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081c0cd180 con 0x7f081c143790 2024-03-30T01:51:52.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.385+0000 7f0820a00640 1 --2- 172.21.15.133:0/2741075054 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f081c143790 0x7f081c0cbb10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f08100097a0 tx=0x7f081002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac0249ba64667d0a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:52.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.386+0000 7f081b400640 1 -- 172.21.15.133:0/2741075054 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0810030610 con 0x7f081c143790 2024-03-30T01:51:52.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.386+0000 7f081b400640 1 -- 172.21.15.133:0/2741075054 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0810030770 con 0x7f081c143790 2024-03-30T01:51:52.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.386+0000 7f081b400640 1 -- 172.21.15.133:0/2741075054 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0810030b00 con 0x7f081c143790 2024-03-30T01:51:52.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.386+0000 7f0823400640 1 -- 172.21.15.133:0/2741075054 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f081c143790 msgr2=0x7f081c0cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:52.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.386+0000 7f0823400640 1 --2- 172.21.15.133:0/2741075054 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f081c143790 0x7f081c0cbb10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f08100097a0 tx=0x7f081002b960 comp rx=0 tx=0).stop 2024-03-30T01:51:52.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.387+0000 7f0823400640 1 -- 172.21.15.133:0/2741075054 shutdown_connections 2024-03-30T01:51:52.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.387+0000 7f0823400640 1 --2- 172.21.15.133:0/2741075054 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f081c0ccc40 0x7f081c070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:52.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.387+0000 7f0823400640 1 --2- 172.21.15.133:0/2741075054 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f081c143790 0x7f081c0cbb10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:52.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.387+0000 7f0823400640 1 -- 172.21.15.133:0/2741075054 >> 172.21.15.133:0/2741075054 conn(0x7f081c0b07a0 msgr2=0x7f081c0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:52.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.387+0000 7f0823400640 1 -- 172.21.15.133:0/2741075054 shutdown_connections 2024-03-30T01:51:52.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.387+0000 7f0823400640 1 -- 172.21.15.133:0/2741075054 wait complete. 2024-03-30T01:51:52.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.389+0000 7f0823400640 1 Processor -- start 2024-03-30T01:51:52.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.389+0000 7f0823400640 1 -- start start 2024-03-30T01:51:52.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.390+0000 7f0823400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f081c070500 0x7f081c1395f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:52.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.390+0000 7f0823400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f081c0ccc40 0x7f081c0aa250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:52.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.390+0000 7f0823400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f081c143790 0x7f081c1413b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:52.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.390+0000 7f0823400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081c0a91b0 con 0x7f081c070500 2024-03-30T01:51:52.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.390+0000 7f0823400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081c0a9490 con 0x7f081c0ccc40 2024-03-30T01:51:52.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.390+0000 7f0823400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081c0a9770 con 0x7f081c143790 2024-03-30T01:51:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.390+0000 7f0820a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f081c070500 0x7f081c1395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.390+0000 7f0820a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f081c070500 0x7f081c1395f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60494/0 (socket says 172.21.15.133:60494) 2024-03-30T01:51:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.390+0000 7f0820a00640 1 -- 172.21.15.133:0/3923941087 learned_addr learned my addr 172.21.15.133:0/3923941087 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.391+0000 7f0821400640 1 --2- 172.21.15.133:0/3923941087 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f081c143790 0x7f081c1413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.391+0000 7f081be00640 1 --2- 172.21.15.133:0/3923941087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f081c0ccc40 0x7f081c0aa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.391+0000 7f0820a00640 1 -- 172.21.15.133:0/3923941087 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f081c143790 msgr2=0x7f081c1413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.391+0000 7f0820a00640 1 --2- 172.21.15.133:0/3923941087 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f081c143790 0x7f081c1413b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.391+0000 7f0820a00640 1 -- 172.21.15.133:0/3923941087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f081c0ccc40 msgr2=0x7f081c0aa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.391+0000 7f0820a00640 1 --2- 172.21.15.133:0/3923941087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f081c0ccc40 0x7f081c0aa250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.391+0000 7f0820a00640 1 -- 172.21.15.133:0/3923941087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0810009400 con 0x7f081c070500 2024-03-30T01:51:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.391+0000 7f0821400640 1 --2- 172.21.15.133:0/3923941087 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f081c143790 0x7f081c1413b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.391+0000 7f0820a00640 1 --2- 172.21.15.133:0/3923941087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f081c070500 0x7f081c1395f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f081002bf70 tx=0x7f0810004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:52.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.392+0000 7f0818c00640 1 -- 172.21.15.133:0/3923941087 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081003e040 con 0x7f081c070500 2024-03-30T01:51:52.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.392+0000 7f0818c00640 1 -- 172.21.15.133:0/3923941087 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0810039cb0 con 0x7f081c070500 2024-03-30T01:51:52.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.392+0000 7f0818c00640 1 -- 172.21.15.133:0/3923941087 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0810044630 con 0x7f081c070500 2024-03-30T01:51:52.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.392+0000 7f0823400640 1 -- 172.21.15.133:0/3923941087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f081c0a9a50 con 0x7f081c070500 2024-03-30T01:51:52.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.392+0000 7f0823400640 1 -- 172.21.15.133:0/3923941087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f081c0aa790 con 0x7f081c070500 2024-03-30T01:51:52.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.393+0000 7f0823400640 1 -- 172.21.15.133:0/3923941087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f081c066d80 con 0x7f081c070500 2024-03-30T01:51:52.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.394+0000 7f0818c00640 1 -- 172.21.15.133:0/3923941087 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0810043390 con 0x7f081c070500 2024-03-30T01:51:52.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.395+0000 7f0818c00640 1 --2- 172.21.15.133:0/3923941087 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f080006ac00 0x7f080006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:52.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.395+0000 7f0818c00640 1 -- 172.21.15.133:0/3923941087 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08100ab620 con 0x7f081c070500 2024-03-30T01:51:52.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.395+0000 7f081be00640 1 --2- 172.21.15.133:0/3923941087 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f080006ac00 0x7f080006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:52.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.396+0000 7f081be00640 1 --2- 172.21.15.133:0/3923941087 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f080006ac00 0x7f080006d0c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f081c0a8030 tx=0x7f080c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:52.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.399+0000 7f0818c00640 1 -- 172.21.15.133:0/3923941087 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f08100766d0 con 0x7f081c070500 2024-03-30T01:51:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.596+0000 7f0823400640 1 -- 172.21.15.133:0/3923941087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f081c0b01a0 con 0x7f081c070500 2024-03-30T01:51:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.597+0000 7f0818c00640 1 -- 172.21.15.133:0/3923941087 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0810079cf0 con 0x7f081c070500 2024-03-30T01:51:52.603 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-03-30T01:51:52.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.600+0000 7f0823400640 1 -- 172.21.15.133:0/3923941087 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f080006ac00 msgr2=0x7f080006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:52.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.600+0000 7f0823400640 1 --2- 172.21.15.133:0/3923941087 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f080006ac00 0x7f080006d0c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f081c0a8030 tx=0x7f080c009040 comp rx=0 tx=0).stop 2024-03-30T01:51:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.600+0000 7f0823400640 1 -- 172.21.15.133:0/3923941087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f081c070500 msgr2=0x7f081c1395f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.600+0000 7f0823400640 1 --2- 172.21.15.133:0/3923941087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f081c070500 0x7f081c1395f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f081002bf70 tx=0x7f0810004730 comp rx=0 tx=0).stop 2024-03-30T01:51:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.600+0000 7f0823400640 1 -- 172.21.15.133:0/3923941087 shutdown_connections 2024-03-30T01:51:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.600+0000 7f0823400640 1 --2- 172.21.15.133:0/3923941087 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f080006ac00 0x7f080006d0c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.600+0000 7f0823400640 1 --2- 172.21.15.133:0/3923941087 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f081c143790 0x7f081c1413b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.600+0000 7f0823400640 1 --2- 172.21.15.133:0/3923941087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f081c0ccc40 0x7f081c0aa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.600+0000 7f0823400640 1 --2- 172.21.15.133:0/3923941087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f081c070500 0x7f081c1395f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.600+0000 7f0823400640 1 -- 172.21.15.133:0/3923941087 >> 172.21.15.133:0/3923941087 conn(0x7f081c0b07a0 msgr2=0x7f081c0b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.600+0000 7f0823400640 1 -- 172.21.15.133:0/3923941087 shutdown_connections 2024-03-30T01:51:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.600+0000 7f0823400640 1 -- 172.21.15.133:0/3923941087 wait complete. 2024-03-30T01:51:52.626 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T01:51:52.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.830+0000 7f64dd000640 1 Processor -- start 2024-03-30T01:51:52.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.831+0000 7f64dd000640 1 -- start start 2024-03-30T01:51:52.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.832+0000 7f64dd000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f64d815ae70 0x7f64d80cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:52.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.832+0000 7f64dd000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d80ccf00 con 0x7f64d80cf670 2024-03-30T01:51:52.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.832+0000 7f64dd000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d80cb920 con 0x7f64d80ce570 2024-03-30T01:51:52.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.832+0000 7f64dd000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d80cbc00 con 0x7f64d815ae70 2024-03-30T01:51:52.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.832+0000 7f64d5e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f64d815ae70 0x7f64d80cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:52.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.832+0000 7f64d6800640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f64d80cf670 0x7f64d80c44f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48846/0 (socket says 172.21.15.133:48846) 2024-03-30T01:51:52.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.832+0000 7f64d6800640 1 -- 172.21.15.133:0/1503202037 learned_addr learned my addr 172.21.15.133:0/1503202037 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:52.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.833+0000 7f64d5e00640 1 -- 172.21.15.133:0/1503202037 >> v1:172.21.15.137:6789/0 conn(0x7f64d80ce570 legacy=0x7f64d80cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:52.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.833+0000 7f64d4a00640 1 -- 172.21.15.133:0/1503202037 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1704847959 0 0) 0x7f64d80ccf00 con 0x7f64d80cf670 2024-03-30T01:51:52.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.833+0000 7f64d5e00640 1 -- 172.21.15.133:0/1503202037 >> v1:172.21.15.133:6789/0 conn(0x7f64d80cf670 legacy=0x7f64d80c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:52.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.833+0000 7f64d5e00640 1 -- 172.21.15.133:0/1503202037 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d80cbee0 con 0x7f64d815ae70 2024-03-30T01:51:52.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.834+0000 7f64d5e00640 1 --2- 172.21.15.133:0/1503202037 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d815ae70 0x7f64d80cc9c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f64c8009d90 tx=0x7f64c802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f7cddd27faf7a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:52.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.834+0000 7f64d4a00640 1 -- 172.21.15.133:0/1503202037 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c802cc60 con 0x7f64d815ae70 2024-03-30T01:51:52.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.834+0000 7f64d4a00640 1 -- 172.21.15.133:0/1503202037 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c802cdc0 con 0x7f64d815ae70 2024-03-30T01:51:52.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.834+0000 7f64d4a00640 1 -- 172.21.15.133:0/1503202037 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c8034660 con 0x7f64d815ae70 2024-03-30T01:51:52.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.835+0000 7f64dd000640 1 -- 172.21.15.133:0/1503202037 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d815ae70 msgr2=0x7f64d80cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:52.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.835+0000 7f64dd000640 1 --2- 172.21.15.133:0/1503202037 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d815ae70 0x7f64d80cc9c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f64c8009d90 tx=0x7f64c802beb0 comp rx=0 tx=0).stop 2024-03-30T01:51:52.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.835+0000 7f64dd000640 1 -- 172.21.15.133:0/1503202037 shutdown_connections 2024-03-30T01:51:52.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.835+0000 7f64dd000640 1 --2- 172.21.15.133:0/1503202037 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d815ae70 0x7f64d80cc9c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:52.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.835+0000 7f64dd000640 1 -- 172.21.15.133:0/1503202037 >> 172.21.15.133:0/1503202037 conn(0x7f64d80d09a0 msgr2=0x7f64d80d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:52.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.835+0000 7f64dd000640 1 -- 172.21.15.133:0/1503202037 shutdown_connections 2024-03-30T01:51:52.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.835+0000 7f64dd000640 1 -- 172.21.15.133:0/1503202037 wait complete. 2024-03-30T01:51:52.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.837+0000 7f64dd000640 1 Processor -- start 2024-03-30T01:51:52.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.837+0000 7f64dd000640 1 -- start start 2024-03-30T01:51:52.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.838+0000 7f64dd000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64d80ce570 0x7f64d8156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:52.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.838+0000 7f64dd000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64d80cf670 0x7f64d815b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.838+0000 7f64dd000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d815ae70 0x7f64d815b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.838+0000 7f64dd000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d815d5c0 con 0x7f64d815ae70 2024-03-30T01:51:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.838+0000 7f64dd000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d815d8a0 con 0x7f64d80cf670 2024-03-30T01:51:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.838+0000 7f64dd000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d815db80 con 0x7f64d80ce570 2024-03-30T01:51:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.838+0000 7f64d6800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d815ae70 0x7f64d815b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.838+0000 7f64d6800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d815ae70 0x7f64d815b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60518/0 (socket says 172.21.15.133:60518) 2024-03-30T01:51:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.838+0000 7f64d6800640 1 -- 172.21.15.133:0/2582087101 learned_addr learned my addr 172.21.15.133:0/2582087101 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.838+0000 7f64d5e00640 1 --2- 172.21.15.133:0/2582087101 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64d80ce570 0x7f64d8156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.838+0000 7f64d6800640 1 -- 172.21.15.133:0/2582087101 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64d80ce570 msgr2=0x7f64d8156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.838+0000 7f64d6800640 1 --2- 172.21.15.133:0/2582087101 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64d80ce570 0x7f64d8156820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.838+0000 7f64d6800640 1 -- 172.21.15.133:0/2582087101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64d80cf670 msgr2=0x7f64d815b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.838+0000 7f64d6800640 1 --2- 172.21.15.133:0/2582087101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64d80cf670 0x7f64d815b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.838+0000 7f64d6800640 1 -- 172.21.15.133:0/2582087101 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c8009a70 con 0x7f64d815ae70 2024-03-30T01:51:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.839+0000 7f64d6800640 1 --2- 172.21.15.133:0/2582087101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d815ae70 0x7f64d815b790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f64d000c410 tx=0x7f64d000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:52.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.839+0000 7f64ce000640 1 -- 172.21.15.133:0/2582087101 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d00074e0 con 0x7f64d815ae70 2024-03-30T01:51:52.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.839+0000 7f64ce000640 1 -- 172.21.15.133:0/2582087101 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d0007640 con 0x7f64d815ae70 2024-03-30T01:51:52.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.839+0000 7f64dd000640 1 -- 172.21.15.133:0/2582087101 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d815de60 con 0x7f64d815ae70 2024-03-30T01:51:52.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.839+0000 7f64ce000640 1 -- 172.21.15.133:0/2582087101 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d0004a20 con 0x7f64d815ae70 2024-03-30T01:51:52.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.839+0000 7f64dd000640 1 -- 172.21.15.133:0/2582087101 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d815d2b0 con 0x7f64d815ae70 2024-03-30T01:51:52.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.840+0000 7f64dd000640 1 -- 172.21.15.133:0/2582087101 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d815e050 con 0x7f64d815ae70 2024-03-30T01:51:52.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.841+0000 7f64ce000640 1 -- 172.21.15.133:0/2582087101 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f64d0004b80 con 0x7f64d815ae70 2024-03-30T01:51:52.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.842+0000 7f64ce000640 1 --2- 172.21.15.133:0/2582087101 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f64b406ac00 0x7f64b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:52.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.842+0000 7f64ce000640 1 -- 172.21.15.133:0/2582087101 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64d0089160 con 0x7f64d815ae70 2024-03-30T01:51:52.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.842+0000 7f64d5e00640 1 --2- 172.21.15.133:0/2582087101 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f64b406ac00 0x7f64b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:52.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.843+0000 7f64d5e00640 1 --2- 172.21.15.133:0/2582087101 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f64b406ac00 0x7f64b406d0c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f64c8036000 tx=0x7f64c8030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:52.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:52.846+0000 7f64ce000640 1 -- 172.21.15.133:0/2582087101 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f64d00542a0 con 0x7f64d815ae70 2024-03-30T01:51:53.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.072+0000 7f64dd000640 1 -- 172.21.15.133:0/2582087101 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64d815d700 con 0x7f64d815ae70 2024-03-30T01:51:53.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.073+0000 7f64ce000640 1 -- 172.21.15.133:0/2582087101 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4737 (secure 0 0 0) 0x7f64d815d700 con 0x7f64d815ae70 2024-03-30T01:51:53.079 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:53.079 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2218506023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2218506023},{"type":"v1","addr":"172.21.15.137:6835","nonce":2218506023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2935514153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2935514153},{"type":"v1","addr":"172.21.15.133:6836","nonce":2935514153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2942187095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2942187095},{"type":"v1","addr":"172.21.15.133:6837","nonce":2942187095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T01:51:32.776583+0000","modified":"2024-03-30T01:51:35.787820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/225370013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":225370013},{"type":"v1","addr":"172.21.15.137:6834","nonce":225370013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-30T01:51:53.079 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 7 2024-03-30T01:51:53.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.075+0000 7f64dd000640 1 -- 172.21.15.133:0/2582087101 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f64b406ac00 msgr2=0x7f64b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:53.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.075+0000 7f64dd000640 1 --2- 172.21.15.133:0/2582087101 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f64b406ac00 0x7f64b406d0c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f64c8036000 tx=0x7f64c8030000 comp rx=0 tx=0).stop 2024-03-30T01:51:53.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.075+0000 7f64dd000640 1 -- 172.21.15.133:0/2582087101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d815ae70 msgr2=0x7f64d815b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:53.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.075+0000 7f64dd000640 1 --2- 172.21.15.133:0/2582087101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d815ae70 0x7f64d815b790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f64d000c410 tx=0x7f64d000c8d0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.075+0000 7f64dd000640 1 -- 172.21.15.133:0/2582087101 shutdown_connections 2024-03-30T01:51:53.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.075+0000 7f64dd000640 1 --2- 172.21.15.133:0/2582087101 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f64b406ac00 0x7f64b406d0c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.075+0000 7f64dd000640 1 --2- 172.21.15.133:0/2582087101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d815ae70 0x7f64d815b790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.075+0000 7f64dd000640 1 --2- 172.21.15.133:0/2582087101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64d80cf670 0x7f64d815b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.075+0000 7f64dd000640 1 --2- 172.21.15.133:0/2582087101 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64d80ce570 0x7f64d8156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.075+0000 7f64dd000640 1 -- 172.21.15.133:0/2582087101 >> 172.21.15.133:0/2582087101 conn(0x7f64d80d09a0 msgr2=0x7f64d8098b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:53.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.076+0000 7f64dd000640 1 -- 172.21.15.133:0/2582087101 shutdown_connections 2024-03-30T01:51:53.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.076+0000 7f64dd000640 1 -- 172.21.15.133:0/2582087101 wait complete. 2024-03-30T01:51:53.101 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:51:53.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.300+0000 7fb142800640 1 Processor -- start 2024-03-30T01:51:53.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.300+0000 7fb142800640 1 -- start start 2024-03-30T01:51:53.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.301+0000 7fb142800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb13c15c9f0 0x7fb13c0b83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:53.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.301+0000 7fb142800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb13c0d0bd0 0x7fb13c0b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:53.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.301+0000 7fb142800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb13c0b4c80 con 0x7fb13c0b4830 2024-03-30T01:51:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.302+0000 7fb142800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb13c0d1340 con 0x7fb13c15c9f0 2024-03-30T01:51:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.302+0000 7fb142800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb13c0d1620 con 0x7fb13c0d0bd0 2024-03-30T01:51:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.302+0000 7fb141400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb13c15c9f0 0x7fb13c0b83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.302+0000 7fb141400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb13c15c9f0 0x7fb13c0b83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60532/0 (socket says 172.21.15.133:60532) 2024-03-30T01:51:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.302+0000 7fb141400640 1 -- 172.21.15.133:0/1613018472 learned_addr learned my addr 172.21.15.133:0/1613018472 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.302+0000 7fb141e00640 1 --1- 172.21.15.133:0/1613018472 >> v1:172.21.15.133:6789/0 conn(0x7fb13c0b4830 0x7fb13c06b220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48860/0 (socket says 172.21.15.133:48860) 2024-03-30T01:51:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.302+0000 7fb140a00640 1 --2- 172.21.15.133:0/1613018472 >> v2:172.21.15.137:3300/0 conn(0x7fb13c0d0bd0 0x7fb13c0b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.302+0000 7fb141400640 1 -- 172.21.15.133:0/1613018472 >> v2:172.21.15.137:3300/0 conn(0x7fb13c0d0bd0 msgr2=0x7fb13c0b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.302+0000 7fb141400640 1 --2- 172.21.15.133:0/1613018472 >> v2:172.21.15.137:3300/0 conn(0x7fb13c0d0bd0 0x7fb13c0b42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.302+0000 7fb141400640 1 -- 172.21.15.133:0/1613018472 >> v1:172.21.15.133:6789/0 conn(0x7fb13c0b4830 legacy=0x7fb13c06b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.302+0000 7fb141400640 1 -- 172.21.15.133:0/1613018472 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c0d1900 con 0x7fb13c15c9f0 2024-03-30T01:51:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.302+0000 7fb13be00640 1 -- 172.21.15.133:0/1613018472 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753726801 0 0) 0x7fb134001490 con 0x7fb13c0b4830 2024-03-30T01:51:53.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.303+0000 7fb141400640 1 --2- 172.21.15.133:0/1613018472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb13c15c9f0 0x7fb13c0b83c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0cf010 tx=0x7fb13002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52635a68a7ffc90 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:53.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.304+0000 7fb13be00640 1 -- 172.21.15.133:0/1613018472 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb130030860 con 0x7fb13c15c9f0 2024-03-30T01:51:53.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.304+0000 7fb13be00640 1 -- 172.21.15.133:0/1613018472 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1300309c0 con 0x7fb13c15c9f0 2024-03-30T01:51:53.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.304+0000 7fb13be00640 1 -- 172.21.15.133:0/1613018472 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb130030d50 con 0x7fb13c15c9f0 2024-03-30T01:51:53.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.304+0000 7fb142800640 1 -- 172.21.15.133:0/1613018472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb13c15c9f0 msgr2=0x7fb13c0b83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:53.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.304+0000 7fb142800640 1 --2- 172.21.15.133:0/1613018472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb13c15c9f0 0x7fb13c0b83c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0cf010 tx=0x7fb13002b9a0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.304+0000 7fb142800640 1 -- 172.21.15.133:0/1613018472 shutdown_connections 2024-03-30T01:51:53.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.304+0000 7fb142800640 1 --2- 172.21.15.133:0/1613018472 >> v2:172.21.15.137:3300/0 conn(0x7fb13c0d0bd0 0x7fb13c0b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.304+0000 7fb142800640 1 --2- 172.21.15.133:0/1613018472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb13c15c9f0 0x7fb13c0b83c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.304+0000 7fb142800640 1 -- 172.21.15.133:0/1613018472 >> 172.21.15.133:0/1613018472 conn(0x7fb13c071a40 msgr2=0x7fb13c0cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:53.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.304+0000 7fb142800640 1 -- 172.21.15.133:0/1613018472 shutdown_connections 2024-03-30T01:51:53.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.305+0000 7fb142800640 1 -- 172.21.15.133:0/1613018472 wait complete. 2024-03-30T01:51:53.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.306+0000 7fb142800640 1 Processor -- start 2024-03-30T01:51:53.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.306+0000 7fb142800640 1 -- start start 2024-03-30T01:51:53.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.307+0000 7fb142800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb13c0b4830 0x7fb13c15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:53.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.307+0000 7fb142800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb13c0d0bd0 0x7fb13c14c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:53.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.307+0000 7fb142800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb13c15c9f0 0x7fb13c153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:53.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.307+0000 7fb142800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c155f90 con 0x7fb13c15c9f0 2024-03-30T01:51:53.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.307+0000 7fb142800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c156270 con 0x7fb13c0d0bd0 2024-03-30T01:51:53.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.307+0000 7fb142800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c156550 con 0x7fb13c0b4830 2024-03-30T01:51:53.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.307+0000 7fb141e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb13c15c9f0 0x7fb13c153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:53.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.307+0000 7fb141e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb13c15c9f0 0x7fb13c153380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60534/0 (socket says 172.21.15.133:60534) 2024-03-30T01:51:53.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.307+0000 7fb141e00640 1 -- 172.21.15.133:0/1921065979 learned_addr learned my addr 172.21.15.133:0/1921065979 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:53.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.308+0000 7fb141400640 1 --2- 172.21.15.133:0/1921065979 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb13c0b4830 0x7fb13c15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:53.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.308+0000 7fb140a00640 1 --2- 172.21.15.133:0/1921065979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb13c0d0bd0 0x7fb13c14c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:53.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.308+0000 7fb141e00640 1 -- 172.21.15.133:0/1921065979 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb13c0b4830 msgr2=0x7fb13c15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:53.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.308+0000 7fb141e00640 1 --2- 172.21.15.133:0/1921065979 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb13c0b4830 0x7fb13c15efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.308+0000 7fb141e00640 1 -- 172.21.15.133:0/1921065979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb13c0d0bd0 msgr2=0x7fb13c14c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:53.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.308+0000 7fb141e00640 1 --2- 172.21.15.133:0/1921065979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb13c0d0bd0 0x7fb13c14c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.308+0000 7fb141e00640 1 -- 172.21.15.133:0/1921065979 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1300094d0 con 0x7fb13c15c9f0 2024-03-30T01:51:53.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.308+0000 7fb141e00640 1 --2- 172.21.15.133:0/1921065979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb13c15c9f0 0x7fb13c153380 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb13400c7d0 tx=0x7fb13400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:53.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.308+0000 7fb139600640 1 -- 172.21.15.133:0/1921065979 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13400a640 con 0x7fb13c15c9f0 2024-03-30T01:51:53.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.309+0000 7fb139600640 1 -- 172.21.15.133:0/1921065979 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13400a7c0 con 0x7fb13c15c9f0 2024-03-30T01:51:53.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.309+0000 7fb142800640 1 -- 172.21.15.133:0/1921065979 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb13c156830 con 0x7fb13c15c9f0 2024-03-30T01:51:53.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.309+0000 7fb139600640 1 -- 172.21.15.133:0/1921065979 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13400abb0 con 0x7fb13c15c9f0 2024-03-30T01:51:53.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.309+0000 7fb142800640 1 -- 172.21.15.133:0/1921065979 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb13c1538c0 con 0x7fb13c15c9f0 2024-03-30T01:51:53.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.310+0000 7fb142800640 1 -- 172.21.15.133:0/1921065979 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb13c073750 con 0x7fb13c15c9f0 2024-03-30T01:51:53.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.310+0000 7fb139600640 1 -- 172.21.15.133:0/1921065979 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb13400ad10 con 0x7fb13c15c9f0 2024-03-30T01:51:53.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.311+0000 7fb139600640 1 --2- 172.21.15.133:0/1921065979 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb11c06ac30 0x7fb11c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:53.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.311+0000 7fb139600640 1 -- 172.21.15.133:0/1921065979 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb134088a70 con 0x7fb13c15c9f0 2024-03-30T01:51:53.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.312+0000 7fb141400640 1 --2- 172.21.15.133:0/1921065979 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb11c06ac30 0x7fb11c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:53.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.312+0000 7fb141400640 1 --2- 172.21.15.133:0/1921065979 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb11c06ac30 0x7fb11c06d0f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb130036000 tx=0x7fb13003b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:53.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.316+0000 7fb139600640 1 -- 172.21.15.133:0/1921065979 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fb134053bb0 con 0x7fb13c15c9f0 2024-03-30T01:51:53.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.510+0000 7fb142800640 1 -- 172.21.15.133:0/1921065979 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb13c0b4c80 con 0x7fb13c15c9f0 2024-03-30T01:51:53.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.513+0000 7fb139600640 1 -- 172.21.15.133:0/1921065979 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7fb13c0b4c80 con 0x7fb13c15c9f0 2024-03-30T01:51:53.519 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:53.519 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:51:33.780665+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:51:31.245378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T01:51:31.774247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:51:53.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.515+0000 7fb142800640 1 -- 172.21.15.133:0/1921065979 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb11c06ac30 msgr2=0x7fb11c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:53.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.515+0000 7fb142800640 1 --2- 172.21.15.133:0/1921065979 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb11c06ac30 0x7fb11c06d0f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb130036000 tx=0x7fb13003b040 comp rx=0 tx=0).stop 2024-03-30T01:51:53.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.515+0000 7fb142800640 1 -- 172.21.15.133:0/1921065979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb13c15c9f0 msgr2=0x7fb13c153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:53.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.515+0000 7fb142800640 1 --2- 172.21.15.133:0/1921065979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb13c15c9f0 0x7fb13c153380 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb13400c7d0 tx=0x7fb13400cc90 comp rx=0 tx=0).stop 2024-03-30T01:51:53.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.515+0000 7fb142800640 1 -- 172.21.15.133:0/1921065979 shutdown_connections 2024-03-30T01:51:53.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.515+0000 7fb142800640 1 --2- 172.21.15.133:0/1921065979 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb11c06ac30 0x7fb11c06d0f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.515+0000 7fb142800640 1 --2- 172.21.15.133:0/1921065979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb13c15c9f0 0x7fb13c153380 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.515+0000 7fb142800640 1 --2- 172.21.15.133:0/1921065979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb13c0d0bd0 0x7fb13c14c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.515+0000 7fb142800640 1 --2- 172.21.15.133:0/1921065979 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb13c0b4830 0x7fb13c15efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.515+0000 7fb142800640 1 -- 172.21.15.133:0/1921065979 >> 172.21.15.133:0/1921065979 conn(0x7fb13c071a40 msgr2=0x7fb13c0b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:53.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.516+0000 7fb142800640 1 -- 172.21.15.133:0/1921065979 shutdown_connections 2024-03-30T01:51:53.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.516+0000 7fb142800640 1 -- 172.21.15.133:0/1921065979 wait complete. 2024-03-30T01:51:53.541 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T01:51:53.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.740+0000 7fa21f800640 1 Processor -- start 2024-03-30T01:51:53.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.741+0000 7fa21f800640 1 -- start start 2024-03-30T01:51:53.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.742+0000 7fa21f800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa21815ab90 0x7fa218099900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:53.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.742+0000 7fa21f800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2180ce9a0 con 0x7fa2180cee60 2024-03-30T01:51:53.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.742+0000 7fa21f800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2180cb6a0 con 0x7fa2180ce450 2024-03-30T01:51:53.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.742+0000 7fa21f800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21815af70 con 0x7fa21815ab90 2024-03-30T01:51:53.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.742+0000 7fa21d800640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa2180cee60 0x7fa21806e7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48868/0 (socket says 172.21.15.133:48868) 2024-03-30T01:51:53.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.742+0000 7fa21d800640 1 -- 172.21.15.133:0/1371176253 learned_addr learned my addr 172.21.15.133:0/1371176253 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:53.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.743+0000 7fa21ce00640 1 --2- 172.21.15.133:0/1371176253 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa21815ab90 0x7fa218099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:53.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.743+0000 7fa217400640 1 -- 172.21.15.133:0/1371176253 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156819179 0 0) 0x7fa2180ce9a0 con 0x7fa2180cee60 2024-03-30T01:51:53.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.743+0000 7fa217400640 1 -- 172.21.15.133:0/1371176253 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1fc003520 con 0x7fa2180cee60 2024-03-30T01:51:53.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.743+0000 7fa217400640 1 -- 172.21.15.133:0/1371176253 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4011679675 0 0) 0x7fa1fc003520 con 0x7fa2180cee60 2024-03-30T01:51:53.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.743+0000 7fa217400640 1 -- 172.21.15.133:0/1371176253 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa21815ab90 msgr2=0x7fa218099900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:53.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.743+0000 7fa217400640 1 --2- 172.21.15.133:0/1371176253 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa21815ab90 0x7fa218099900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.743+0000 7fa217400640 1 -- 172.21.15.133:0/1371176253 >> v1:172.21.15.137:6789/0 conn(0x7fa2180ce450 legacy=0x7fa2180cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:53.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.743+0000 7fa217400640 1 -- 172.21.15.133:0/1371176253 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2180cb980 con 0x7fa2180cee60 2024-03-30T01:51:53.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.743+0000 7fa217400640 1 -- 172.21.15.133:0/1371176253 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fa210001670 con 0x7fa2180cee60 2024-03-30T01:51:53.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.743+0000 7fa217400640 1 -- 172.21.15.133:0/1371176253 >> v1:172.21.15.133:6789/0 conn(0x7fa2180cee60 legacy=0x7fa21806e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:53.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.743+0000 7fa217400640 1 --2- 172.21.15.133:0/1371176253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1fc0039a0 0x7fa1fc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:53.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.744+0000 7fa217400640 1 --2- 172.21.15.133:0/1371176253 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa21815ab90 0x7fa1fc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:53.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.744+0000 7fa217400640 1 --2- 172.21.15.133:0/1371176253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1fc004d00 0x7fa1fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:53.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.744+0000 7fa217400640 1 -- 172.21.15.133:0/1371176253 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21815af70 con 0x7fa1fc0039a0 2024-03-30T01:51:53.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.744+0000 7fa217400640 1 -- 172.21.15.133:0/1371176253 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc00bb10 con 0x7fa1fc004d00 2024-03-30T01:51:53.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.744+0000 7fa217400640 1 -- 172.21.15.133:0/1371176253 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc00bcd0 con 0x7fa21815ab90 2024-03-30T01:51:53.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.744+0000 7fa21ce00640 1 --2- 172.21.15.133:0/1371176253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1fc0039a0 0x7fa1fc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:53.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.744+0000 7fa217e00640 1 --2- 172.21.15.133:0/1371176253 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa21815ab90 0x7fa1fc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:53.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.744+0000 7fa21ce00640 1 -- 172.21.15.133:0/1371176253 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa21815ab90 msgr2=0x7fa1fc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:53.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.744+0000 7fa21ce00640 1 --2- 172.21.15.133:0/1371176253 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa21815ab90 0x7fa1fc0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.744+0000 7fa21ce00640 1 -- 172.21.15.133:0/1371176253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1fc004d00 msgr2=0x7fa1fc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:53.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.744+0000 7fa21ce00640 1 --2- 172.21.15.133:0/1371176253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1fc004d00 0x7fa1fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.744+0000 7fa21ce00640 1 -- 172.21.15.133:0/1371176253 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1fc003520 con 0x7fa1fc0039a0 2024-03-30T01:51:53.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.745+0000 7fa21ce00640 1 --2- 172.21.15.133:0/1371176253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1fc0039a0 0x7fa1fc003dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa208009ac0 tx=0x7fa1fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e855d2e893bfb129 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:53.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.745+0000 7fa217400640 1 -- 172.21.15.133:0/1371176253 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20802c6b0 con 0x7fa1fc0039a0 2024-03-30T01:51:53.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.745+0000 7fa217400640 1 -- 172.21.15.133:0/1371176253 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20802c810 con 0x7fa1fc0039a0 2024-03-30T01:51:53.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.745+0000 7fa217400640 1 -- 172.21.15.133:0/1371176253 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20802cba0 con 0x7fa1fc0039a0 2024-03-30T01:51:53.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.746+0000 7fa21f800640 1 -- 172.21.15.133:0/1371176253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1fc0039a0 msgr2=0x7fa1fc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:53.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.746+0000 7fa21f800640 1 --2- 172.21.15.133:0/1371176253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1fc0039a0 0x7fa1fc003dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa208009ac0 tx=0x7fa1fc0057f0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.746+0000 7fa21d800640 1 -- 172.21.15.133:0/1371176253 reap_dead start 2024-03-30T01:51:53.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.746+0000 7fa21f800640 1 -- 172.21.15.133:0/1371176253 shutdown_connections 2024-03-30T01:51:53.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.746+0000 7fa21f800640 1 -- 172.21.15.133:0/1371176253 >> 172.21.15.133:0/1371176253 conn(0x7fa2180d0880 msgr2=0x7fa2180d0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:53.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.746+0000 7fa21f800640 1 -- 172.21.15.133:0/1371176253 shutdown_connections 2024-03-30T01:51:53.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.746+0000 7fa21f800640 1 -- 172.21.15.133:0/1371176253 wait complete. 2024-03-30T01:51:53.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.748+0000 7fa21f800640 1 Processor -- start 2024-03-30T01:51:53.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.748+0000 7fa21f800640 1 -- start start 2024-03-30T01:51:53.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.749+0000 7fa21f800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1fc0039a0 0x7fa2180b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:53.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.749+0000 7fa21f800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2181582f0 0x7fa2180ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:53.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.749+0000 7fa21f800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa21815b0b0 0x7fa21815b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:53.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.749+0000 7fa21f800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21815ba80 con 0x7fa2181582f0 2024-03-30T01:51:53.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.749+0000 7fa21f800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2180c8140 con 0x7fa1fc0039a0 2024-03-30T01:51:53.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.749+0000 7fa21f800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2180aee50 con 0x7fa21815b0b0 2024-03-30T01:51:53.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.749+0000 7fa217e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2181582f0 0x7fa2180ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:53.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.749+0000 7fa217e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2181582f0 0x7fa2180ae500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60560/0 (socket says 172.21.15.133:60560) 2024-03-30T01:51:53.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.749+0000 7fa217e00640 1 -- 172.21.15.133:0/2410732626 learned_addr learned my addr 172.21.15.133:0/2410732626 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:53.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.749+0000 7fa21ce00640 1 --2- 172.21.15.133:0/2410732626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1fc0039a0 0x7fa2180b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:53.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.750+0000 7fa217e00640 1 -- 172.21.15.133:0/2410732626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa21815b0b0 msgr2=0x7fa21815b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:53.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.750+0000 7fa21d800640 1 --2- 172.21.15.133:0/2410732626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa21815b0b0 0x7fa21815b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:53.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.750+0000 7fa217e00640 1 --2- 172.21.15.133:0/2410732626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa21815b0b0 0x7fa21815b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.750+0000 7fa217e00640 1 -- 172.21.15.133:0/2410732626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1fc0039a0 msgr2=0x7fa2180b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:53.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.750+0000 7fa217e00640 1 --2- 172.21.15.133:0/2410732626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1fc0039a0 0x7fa2180b5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.750+0000 7fa217e00640 1 -- 172.21.15.133:0/2410732626 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2180af130 con 0x7fa2181582f0 2024-03-30T01:51:53.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.750+0000 7fa21ce00640 1 --2- 172.21.15.133:0/2410732626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1fc0039a0 0x7fa2180b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:51:53.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.750+0000 7fa217e00640 1 --2- 172.21.15.133:0/2410732626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2181582f0 0x7fa2180ae500 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa20400d8e0 tx=0x7fa20400dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:53.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.750+0000 7fa214c00640 1 -- 172.21.15.133:0/2410732626 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa204003da0 con 0x7fa2181582f0 2024-03-30T01:51:53.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.750+0000 7fa214c00640 1 -- 172.21.15.133:0/2410732626 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20400b6b0 con 0x7fa2181582f0 2024-03-30T01:51:53.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.750+0000 7fa214c00640 1 -- 172.21.15.133:0/2410732626 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20400ba60 con 0x7fa2181582f0 2024-03-30T01:51:53.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.750+0000 7fa21f800640 1 -- 172.21.15.133:0/2410732626 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2180af410 con 0x7fa2181582f0 2024-03-30T01:51:53.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.750+0000 7fa21f800640 1 -- 172.21.15.133:0/2410732626 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2180b6150 con 0x7fa2181582f0 2024-03-30T01:51:53.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.752+0000 7fa21f800640 1 -- 172.21.15.133:0/2410732626 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa218099750 con 0x7fa2181582f0 2024-03-30T01:51:53.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.752+0000 7fa214c00640 1 -- 172.21.15.133:0/2410732626 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fa20400bbc0 con 0x7fa2181582f0 2024-03-30T01:51:53.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.753+0000 7fa214c00640 1 --2- 172.21.15.133:0/2410732626 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa1f806ac00 0x7fa1f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:53.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.753+0000 7fa214c00640 1 -- 172.21.15.133:0/2410732626 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2040896b0 con 0x7fa2181582f0 2024-03-30T01:51:53.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.753+0000 7fa21ce00640 1 --2- 172.21.15.133:0/2410732626 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa1f806ac00 0x7fa1f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:53.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.754+0000 7fa21ce00640 1 --2- 172.21.15.133:0/2410732626 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa1f806ac00 0x7fa1f806d0c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa208036000 tx=0x7fa208030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:53.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.758+0000 7fa214c00640 1 -- 172.21.15.133:0/2410732626 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fa204054890 con 0x7fa2181582f0 2024-03-30T01:51:53.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.972+0000 7fa21f800640 1 -- 172.21.15.133:0/2410732626 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2180cb350 con 0x7fa2181582f0 2024-03-30T01:51:53.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.973+0000 7fa214c00640 1 -- 172.21.15.133:0/2410732626 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4737 (secure 0 0 0) 0x7fa204057eb0 con 0x7fa2181582f0 2024-03-30T01:51:53.979 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:51:53.979 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2218506023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2218506023},{"type":"v1","addr":"172.21.15.137:6835","nonce":2218506023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2935514153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2935514153},{"type":"v1","addr":"172.21.15.133:6836","nonce":2935514153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2942187095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2942187095},{"type":"v1","addr":"172.21.15.133:6837","nonce":2942187095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T01:51:32.776583+0000","modified":"2024-03-30T01:51:35.787820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/225370013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":225370013},{"type":"v1","addr":"172.21.15.137:6834","nonce":225370013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-30T01:51:53.980 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 7 2024-03-30T01:51:53.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.975+0000 7fa21f800640 1 -- 172.21.15.133:0/2410732626 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa1f806ac00 msgr2=0x7fa1f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:53.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.975+0000 7fa21f800640 1 --2- 172.21.15.133:0/2410732626 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa1f806ac00 0x7fa1f806d0c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa208036000 tx=0x7fa208030000 comp rx=0 tx=0).stop 2024-03-30T01:51:53.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.975+0000 7fa21f800640 1 -- 172.21.15.133:0/2410732626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2181582f0 msgr2=0x7fa2180ae500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:53.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.975+0000 7fa21f800640 1 --2- 172.21.15.133:0/2410732626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2181582f0 0x7fa2180ae500 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa20400d8e0 tx=0x7fa20400dda0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.976+0000 7fa21f800640 1 -- 172.21.15.133:0/2410732626 shutdown_connections 2024-03-30T01:51:53.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.976+0000 7fa21f800640 1 --2- 172.21.15.133:0/2410732626 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa1f806ac00 0x7fa1f806d0c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.976+0000 7fa21f800640 1 --2- 172.21.15.133:0/2410732626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa21815b0b0 0x7fa21815b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.976+0000 7fa21f800640 1 --2- 172.21.15.133:0/2410732626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2181582f0 0x7fa2180ae500 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.976+0000 7fa21f800640 1 --2- 172.21.15.133:0/2410732626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1fc0039a0 0x7fa2180b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:53.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.976+0000 7fa21f800640 1 -- 172.21.15.133:0/2410732626 >> 172.21.15.133:0/2410732626 conn(0x7fa2180d0880 msgr2=0x7fa2180cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:53.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.976+0000 7fa21f800640 1 -- 172.21.15.133:0/2410732626 shutdown_connections 2024-03-30T01:51:53.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:53.976+0000 7fa21f800640 1 -- 172.21.15.133:0/2410732626 wait complete. 2024-03-30T01:51:54.401 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-30T01:51:32.776583+0000', 'modified': '2024-03-30T01:51:35.787820+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.137:6834/225370013', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6832', 'nonce': 225370013}, {'type': 'v1', 'addr': '172.21.15.137:6834', 'nonce': 225370013}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-03-30T01:51:54.401 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-30T01:51:54.401 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-03-30T01:51:54.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.612+0000 7f7ae9800640 1 Processor -- start 2024-03-30T01:51:54.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.612+0000 7f7ae9800640 1 -- start start 2024-03-30T01:51:54.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.613+0000 7f7ae9800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ae415b9c0 0x7f7ae40b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:54.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.613+0000 7f7ae9800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7ae40b40f0 0x7f7ae40cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:54.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.613+0000 7f7ae9800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ae40ccb30 0x7f7ae406c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:54.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.614+0000 7f7ae9800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae415bda0 con 0x7f7ae415b9c0 2024-03-30T01:51:54.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.614+0000 7f7ae9800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae40b4580 con 0x7f7ae40b40f0 2024-03-30T01:51:54.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.614+0000 7f7ae9800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae413dba0 con 0x7f7ae40ccb30 2024-03-30T01:51:54.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.614+0000 7f7ae3e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ae415b9c0 0x7f7ae40b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:54.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.614+0000 7f7ae3e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ae415b9c0 0x7f7ae40b3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60576/0 (socket says 172.21.15.133:60576) 2024-03-30T01:51:54.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.614+0000 7f7ae3e00640 1 -- 172.21.15.133:0/4276921328 learned_addr learned my addr 172.21.15.133:0/4276921328 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:54.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.614+0000 7f7ae8e00640 1 --2- 172.21.15.133:0/4276921328 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ae40ccb30 0x7f7ae406c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:54.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.614+0000 7f7ae3400640 1 --2- 172.21.15.133:0/4276921328 >> v2:172.21.15.137:3300/0 conn(0x7f7ae40b40f0 0x7f7ae40cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:54.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.614+0000 7f7ae3e00640 1 -- 172.21.15.133:0/4276921328 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ae40ccb30 msgr2=0x7f7ae406c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:54.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.614+0000 7f7ae3e00640 1 --2- 172.21.15.133:0/4276921328 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ae40ccb30 0x7f7ae406c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.614+0000 7f7ae3e00640 1 -- 172.21.15.133:0/4276921328 >> v2:172.21.15.137:3300/0 conn(0x7f7ae40b40f0 msgr2=0x7f7ae40cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:54.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.614+0000 7f7ae3e00640 1 --2- 172.21.15.133:0/4276921328 >> v2:172.21.15.137:3300/0 conn(0x7f7ae40b40f0 0x7f7ae40cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.614+0000 7f7ae3e00640 1 -- 172.21.15.133:0/4276921328 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae41408b0 con 0x7f7ae415b9c0 2024-03-30T01:51:54.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.615+0000 7f7ae3e00640 1 --2- 172.21.15.133:0/4276921328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae415b9c0 0x7f7ae40b3bb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7ae40ae460 tx=0x7f7ad402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c6605b82a9663c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:54.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.616+0000 7f7ae2a00640 1 -- 172.21.15.133:0/4276921328 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4031640 con 0x7f7ae415b9c0 2024-03-30T01:51:54.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.616+0000 7f7ae2a00640 1 -- 172.21.15.133:0/4276921328 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad40317a0 con 0x7f7ae415b9c0 2024-03-30T01:51:54.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.616+0000 7f7ae2a00640 1 -- 172.21.15.133:0/4276921328 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4031b30 con 0x7f7ae415b9c0 2024-03-30T01:51:54.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.616+0000 7f7ae9800640 1 -- 172.21.15.133:0/4276921328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae415b9c0 msgr2=0x7f7ae40b3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:54.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.616+0000 7f7ae9800640 1 --2- 172.21.15.133:0/4276921328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae415b9c0 0x7f7ae40b3bb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7ae40ae460 tx=0x7f7ad402b8f0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.616+0000 7f7ae9800640 1 -- 172.21.15.133:0/4276921328 shutdown_connections 2024-03-30T01:51:54.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.616+0000 7f7ae9800640 1 --2- 172.21.15.133:0/4276921328 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ae40ccb30 0x7f7ae406c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.616+0000 7f7ae9800640 1 --2- 172.21.15.133:0/4276921328 >> v2:172.21.15.137:3300/0 conn(0x7f7ae40b40f0 0x7f7ae40cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.617+0000 7f7ae9800640 1 --2- 172.21.15.133:0/4276921328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae415b9c0 0x7f7ae40b3bb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.617+0000 7f7ae9800640 1 -- 172.21.15.133:0/4276921328 >> 172.21.15.133:0/4276921328 conn(0x7f7ae40b05a0 msgr2=0x7f7ae40b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:54.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.617+0000 7f7ae9800640 1 -- 172.21.15.133:0/4276921328 shutdown_connections 2024-03-30T01:51:54.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.617+0000 7f7ae9800640 1 -- 172.21.15.133:0/4276921328 wait complete. 2024-03-30T01:51:54.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.618+0000 7f7ae9800640 1 Processor -- start 2024-03-30T01:51:54.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.618+0000 7f7ae9800640 1 -- start start 2024-03-30T01:51:54.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.619+0000 7f7ae9800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae40b40f0 0x7f7ae40b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:54.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.619+0000 7f7ae9800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ae40ccb30 0x7f7ae40ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:54.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.619+0000 7f7ae9800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ae415b9c0 0x7f7ae40a7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:54.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.619+0000 7f7ae9800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae40ad5e0 con 0x7f7ae40b40f0 2024-03-30T01:51:54.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.619+0000 7f7ae9800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae4151ed0 con 0x7f7ae40ccb30 2024-03-30T01:51:54.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.619+0000 7f7ae9800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae4152140 con 0x7f7ae415b9c0 2024-03-30T01:51:54.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.620+0000 7f7ae3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae40b40f0 0x7f7ae40b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:54.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.620+0000 7f7ae3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae40b40f0 0x7f7ae40b3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60580/0 (socket says 172.21.15.133:60580) 2024-03-30T01:51:54.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.620+0000 7f7ae3e00640 1 -- 172.21.15.133:0/51170461 learned_addr learned my addr 172.21.15.133:0/51170461 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:54.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.620+0000 7f7ae3e00640 1 -- 172.21.15.133:0/51170461 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ae415b9c0 msgr2=0x7f7ae40a7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:54.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.620+0000 7f7ae3e00640 1 --2- 172.21.15.133:0/51170461 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ae415b9c0 0x7f7ae40a7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.620+0000 7f7ae3e00640 1 -- 172.21.15.133:0/51170461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ae40ccb30 msgr2=0x7f7ae40ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:54.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.620+0000 7f7ae3e00640 1 --2- 172.21.15.133:0/51170461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ae40ccb30 0x7f7ae40ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.620+0000 7f7ae3e00640 1 -- 172.21.15.133:0/51170461 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad40094d0 con 0x7f7ae40b40f0 2024-03-30T01:51:54.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.620+0000 7f7ae3e00640 1 --2- 172.21.15.133:0/51170461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae40b40f0 0x7f7ae40b3850 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4000c00 tx=0x7f7ad40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:54.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.621+0000 7f7adbe00640 1 -- 172.21.15.133:0/51170461 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad403ac60 con 0x7f7ae40b40f0 2024-03-30T01:51:54.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.621+0000 7f7adbe00640 1 -- 172.21.15.133:0/51170461 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad403adc0 con 0x7f7ae40b40f0 2024-03-30T01:51:54.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.621+0000 7f7adbe00640 1 -- 172.21.15.133:0/51170461 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4044630 con 0x7f7ae40b40f0 2024-03-30T01:51:54.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.621+0000 7f7ae9800640 1 -- 172.21.15.133:0/51170461 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae4152420 con 0x7f7ae40b40f0 2024-03-30T01:51:54.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.621+0000 7f7ae9800640 1 -- 172.21.15.133:0/51170461 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae41529e0 con 0x7f7ae40b40f0 2024-03-30T01:51:54.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.623+0000 7f7adbe00640 1 -- 172.21.15.133:0/51170461 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f7ad402f050 con 0x7f7ae40b40f0 2024-03-30T01:51:54.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.624+0000 7f7adbe00640 1 --2- 172.21.15.133:0/51170461 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7ac406ac30 0x7f7ac406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:54.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.624+0000 7f7adbe00640 1 -- 172.21.15.133:0/51170461 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ad40ab230 con 0x7f7ae40b40f0 2024-03-30T01:51:54.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.624+0000 7f7ae3400640 1 --2- 172.21.15.133:0/51170461 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7ac406ac30 0x7f7ac406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:54.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.625+0000 7f7aedbac740 1 Processor -- start 2024-03-30T01:51:54.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.625+0000 7f7aedbac740 1 -- start start 2024-03-30T01:51:54.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.625+0000 7f7ae3400640 1 --2- 172.21.15.133:0/51170461 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7ac406ac30 0x7f7ac406d0f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7ae40b0410 tx=0x7f7ad0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:54.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.626+0000 7f7aedbac740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559386371eb0 0x559386344e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:54.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.626+0000 7f7aedbac740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559386372290 0x559386374c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:54.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.626+0000 7f7aedbac740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559386345390 0x559386375180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:54.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.626+0000 7f7aedbac740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593863202c0 con 0x559386345390 2024-03-30T01:51:54.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.626+0000 7f7aedbac740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593862b58f0 con 0x559386371eb0 2024-03-30T01:51:54.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.626+0000 7f7aedbac740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x5593862b3080 con 0x559386372290 2024-03-30T01:51:54.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.626+0000 7f7ae8e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559386345390 0x559386375180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:54.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.626+0000 7f7ae8e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559386345390 0x559386375180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60590/0 (socket says 172.21.15.133:60590) 2024-03-30T01:51:54.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.626+0000 7f7ae8e00640 1 -- 172.21.15.133:0/243516194 learned_addr learned my addr 172.21.15.133:0/243516194 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:54.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.626+0000 7f7ae3e00640 1 --2- 172.21.15.133:0/243516194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559386371eb0 0x559386344e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:54.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.626+0000 7f7ae3400640 1 --2- 172.21.15.133:0/243516194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559386372290 0x559386374c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:54.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.626+0000 7f7ae8e00640 1 -- 172.21.15.133:0/243516194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559386372290 msgr2=0x559386374c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:54.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.626+0000 7f7ae8e00640 1 --2- 172.21.15.133:0/243516194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559386372290 0x559386374c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.626+0000 7f7ae8e00640 1 -- 172.21.15.133:0/243516194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559386371eb0 msgr2=0x559386344e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:54.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.626+0000 7f7ae8e00640 1 --2- 172.21.15.133:0/243516194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559386371eb0 0x559386344e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.626+0000 7f7ae8e00640 1 -- 172.21.15.133:0/243516194 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559386279a10 con 0x559386345390 2024-03-30T01:51:54.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.626+0000 7f7ae3400640 1 --2- 172.21.15.133:0/243516194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559386372290 0x559386374c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:54.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.627+0000 7f7ae8e00640 1 --2- 172.21.15.133:0/243516194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559386345390 0x559386375180 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009f60 tx=0x7f7adc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61c1eb27fd651e15 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:54.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.627+0000 7f7ad8c00640 1 -- 172.21.15.133:0/243516194 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc012710 con 0x559386345390 2024-03-30T01:51:54.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.627+0000 7f7ad8c00640 1 -- 172.21.15.133:0/243516194 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7adc012870 con 0x559386345390 2024-03-30T01:51:54.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.627+0000 7f7ad8c00640 1 -- 172.21.15.133:0/243516194 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc012c20 con 0x559386345390 2024-03-30T01:51:54.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.627+0000 7f7aedbac740 1 -- 172.21.15.133:0/243516194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559386345390 msgr2=0x559386375180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:54.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.627+0000 7f7aedbac740 1 --2- 172.21.15.133:0/243516194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559386345390 0x559386375180 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009f60 tx=0x7f7adc009f90 comp rx=0 tx=0).stop 2024-03-30T01:51:54.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.628+0000 7f7aedbac740 1 -- 172.21.15.133:0/243516194 shutdown_connections 2024-03-30T01:51:54.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.628+0000 7f7aedbac740 1 --2- 172.21.15.133:0/243516194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559386345390 0x559386375180 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.628+0000 7f7aedbac740 1 --2- 172.21.15.133:0/243516194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559386372290 0x559386374c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.628+0000 7f7aedbac740 1 --2- 172.21.15.133:0/243516194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559386371eb0 0x559386344e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.628+0000 7f7aedbac740 1 -- 172.21.15.133:0/243516194 >> 172.21.15.133:0/243516194 conn(0x5593863470c0 msgr2=0x55938638fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:54.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.628+0000 7f7aedbac740 1 -- 172.21.15.133:0/243516194 shutdown_connections 2024-03-30T01:51:54.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.628+0000 7f7aedbac740 1 -- 172.21.15.133:0/243516194 wait complete. 2024-03-30T01:51:54.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.628+0000 7f7aedbac740 1 -- start start 2024-03-30T01:51:54.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.629+0000 7f7aedbac740 1 Processor -- start 2024-03-30T01:51:54.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.630+0000 7f7aedbac740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559386371eb0 0x559386378790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:54.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.630+0000 7f7aedbac740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559386372290 0x559386390120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:54.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.630+0000 7f7aedbac740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55938636e560 0x559386390660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:54.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.630+0000 7f7aedbac740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593862ae970 con 0x55938636e560 2024-03-30T01:51:54.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.630+0000 7f7aedbac740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593862500a0 con 0x559386371eb0 2024-03-30T01:51:54.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.630+0000 7f7aedbac740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55938624fd40 con 0x559386372290 2024-03-30T01:51:54.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.630+0000 7f7aedbac740 10 client.0 _ll_register_callbacks cb 0x5593862a7fe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T01:51:54.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.630+0000 7f7ae8e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55938636e560 0x559386390660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:54.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.630+0000 7f7ae8e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55938636e560 0x559386390660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60598/0 (socket says 172.21.15.133:60598) 2024-03-30T01:51:54.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.630+0000 7f7ae8e00640 1 -- 172.21.15.133:0/3684797563 learned_addr learned my addr 172.21.15.133:0/3684797563 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:54.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.630+0000 7f7ae3e00640 1 --2- 172.21.15.133:0/3684797563 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559386371eb0 0x559386378790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:54.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.630+0000 7f7ae3400640 1 --2- 172.21.15.133:0/3684797563 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559386372290 0x559386390120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:54.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.630+0000 7f7ae8e00640 1 -- 172.21.15.133:0/3684797563 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559386372290 msgr2=0x559386390120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:54.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.630+0000 7f7ae8e00640 1 --2- 172.21.15.133:0/3684797563 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559386372290 0x559386390120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.630+0000 7f7ae8e00640 1 -- 172.21.15.133:0/3684797563 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559386371eb0 msgr2=0x559386378790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:54.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.630+0000 7f7ae8e00640 1 --2- 172.21.15.133:0/3684797563 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559386371eb0 0x559386378790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.630+0000 7f7ae8e00640 1 -- 172.21.15.133:0/3684797563 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7adc009b60 con 0x55938636e560 2024-03-30T01:51:54.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.630+0000 7f7ae3400640 1 --2- 172.21.15.133:0/3684797563 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559386372290 0x559386390120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:54.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.630+0000 7f7ae3e00640 1 --2- 172.21.15.133:0/3684797563 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559386371eb0 0x559386378790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:54.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.631+0000 7f7ae8e00640 1 --2- 172.21.15.133:0/3684797563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55938636e560 0x559386390660 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7adc000f80 tx=0x7f7adc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2891d34e5961ce server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:54.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.631+0000 7f7acd600640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-03-30T01:51:54.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.631+0000 7f7acd600640 1 -- 172.21.15.133:0/3684797563 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc003b90 con 0x55938636e560 2024-03-30T01:51:54.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.631+0000 7f7aedbac740 1 -- 172.21.15.133:0/3684797563 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5593862d8b10 con 0x55938636e560 2024-03-30T01:51:54.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.631+0000 7f7acd600640 1 -- 172.21.15.133:0/3684797563 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7adc003cf0 con 0x55938636e560 2024-03-30T01:51:54.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.631+0000 7f7acd600640 1 -- 172.21.15.133:0/3684797563 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7adc004030 con 0x55938636e560 2024-03-30T01:51:54.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.631+0000 7f7aedbac740 10 client.4692 fetch_fsmap learned FSMap version 7 2024-03-30T01:51:54.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.631+0000 7f7aedbac740 1 -- 172.21.15.133:0/3684797563 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5593862acff0 con 0x55938636e560 2024-03-30T01:51:54.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.632+0000 7f7acd600640 1 -- 172.21.15.133:0/3684797563 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5593862d8b10 con 0x55938636e560 2024-03-30T01:51:54.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.632+0000 7f7acd600640 1 -- 172.21.15.133:0/3684797563 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7adc004190 con 0x55938636e560 2024-03-30T01:51:54.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.632+0000 7f7aedbac740 10 client.4692 fetch_fsmap finished waiting for FSMap version 7 2024-03-30T01:51:54.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.632+0000 7f7aedbac740 10 client.4692 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-30T01:51:54.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.632+0000 7f7aedbac740 20 client.4692 populate_metadata read hostname 'smithi133' 2024-03-30T01:51:54.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.632+0000 7f7aedbac740 1 --2- 172.21.15.133:0/3684797563 >> [v2:172.21.15.137:6832/225370013,v1:172.21.15.137:6834/225370013] conn(0x55938635e9e0 0x55938635c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:54.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.632+0000 7f7aedbac740 4 client.4692 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T01:51:54.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.632+0000 7f7aedbac740 1 -- 172.21.15.133:0/3684797563 --> [v2:172.21.15.137:6832/225370013,v1:172.21.15.137:6834/225370013] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559385fa23c0 con 0x55938635e9e0 2024-03-30T01:51:54.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.632+0000 7f7ae3e00640 1 --2- 172.21.15.133:0/3684797563 >> [v2:172.21.15.137:6832/225370013,v1:172.21.15.137:6834/225370013] conn(0x55938635e9e0 0x55938635c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:54.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.633+0000 7f7ae3e00640 1 --2- 172.21.15.133:0/3684797563 >> [v2:172.21.15.137:6832/225370013,v1:172.21.15.137:6834/225370013] conn(0x55938635e9e0 0x55938635c490 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da05febb1718c32e server_cookie=7dafe612d79603a9 in_seq=0 out_seq=0 2024-03-30T01:51:54.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.633+0000 7f7acd600640 10 client.4692 ms_handle_connect on v2:172.21.15.137:6832/225370013 2024-03-30T01:51:54.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.635+0000 7f7acd600640 1 -- 172.21.15.133:0/3684797563 <== mds.0 v2:172.21.15.137:6832/225370013 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559385fa23c0 con 0x55938635e9e0 2024-03-30T01:51:54.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.635+0000 7f7acd600640 10 client.4692 handle_command_reply: tid=0 2024-03-30T01:51:54.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.635+0000 7f7aedbac740 1 client.4692 shutdown 2024-03-30T01:51:54.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.635+0000 7f7aedbac740 1 -- 172.21.15.133:0/3684797563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55938636e560 msgr2=0x559386390660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:54.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.635+0000 7f7aedbac740 1 --2- 172.21.15.133:0/3684797563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55938636e560 0x559386390660 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7adc000f80 tx=0x7f7adc011000 comp rx=0 tx=0).stop 2024-03-30T01:51:54.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.635+0000 7f7aedbac740 1 -- 172.21.15.133:0/3684797563 shutdown_connections 2024-03-30T01:51:54.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.635+0000 7f7aedbac740 1 --2- 172.21.15.133:0/3684797563 >> [v2:172.21.15.137:6832/225370013,v1:172.21.15.137:6834/225370013] conn(0x55938635e9e0 0x55938635c490 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.635+0000 7f7aedbac740 1 --2- 172.21.15.133:0/3684797563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55938636e560 0x559386390660 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.635+0000 7f7aedbac740 1 --2- 172.21.15.133:0/3684797563 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559386372290 0x559386390120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.635+0000 7f7acd600640 0 client.4692 ms_handle_reset on v2:172.21.15.137:6832/225370013 2024-03-30T01:51:54.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.635+0000 7f7aedbac740 1 --2- 172.21.15.133:0/3684797563 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559386371eb0 0x559386378790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.635+0000 7f7aedbac740 1 -- 172.21.15.133:0/3684797563 >> 172.21.15.133:0/3684797563 conn(0x559386345390 msgr2=0x559386344530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:54.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.635+0000 7f7aedbac740 1 -- 172.21.15.133:0/3684797563 shutdown_connections 2024-03-30T01:51:54.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.635+0000 7f7aedbac740 1 -- 172.21.15.133:0/3684797563 wait complete. 2024-03-30T01:51:54.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.636+0000 7f7aedbac740 20 client.4692 trim_cache size 0 max 16384 2024-03-30T01:51:54.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.652+0000 7f7aedbac740 1 Processor -- start 2024-03-30T01:51:54.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.652+0000 7f7aedbac740 1 -- start start 2024-03-30T01:51:54.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.653+0000 7f7aedbac740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55938636e560 0x559386348ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:54.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.653+0000 7f7aedbac740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559386371eb0 0x55938635aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:54.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.653+0000 7f7aedbac740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559386372290 0x55938635b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:54.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.653+0000 7f7aedbac740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559386015f20 con 0x55938636e560 2024-03-30T01:51:54.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.653+0000 7f7aedbac740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593862682c0 con 0x559386371eb0 2024-03-30T01:51:54.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.653+0000 7f7aedbac740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x559386378a50 con 0x559386372290 2024-03-30T01:51:54.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.653+0000 7f7ae3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55938636e560 0x559386348ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:54.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.653+0000 7f7ae3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55938636e560 0x559386348ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60604/0 (socket says 172.21.15.133:60604) 2024-03-30T01:51:54.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.653+0000 7f7ae3e00640 1 -- 172.21.15.133:0/554126006 learned_addr learned my addr 172.21.15.133:0/554126006 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:54.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.654+0000 7f7ae3e00640 1 -- 172.21.15.133:0/554126006 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559386372290 msgr2=0x55938635b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:54.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.654+0000 7f7ae3e00640 1 --2- 172.21.15.133:0/554126006 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559386372290 0x55938635b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.654+0000 7f7ae3e00640 1 -- 172.21.15.133:0/554126006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559386371eb0 msgr2=0x55938635aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:54.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.654+0000 7f7ae3e00640 1 --2- 172.21.15.133:0/554126006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559386371eb0 0x55938635aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.654+0000 7f7ae3e00640 1 -- 172.21.15.133:0/554126006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593862e27c0 con 0x55938636e560 2024-03-30T01:51:54.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.654+0000 7f7ae3e00640 1 --2- 172.21.15.133:0/554126006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55938636e560 0x559386348ba0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40764e0 tx=0x7f7ad40ab040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da9a96724bbb0f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:54.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.654+0000 7f7ad9600640 1 -- 172.21.15.133:0/554126006 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4082420 con 0x55938636e560 2024-03-30T01:51:54.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.654+0000 7f7ad9600640 1 -- 172.21.15.133:0/554126006 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad4078170 con 0x55938636e560 2024-03-30T01:51:54.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.654+0000 7f7ad9600640 1 -- 172.21.15.133:0/554126006 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad40a97d0 con 0x55938636e560 2024-03-30T01:51:54.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.655+0000 7f7aedbac740 1 -- 172.21.15.133:0/554126006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55938636e560 msgr2=0x559386348ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:54.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.655+0000 7f7aedbac740 1 --2- 172.21.15.133:0/554126006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55938636e560 0x559386348ba0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40764e0 tx=0x7f7ad40ab040 comp rx=0 tx=0).stop 2024-03-30T01:51:54.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.655+0000 7f7aedbac740 1 -- 172.21.15.133:0/554126006 shutdown_connections 2024-03-30T01:51:54.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.655+0000 7f7aedbac740 1 --2- 172.21.15.133:0/554126006 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559386372290 0x55938635b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.655+0000 7f7aedbac740 1 --2- 172.21.15.133:0/554126006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559386371eb0 0x55938635aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.655+0000 7f7aedbac740 1 --2- 172.21.15.133:0/554126006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55938636e560 0x559386348ba0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.655+0000 7f7aedbac740 1 -- 172.21.15.133:0/554126006 >> 172.21.15.133:0/554126006 conn(0x559386345390 msgr2=0x559386393680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:54.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.655+0000 7f7aedbac740 1 -- 172.21.15.133:0/554126006 shutdown_connections 2024-03-30T01:51:54.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.655+0000 7f7aedbac740 1 -- 172.21.15.133:0/554126006 wait complete. 2024-03-30T01:51:54.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.656+0000 7f7aedbac740 1 -- start start 2024-03-30T01:51:54.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.656+0000 7f7aedbac740 1 Processor -- start 2024-03-30T01:51:54.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.657+0000 7f7aedbac740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55938636e560 0x559386349d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:54.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.657+0000 7f7aedbac740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559386371eb0 0x55938634a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:54.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.657+0000 7f7aedbac740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559386372290 0x559386343ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:54.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.657+0000 7f7aedbac740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559386359f70 con 0x55938636e560 2024-03-30T01:51:54.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.657+0000 7f7aedbac740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x559386344d40 con 0x559386372290 2024-03-30T01:51:54.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.657+0000 7f7aedbac740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x559386344f80 con 0x559386371eb0 2024-03-30T01:51:54.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.657+0000 7f7aedbac740 10 client.0 _ll_register_callbacks cb 0x7f7adc017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T01:51:54.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.657+0000 7f7ae3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55938636e560 0x559386349d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:54.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.657+0000 7f7ae3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55938636e560 0x559386349d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60620/0 (socket says 172.21.15.133:60620) 2024-03-30T01:51:54.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.657+0000 7f7ae3e00640 1 -- 172.21.15.133:0/4270525439 learned_addr learned my addr 172.21.15.133:0/4270525439 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:54.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.657+0000 7f7ae3e00640 1 -- 172.21.15.133:0/4270525439 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559386371eb0 msgr2=0x55938634a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:54.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.657+0000 7f7ae8e00640 1 --2- 172.21.15.133:0/4270525439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559386372290 0x559386343ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:54.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.657+0000 7f7ae3400640 1 --2- 172.21.15.133:0/4270525439 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559386371eb0 0x55938634a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:54.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.657+0000 7f7ae3e00640 1 --2- 172.21.15.133:0/4270525439 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559386371eb0 0x55938634a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.657+0000 7f7ae3e00640 1 -- 172.21.15.133:0/4270525439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559386372290 msgr2=0x559386343ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:54.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.657+0000 7f7ae3e00640 1 --2- 172.21.15.133:0/4270525439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559386372290 0x559386343ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.657+0000 7f7ae3e00640 1 -- 172.21.15.133:0/4270525439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae41529e0 con 0x55938636e560 2024-03-30T01:51:54.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.657+0000 7f7ae8e00640 1 --2- 172.21.15.133:0/4270525439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559386372290 0x559386343ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:51:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.658+0000 7f7ae3e00640 1 --2- 172.21.15.133:0/4270525439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55938636e560 0x559386349d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4076530 tx=0x7f7adc00b030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac2c10565150cf9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.658+0000 7f7acd600640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-03-30T01:51:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.658+0000 7f7acd600640 1 -- 172.21.15.133:0/4270525439 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4082420 con 0x55938636e560 2024-03-30T01:51:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.658+0000 7f7acd600640 1 -- 172.21.15.133:0/4270525439 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ad40a97d0 con 0x55938636e560 2024-03-30T01:51:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.658+0000 7f7aedbac740 1 -- 172.21.15.133:0/4270525439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7adc012870 con 0x55938636e560 2024-03-30T01:51:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.658+0000 7f7acd600640 1 -- 172.21.15.133:0/4270525439 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ad40a9270 con 0x55938636e560 2024-03-30T01:51:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.658+0000 7f7aedbac740 10 client.4698 fetch_fsmap learned FSMap version 7 2024-03-30T01:51:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.658+0000 7f7aedbac740 1 -- 172.21.15.133:0/4270525439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55938624f2b0 con 0x55938636e560 2024-03-30T01:51:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.658+0000 7f7acd600640 1 -- 172.21.15.133:0/4270525439 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7adc012870 con 0x55938636e560 2024-03-30T01:51:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.658+0000 7f7acd600640 1 -- 172.21.15.133:0/4270525439 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7ad40a3250 con 0x55938636e560 2024-03-30T01:51:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.658+0000 7f7aedbac740 10 client.4698 fetch_fsmap finished waiting for FSMap version 7 2024-03-30T01:51:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.658+0000 7f7aedbac740 10 client.4698 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-30T01:51:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.658+0000 7f7aedbac740 20 client.4698 populate_metadata read hostname 'smithi133' 2024-03-30T01:51:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.658+0000 7f7aedbac740 1 --2- 172.21.15.133:0/4270525439 >> [v2:172.21.15.137:6832/225370013,v1:172.21.15.137:6834/225370013] conn(0x5593863f7b40 0x5593863441e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:54.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.658+0000 7f7aedbac740 4 client.4698 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-30T01:51:54.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.658+0000 7f7aedbac740 1 -- 172.21.15.133:0/4270525439 --> [v2:172.21.15.137:6832/225370013,v1:172.21.15.137:6834/225370013] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559385fb36c0 con 0x5593863f7b40 2024-03-30T01:51:54.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.659+0000 7f7ae3400640 1 --2- 172.21.15.133:0/4270525439 >> [v2:172.21.15.137:6832/225370013,v1:172.21.15.137:6834/225370013] conn(0x5593863f7b40 0x5593863441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:54.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.660+0000 7f7ae3400640 1 --2- 172.21.15.133:0/4270525439 >> [v2:172.21.15.137:6832/225370013,v1:172.21.15.137:6834/225370013] conn(0x5593863f7b40 0x5593863441e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71b65ecd313c0b24 server_cookie=e10741f7c2de7100 in_seq=0 out_seq=0 2024-03-30T01:51:54.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.660+0000 7f7acd600640 10 client.4698 ms_handle_connect on v2:172.21.15.137:6832/225370013 2024-03-30T01:51:54.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.660+0000 7f7acd600640 1 -- 172.21.15.133:0/4270525439 <== mds.0 v2:172.21.15.137:6832/225370013 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x559385fb36c0 con 0x5593863f7b40 2024-03-30T01:51:54.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.660+0000 7f7acd600640 10 client.4698 handle_command_reply: tid=0 2024-03-30T01:51:54.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.660+0000 7f7aedbac740 1 client.4698 shutdown 2024-03-30T01:51:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.661+0000 7f7aedbac740 1 -- 172.21.15.133:0/4270525439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55938636e560 msgr2=0x559386349d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.661+0000 7f7aedbac740 1 --2- 172.21.15.133:0/4270525439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55938636e560 0x559386349d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4076530 tx=0x7f7adc00b030 comp rx=0 tx=0).stop 2024-03-30T01:51:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.661+0000 7f7aedbac740 1 -- 172.21.15.133:0/4270525439 shutdown_connections 2024-03-30T01:51:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.661+0000 7f7aedbac740 1 --2- 172.21.15.133:0/4270525439 >> [v2:172.21.15.137:6832/225370013,v1:172.21.15.137:6834/225370013] conn(0x5593863f7b40 0x5593863441e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.661+0000 7f7aedbac740 1 --2- 172.21.15.133:0/4270525439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559386372290 0x559386343ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.661+0000 7f7aedbac740 1 --2- 172.21.15.133:0/4270525439 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559386371eb0 0x55938634a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.661+0000 7f7acd600640 0 client.4698 ms_handle_reset on v2:172.21.15.137:6832/225370013 2024-03-30T01:51:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.661+0000 7f7aedbac740 1 --2- 172.21.15.133:0/4270525439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55938636e560 0x559386349d40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.661+0000 7f7aedbac740 1 -- 172.21.15.133:0/4270525439 >> 172.21.15.133:0/4270525439 conn(0x559386345390 msgr2=0x55938636d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.661+0000 7f7aedbac740 1 -- 172.21.15.133:0/4270525439 shutdown_connections 2024-03-30T01:51:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.661+0000 7f7aedbac740 1 -- 172.21.15.133:0/4270525439 wait complete. 2024-03-30T01:51:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.661+0000 7f7aedbac740 20 client.4698 trim_cache size 0 max 16384 2024-03-30T01:51:54.672 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-03-30T01:51:54.672 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "10e5f47a-7547-42f1-8bb3-a8ac3aae8cad", 2024-03-30T01:51:54.672 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2024-03-30T01:51:54.672 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 4285, 2024-03-30T01:51:54.672 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2024-03-30T01:51:54.672 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2024-03-30T01:51:54.672 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2024-03-30T01:51:54.672 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 21.877059286000001, 2024-03-30T01:51:54.672 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 7, 2024-03-30T01:51:54.672 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 20, 2024-03-30T01:51:54.672 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 20, 2024-03-30T01:51:54.672 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 26.399074771999999 2024-03-30T01:51:54.672 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-03-30T01:51:54.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.661+0000 7f7ae9800640 1 -- 172.21.15.133:0/51170461 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7ac406ac30 msgr2=0x7f7ac406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:54.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.661+0000 7f7ae9800640 1 --2- 172.21.15.133:0/51170461 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7ac406ac30 0x7f7ac406d0f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7ae40b0410 tx=0x7f7ad0008040 comp rx=0 tx=0).stop 2024-03-30T01:51:54.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.661+0000 7f7ae9800640 1 -- 172.21.15.133:0/51170461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae40b40f0 msgr2=0x7f7ae40b3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:54.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.661+0000 7f7ae9800640 1 --2- 172.21.15.133:0/51170461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae40b40f0 0x7f7ae40b3850 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4000c00 tx=0x7f7ad40046c0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.662+0000 7f7ae9800640 1 -- 172.21.15.133:0/51170461 shutdown_connections 2024-03-30T01:51:54.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.662+0000 7f7ae9800640 1 --2- 172.21.15.133:0/51170461 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7ac406ac30 0x7f7ac406d0f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.662+0000 7f7ae9800640 1 --2- 172.21.15.133:0/51170461 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ae415b9c0 0x7f7ae40a7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.662+0000 7f7ae9800640 1 --2- 172.21.15.133:0/51170461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ae40ccb30 0x7f7ae40ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.662+0000 7f7ae9800640 1 --2- 172.21.15.133:0/51170461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae40b40f0 0x7f7ae40b3850 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:54.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.662+0000 7f7ae9800640 1 -- 172.21.15.133:0/51170461 >> 172.21.15.133:0/51170461 conn(0x7f7ae40b05a0 msgr2=0x7f7ae406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:54.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.662+0000 7f7ae9800640 1 -- 172.21.15.133:0/51170461 shutdown_connections 2024-03-30T01:51:54.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:54.662+0000 7f7ae9800640 1 -- 172.21.15.133:0/51170461 wait complete. 2024-03-30T01:51:54.684 INFO:teuthology.run_tasks:Running task kclient... 2024-03-30T01:51:54.709 INFO:tasks.kclient:Mounting kernel clients... 2024-03-30T01:51:54.709 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-03-30T01:51:54.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:54.709 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-03-30T01:51:54.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:54.764 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2024-03-30T01:51:54.859 INFO:teuthology.orchestra.run.smithi133.stderr:Cannot find device "ceph-brx" 2024-03-30T01:51:54.864 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T01:51:54.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:54.864 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-03-30T01:51:54.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:54.917 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2024-03-30T01:51:55.010 INFO:teuthology.orchestra.run.smithi133.stderr:Cannot find device "ceph-brx" 2024-03-30T01:51:55.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T01:51:55.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:55.015 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-03-30T01:51:55.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:55.073 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-03-30T01:51:55.173 INFO:teuthology.orchestra.run.smithi137.stderr:Cannot find device "ceph-brx" 2024-03-30T01:51:55.177 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T01:51:55.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:55.177 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-03-30T01:51:55.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:55.226 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-03-30T01:51:55.314 INFO:teuthology.orchestra.run.smithi137.stderr:Cannot find device "ceph-brx" 2024-03-30T01:51:55.317 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T01:51:55.318 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-03-30T01:51:55.318 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-30T01:51:55.318 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-30T01:51:55.318 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T01:51:55.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.527+0000 7fe418800640 1 Processor -- start 2024-03-30T01:51:55.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.527+0000 7fe418800640 1 -- start start 2024-03-30T01:51:55.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.528+0000 7fe418800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4101457b0 0x7fe4100b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:55.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.528+0000 7fe418800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe410070c10 0x7fe4100b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:55.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.528+0000 7fe418800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe41006c320 con 0x7fe410145d30 2024-03-30T01:51:55.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.528+0000 7fe418800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe410145b90 con 0x7fe410070c10 2024-03-30T01:51:55.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.528+0000 7fe418800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41006c600 con 0x7fe4101457b0 2024-03-30T01:51:55.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.529+0000 7fe415400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe410145d30 0x7fe410070500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48880/0 (socket says 172.21.15.133:48880) 2024-03-30T01:51:55.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.529+0000 7fe415400640 1 -- 172.21.15.133:0/3989962102 learned_addr learned my addr 172.21.15.133:0/3989962102 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:55.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.529+0000 7fe416800640 1 --2- 172.21.15.133:0/3989962102 >> v2:172.21.15.137:3300/0 conn(0x7fe410070c10 0x7fe4100b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:55.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.529+0000 7fe415e00640 1 --2- 172.21.15.133:0/3989962102 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4101457b0 0x7fe4100b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:55.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.529+0000 7fe414a00640 1 -- 172.21.15.133:0/3989962102 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307182152 0 0) 0x7fe41006c320 con 0x7fe410145d30 2024-03-30T01:51:55.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.529+0000 7fe414a00640 1 -- 172.21.15.133:0/3989962102 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3f8003520 con 0x7fe410145d30 2024-03-30T01:51:55.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.530+0000 7fe414a00640 1 -- 172.21.15.133:0/3989962102 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 975185571 0 0) 0x7fe3f8003520 con 0x7fe410145d30 2024-03-30T01:51:55.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.530+0000 7fe414a00640 1 -- 172.21.15.133:0/3989962102 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4101457b0 msgr2=0x7fe4100b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:55.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.530+0000 7fe414a00640 1 --2- 172.21.15.133:0/3989962102 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4101457b0 0x7fe4100b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:55.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.530+0000 7fe414a00640 1 -- 172.21.15.133:0/3989962102 >> v2:172.21.15.137:3300/0 conn(0x7fe410070c10 msgr2=0x7fe4100b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:55.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.530+0000 7fe414a00640 1 --2- 172.21.15.133:0/3989962102 >> v2:172.21.15.137:3300/0 conn(0x7fe410070c10 0x7fe4100b18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:55.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.530+0000 7fe414a00640 1 -- 172.21.15.133:0/3989962102 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41006c8e0 con 0x7fe410145d30 2024-03-30T01:51:55.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.530+0000 7fe414a00640 1 -- 172.21.15.133:0/3989962102 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fe400001670 con 0x7fe410145d30 2024-03-30T01:51:55.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.530+0000 7fe414a00640 1 -- 172.21.15.133:0/3989962102 >> v1:172.21.15.133:6789/0 conn(0x7fe410145d30 legacy=0x7fe410070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:55.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.530+0000 7fe414a00640 1 --2- 172.21.15.133:0/3989962102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3f8003970 0x7fe3f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:55.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.530+0000 7fe414a00640 1 --2- 172.21.15.133:0/3989962102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3f80047c0 0x7fe3f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:55.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.530+0000 7fe414a00640 1 --2- 172.21.15.133:0/3989962102 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4101457b0 0x7fe3f8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:55.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.530+0000 7fe414a00640 1 -- 172.21.15.133:0/3989962102 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe410145b90 con 0x7fe3f8003970 2024-03-30T01:51:55.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.530+0000 7fe414a00640 1 -- 172.21.15.133:0/3989962102 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41006c600 con 0x7fe3f80047c0 2024-03-30T01:51:55.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.530+0000 7fe414a00640 1 -- 172.21.15.133:0/3989962102 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f800b980 con 0x7fe4101457b0 2024-03-30T01:51:55.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.530+0000 7fe415e00640 1 --2- 172.21.15.133:0/3989962102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3f8003970 0x7fe3f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:55.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.530+0000 7fe416800640 1 --2- 172.21.15.133:0/3989962102 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4101457b0 0x7fe3f8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:55.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.530+0000 7fe415e00640 1 -- 172.21.15.133:0/3989962102 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4101457b0 msgr2=0x7fe3f8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:55.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.530+0000 7fe415e00640 1 --2- 172.21.15.133:0/3989962102 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4101457b0 0x7fe3f8005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:55.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.530+0000 7fe415e00640 1 -- 172.21.15.133:0/3989962102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3f80047c0 msgr2=0x7fe3f8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:55.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.530+0000 7fe415e00640 1 --2- 172.21.15.133:0/3989962102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3f80047c0 0x7fe3f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:55.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.530+0000 7fe415e00640 1 -- 172.21.15.133:0/3989962102 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f8003520 con 0x7fe3f8003970 2024-03-30T01:51:55.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.531+0000 7fe415e00640 1 --2- 172.21.15.133:0/3989962102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3f8003970 0x7fe3f8003d90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe404009ac0 tx=0x7fe3f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f035fcd71009dd6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:55.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.532+0000 7fe414a00640 1 -- 172.21.15.133:0/3989962102 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40402c6b0 con 0x7fe3f8003970 2024-03-30T01:51:55.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.532+0000 7fe414a00640 1 -- 172.21.15.133:0/3989962102 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40402c810 con 0x7fe3f8003970 2024-03-30T01:51:55.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.532+0000 7fe414a00640 1 -- 172.21.15.133:0/3989962102 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40402cba0 con 0x7fe3f8003970 2024-03-30T01:51:55.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.532+0000 7fe418800640 1 -- 172.21.15.133:0/3989962102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3f8003970 msgr2=0x7fe3f8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:55.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.532+0000 7fe418800640 1 --2- 172.21.15.133:0/3989962102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3f8003970 0x7fe3f8003d90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe404009ac0 tx=0x7fe3f80057f0 comp rx=0 tx=0).stop 2024-03-30T01:51:55.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.532+0000 7fe416800640 1 -- 172.21.15.133:0/3989962102 reap_dead start 2024-03-30T01:51:55.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.532+0000 7fe418800640 1 -- 172.21.15.133:0/3989962102 shutdown_connections 2024-03-30T01:51:55.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.532+0000 7fe418800640 1 -- 172.21.15.133:0/3989962102 >> 172.21.15.133:0/3989962102 conn(0x7fe4100b07a0 msgr2=0x7fe4100b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:55.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.532+0000 7fe418800640 1 -- 172.21.15.133:0/3989962102 shutdown_connections 2024-03-30T01:51:55.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.532+0000 7fe418800640 1 -- 172.21.15.133:0/3989962102 wait complete. 2024-03-30T01:51:55.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.534+0000 7fe418800640 1 Processor -- start 2024-03-30T01:51:55.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.534+0000 7fe418800640 1 -- start start 2024-03-30T01:51:55.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.535+0000 7fe418800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe3f8003970 0x7fe4100ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:55.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.535+0000 7fe418800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe41015ffe0 0x7fe4101418d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:55.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.535+0000 7fe418800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe410141e10 0x7fe4101f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:55.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.535+0000 7fe418800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe410143350 con 0x7fe410141e10 2024-03-30T01:51:55.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.535+0000 7fe418800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4101422b0 con 0x7fe41015ffe0 2024-03-30T01:51:55.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.535+0000 7fe418800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe410142590 con 0x7fe3f8003970 2024-03-30T01:51:55.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.535+0000 7fe416800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe410141e10 0x7fe4101f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:55.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.535+0000 7fe416800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe410141e10 0x7fe4101f58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60630/0 (socket says 172.21.15.133:60630) 2024-03-30T01:51:55.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.535+0000 7fe416800640 1 -- 172.21.15.133:0/630505920 learned_addr learned my addr 172.21.15.133:0/630505920 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:55.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.536+0000 7fe415e00640 1 --2- 172.21.15.133:0/630505920 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe3f8003970 0x7fe4100ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:55.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.536+0000 7fe416800640 1 -- 172.21.15.133:0/630505920 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe3f8003970 msgr2=0x7fe4100ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.536+0000 7fe416800640 1 --2- 172.21.15.133:0/630505920 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe3f8003970 0x7fe4100ca180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.536+0000 7fe415400640 1 --2- 172.21.15.133:0/630505920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe41015ffe0 0x7fe4101418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.536+0000 7fe416800640 1 -- 172.21.15.133:0/630505920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe41015ffe0 msgr2=0x7fe4101418d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.536+0000 7fe416800640 1 --2- 172.21.15.133:0/630505920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe41015ffe0 0x7fe4101418d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.536+0000 7fe416800640 1 -- 172.21.15.133:0/630505920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe410142870 con 0x7fe410141e10 2024-03-30T01:51:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.536+0000 7fe416800640 1 --2- 172.21.15.133:0/630505920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe410141e10 0x7fe4101f58e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe41006ea10 tx=0x7fe40c00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.536+0000 7fe40a000640 1 -- 172.21.15.133:0/630505920 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c017400 con 0x7fe410141e10 2024-03-30T01:51:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.536+0000 7fe40a000640 1 -- 172.21.15.133:0/630505920 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c011040 con 0x7fe410141e10 2024-03-30T01:51:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.536+0000 7fe40a000640 1 -- 172.21.15.133:0/630505920 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c0177c0 con 0x7fe410141e10 2024-03-30T01:51:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.536+0000 7fe418800640 1 -- 172.21.15.133:0/630505920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe410142b50 con 0x7fe410141e10 2024-03-30T01:51:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.536+0000 7fe418800640 1 -- 172.21.15.133:0/630505920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4101f5e20 con 0x7fe410141e10 2024-03-30T01:51:55.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.537+0000 7fe418800640 1 -- 172.21.15.133:0/630505920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe410143070 con 0x7fe410141e10 2024-03-30T01:51:55.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.538+0000 7fe40a000640 1 -- 172.21.15.133:0/630505920 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe40c017920 con 0x7fe410141e10 2024-03-30T01:51:55.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.539+0000 7fe40a000640 1 --2- 172.21.15.133:0/630505920 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe3f406ac00 0x7fe3f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:55.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.539+0000 7fe40a000640 1 -- 172.21.15.133:0/630505920 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe40c089770 con 0x7fe410141e10 2024-03-30T01:51:55.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.539+0000 7fe415e00640 1 --2- 172.21.15.133:0/630505920 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe3f406ac00 0x7fe3f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:55.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.540+0000 7fe415e00640 1 --2- 172.21.15.133:0/630505920 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe3f406ac00 0x7fe3f406d0c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe404036000 tx=0x7fe404030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:55.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.543+0000 7fe40a000640 1 -- 172.21.15.133:0/630505920 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fe410143070 con 0x7fe410141e10 2024-03-30T01:51:55.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.775+0000 7fe418800640 1 -- 172.21.15.133:0/630505920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe410143070 con 0x7fe410141e10 2024-03-30T01:51:55.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.776+0000 7fe40a000640 1 -- 172.21.15.133:0/630505920 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe410143070 con 0x7fe410141e10 2024-03-30T01:51:55.783 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-30T01:51:55.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.779+0000 7fe418800640 1 -- 172.21.15.133:0/630505920 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe3f406ac00 msgr2=0x7fe3f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.779+0000 7fe418800640 1 --2- 172.21.15.133:0/630505920 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe3f406ac00 0x7fe3f406d0c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe404036000 tx=0x7fe404030000 comp rx=0 tx=0).stop 2024-03-30T01:51:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.779+0000 7fe418800640 1 -- 172.21.15.133:0/630505920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe410141e10 msgr2=0x7fe4101f58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.779+0000 7fe418800640 1 --2- 172.21.15.133:0/630505920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe410141e10 0x7fe4101f58e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe41006ea10 tx=0x7fe40c00f4a0 comp rx=0 tx=0).stop 2024-03-30T01:51:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.779+0000 7fe418800640 1 -- 172.21.15.133:0/630505920 shutdown_connections 2024-03-30T01:51:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.779+0000 7fe418800640 1 --2- 172.21.15.133:0/630505920 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe3f406ac00 0x7fe3f406d0c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.779+0000 7fe418800640 1 --2- 172.21.15.133:0/630505920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe410141e10 0x7fe4101f58e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.779+0000 7fe418800640 1 --2- 172.21.15.133:0/630505920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe41015ffe0 0x7fe4101418d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.779+0000 7fe418800640 1 --2- 172.21.15.133:0/630505920 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe3f8003970 0x7fe4100ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.779+0000 7fe418800640 1 -- 172.21.15.133:0/630505920 >> 172.21.15.133:0/630505920 conn(0x7fe4100b07a0 msgr2=0x7fe4100afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.779+0000 7fe418800640 1 -- 172.21.15.133:0/630505920 shutdown_connections 2024-03-30T01:51:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:55.779+0000 7fe418800640 1 -- 172.21.15.133:0/630505920 wait complete. 2024-03-30T01:51:55.804 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-30T01:51:55.804 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T01:51:55.804 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2024-03-30T01:51:55.804 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-30T01:51:55.804 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-30T01:51:55.804 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-30T01:51:55.804 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-30T01:51:55.804 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T01:51:55.804 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-30T01:51:55.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:55.805 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2024-03-30T01:51:55.852 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T01:51:55.852 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T01:51:55.852 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T01:51:55.853 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:51:55.853 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-03-30T01:51:55.853 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:51:55.853 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T01:51:55.853 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2024-03-30T01:51:55.853 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2024-03-30T01:51:55.853 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T01:51:55.853 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2024-03-30T01:51:55.853 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2024-03-30T01:51:55.853 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T01:51:55.853 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2024-03-30T01:51:55.853 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T01:51:55.854 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2024-03-30T01:51:55.854 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-30T01:51:55.854 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42539sec preferred_lft 42539sec 2024-03-30T01:51:55.854 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2024-03-30T01:51:55.854 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:51:55.855 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-30T01:51:55.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:55.855 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-03-30T01:51:55.856 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-03-30T01:51:55.856 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add name ceph-brx type bridge 2024-03-30T01:51:55.856 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr flush dev ceph-brx 2024-03-30T01:51:55.856 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set ceph-brx up 2024-03-30T01:51:55.856 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-30T01:51:55.856 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-03-30T01:51:56.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:56.291 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T01:51:56.372 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-03-30T01:51:56.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:56.375 DEBUG:teuthology.orchestra.run.smithi133:> route 2024-03-30T01:51:56.423 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2024-03-30T01:51:56.423 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T01:51:56.423 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-30T01:51:56.423 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-30T01:51:56.423 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T01:51:56.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:56.424 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-03-30T01:51:56.424 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-03-30T01:51:56.424 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-30T01:51:56.424 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-30T01:51:56.424 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-30T01:51:56.424 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-03-30T01:51:57.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:57.100 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-03-30T01:51:57.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:57.152 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list-id 2024-03-30T01:51:57.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:57.201 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-03-30T01:51:57.201 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-03-30T01:51:57.201 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T01:51:57.201 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-30T01:51:57.202 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-03-30T01:51:57.341 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-30T01:51:57.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:57.341 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-03-30T01:51:57.341 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-03-30T01:51:57.341 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-30T01:51:57.341 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-30T01:51:57.341 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-30T01:51:57.341 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-30T01:51:57.342 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-30T01:51:57.342 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-03-30T01:51:57.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:57.604 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-03-30T01:51:57.604 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-03-30T01:51:57.604 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2024-03-30T01:51:57.605 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set dev brx.0 master ceph-brx 2024-03-30T01:51:57.605 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-03-30T01:51:57.769 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T01:51:57.769 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-30T01:51:57.814 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-30T01:51:57.814 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T01:51:57.814 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-30T01:51:57.908 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-30T01:51:57.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:57.909 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T01:51:58.045 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T01:51:58.045 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-30T01:51:58.045 INFO:teuthology.orchestra.run.smithi133.stdout:invalid new device string format 2024-03-30T01:51:58.646 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T01:51:58.647 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-30T01:51:58.647 INFO:teuthology.orchestra.run.smithi133.stdout:invalid new device string format 2024-03-30T01:51:58.647 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-03-30T01:51:58.647 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T01:51:58.682 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T01:51:58.682 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-30T01:51:58.682 INFO:teuthology.orchestra.run.smithi133.stdout:invalid new device string format 2024-03-30T01:51:58.682 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-03-30T01:51:58.682 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T01:51:58.683 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.133:6789,172.21.15.137:6789,172.21.15.137:6790" 2024-03-30T01:51:58.683 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.133:6789,172.21.15.137:6789,172.21.15.137:6790:/ 2024-03-30T01:51:58.683 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=10e5f47a-7547-42f1-8bb3-a8ac3aae8cad" will pass to kernel 2024-03-30T01:51:58.685 INFO:teuthology.orchestra.run.smithi133.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-30T01:51:58.685 INFO:teuthology.orchestra.run.smithi133.stdout: You just mounted a file system that supports labels which does not 2024-03-30T01:51:58.685 INFO:teuthology.orchestra.run.smithi133.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-30T01:51:58.685 INFO:teuthology.orchestra.run.smithi133.stdout: applications will generate AVC messages and not be allowed access to 2024-03-30T01:51:58.686 INFO:teuthology.orchestra.run.smithi133.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-30T01:51:58.691 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-30T01:51:58.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:58.692 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-30T01:51:58.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:58.782 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T01:51:58.861 INFO:teuthology.orchestra.run.smithi133.stdout:client4707 2024-03-30T01:51:58.861 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:51:58.861 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:51:58.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:58.914 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T01:51:59.034 INFO:teuthology.orchestra.run.smithi133.stdout:client4707 2024-03-30T01:51:59.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:59.035 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T01:51:59.115 INFO:teuthology.orchestra.run.smithi133.stdout:client4707 2024-03-30T01:51:59.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:59.116 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/10e5f47a-7547-42f1-8bb3-a8ac3aae8cad.client4707/status') 2024-03-30T01:51:59.226 INFO:teuthology.orchestra.run.smithi133.stdout:instance: client.4707 (3)192.168.0.1:0/354874343 2024-03-30T01:51:59.226 INFO:teuthology.orchestra.run.smithi133.stdout:blocklisted: false 2024-03-30T01:51:59.226 INFO:teuthology.orchestra.run.smithi133.stderr:0+1 records in 2024-03-30T01:51:59.226 INFO:teuthology.orchestra.run.smithi133.stderr:0+1 records out 2024-03-30T01:51:59.226 INFO:teuthology.orchestra.run.smithi133.stderr:68 bytes copied, 6.5587e-05 s, 1.0 MB/s 2024-03-30T01:51:59.231 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-03-30T01:51:59.231 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-30T01:51:59.231 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-30T01:51:59.231 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T01:51:59.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.442+0000 7fbafd800640 1 Processor -- start 2024-03-30T01:51:59.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.442+0000 7fbafd800640 1 -- start start 2024-03-30T01:51:59.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.443+0000 7fbafd800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbaf815aa60 0x7fbaf80cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:59.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.443+0000 7fbafd800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbaf80cc360 0x7fbaf815e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:59.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.443+0000 7fbafd800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf806f790 con 0x7fbaf815eb70 2024-03-30T01:51:59.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.444+0000 7fbafd800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf815ef80 con 0x7fbaf815aa60 2024-03-30T01:51:59.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.444+0000 7fbafd800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf80ce5c0 con 0x7fbaf80cc360 2024-03-30T01:51:59.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.444+0000 7fbaf7400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbaf815eb70 0x7fbaf8098bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:44800/0 (socket says 172.21.15.133:44800) 2024-03-30T01:51:59.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.444+0000 7fbaf6a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbaf815aa60 0x7fbaf80cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:59.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.444+0000 7fbaf7400640 1 -- 172.21.15.133:0/2600767786 learned_addr learned my addr 172.21.15.133:0/2600767786 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:51:59.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.444+0000 7fbaf6000640 1 --2- 172.21.15.133:0/2600767786 >> v2:172.21.15.137:3300/0 conn(0x7fbaf80cc360 0x7fbaf815e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:59.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.444+0000 7fbaf5600640 1 -- 172.21.15.133:0/2600767786 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999468435 0 0) 0x7fbaf806f790 con 0x7fbaf815eb70 2024-03-30T01:51:59.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.445+0000 7fbaf5600640 1 -- 172.21.15.133:0/2600767786 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbadc003520 con 0x7fbaf815eb70 2024-03-30T01:51:59.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.445+0000 7fbaf5600640 1 -- 172.21.15.133:0/2600767786 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 450957133 0 0) 0x7fbadc003520 con 0x7fbaf815eb70 2024-03-30T01:51:59.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.445+0000 7fbaf6a00640 1 -- 172.21.15.133:0/2600767786 >> v2:172.21.15.137:3300/0 conn(0x7fbaf80cc360 msgr2=0x7fbaf815e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:51:59.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.445+0000 7fbaf6a00640 1 --2- 172.21.15.133:0/2600767786 >> v2:172.21.15.137:3300/0 conn(0x7fbaf80cc360 0x7fbaf815e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:59.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.445+0000 7fbaf6a00640 1 -- 172.21.15.133:0/2600767786 >> v1:172.21.15.133:6789/0 conn(0x7fbaf815eb70 legacy=0x7fbaf8098bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:59.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.445+0000 7fbaf6a00640 1 -- 172.21.15.133:0/2600767786 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf80ce8a0 con 0x7fbaf815aa60 2024-03-30T01:51:59.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.446+0000 7fbaf6a00640 1 --2- 172.21.15.133:0/2600767786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbaf815aa60 0x7fbaf80cbe20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80cfe70 tx=0x7fbae802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ac408492cfc2e4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:59.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.446+0000 7fbaf5600640 1 -- 172.21.15.133:0/2600767786 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf00019f0 con 0x7fbaf815aa60 2024-03-30T01:51:59.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.446+0000 7fbaf5600640 1 -- 172.21.15.133:0/2600767786 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae8033440 con 0x7fbaf815aa60 2024-03-30T01:51:59.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.446+0000 7fbaf5600640 1 -- 172.21.15.133:0/2600767786 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae80337b0 con 0x7fbaf815aa60 2024-03-30T01:51:59.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.447+0000 7fbafd800640 1 -- 172.21.15.133:0/2600767786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbaf815aa60 msgr2=0x7fbaf80cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:59.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.447+0000 7fbafd800640 1 --2- 172.21.15.133:0/2600767786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbaf815aa60 0x7fbaf80cbe20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80cfe70 tx=0x7fbae802b7a0 comp rx=0 tx=0).stop 2024-03-30T01:51:59.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.447+0000 7fbafd800640 1 -- 172.21.15.133:0/2600767786 shutdown_connections 2024-03-30T01:51:59.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.447+0000 7fbafd800640 1 --2- 172.21.15.133:0/2600767786 >> v2:172.21.15.137:3300/0 conn(0x7fbaf80cc360 0x7fbaf815e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:59.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.447+0000 7fbafd800640 1 --2- 172.21.15.133:0/2600767786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbaf815aa60 0x7fbaf80cbe20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:59.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.447+0000 7fbafd800640 1 -- 172.21.15.133:0/2600767786 >> 172.21.15.133:0/2600767786 conn(0x7fbaf80d0850 msgr2=0x7fbaf80d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:59.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.447+0000 7fbafd800640 1 -- 172.21.15.133:0/2600767786 shutdown_connections 2024-03-30T01:51:59.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.447+0000 7fbafd800640 1 -- 172.21.15.133:0/2600767786 wait complete. 2024-03-30T01:51:59.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.449+0000 7fbafd800640 1 Processor -- start 2024-03-30T01:51:59.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.449+0000 7fbafd800640 1 -- start start 2024-03-30T01:51:59.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.450+0000 7fbafd800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbaf80cc360 0x7fbaf80c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:59.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.450+0000 7fbafd800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbaf815aa60 0x7fbaf8155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:59.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.450+0000 7fbafd800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbaf815eb70 0x7fbaf8157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:59.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.450+0000 7fbafd800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf80c7b30 con 0x7fbaf80cc360 2024-03-30T01:51:59.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.450+0000 7fbafd800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf80c7e10 con 0x7fbaf815aa60 2024-03-30T01:51:59.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.450+0000 7fbafd800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf80c80f0 con 0x7fbaf815eb70 2024-03-30T01:51:59.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.450+0000 7fbaf6a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbaf80cc360 0x7fbaf80c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:59.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.450+0000 7fbaf6a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbaf80cc360 0x7fbaf80c8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60242/0 (socket says 172.21.15.133:60242) 2024-03-30T01:51:59.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.450+0000 7fbaf6a00640 1 -- 172.21.15.133:0/3496484044 learned_addr learned my addr 172.21.15.133:0/3496484044 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:51:59.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.450+0000 7fbaf6000640 1 --2- 172.21.15.133:0/3496484044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbaf815aa60 0x7fbaf8155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:59.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.451+0000 7fbaf7400640 1 --2- 172.21.15.133:0/3496484044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbaf815eb70 0x7fbaf8157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:59.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.451+0000 7fbaf6a00640 1 -- 172.21.15.133:0/3496484044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbaf815eb70 msgr2=0x7fbaf8157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:59.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.451+0000 7fbaf6a00640 1 --2- 172.21.15.133:0/3496484044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbaf815eb70 0x7fbaf8157010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:59.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.451+0000 7fbaf6a00640 1 -- 172.21.15.133:0/3496484044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbaf815aa60 msgr2=0x7fbaf8155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:59.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.451+0000 7fbaf6a00640 1 --2- 172.21.15.133:0/3496484044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbaf815aa60 0x7fbaf8155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:59.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.451+0000 7fbaf6a00640 1 -- 172.21.15.133:0/3496484044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae8009400 con 0x7fbaf80cc360 2024-03-30T01:51:59.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.451+0000 7fbaf6a00640 1 --2- 172.21.15.133:0/3496484044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbaf80cc360 0x7fbaf80c8eb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbae802b7e0 tx=0x7fbae80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:59.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.451+0000 7fbaeea00640 1 -- 172.21.15.133:0/3496484044 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae8030940 con 0x7fbaf80cc360 2024-03-30T01:51:59.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.451+0000 7fbaeea00640 1 -- 172.21.15.133:0/3496484044 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae8030aa0 con 0x7fbaf80cc360 2024-03-30T01:51:59.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.451+0000 7fbaeea00640 1 -- 172.21.15.133:0/3496484044 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae8030e30 con 0x7fbaf80cc360 2024-03-30T01:51:59.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.451+0000 7fbafd800640 1 -- 172.21.15.133:0/3496484044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf80c83d0 con 0x7fbaf80cc360 2024-03-30T01:51:59.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.452+0000 7fbafd800640 1 -- 172.21.15.133:0/3496484044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf80c8990 con 0x7fbaf80cc360 2024-03-30T01:51:59.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.453+0000 7fbafd800640 1 -- 172.21.15.133:0/3496484044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf8066d80 con 0x7fbaf80cc360 2024-03-30T01:51:59.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.454+0000 7fbaeea00640 1 -- 172.21.15.133:0/3496484044 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fbae803a050 con 0x7fbaf80cc360 2024-03-30T01:51:59.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.454+0000 7fbaeea00640 1 --2- 172.21.15.133:0/3496484044 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbad806ac30 0x7fbad806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:51:59.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.455+0000 7fbaeea00640 1 -- 172.21.15.133:0/3496484044 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbae80aa770 con 0x7fbaf80cc360 2024-03-30T01:51:59.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.455+0000 7fbaf6000640 1 --2- 172.21.15.133:0/3496484044 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbad806ac30 0x7fbad806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:51:59.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.455+0000 7fbaf6000640 1 --2- 172.21.15.133:0/3496484044 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbad806ac30 0x7fbad806d0f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80c93f0 tx=0x7fbae4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:51:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.460+0000 7fbaeea00640 1 -- 172.21.15.133:0/3496484044 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fbae80758b0 con 0x7fbaf80cc360 2024-03-30T01:51:59.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.695+0000 7fbafd800640 1 -- 172.21.15.133:0/3496484044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbaf80c3ee0 con 0x7fbaf80cc360 2024-03-30T01:51:59.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.695+0000 7fbaeea00640 1 -- 172.21.15.133:0/3496484044 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbae8078ed0 con 0x7fbaf80cc360 2024-03-30T01:51:59.701 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-30T01:51:59.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.698+0000 7fbafd800640 1 -- 172.21.15.133:0/3496484044 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbad806ac30 msgr2=0x7fbad806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:59.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.698+0000 7fbafd800640 1 --2- 172.21.15.133:0/3496484044 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbad806ac30 0x7fbad806d0f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80c93f0 tx=0x7fbae4008040 comp rx=0 tx=0).stop 2024-03-30T01:51:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.698+0000 7fbafd800640 1 -- 172.21.15.133:0/3496484044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbaf80cc360 msgr2=0x7fbaf80c8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:51:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.698+0000 7fbafd800640 1 --2- 172.21.15.133:0/3496484044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbaf80cc360 0x7fbaf80c8eb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbae802b7e0 tx=0x7fbae80046c0 comp rx=0 tx=0).stop 2024-03-30T01:51:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.698+0000 7fbafd800640 1 -- 172.21.15.133:0/3496484044 shutdown_connections 2024-03-30T01:51:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.698+0000 7fbafd800640 1 --2- 172.21.15.133:0/3496484044 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbad806ac30 0x7fbad806d0f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.698+0000 7fbafd800640 1 --2- 172.21.15.133:0/3496484044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbaf815eb70 0x7fbaf8157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.698+0000 7fbafd800640 1 --2- 172.21.15.133:0/3496484044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbaf815aa60 0x7fbaf8155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.698+0000 7fbafd800640 1 --2- 172.21.15.133:0/3496484044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbaf80cc360 0x7fbaf80c8eb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:51:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.698+0000 7fbafd800640 1 -- 172.21.15.133:0/3496484044 >> 172.21.15.133:0/3496484044 conn(0x7fbaf80d0850 msgr2=0x7fbaf806e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:51:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.698+0000 7fbafd800640 1 -- 172.21.15.133:0/3496484044 shutdown_connections 2024-03-30T01:51:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:51:59.698+0000 7fbafd800640 1 -- 172.21.15.133:0/3496484044 wait complete. 2024-03-30T01:51:59.724 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-30T01:51:59.724 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T01:51:59.724 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2024-03-30T01:51:59.724 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-03-30T01:51:59.724 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-30T01:51:59.724 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-30T01:51:59.724 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-30T01:51:59.724 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T01:51:59.724 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-03-30T01:51:59.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:59.725 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2024-03-30T01:51:59.779 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T01:51:59.779 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T01:51:59.779 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T01:51:59.779 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:51:59.779 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-03-30T01:51:59.779 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:51:59.779 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T01:51:59.779 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2024-03-30T01:51:59.779 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2024-03-30T01:51:59.779 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T01:51:59.779 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2024-03-30T01:51:59.779 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2024-03-30T01:51:59.780 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T01:51:59.780 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2024-03-30T01:51:59.780 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T01:51:59.780 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2024-03-30T01:51:59.780 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-30T01:51:59.780 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42535sec preferred_lft 42535sec 2024-03-30T01:51:59.780 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2024-03-30T01:51:59.780 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:51:59.780 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T01:51:59.780 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether e2:c1:fe:aa:32:5e brd ff:ff:ff:ff:ff:ff 2024-03-30T01:51:59.780 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-30T01:51:59.780 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:51:59.780 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c9e:e4ff:fe1f:eb21/64 scope link 2024-03-30T01:51:59.780 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:51:59.780 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-30T01:51:59.781 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether e2:c1:fe:aa:32:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T01:51:59.781 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::e0c1:feff:feaa:325e/64 scope link 2024-03-30T01:51:59.781 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:51:59.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:59.782 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T01:51:59.865 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-03-30T01:51:59.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:59.870 DEBUG:teuthology.orchestra.run.smithi133:> route 2024-03-30T01:51:59.921 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2024-03-30T01:51:59.921 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T01:51:59.921 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-30T01:51:59.921 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-30T01:51:59.921 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T01:51:59.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:51:59.922 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-03-30T01:51:59.922 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-03-30T01:51:59.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-30T01:51:59.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-30T01:51:59.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-30T01:51:59.922 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-03-30T01:52:00.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:00.100 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-03-30T01:52:00.148 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-30T01:52:00.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:00.149 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list-id 2024-03-30T01:52:00.195 INFO:teuthology.orchestra.run.smithi133.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-03-30T01:52:00.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:00.196 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-03-30T01:52:00.196 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-03-30T01:52:00.196 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T01:52:00.196 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-03-30T01:52:00.196 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-03-30T01:52:00.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:00.380 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-30T01:52:00.465 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T01:52:00.466 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T01:52:00.466 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T01:52:00.466 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:00.466 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-03-30T01:52:00.466 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:00.466 INFO:teuthology.orchestra.run.smithi133.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T01:52:00.466 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 22:36:5d:00:76:c0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-30T01:52:00.466 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-30T01:52:00.466 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:00.466 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::2036:5dff:fe00:76c0/64 scope link 2024-03-30T01:52:00.466 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:00.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:00.470 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-30T01:52:00.562 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T01:52:00.562 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T01:52:00.562 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T01:52:00.563 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:00.563 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-03-30T01:52:00.563 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:00.563 INFO:teuthology.orchestra.run.smithi133.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T01:52:00.563 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 22:36:5d:00:76:c0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-30T01:52:00.563 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-30T01:52:00.563 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:00.563 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::2036:5dff:fe00:76c0/64 scope link 2024-03-30T01:52:00.563 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:00.566 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-03-30T01:52:00.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:00.566 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-03-30T01:52:00.567 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-03-30T01:52:00.567 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-03-30T01:52:00.567 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-30T01:52:00.567 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-03-30T01:52:00.567 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-03-30T01:52:00.567 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-03-30T01:52:00.567 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-03-30T01:52:00.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:00.830 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-03-30T01:52:00.830 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-03-30T01:52:00.830 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.1 up 2024-03-30T01:52:00.830 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set dev brx.1 master ceph-brx 2024-03-30T01:52:00.830 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-03-30T01:52:01.000 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T01:52:01.000 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-03-30T01:52:01.047 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-03-30T01:52:01.048 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T01:52:01.048 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-03-30T01:52:01.098 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-30T01:52:01.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:01.099 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-30T01:52:01.234 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-30T01:52:01.234 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-03-30T01:52:01.234 INFO:teuthology.orchestra.run.smithi133.stdout:invalid new device string format 2024-03-30T01:52:01.255 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-30T01:52:01.256 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-03-30T01:52:01.256 INFO:teuthology.orchestra.run.smithi133.stdout:invalid new device string format 2024-03-30T01:52:01.256 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-03-30T01:52:01.256 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T01:52:01.282 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-30T01:52:01.282 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-03-30T01:52:01.282 INFO:teuthology.orchestra.run.smithi133.stdout:invalid new device string format 2024-03-30T01:52:01.282 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-03-30T01:52:01.283 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T01:52:01.283 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.133:6789,172.21.15.137:6789,172.21.15.137:6790" 2024-03-30T01:52:01.283 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.133:6789,172.21.15.137:6789,172.21.15.137:6790:/ 2024-03-30T01:52:01.283 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=10e5f47a-7547-42f1-8bb3-a8ac3aae8cad" will pass to kernel 2024-03-30T01:52:01.285 INFO:teuthology.orchestra.run.smithi133.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-03-30T01:52:01.286 INFO:teuthology.orchestra.run.smithi133.stdout: You just mounted a file system that supports labels which does not 2024-03-30T01:52:01.286 INFO:teuthology.orchestra.run.smithi133.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-30T01:52:01.286 INFO:teuthology.orchestra.run.smithi133.stdout: applications will generate AVC messages and not be allowed access to 2024-03-30T01:52:01.286 INFO:teuthology.orchestra.run.smithi133.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-30T01:52:01.289 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-30T01:52:01.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:01.290 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-03-30T01:52:01.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:01.368 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T01:52:01.426 INFO:teuthology.orchestra.run.smithi133.stdout:client4719 2024-03-30T01:52:01.427 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:52:01.427 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:52:01.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:01.477 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T01:52:01.531 INFO:teuthology.orchestra.run.smithi133.stdout:client4719 2024-03-30T01:52:01.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:01.531 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T01:52:01.586 INFO:teuthology.orchestra.run.smithi133.stdout:client4719 2024-03-30T01:52:01.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:01.587 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/10e5f47a-7547-42f1-8bb3-a8ac3aae8cad.client4719/status') 2024-03-30T01:52:01.674 INFO:teuthology.orchestra.run.smithi133.stdout:instance: client.4719 (3)192.168.0.2:0/4256597118 2024-03-30T01:52:01.674 INFO:teuthology.orchestra.run.smithi133.stdout:blocklisted: false 2024-03-30T01:52:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:0+1 records in 2024-03-30T01:52:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:0+1 records out 2024-03-30T01:52:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:69 bytes copied, 6.7545e-05 s, 1.0 MB/s 2024-03-30T01:52:01.678 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-03-30T01:52:01.678 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-30T01:52:01.679 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-30T01:52:01.679 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T01:52:01.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.885+0000 7fd666e00640 1 Processor -- start 2024-03-30T01:52:01.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.886+0000 7fd666e00640 1 -- start start 2024-03-30T01:52:01.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.887+0000 7fd666e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd66015cec0 0x7fd6600b8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:01.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.887+0000 7fd666e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd6600cf860 0x7fd6600cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:01.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.887+0000 7fd666e00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6600b5ba0 con 0x7fd6600b4530 2024-03-30T01:52:01.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.887+0000 7fd666e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd660161810 con 0x7fd6600cf860 2024-03-30T01:52:01.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.887+0000 7fd666e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd660160b90 con 0x7fd66015cec0 2024-03-30T01:52:01.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.887+0000 7fd664e00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd6600b4530 0x7fd6600b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:44814/0 (socket says 172.21.15.133:44814) 2024-03-30T01:52:01.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.887+0000 7fd664e00640 1 -- 172.21.15.133:0/2666001172 learned_addr learned my addr 172.21.15.133:0/2666001172 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:01.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.888+0000 7fd65fe00640 1 --2- 172.21.15.133:0/2666001172 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd66015cec0 0x7fd6600b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:01.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.888+0000 7fd657e00640 1 --2- 172.21.15.133:0/2666001172 >> v2:172.21.15.137:3300/0 conn(0x7fd6600cf860 0x7fd6600cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:01.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.888+0000 7fd65f400640 1 -- 172.21.15.133:0/2666001172 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923629423 0 0) 0x7fd6600b5ba0 con 0x7fd6600b4530 2024-03-30T01:52:01.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.888+0000 7fd65f400640 1 -- 172.21.15.133:0/2666001172 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd644003520 con 0x7fd6600b4530 2024-03-30T01:52:01.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.888+0000 7fd65f400640 1 -- 172.21.15.133:0/2666001172 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3213384600 0 0) 0x7fd644003520 con 0x7fd6600b4530 2024-03-30T01:52:01.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.888+0000 7fd65f400640 1 -- 172.21.15.133:0/2666001172 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd66015cec0 msgr2=0x7fd6600b8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:01.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.888+0000 7fd65f400640 1 --2- 172.21.15.133:0/2666001172 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd66015cec0 0x7fd6600b8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:01.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.888+0000 7fd65f400640 1 -- 172.21.15.133:0/2666001172 >> v2:172.21.15.137:3300/0 conn(0x7fd6600cf860 msgr2=0x7fd6600cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:01.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.888+0000 7fd65f400640 1 --2- 172.21.15.133:0/2666001172 >> v2:172.21.15.137:3300/0 conn(0x7fd6600cf860 0x7fd6600cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:01.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.888+0000 7fd65f400640 1 -- 172.21.15.133:0/2666001172 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6600d0200 con 0x7fd6600b4530 2024-03-30T01:52:01.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.888+0000 7fd65f400640 1 -- 172.21.15.133:0/2666001172 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fd6580019f0 con 0x7fd6600b4530 2024-03-30T01:52:01.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.888+0000 7fd65f400640 1 -- 172.21.15.133:0/2666001172 >> v1:172.21.15.133:6789/0 conn(0x7fd6600b4530 legacy=0x7fd6600b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:01.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.888+0000 7fd65f400640 1 --2- 172.21.15.133:0/2666001172 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd644003970 0x7fd644003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:01.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.888+0000 7fd65f400640 1 --2- 172.21.15.133:0/2666001172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6440042d0 0x7fd6440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:01.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.889+0000 7fd65f400640 1 --2- 172.21.15.133:0/2666001172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd644004e10 0x7fd644005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:01.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.889+0000 7fd65f400640 1 -- 172.21.15.133:0/2666001172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd660161810 con 0x7fd6440042d0 2024-03-30T01:52:01.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.889+0000 7fd65f400640 1 -- 172.21.15.133:0/2666001172 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd660160b90 con 0x7fd644004e10 2024-03-30T01:52:01.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.889+0000 7fd65f400640 1 -- 172.21.15.133:0/2666001172 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64400bd90 con 0x7fd644003970 2024-03-30T01:52:01.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.889+0000 7fd657e00640 1 --2- 172.21.15.133:0/2666001172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6440042d0 0x7fd6440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:01.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.889+0000 7fd65fe00640 1 --2- 172.21.15.133:0/2666001172 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd644003970 0x7fd644003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:01.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.889+0000 7fd657e00640 1 -- 172.21.15.133:0/2666001172 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd644003970 msgr2=0x7fd644003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:01.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.889+0000 7fd657e00640 1 --2- 172.21.15.133:0/2666001172 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd644003970 0x7fd644003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:01.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.889+0000 7fd664e00640 1 --2- 172.21.15.133:0/2666001172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd644004e10 0x7fd644005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:01.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.889+0000 7fd657e00640 1 -- 172.21.15.133:0/2666001172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd644004e10 msgr2=0x7fd644005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:01.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.889+0000 7fd657e00640 1 --2- 172.21.15.133:0/2666001172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd644004e10 0x7fd644005290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:01.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.889+0000 7fd657e00640 1 -- 172.21.15.133:0/2666001172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd644003520 con 0x7fd6440042d0 2024-03-30T01:52:01.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.890+0000 7fd657e00640 1 --2- 172.21.15.133:0/2666001172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6440042d0 0x7fd6440047c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd648009ac0 tx=0x7fd6440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7f299a450fea45 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:01.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.890+0000 7fd65f400640 1 -- 172.21.15.133:0/2666001172 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64802c710 con 0x7fd6440042d0 2024-03-30T01:52:01.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.891+0000 7fd65f400640 1 -- 172.21.15.133:0/2666001172 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64802c870 con 0x7fd6440042d0 2024-03-30T01:52:01.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.891+0000 7fd65f400640 1 -- 172.21.15.133:0/2666001172 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64802cc00 con 0x7fd6440042d0 2024-03-30T01:52:01.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.891+0000 7fd666e00640 1 -- 172.21.15.133:0/2666001172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6440042d0 msgr2=0x7fd6440047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:01.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.891+0000 7fd666e00640 1 --2- 172.21.15.133:0/2666001172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6440042d0 0x7fd6440047c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd648009ac0 tx=0x7fd6440057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:01.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.891+0000 7fd664e00640 1 -- 172.21.15.133:0/2666001172 reap_dead start 2024-03-30T01:52:01.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.891+0000 7fd666e00640 1 -- 172.21.15.133:0/2666001172 shutdown_connections 2024-03-30T01:52:01.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.891+0000 7fd666e00640 1 -- 172.21.15.133:0/2666001172 >> 172.21.15.133:0/2666001172 conn(0x7fd66006b5e0 msgr2=0x7fd66006b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:01.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.891+0000 7fd666e00640 1 -- 172.21.15.133:0/2666001172 shutdown_connections 2024-03-30T01:52:01.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.891+0000 7fd666e00640 1 -- 172.21.15.133:0/2666001172 wait complete. 2024-03-30T01:52:01.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.893+0000 7fd666e00640 1 Processor -- start 2024-03-30T01:52:01.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.893+0000 7fd666e00640 1 -- start start 2024-03-30T01:52:01.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.894+0000 7fd666e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6440042d0 0x7fd6600ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:01.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.894+0000 7fd666e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6601f3640 0x7fd6600b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:01.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.894+0000 7fd666e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6600b2fd0 0x7fd6600c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:01.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.894+0000 7fd666e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6600b3480 con 0x7fd6440042d0 2024-03-30T01:52:01.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.894+0000 7fd666e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6600ca9f0 con 0x7fd6601f3640 2024-03-30T01:52:01.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.894+0000 7fd666e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6601f3420 con 0x7fd6600b2fd0 2024-03-30T01:52:01.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.894+0000 7fd65fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6440042d0 0x7fd6600ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:01.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.894+0000 7fd65fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6440042d0 0x7fd6600ca4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60268/0 (socket says 172.21.15.133:60268) 2024-03-30T01:52:01.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.895+0000 7fd65fe00640 1 -- 172.21.15.133:0/445208502 learned_addr learned my addr 172.21.15.133:0/445208502 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:01.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.895+0000 7fd664e00640 1 --2- 172.21.15.133:0/445208502 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6600b2fd0 0x7fd6600c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:01.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.895+0000 7fd657e00640 1 --2- 172.21.15.133:0/445208502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6601f3640 0x7fd6600b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:01.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.895+0000 7fd65fe00640 1 -- 172.21.15.133:0/445208502 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6600b2fd0 msgr2=0x7fd6600c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:01.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.895+0000 7fd65fe00640 1 --2- 172.21.15.133:0/445208502 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6600b2fd0 0x7fd6600c7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:01.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.895+0000 7fd65fe00640 1 -- 172.21.15.133:0/445208502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6601f3640 msgr2=0x7fd6600b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:01.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.895+0000 7fd65fe00640 1 --2- 172.21.15.133:0/445208502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6601f3640 0x7fd6600b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:01.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.895+0000 7fd65fe00640 1 -- 172.21.15.133:0/445208502 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6601f2b80 con 0x7fd6440042d0 2024-03-30T01:52:01.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.895+0000 7fd657e00640 1 --2- 172.21.15.133:0/445208502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6601f3640 0x7fd6600b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:01.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.895+0000 7fd65fe00640 1 --2- 172.21.15.133:0/445208502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6440042d0 0x7fd6600ca4b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd650011600 tx=0x7fd650011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:01.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.896+0000 7fd65cc00640 1 -- 172.21.15.133:0/445208502 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65000f920 con 0x7fd6440042d0 2024-03-30T01:52:01.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.896+0000 7fd65cc00640 1 -- 172.21.15.133:0/445208502 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65000fa80 con 0x7fd6440042d0 2024-03-30T01:52:01.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.896+0000 7fd65cc00640 1 -- 172.21.15.133:0/445208502 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65000fdf0 con 0x7fd6440042d0 2024-03-30T01:52:01.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.896+0000 7fd666e00640 1 -- 172.21.15.133:0/445208502 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6601f2e60 con 0x7fd6440042d0 2024-03-30T01:52:01.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.896+0000 7fd666e00640 1 -- 172.21.15.133:0/445208502 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6600c7880 con 0x7fd6440042d0 2024-03-30T01:52:01.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.897+0000 7fd666e00640 1 -- 172.21.15.133:0/445208502 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6600ccec0 con 0x7fd6440042d0 2024-03-30T01:52:01.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.898+0000 7fd65cc00640 1 -- 172.21.15.133:0/445208502 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd650015460 con 0x7fd6440042d0 2024-03-30T01:52:01.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.899+0000 7fd65cc00640 1 --2- 172.21.15.133:0/445208502 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd63c06ac00 0x7fd63c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:01.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.899+0000 7fd65cc00640 1 -- 172.21.15.133:0/445208502 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6500897f0 con 0x7fd6440042d0 2024-03-30T01:52:01.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.900+0000 7fd657e00640 1 --2- 172.21.15.133:0/445208502 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd63c06ac00 0x7fd63c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:01.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.900+0000 7fd657e00640 1 --2- 172.21.15.133:0/445208502 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd63c06ac00 0x7fd63c06d0c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd648036000 tx=0x7fd648030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:01.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:01.904+0000 7fd65cc00640 1 -- 172.21.15.133:0/445208502 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fd6500549c0 con 0x7fd6440042d0 2024-03-30T01:52:02.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:02.136+0000 7fd666e00640 1 -- 172.21.15.133:0/445208502 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd660066d80 con 0x7fd6440042d0 2024-03-30T01:52:02.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:02.136+0000 7fd65cc00640 1 -- 172.21.15.133:0/445208502 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd650057fe0 con 0x7fd6440042d0 2024-03-30T01:52:02.142 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-30T01:52:02.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:02.139+0000 7fd666e00640 1 -- 172.21.15.133:0/445208502 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd63c06ac00 msgr2=0x7fd63c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:02.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:02.139+0000 7fd666e00640 1 --2- 172.21.15.133:0/445208502 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd63c06ac00 0x7fd63c06d0c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd648036000 tx=0x7fd648030000 comp rx=0 tx=0).stop 2024-03-30T01:52:02.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:02.139+0000 7fd666e00640 1 -- 172.21.15.133:0/445208502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6440042d0 msgr2=0x7fd6600ca4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:02.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:02.139+0000 7fd666e00640 1 --2- 172.21.15.133:0/445208502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6440042d0 0x7fd6600ca4b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd650011600 tx=0x7fd650011ac0 comp rx=0 tx=0).stop 2024-03-30T01:52:02.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:02.139+0000 7fd666e00640 1 -- 172.21.15.133:0/445208502 shutdown_connections 2024-03-30T01:52:02.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:02.139+0000 7fd666e00640 1 --2- 172.21.15.133:0/445208502 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd63c06ac00 0x7fd63c06d0c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:02.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:02.139+0000 7fd666e00640 1 --2- 172.21.15.133:0/445208502 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6600b2fd0 0x7fd6600c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:02.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:02.139+0000 7fd666e00640 1 --2- 172.21.15.133:0/445208502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6601f3640 0x7fd6600b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:02.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:02.139+0000 7fd666e00640 1 --2- 172.21.15.133:0/445208502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6440042d0 0x7fd6600ca4b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:02.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:02.140+0000 7fd666e00640 1 -- 172.21.15.133:0/445208502 >> 172.21.15.133:0/445208502 conn(0x7fd66006b5e0 msgr2=0x7fd66006b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:02.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:02.140+0000 7fd666e00640 1 -- 172.21.15.133:0/445208502 shutdown_connections 2024-03-30T01:52:02.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:02.140+0000 7fd666e00640 1 -- 172.21.15.133:0/445208502 wait complete. 2024-03-30T01:52:02.164 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-30T01:52:02.164 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T01:52:02.164 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-03-30T01:52:02.164 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-30T01:52:02.164 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-30T01:52:02.164 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-30T01:52:02.164 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-30T01:52:02.164 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T01:52:02.164 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-30T01:52:02.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:02.164 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-03-30T01:52:02.221 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T01:52:02.221 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T01:52:02.221 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T01:52:02.222 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:02.222 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-03-30T01:52:02.222 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:02.222 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T01:52:02.222 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-03-30T01:52:02.222 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-03-30T01:52:02.222 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T01:52:02.222 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-03-30T01:52:02.222 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-03-30T01:52:02.222 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T01:52:02.222 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-03-30T01:52:02.222 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T01:52:02.222 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-03-30T01:52:02.223 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-30T01:52:02.223 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42439sec preferred_lft 42439sec 2024-03-30T01:52:02.223 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link 2024-03-30T01:52:02.223 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:02.224 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-30T01:52:02.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:02.224 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec bash -c ' 2024-03-30T01:52:02.224 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-03-30T01:52:02.224 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link add name ceph-brx type bridge 2024-03-30T01:52:02.224 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip addr flush dev ceph-brx 2024-03-30T01:52:02.224 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set ceph-brx up 2024-03-30T01:52:02.224 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-30T01:52:02.224 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-03-30T01:52:02.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:02.667 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T01:52:02.743 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-03-30T01:52:02.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:02.747 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-03-30T01:52:02.804 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-03-30T01:52:02.804 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T01:52:02.804 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-30T01:52:02.804 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-30T01:52:02.804 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T01:52:02.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:02.804 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec bash -c ' 2024-03-30T01:52:02.805 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-03-30T01:52:02.805 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-30T01:52:02.805 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-30T01:52:02.805 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-30T01:52:02.805 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-03-30T01:52:03.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:03.539 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-03-30T01:52:03.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:03.592 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list-id 2024-03-30T01:52:03.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:03.647 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec bash -c ' 2024-03-30T01:52:03.647 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-03-30T01:52:03.647 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T01:52:03.647 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-30T01:52:03.647 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-03-30T01:52:03.782 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-30T01:52:03.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:03.783 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec bash -c ' 2024-03-30T01:52:03.783 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-03-30T01:52:03.783 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-30T01:52:03.783 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-30T01:52:03.783 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-30T01:52:03.783 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-30T01:52:03.783 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-30T01:52:03.783 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-03-30T01:52:04.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:04.059 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec bash -c ' 2024-03-30T01:52:04.059 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-03-30T01:52:04.059 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-03-30T01:52:04.060 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set dev brx.0 master ceph-brx 2024-03-30T01:52:04.060 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-03-30T01:52:04.224 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T01:52:04.224 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-30T01:52:04.266 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-30T01:52:04.266 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T01:52:04.266 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-30T01:52:04.361 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-30T01:52:04.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:04.361 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-30T01:52:04.486 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-30T01:52:04.487 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-30T01:52:04.487 INFO:teuthology.orchestra.run.smithi137.stdout:invalid new device string format 2024-03-30T01:52:05.085 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-30T01:52:05.085 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-30T01:52:05.085 INFO:teuthology.orchestra.run.smithi137.stdout:invalid new device string format 2024-03-30T01:52:05.085 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-03-30T01:52:05.085 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T01:52:05.123 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-30T01:52:05.124 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-30T01:52:05.124 INFO:teuthology.orchestra.run.smithi137.stdout:invalid new device string format 2024-03-30T01:52:05.124 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-03-30T01:52:05.124 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T01:52:05.124 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.133:6789,172.21.15.137:6789,172.21.15.137:6790" 2024-03-30T01:52:05.124 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.133:6789,172.21.15.137:6789,172.21.15.137:6790:/ 2024-03-30T01:52:05.124 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=10e5f47a-7547-42f1-8bb3-a8ac3aae8cad" will pass to kernel 2024-03-30T01:52:05.132 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-03-30T01:52:05.132 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-03-30T01:52:05.132 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-30T01:52:05.132 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-03-30T01:52:05.132 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-30T01:52:05.137 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-30T01:52:05.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:05.138 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-30T01:52:05.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:05.233 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T01:52:05.288 INFO:teuthology.orchestra.run.smithi137.stdout:client4728 2024-03-30T01:52:05.288 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:52:05.288 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:52:05.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:05.339 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T01:52:05.440 INFO:teuthology.orchestra.run.smithi137.stdout:client4728 2024-03-30T01:52:05.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:05.441 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T01:52:05.496 INFO:teuthology.orchestra.run.smithi137.stdout:client4728 2024-03-30T01:52:05.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:05.497 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/10e5f47a-7547-42f1-8bb3-a8ac3aae8cad.client4728/status') 2024-03-30T01:52:05.582 INFO:teuthology.orchestra.run.smithi137.stdout:instance: client.4728 (3)172.21.15.137:0/1930529678 2024-03-30T01:52:05.583 INFO:teuthology.orchestra.run.smithi137.stdout:blocklisted: false 2024-03-30T01:52:05.583 INFO:teuthology.orchestra.run.smithi137.stderr:0+1 records in 2024-03-30T01:52:05.583 INFO:teuthology.orchestra.run.smithi137.stderr:0+1 records out 2024-03-30T01:52:05.583 INFO:teuthology.orchestra.run.smithi137.stderr:71 bytes copied, 7.659e-05 s, 927 kB/s 2024-03-30T01:52:05.587 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-03-30T01:52:05.587 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-30T01:52:05.587 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-30T01:52:05.587 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T01:52:05.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.801+0000 7f31db200640 1 Processor -- start 2024-03-30T01:52:05.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.801+0000 7f31db200640 1 -- start start 2024-03-30T01:52:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.803+0000 7f31db200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31d40d0af0 0x7f31d40cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.803+0000 7f31db200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f31d40cf9b0 0x7f31d40b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.803+0000 7f31db200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d415d030 con 0x7f31d415cc50 2024-03-30T01:52:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.803+0000 7f31db200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d40d1c50 con 0x7f31d40cf9b0 2024-03-30T01:52:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.803+0000 7f31db200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40cfe40 con 0x7f31d40d0af0 2024-03-30T01:52:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.803+0000 7f31d3e00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f31d415cc50 0x7f31d40d2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:44828/0 (socket says 172.21.15.133:44828) 2024-03-30T01:52:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.803+0000 7f31d3e00640 1 -- 172.21.15.133:0/2395355888 learned_addr learned my addr 172.21.15.133:0/2395355888 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:05.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.803+0000 7f31d3400640 1 -- 172.21.15.133:0/2395355888 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13965593 0 0) 0x7f31d415d030 con 0x7f31d415cc50 2024-03-30T01:52:05.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.804+0000 7f31d3400640 1 -- 172.21.15.133:0/2395355888 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31b8003520 con 0x7f31d415cc50 2024-03-30T01:52:05.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.804+0000 7f31cb400640 1 --2- 172.21.15.133:0/2395355888 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31d40d0af0 0x7f31d40cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:05.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.804+0000 7f31d9200640 1 --2- 172.21.15.133:0/2395355888 >> v2:172.21.15.137:3300/0 conn(0x7f31d40cf9b0 0x7f31d40b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:05.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.804+0000 7f31d3400640 1 -- 172.21.15.133:0/2395355888 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2540069556 0 0) 0x7f31b8003520 con 0x7f31d415cc50 2024-03-30T01:52:05.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.804+0000 7f31d3400640 1 -- 172.21.15.133:0/2395355888 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31d40d0af0 msgr2=0x7f31d40cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:05.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.804+0000 7f31d3400640 1 --2- 172.21.15.133:0/2395355888 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31d40d0af0 0x7f31d40cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:05.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.804+0000 7f31d3400640 1 -- 172.21.15.133:0/2395355888 >> v2:172.21.15.137:3300/0 conn(0x7f31d40cf9b0 msgr2=0x7f31d40b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:05.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.804+0000 7f31d3400640 1 --2- 172.21.15.133:0/2395355888 >> v2:172.21.15.137:3300/0 conn(0x7f31d40cf9b0 0x7f31d40b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:05.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.804+0000 7f31d3400640 1 -- 172.21.15.133:0/2395355888 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d40b5af0 con 0x7f31d415cc50 2024-03-30T01:52:05.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.804+0000 7f31d3400640 1 -- 172.21.15.133:0/2395355888 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f31c4001670 con 0x7f31d415cc50 2024-03-30T01:52:05.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.804+0000 7f31d9200640 1 --2- 172.21.15.133:0/2395355888 >> v2:172.21.15.137:3300/0 conn(0x7f31d40cf9b0 0x7f31d40b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:05.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.804+0000 7f31d3400640 1 -- 172.21.15.133:0/2395355888 >> v1:172.21.15.133:6789/0 conn(0x7f31d415cc50 legacy=0x7f31d40d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:05.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.804+0000 7f31d3400640 1 --2- 172.21.15.133:0/2395355888 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31d40d0af0 0x7f31b8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:05.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.804+0000 7f31d3400640 1 --2- 172.21.15.133:0/2395355888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b80040d0 0x7f31b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:05.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.804+0000 7f31d3400640 1 --2- 172.21.15.133:0/2395355888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31b8004e20 0x7f31b800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:05.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.804+0000 7f31d3400640 1 -- 172.21.15.133:0/2395355888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40d1c50 con 0x7f31b80040d0 2024-03-30T01:52:05.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.804+0000 7f31d3400640 1 -- 172.21.15.133:0/2395355888 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40cfe40 con 0x7f31b8004e20 2024-03-30T01:52:05.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.804+0000 7f31d3400640 1 -- 172.21.15.133:0/2395355888 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b80055a0 con 0x7f31d40d0af0 2024-03-30T01:52:05.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.804+0000 7f31cb400640 1 --2- 172.21.15.133:0/2395355888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b80040d0 0x7f31b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:05.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.805+0000 7f31d3e00640 1 --2- 172.21.15.133:0/2395355888 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31d40d0af0 0x7f31b8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:05.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.805+0000 7f31cb400640 1 -- 172.21.15.133:0/2395355888 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31d40d0af0 msgr2=0x7f31b8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:05.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.805+0000 7f31cb400640 1 --2- 172.21.15.133:0/2395355888 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31d40d0af0 0x7f31b8003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:05.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.805+0000 7f31cb400640 1 -- 172.21.15.133:0/2395355888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31b8004e20 msgr2=0x7f31b800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:05.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.805+0000 7f31cb400640 1 --2- 172.21.15.133:0/2395355888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31b8004e20 0x7f31b800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:05.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.805+0000 7f31cb400640 1 -- 172.21.15.133:0/2395355888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b8003520 con 0x7f31b80040d0 2024-03-30T01:52:05.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.806+0000 7f31cb400640 1 --2- 172.21.15.133:0/2395355888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b80040d0 0x7f31b80047c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f31bc007f60 tx=0x7f31b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b267b288a2f6f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:05.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.806+0000 7f31d3400640 1 -- 172.21.15.133:0/2395355888 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc033600 con 0x7f31b80040d0 2024-03-30T01:52:05.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.806+0000 7f31d3400640 1 -- 172.21.15.133:0/2395355888 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc02f050 con 0x7f31b80040d0 2024-03-30T01:52:05.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.806+0000 7f31d3400640 1 -- 172.21.15.133:0/2395355888 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0339a0 con 0x7f31b80040d0 2024-03-30T01:52:05.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.807+0000 7f31db200640 1 -- 172.21.15.133:0/2395355888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b80040d0 msgr2=0x7f31b80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:05.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.807+0000 7f31db200640 1 --2- 172.21.15.133:0/2395355888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b80040d0 0x7f31b80047c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f31bc007f60 tx=0x7f31b80057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:05.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.807+0000 7f31d9200640 1 -- 172.21.15.133:0/2395355888 reap_dead start 2024-03-30T01:52:05.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.807+0000 7f31db200640 1 -- 172.21.15.133:0/2395355888 shutdown_connections 2024-03-30T01:52:05.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.807+0000 7f31db200640 1 -- 172.21.15.133:0/2395355888 >> 172.21.15.133:0/2395355888 conn(0x7f31d4071a40 msgr2=0x7f31d406b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:05.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.807+0000 7f31db200640 1 -- 172.21.15.133:0/2395355888 shutdown_connections 2024-03-30T01:52:05.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.807+0000 7f31db200640 1 -- 172.21.15.133:0/2395355888 wait complete. 2024-03-30T01:52:05.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.809+0000 7f31db200640 1 Processor -- start 2024-03-30T01:52:05.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.809+0000 7f31db200640 1 -- start start 2024-03-30T01:52:05.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.810+0000 7f31db200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31b80040d0 0x7f31d414f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:05.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.810+0000 7f31db200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31d40d2cb0 0x7f31d40d3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:05.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.810+0000 7f31db200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31d41f2210 0x7f31d41f2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:05.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.810+0000 7f31db200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40d3670 con 0x7f31d40d2cb0 2024-03-30T01:52:05.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.810+0000 7f31db200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d414fd90 con 0x7f31b80040d0 2024-03-30T01:52:05.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.810+0000 7f31db200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d41f2ec0 con 0x7f31d41f2210 2024-03-30T01:52:05.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.810+0000 7f31cb400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31d40d2cb0 0x7f31d40d3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:05.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.810+0000 7f31cb400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31d40d2cb0 0x7f31d40d3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60272/0 (socket says 172.21.15.133:60272) 2024-03-30T01:52:05.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.810+0000 7f31cb400640 1 -- 172.21.15.133:0/552319830 learned_addr learned my addr 172.21.15.133:0/552319830 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:05.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.810+0000 7f31d3e00640 1 --2- 172.21.15.133:0/552319830 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31b80040d0 0x7f31d414f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:05.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.810+0000 7f31d9200640 1 --2- 172.21.15.133:0/552319830 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31d41f2210 0x7f31d41f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:05.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.810+0000 7f31cb400640 1 -- 172.21.15.133:0/552319830 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31d41f2210 msgr2=0x7f31d41f2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:05.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.810+0000 7f31cb400640 1 --2- 172.21.15.133:0/552319830 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31d41f2210 0x7f31d41f2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:05.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.810+0000 7f31cb400640 1 -- 172.21.15.133:0/552319830 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31b80040d0 msgr2=0x7f31d414f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:05.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.810+0000 7f31cb400640 1 --2- 172.21.15.133:0/552319830 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31b80040d0 0x7f31d414f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:05.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.810+0000 7f31cb400640 1 -- 172.21.15.133:0/552319830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d41f31a0 con 0x7f31d40d2cb0 2024-03-30T01:52:05.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.811+0000 7f31cb400640 1 --2- 172.21.15.133:0/552319830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31d40d2cb0 0x7f31d40d3130 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f31bc007f60 tx=0x7f31bc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:05.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.811+0000 7f31d0c00640 1 -- 172.21.15.133:0/552319830 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc03d820 con 0x7f31d40d2cb0 2024-03-30T01:52:05.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.811+0000 7f31d0c00640 1 -- 172.21.15.133:0/552319830 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc03d980 con 0x7f31d40d2cb0 2024-03-30T01:52:05.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.811+0000 7f31db200640 1 -- 172.21.15.133:0/552319830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d41f3480 con 0x7f31d40d2cb0 2024-03-30T01:52:05.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.811+0000 7f31d0c00640 1 -- 172.21.15.133:0/552319830 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc03dcf0 con 0x7f31d40d2cb0 2024-03-30T01:52:05.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.811+0000 7f31db200640 1 -- 172.21.15.133:0/552319830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d41f3a40 con 0x7f31d40d2cb0 2024-03-30T01:52:05.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.812+0000 7f31db200640 1 -- 172.21.15.133:0/552319830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d4066d80 con 0x7f31d40d2cb0 2024-03-30T01:52:05.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.813+0000 7f31d0c00640 1 -- 172.21.15.133:0/552319830 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f31bc046460 con 0x7f31d40d2cb0 2024-03-30T01:52:05.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.814+0000 7f31d0c00640 1 --2- 172.21.15.133:0/552319830 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f31b006ac00 0x7f31b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:05.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.814+0000 7f31d0c00640 1 -- 172.21.15.133:0/552319830 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31bc0ac7b0 con 0x7f31d40d2cb0 2024-03-30T01:52:05.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.814+0000 7f31d3e00640 1 --2- 172.21.15.133:0/552319830 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f31b006ac00 0x7f31b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:05.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.815+0000 7f31d3e00640 1 --2- 172.21.15.133:0/552319830 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f31b006ac00 0x7f31b006d0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f31c4000c00 tx=0x7f31c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:05.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:05.819+0000 7f31d0c00640 1 -- 172.21.15.133:0/552319830 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f31bc0778f0 con 0x7f31d40d2cb0 2024-03-30T01:52:06.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:06.054+0000 7f31db200640 1 -- 172.21.15.133:0/552319830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f31d415c430 con 0x7f31d40d2cb0 2024-03-30T01:52:06.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:06.055+0000 7f31d0c00640 1 -- 172.21.15.133:0/552319830 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f31bc007410 con 0x7f31d40d2cb0 2024-03-30T01:52:06.062 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-30T01:52:06.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:06.058+0000 7f31db200640 1 -- 172.21.15.133:0/552319830 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f31b006ac00 msgr2=0x7f31b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:06.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:06.058+0000 7f31db200640 1 --2- 172.21.15.133:0/552319830 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f31b006ac00 0x7f31b006d0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f31c4000c00 tx=0x7f31c4009040 comp rx=0 tx=0).stop 2024-03-30T01:52:06.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:06.058+0000 7f31db200640 1 -- 172.21.15.133:0/552319830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31d40d2cb0 msgr2=0x7f31d40d3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:06.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:06.058+0000 7f31db200640 1 --2- 172.21.15.133:0/552319830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31d40d2cb0 0x7f31d40d3130 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f31bc007f60 tx=0x7f31bc004ab0 comp rx=0 tx=0).stop 2024-03-30T01:52:06.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:06.058+0000 7f31db200640 1 -- 172.21.15.133:0/552319830 shutdown_connections 2024-03-30T01:52:06.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:06.058+0000 7f31db200640 1 --2- 172.21.15.133:0/552319830 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f31b006ac00 0x7f31b006d0c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:06.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:06.058+0000 7f31db200640 1 --2- 172.21.15.133:0/552319830 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31d41f2210 0x7f31d41f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:06.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:06.058+0000 7f31db200640 1 --2- 172.21.15.133:0/552319830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31d40d2cb0 0x7f31d40d3130 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:06.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:06.058+0000 7f31db200640 1 --2- 172.21.15.133:0/552319830 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31b80040d0 0x7f31d414f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:06.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:06.058+0000 7f31db200640 1 -- 172.21.15.133:0/552319830 >> 172.21.15.133:0/552319830 conn(0x7f31d4071a40 msgr2=0x7f31d40caa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:06.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:06.058+0000 7f31db200640 1 -- 172.21.15.133:0/552319830 shutdown_connections 2024-03-30T01:52:06.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:06.058+0000 7f31db200640 1 -- 172.21.15.133:0/552319830 wait complete. 2024-03-30T01:52:06.083 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-30T01:52:06.083 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T01:52:06.083 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-03-30T01:52:06.083 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-03-30T01:52:06.083 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-30T01:52:06.083 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-30T01:52:06.083 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-30T01:52:06.083 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T01:52:06.083 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-03-30T01:52:06.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:06.084 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-03-30T01:52:06.141 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T01:52:06.141 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T01:52:06.141 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T01:52:06.141 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:06.141 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-03-30T01:52:06.142 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:06.142 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T01:52:06.142 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-03-30T01:52:06.142 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-03-30T01:52:06.142 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T01:52:06.142 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-03-30T01:52:06.142 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-03-30T01:52:06.142 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T01:52:06.142 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-03-30T01:52:06.142 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T01:52:06.142 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-03-30T01:52:06.142 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-30T01:52:06.142 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42435sec preferred_lft 42435sec 2024-03-30T01:52:06.142 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link 2024-03-30T01:52:06.143 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:06.143 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T01:52:06.143 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether de:c6:ea:bd:f2:f1 brd ff:ff:ff:ff:ff:ff 2024-03-30T01:52:06.143 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-30T01:52:06.143 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:06.143 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::5823:49ff:fe3e:f424/64 scope link 2024-03-30T01:52:06.143 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:06.143 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-30T01:52:06.143 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether de:c6:ea:bd:f2:f1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T01:52:06.143 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::dcc6:eaff:febd:f2f1/64 scope link 2024-03-30T01:52:06.143 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:06.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:06.144 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T01:52:06.239 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-03-30T01:52:06.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:06.244 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-03-30T01:52:06.295 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-03-30T01:52:06.295 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T01:52:06.295 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-30T01:52:06.295 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-30T01:52:06.295 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T01:52:06.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:06.297 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec bash -c ' 2024-03-30T01:52:06.297 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-03-30T01:52:06.297 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-30T01:52:06.297 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-30T01:52:06.297 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-30T01:52:06.297 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-03-30T01:52:06.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:06.478 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-03-30T01:52:06.529 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-30T01:52:06.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:06.529 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list-id 2024-03-30T01:52:06.579 INFO:teuthology.orchestra.run.smithi137.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-03-30T01:52:06.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:06.581 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec bash -c ' 2024-03-30T01:52:06.581 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-03-30T01:52:06.581 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-30T01:52:06.581 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-03-30T01:52:06.581 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-03-30T01:52:06.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:06.715 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-30T01:52:06.800 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T01:52:06.800 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T01:52:06.800 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T01:52:06.800 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:06.800 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-03-30T01:52:06.800 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:06.800 INFO:teuthology.orchestra.run.smithi137.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T01:52:06.800 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether fa:2f:e0:a7:72:4a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-30T01:52:06.800 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-30T01:52:06.800 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:06.800 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::f82f:e0ff:fea7:724a/64 scope link 2024-03-30T01:52:06.801 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:06.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:06.804 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-30T01:52:06.894 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T01:52:06.894 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T01:52:06.894 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T01:52:06.895 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:06.895 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-03-30T01:52:06.895 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:06.895 INFO:teuthology.orchestra.run.smithi137.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T01:52:06.895 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether fa:2f:e0:a7:72:4a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-30T01:52:06.895 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-30T01:52:06.895 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:06.895 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::f82f:e0ff:fea7:724a/64 scope link 2024-03-30T01:52:06.895 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:06.899 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-03-30T01:52:06.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:06.899 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec bash -c ' 2024-03-30T01:52:06.899 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-03-30T01:52:06.900 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-03-30T01:52:06.900 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-30T01:52:06.900 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-03-30T01:52:06.900 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-03-30T01:52:06.900 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-03-30T01:52:06.900 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-03-30T01:52:07.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:07.171 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec bash -c ' 2024-03-30T01:52:07.171 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-03-30T01:52:07.171 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.1 up 2024-03-30T01:52:07.171 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set dev brx.1 master ceph-brx 2024-03-30T01:52:07.171 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-03-30T01:52:07.342 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T01:52:07.342 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-03-30T01:52:07.392 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-03-30T01:52:07.392 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T01:52:07.392 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-03-30T01:52:07.440 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-30T01:52:07.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:07.440 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-30T01:52:07.573 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-30T01:52:07.573 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-03-30T01:52:07.573 INFO:teuthology.orchestra.run.smithi137.stdout:invalid new device string format 2024-03-30T01:52:07.593 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-30T01:52:07.593 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-03-30T01:52:07.593 INFO:teuthology.orchestra.run.smithi137.stdout:invalid new device string format 2024-03-30T01:52:07.593 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-03-30T01:52:07.593 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T01:52:07.621 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-30T01:52:07.621 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-03-30T01:52:07.621 INFO:teuthology.orchestra.run.smithi137.stdout:invalid new device string format 2024-03-30T01:52:07.621 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-03-30T01:52:07.621 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T01:52:07.621 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.133:6789,172.21.15.137:6789,172.21.15.137:6790" 2024-03-30T01:52:07.622 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.133:6789,172.21.15.137:6789,172.21.15.137:6790:/ 2024-03-30T01:52:07.622 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=10e5f47a-7547-42f1-8bb3-a8ac3aae8cad" will pass to kernel 2024-03-30T01:52:07.623 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-03-30T01:52:07.624 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-03-30T01:52:07.624 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-30T01:52:07.624 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-03-30T01:52:07.624 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-30T01:52:07.629 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-30T01:52:07.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:07.629 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-03-30T01:52:07.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:07.713 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T01:52:07.764 INFO:teuthology.orchestra.run.smithi137.stdout:client4737 2024-03-30T01:52:07.764 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:52:07.764 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:52:07.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:07.812 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T01:52:07.913 INFO:teuthology.orchestra.run.smithi137.stdout:client4737 2024-03-30T01:52:07.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:07.913 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T01:52:07.971 INFO:teuthology.orchestra.run.smithi137.stdout:client4737 2024-03-30T01:52:07.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:07.971 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/10e5f47a-7547-42f1-8bb3-a8ac3aae8cad.client4737/status') 2024-03-30T01:52:08.062 INFO:teuthology.orchestra.run.smithi137.stdout:instance: client.4737 (3)172.21.15.137:0/4084843612 2024-03-30T01:52:08.063 INFO:teuthology.orchestra.run.smithi137.stdout:blocklisted: false 2024-03-30T01:52:08.063 INFO:teuthology.orchestra.run.smithi137.stderr:0+1 records in 2024-03-30T01:52:08.063 INFO:teuthology.orchestra.run.smithi137.stderr:0+1 records out 2024-03-30T01:52:08.063 INFO:teuthology.orchestra.run.smithi137.stderr:71 bytes copied, 7.765e-05 s, 914 kB/s 2024-03-30T01:52:08.067 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-03-30T01:52:08.086 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:52:08.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.290+0000 7f4f93400640 1 Processor -- start 2024-03-30T01:52:08.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.291+0000 7f4f93400640 1 -- start start 2024-03-30T01:52:08.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.292+0000 7f4f93400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4f8c143790 0x7f4f8c0cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:08.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.292+0000 7f4f93400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f8c070500 0x7f4f8c070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:08.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.292+0000 7f4f93400640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f8c0a76a0 con 0x7f4f8c0cc530 2024-03-30T01:52:08.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.292+0000 7f4f93400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f8c0b38e0 con 0x7f4f8c143790 2024-03-30T01:52:08.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.292+0000 7f4f93400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c0cd180 con 0x7f4f8c070500 2024-03-30T01:52:08.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.292+0000 7f4f91400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4f8c0cc530 0x7f4f8c0cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43808/0 (socket says 172.21.15.133:43808) 2024-03-30T01:52:08.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.292+0000 7f4f91400640 1 -- 172.21.15.133:0/2299937331 learned_addr learned my addr 172.21.15.133:0/2299937331 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:08.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.293+0000 7f4f8be00640 1 -- 172.21.15.133:0/2299937331 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107787224 0 0) 0x7f4f8c0a76a0 con 0x7f4f8c0cc530 2024-03-30T01:52:08.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.293+0000 7f4f83e00640 1 --2- 172.21.15.133:0/2299937331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f8c070500 0x7f4f8c070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:08.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.293+0000 7f4f8be00640 1 -- 172.21.15.133:0/2299937331 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f6c003520 con 0x7f4f8c0cc530 2024-03-30T01:52:08.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.293+0000 7f4f90a00640 1 --2- 172.21.15.133:0/2299937331 >> v2:172.21.15.137:3300/0 conn(0x7f4f8c143790 0x7f4f8c0cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:08.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.293+0000 7f4f8be00640 1 -- 172.21.15.133:0/2299937331 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 499414614 0 0) 0x7f4f6c003520 con 0x7f4f8c0cc530 2024-03-30T01:52:08.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.293+0000 7f4f8be00640 1 -- 172.21.15.133:0/2299937331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f8c070500 msgr2=0x7f4f8c070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:08.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.293+0000 7f4f8be00640 1 --2- 172.21.15.133:0/2299937331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f8c070500 0x7f4f8c070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:08.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.293+0000 7f4f8be00640 1 -- 172.21.15.133:0/2299937331 >> v2:172.21.15.137:3300/0 conn(0x7f4f8c143790 msgr2=0x7f4f8c0cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:08.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.293+0000 7f4f8be00640 1 --2- 172.21.15.133:0/2299937331 >> v2:172.21.15.137:3300/0 conn(0x7f4f8c143790 0x7f4f8c0cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:08.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.293+0000 7f4f8be00640 1 -- 172.21.15.133:0/2299937331 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c070ea0 con 0x7f4f8c0cc530 2024-03-30T01:52:08.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.293+0000 7f4f8be00640 1 -- 172.21.15.133:0/2299937331 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f4f840019f0 con 0x7f4f8c0cc530 2024-03-30T01:52:08.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.293+0000 7f4f90a00640 1 --2- 172.21.15.133:0/2299937331 >> v2:172.21.15.137:3300/0 conn(0x7f4f8c143790 0x7f4f8c0cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:52:08.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.293+0000 7f4f8be00640 1 -- 172.21.15.133:0/2299937331 >> v1:172.21.15.133:6789/0 conn(0x7f4f8c0cc530 legacy=0x7f4f8c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:08.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.293+0000 7f4f8be00640 1 --2- 172.21.15.133:0/2299937331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f8c070500 0x7f4f6c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:08.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.293+0000 7f4f8be00640 1 --2- 172.21.15.133:0/2299937331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c003f40 0x7f4f6c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:08.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.293+0000 7f4f8be00640 1 --2- 172.21.15.133:0/2299937331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f6c004d00 0x7f4f6c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:08.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.293+0000 7f4f8be00640 1 -- 172.21.15.133:0/2299937331 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c0b38e0 con 0x7f4f6c004d00 2024-03-30T01:52:08.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.293+0000 7f4f8be00640 1 -- 172.21.15.133:0/2299937331 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c0cd180 con 0x7f4f6c003f40 2024-03-30T01:52:08.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.293+0000 7f4f8be00640 1 -- 172.21.15.133:0/2299937331 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c00bac0 con 0x7f4f8c070500 2024-03-30T01:52:08.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.294+0000 7f4f91400640 1 --2- 172.21.15.133:0/2299937331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f6c004d00 0x7f4f6c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:08.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.294+0000 7f4f90a00640 1 --2- 172.21.15.133:0/2299937331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f8c070500 0x7f4f6c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:08.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.294+0000 7f4f83e00640 1 --2- 172.21.15.133:0/2299937331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c003f40 0x7f4f6c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:08.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.294+0000 7f4f91400640 1 -- 172.21.15.133:0/2299937331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f8c070500 msgr2=0x7f4f6c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:08.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.294+0000 7f4f91400640 1 --2- 172.21.15.133:0/2299937331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f8c070500 0x7f4f6c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:08.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.294+0000 7f4f91400640 1 -- 172.21.15.133:0/2299937331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c003f40 msgr2=0x7f4f6c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:08.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.294+0000 7f4f91400640 1 --2- 172.21.15.133:0/2299937331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c003f40 0x7f4f6c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:08.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.294+0000 7f4f91400640 1 -- 172.21.15.133:0/2299937331 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6c003520 con 0x7f4f6c004d00 2024-03-30T01:52:08.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.294+0000 7f4f90a00640 1 --2- 172.21.15.133:0/2299937331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f8c070500 0x7f4f6c003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:08.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.294+0000 7f4f83e00640 1 --2- 172.21.15.133:0/2299937331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c003f40 0x7f4f6c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:08.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.295+0000 7f4f91400640 1 --2- 172.21.15.133:0/2299937331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f6c004d00 0x7f4f6c005180 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400a780 tx=0x7f4f6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5279848e063d1e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:08.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.295+0000 7f4f8be00640 1 -- 172.21.15.133:0/2299937331 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f84034630 con 0x7f4f6c004d00 2024-03-30T01:52:08.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.296+0000 7f4f8be00640 1 -- 172.21.15.133:0/2299937331 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8402f070 con 0x7f4f6c004d00 2024-03-30T01:52:08.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.296+0000 7f4f8be00640 1 -- 172.21.15.133:0/2299937331 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f84034a10 con 0x7f4f6c004d00 2024-03-30T01:52:08.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.296+0000 7f4f93400640 1 -- 172.21.15.133:0/2299937331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f6c004d00 msgr2=0x7f4f6c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:08.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.296+0000 7f4f93400640 1 --2- 172.21.15.133:0/2299937331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f6c004d00 0x7f4f6c005180 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400a780 tx=0x7f4f6c0057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:08.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.296+0000 7f4f91400640 1 -- 172.21.15.133:0/2299937331 reap_dead start 2024-03-30T01:52:08.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.296+0000 7f4f93400640 1 -- 172.21.15.133:0/2299937331 shutdown_connections 2024-03-30T01:52:08.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.296+0000 7f4f93400640 1 -- 172.21.15.133:0/2299937331 >> 172.21.15.133:0/2299937331 conn(0x7f4f8c0b07a0 msgr2=0x7f4f8c0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:08.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.296+0000 7f4f93400640 1 -- 172.21.15.133:0/2299937331 shutdown_connections 2024-03-30T01:52:08.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.296+0000 7f4f93400640 1 -- 172.21.15.133:0/2299937331 wait complete. 2024-03-30T01:52:08.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.298+0000 7f4f93400640 1 Processor -- start 2024-03-30T01:52:08.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.298+0000 7f4f93400640 1 -- start start 2024-03-30T01:52:08.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.299+0000 7f4f93400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f6c004d00 0x7f4f8c139910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:08.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.299+0000 7f4f93400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f8c0c9d40 0x7f4f8c13ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:08.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.299+0000 7f4f93400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f8c1f1d20 0x7f4f8c1f21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:08.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.299+0000 7f4f93400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c139e50 con 0x7f4f8c0c9d40 2024-03-30T01:52:08.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.299+0000 7f4f93400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c1f26e0 con 0x7f4f8c1f1d20 2024-03-30T01:52:08.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.299+0000 7f4f93400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c0c8ca0 con 0x7f4f6c004d00 2024-03-30T01:52:08.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.299+0000 7f4f83e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f8c0c9d40 0x7f4f8c13ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:08.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.300+0000 7f4f83e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f8c0c9d40 0x7f4f8c13ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55264/0 (socket says 172.21.15.133:55264) 2024-03-30T01:52:08.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.300+0000 7f4f83e00640 1 -- 172.21.15.133:0/1470081306 learned_addr learned my addr 172.21.15.133:0/1470081306 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:08.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.300+0000 7f4f90a00640 1 --2- 172.21.15.133:0/1470081306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f6c004d00 0x7f4f8c139910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:08.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.300+0000 7f4f83e00640 1 -- 172.21.15.133:0/1470081306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f6c004d00 msgr2=0x7f4f8c139910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:08.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.300+0000 7f4f83e00640 1 --2- 172.21.15.133:0/1470081306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f6c004d00 0x7f4f8c139910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:08.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.300+0000 7f4f83e00640 1 -- 172.21.15.133:0/1470081306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f8c1f1d20 msgr2=0x7f4f8c1f21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:08.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.300+0000 7f4f83e00640 1 --2- 172.21.15.133:0/1470081306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f8c1f1d20 0x7f4f8c1f21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:08.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.300+0000 7f4f83e00640 1 -- 172.21.15.133:0/1470081306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c0c8f80 con 0x7f4f8c0c9d40 2024-03-30T01:52:08.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.300+0000 7f4f83e00640 1 --2- 172.21.15.133:0/1470081306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f8c0c9d40 0x7f4f8c13ca00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c0108b0 tx=0x7f4f7c010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:08.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.300+0000 7f4f89600640 1 -- 172.21.15.133:0/1470081306 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c00eae0 con 0x7f4f8c0c9d40 2024-03-30T01:52:08.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.301+0000 7f4f89600640 1 -- 172.21.15.133:0/1470081306 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7c00ec40 con 0x7f4f8c0c9d40 2024-03-30T01:52:08.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.301+0000 7f4f89600640 1 -- 172.21.15.133:0/1470081306 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c01c400 con 0x7f4f8c0c9d40 2024-03-30T01:52:08.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.301+0000 7f4f93400640 1 -- 172.21.15.133:0/1470081306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8c0c9260 con 0x7f4f8c0c9d40 2024-03-30T01:52:08.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.301+0000 7f4f93400640 1 -- 172.21.15.133:0/1470081306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8c0c9820 con 0x7f4f8c0c9d40 2024-03-30T01:52:08.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.302+0000 7f4f93400640 1 -- 172.21.15.133:0/1470081306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f8c0cafb0 con 0x7f4f8c0c9d40 2024-03-30T01:52:08.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.303+0000 7f4f89600640 1 -- 172.21.15.133:0/1470081306 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f4f7c01c560 con 0x7f4f8c0c9d40 2024-03-30T01:52:08.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.304+0000 7f4f89600640 1 --2- 172.21.15.133:0/1470081306 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4f6806ac30 0x7f4f6806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:08.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.304+0000 7f4f89600640 1 -- 172.21.15.133:0/1470081306 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f7c089890 con 0x7f4f8c0c9d40 2024-03-30T01:52:08.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.304+0000 7f4f90a00640 1 --2- 172.21.15.133:0/1470081306 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4f6806ac30 0x7f4f6806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:08.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.305+0000 7f4f90a00640 1 --2- 172.21.15.133:0/1470081306 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4f6806ac30 0x7f4f6806d0f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4f74006fd0 tx=0x7f4f74008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:08.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.308+0000 7f4f89600640 1 -- 172.21.15.133:0/1470081306 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f4f7c054b00 con 0x7f4f8c0c9d40 2024-03-30T01:52:08.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.499+0000 7f4f93400640 1 -- 172.21.15.133:0/1470081306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f8c066d80 con 0x7f4f8c0c9d40 2024-03-30T01:52:08.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.502+0000 7f4f89600640 1 -- 172.21.15.133:0/1470081306 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f4f7c058120 con 0x7f4f8c0c9d40 2024-03-30T01:52:08.509 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:08.509 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:51:33.780665+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:51:31.245378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T01:51:31.774247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:52:08.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.505+0000 7f4f93400640 1 -- 172.21.15.133:0/1470081306 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4f6806ac30 msgr2=0x7f4f6806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:08.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.505+0000 7f4f93400640 1 --2- 172.21.15.133:0/1470081306 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4f6806ac30 0x7f4f6806d0f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4f74006fd0 tx=0x7f4f74008040 comp rx=0 tx=0).stop 2024-03-30T01:52:08.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.505+0000 7f4f93400640 1 -- 172.21.15.133:0/1470081306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f8c0c9d40 msgr2=0x7f4f8c13ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:08.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.505+0000 7f4f93400640 1 --2- 172.21.15.133:0/1470081306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f8c0c9d40 0x7f4f8c13ca00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c0108b0 tx=0x7f4f7c010d70 comp rx=0 tx=0).stop 2024-03-30T01:52:08.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.505+0000 7f4f93400640 1 -- 172.21.15.133:0/1470081306 shutdown_connections 2024-03-30T01:52:08.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.505+0000 7f4f93400640 1 --2- 172.21.15.133:0/1470081306 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4f6806ac30 0x7f4f6806d0f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:08.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.505+0000 7f4f93400640 1 --2- 172.21.15.133:0/1470081306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f8c1f1d20 0x7f4f8c1f21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:08.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.505+0000 7f4f93400640 1 --2- 172.21.15.133:0/1470081306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f8c0c9d40 0x7f4f8c13ca00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:08.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.505+0000 7f4f93400640 1 --2- 172.21.15.133:0/1470081306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f6c004d00 0x7f4f8c139910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:08.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.505+0000 7f4f93400640 1 -- 172.21.15.133:0/1470081306 >> 172.21.15.133:0/1470081306 conn(0x7f4f8c0b07a0 msgr2=0x7f4f8c0c3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:08.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.505+0000 7f4f93400640 1 -- 172.21.15.133:0/1470081306 shutdown_connections 2024-03-30T01:52:08.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.505+0000 7f4f93400640 1 -- 172.21.15.133:0/1470081306 wait complete. 2024-03-30T01:52:08.528 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T01:51:21.771393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T01:51:31.245378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T01:51:31.774247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T01:52:08.529 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T01:52:08.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.712+0000 7f9399200640 1 Processor -- start 2024-03-30T01:52:08.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.713+0000 7f9399200640 1 -- start start 2024-03-30T01:52:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.714+0000 7f9399200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93940d0af0 0x7f93940cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.714+0000 7f9399200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f93940cf9b0 0x7f93940b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.714+0000 7f9399200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f939415d030 con 0x7f939415cc50 2024-03-30T01:52:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.714+0000 7f9399200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93940d1c50 con 0x7f93940d0af0 2024-03-30T01:52:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.714+0000 7f9399200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93940cfe20 con 0x7f93940cf9b0 2024-03-30T01:52:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.714+0000 7f938be00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93940d0af0 0x7f93940cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.714+0000 7f938be00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93940d0af0 0x7f93940cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55266/0 (socket says 172.21.15.133:55266) 2024-03-30T01:52:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.714+0000 7f938be00640 1 -- 172.21.15.133:0/2801478634 learned_addr learned my addr 172.21.15.133:0/2801478634 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.715+0000 7f9392800640 1 --2- 172.21.15.133:0/2801478634 >> v2:172.21.15.137:3300/0 conn(0x7f93940cf9b0 0x7f93940b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.715+0000 7f938be00640 1 -- 172.21.15.133:0/2801478634 >> v2:172.21.15.137:3300/0 conn(0x7f93940cf9b0 msgr2=0x7f93940b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.715+0000 7f938be00640 1 --2- 172.21.15.133:0/2801478634 >> v2:172.21.15.137:3300/0 conn(0x7f93940cf9b0 0x7f93940b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.715+0000 7f938be00640 1 -- 172.21.15.133:0/2801478634 >> v1:172.21.15.133:6789/0 conn(0x7f939415cc50 legacy=0x7f93940d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.715+0000 7f938be00640 1 -- 172.21.15.133:0/2801478634 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93940b5af0 con 0x7f93940d0af0 2024-03-30T01:52:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.715+0000 7f9391400640 1 -- 172.21.15.133:0/2801478634 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603610730 0 0) 0x7f939415d030 con 0x7f939415cc50 2024-03-30T01:52:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.716+0000 7f938be00640 1 --2- 172.21.15.133:0/2801478634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93940d0af0 0x7f93940cf470 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f939406bd10 tx=0x7f937c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a011ac87507a9f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.716+0000 7f9391400640 1 -- 172.21.15.133:0/2801478634 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c030860 con 0x7f93940d0af0 2024-03-30T01:52:08.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.716+0000 7f9391400640 1 -- 172.21.15.133:0/2801478634 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c0309c0 con 0x7f93940d0af0 2024-03-30T01:52:08.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.716+0000 7f9391400640 1 -- 172.21.15.133:0/2801478634 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c030d50 con 0x7f93940d0af0 2024-03-30T01:52:08.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.717+0000 7f9399200640 1 -- 172.21.15.133:0/2801478634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93940d0af0 msgr2=0x7f93940cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:08.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.717+0000 7f9399200640 1 --2- 172.21.15.133:0/2801478634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93940d0af0 0x7f93940cf470 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f939406bd10 tx=0x7f937c02b9a0 comp rx=0 tx=0).stop 2024-03-30T01:52:08.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.717+0000 7f9399200640 1 -- 172.21.15.133:0/2801478634 shutdown_connections 2024-03-30T01:52:08.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.717+0000 7f9399200640 1 --2- 172.21.15.133:0/2801478634 >> v2:172.21.15.137:3300/0 conn(0x7f93940cf9b0 0x7f93940b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:08.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.717+0000 7f9399200640 1 --2- 172.21.15.133:0/2801478634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93940d0af0 0x7f93940cf470 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:08.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.717+0000 7f9399200640 1 -- 172.21.15.133:0/2801478634 >> 172.21.15.133:0/2801478634 conn(0x7f9394071a40 msgr2=0x7f939406b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:08.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.717+0000 7f9399200640 1 -- 172.21.15.133:0/2801478634 shutdown_connections 2024-03-30T01:52:08.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.717+0000 7f9399200640 1 -- 172.21.15.133:0/2801478634 wait complete. 2024-03-30T01:52:08.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.720+0000 7f9399200640 1 Processor -- start 2024-03-30T01:52:08.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.720+0000 7f9399200640 1 -- start start 2024-03-30T01:52:08.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.722+0000 7f9399200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93940cf9b0 0x7f9394157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:08.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.722+0000 7f9399200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93940d0af0 0x7f93940b2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:08.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.722+0000 7f9399200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f939415cc50 0x7f93940c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:08.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.722+0000 7f9399200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9394157c20 con 0x7f939415cc50 2024-03-30T01:52:08.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.722+0000 7f9399200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9394157e70 con 0x7f93940cf9b0 2024-03-30T01:52:08.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.722+0000 7f9399200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9394158150 con 0x7f93940d0af0 2024-03-30T01:52:08.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.722+0000 7f9392800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f939415cc50 0x7f93940c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:08.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.722+0000 7f9392800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f939415cc50 0x7f93940c9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55268/0 (socket says 172.21.15.133:55268) 2024-03-30T01:52:08.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.722+0000 7f9392800640 1 -- 172.21.15.133:0/3959208834 learned_addr learned my addr 172.21.15.133:0/3959208834 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:08.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.722+0000 7f9391e00640 1 --2- 172.21.15.133:0/3959208834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93940cf9b0 0x7f9394157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:08.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.722+0000 7f938be00640 1 --2- 172.21.15.133:0/3959208834 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93940d0af0 0x7f93940b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:08.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.722+0000 7f9392800640 1 -- 172.21.15.133:0/3959208834 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93940d0af0 msgr2=0x7f93940b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:08.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.722+0000 7f9392800640 1 --2- 172.21.15.133:0/3959208834 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93940d0af0 0x7f93940b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:08.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.722+0000 7f9392800640 1 -- 172.21.15.133:0/3959208834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93940cf9b0 msgr2=0x7f9394157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:08.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.722+0000 7f9392800640 1 --2- 172.21.15.133:0/3959208834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93940cf9b0 0x7f9394157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:08.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.722+0000 7f9392800640 1 -- 172.21.15.133:0/3959208834 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937c0094d0 con 0x7f939415cc50 2024-03-30T01:52:08.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.723+0000 7f9392800640 1 --2- 172.21.15.133:0/3959208834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f939415cc50 0x7f93940c9d60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f938c00cd70 tx=0x7f938c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:08.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.723+0000 7f938a000640 1 -- 172.21.15.133:0/3959208834 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c003b90 con 0x7f939415cc50 2024-03-30T01:52:08.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.723+0000 7f938a000640 1 -- 172.21.15.133:0/3959208834 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938c003cf0 con 0x7f939415cc50 2024-03-30T01:52:08.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.723+0000 7f9399200640 1 -- 172.21.15.133:0/3959208834 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9394158430 con 0x7f939415cc50 2024-03-30T01:52:08.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.723+0000 7f938a000640 1 -- 172.21.15.133:0/3959208834 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c004240 con 0x7f939415cc50 2024-03-30T01:52:08.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.723+0000 7f9399200640 1 -- 172.21.15.133:0/3959208834 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93941589f0 con 0x7f939415cc50 2024-03-30T01:52:08.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.724+0000 7f9399200640 1 -- 172.21.15.133:0/3959208834 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f939408aaa0 con 0x7f939415cc50 2024-03-30T01:52:08.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.725+0000 7f938a000640 1 -- 172.21.15.133:0/3959208834 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f938c0043a0 con 0x7f939415cc50 2024-03-30T01:52:08.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.726+0000 7f938a000640 1 --2- 172.21.15.133:0/3959208834 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f937006ac00 0x7f937006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:08.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.726+0000 7f938a000640 1 -- 172.21.15.133:0/3959208834 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f938c012070 con 0x7f939415cc50 2024-03-30T01:52:08.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.726+0000 7f9391e00640 1 --2- 172.21.15.133:0/3959208834 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f937006ac00 0x7f937006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:08.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.727+0000 7f9391e00640 1 --2- 172.21.15.133:0/3959208834 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f937006ac00 0x7f937006d0c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9384007fd0 tx=0x7f9384009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:08.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.731+0000 7f938a000640 1 -- 172.21.15.133:0/3959208834 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f938c054f40 con 0x7f939415cc50 2024-03-30T01:52:08.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.926+0000 7f9399200640 1 -- 172.21.15.133:0/3959208834 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9394158be0 con 0x7f939415cc50 2024-03-30T01:52:08.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.927+0000 7f938a000640 1 -- 172.21.15.133:0/3959208834 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f938c058560 con 0x7f939415cc50 2024-03-30T01:52:08.933 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-03-30T01:52:08.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.929+0000 7f9399200640 1 -- 172.21.15.133:0/3959208834 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f937006ac00 msgr2=0x7f937006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:08.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.929+0000 7f9399200640 1 --2- 172.21.15.133:0/3959208834 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f937006ac00 0x7f937006d0c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9384007fd0 tx=0x7f9384009040 comp rx=0 tx=0).stop 2024-03-30T01:52:08.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.929+0000 7f9399200640 1 -- 172.21.15.133:0/3959208834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f939415cc50 msgr2=0x7f93940c9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:08.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.929+0000 7f9399200640 1 --2- 172.21.15.133:0/3959208834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f939415cc50 0x7f93940c9d60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f938c00cd70 tx=0x7f938c00a660 comp rx=0 tx=0).stop 2024-03-30T01:52:08.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.930+0000 7f9399200640 1 -- 172.21.15.133:0/3959208834 shutdown_connections 2024-03-30T01:52:08.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.930+0000 7f9399200640 1 --2- 172.21.15.133:0/3959208834 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f937006ac00 0x7f937006d0c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:08.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.930+0000 7f9399200640 1 --2- 172.21.15.133:0/3959208834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f939415cc50 0x7f93940c9d60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:08.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.930+0000 7f9399200640 1 --2- 172.21.15.133:0/3959208834 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93940d0af0 0x7f93940b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:08.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.930+0000 7f9399200640 1 --2- 172.21.15.133:0/3959208834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93940cf9b0 0x7f9394157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:08.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.930+0000 7f9399200640 1 -- 172.21.15.133:0/3959208834 >> 172.21.15.133:0/3959208834 conn(0x7f9394071a40 msgr2=0x7f93940cbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:08.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.930+0000 7f9399200640 1 -- 172.21.15.133:0/3959208834 shutdown_connections 2024-03-30T01:52:08.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:08.930+0000 7f9399200640 1 -- 172.21.15.133:0/3959208834 wait complete. 2024-03-30T01:52:08.952 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T01:52:09.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.142+0000 7f0abb000640 1 Processor -- start 2024-03-30T01:52:09.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.142+0000 7f0abb000640 1 -- start start 2024-03-30T01:52:09.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.144+0000 7f0abb000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0ab415cc50 0x7f0ab40d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:09.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.144+0000 7f0abb000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ab40d2240 0x7f0ab40cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:09.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.144+0000 7f0abb000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab415d030 con 0x7f0ab40cf9b0 2024-03-30T01:52:09.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.144+0000 7f0abb000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab40d1c50 con 0x7f0ab415cc50 2024-03-30T01:52:09.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.144+0000 7f0abb000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab40cfe40 con 0x7f0ab40d2240 2024-03-30T01:52:09.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.144+0000 7f0ab9000640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0ab40cf9b0 0x7f0ab40b14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43832/0 (socket says 172.21.15.133:43832) 2024-03-30T01:52:09.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.144+0000 7f0ab9000640 1 -- 172.21.15.133:0/2534883184 learned_addr learned my addr 172.21.15.133:0/2534883184 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:09.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.144+0000 7f0ab3e00640 1 --2- 172.21.15.133:0/2534883184 >> v2:172.21.15.137:3300/0 conn(0x7f0ab415cc50 0x7f0ab40d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:09.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.144+0000 7f0aabe00640 1 --2- 172.21.15.133:0/2534883184 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ab40d2240 0x7f0ab40cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:09.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.145+0000 7f0ab3400640 1 -- 172.21.15.133:0/2534883184 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1074179236 0 0) 0x7f0ab415d030 con 0x7f0ab40cf9b0 2024-03-30T01:52:09.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.145+0000 7f0ab3400640 1 -- 172.21.15.133:0/2534883184 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a98003520 con 0x7f0ab40cf9b0 2024-03-30T01:52:09.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.145+0000 7f0ab3400640 1 -- 172.21.15.133:0/2534883184 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2583706083 0 0) 0x7f0a98003520 con 0x7f0ab40cf9b0 2024-03-30T01:52:09.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.145+0000 7f0ab3400640 1 -- 172.21.15.133:0/2534883184 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ab40d2240 msgr2=0x7f0ab40cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:09.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.145+0000 7f0ab3400640 1 --2- 172.21.15.133:0/2534883184 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ab40d2240 0x7f0ab40cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.145+0000 7f0ab3400640 1 -- 172.21.15.133:0/2534883184 >> v2:172.21.15.137:3300/0 conn(0x7f0ab415cc50 msgr2=0x7f0ab40d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:09.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.145+0000 7f0ab3400640 1 --2- 172.21.15.133:0/2534883184 >> v2:172.21.15.137:3300/0 conn(0x7f0ab415cc50 0x7f0ab40d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.145+0000 7f0ab3400640 1 -- 172.21.15.133:0/2534883184 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab40b5af0 con 0x7f0ab40cf9b0 2024-03-30T01:52:09.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.145+0000 7f0ab3400640 1 -- 172.21.15.133:0/2534883184 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f0aac0019f0 con 0x7f0ab40cf9b0 2024-03-30T01:52:09.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.145+0000 7f0ab3400640 1 -- 172.21.15.133:0/2534883184 >> v1:172.21.15.133:6789/0 conn(0x7f0ab40cf9b0 legacy=0x7f0ab40b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:09.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.145+0000 7f0ab3400640 1 --2- 172.21.15.133:0/2534883184 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ab40d2240 0x7f0a98003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:09.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.145+0000 7f0ab3400640 1 --2- 172.21.15.133:0/2534883184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a98003ef0 0x7f0a980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:09.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.145+0000 7f0ab3400640 1 --2- 172.21.15.133:0/2534883184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a98004d00 0x7f0a98005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:09.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.145+0000 7f0ab3400640 1 -- 172.21.15.133:0/2534883184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab40d1c50 con 0x7f0a98004d00 2024-03-30T01:52:09.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.145+0000 7f0ab3400640 1 -- 172.21.15.133:0/2534883184 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab40cfe40 con 0x7f0a98003ef0 2024-03-30T01:52:09.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.145+0000 7f0ab3400640 1 -- 172.21.15.133:0/2534883184 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9800b980 con 0x7f0ab40d2240 2024-03-30T01:52:09.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.145+0000 7f0ab9000640 1 --2- 172.21.15.133:0/2534883184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a98004d00 0x7f0a98005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:09.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.146+0000 7f0aabe00640 1 --2- 172.21.15.133:0/2534883184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a98003ef0 0x7f0a980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:09.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.146+0000 7f0ab3e00640 1 --2- 172.21.15.133:0/2534883184 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ab40d2240 0x7f0a98003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:09.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.146+0000 7f0ab9000640 1 -- 172.21.15.133:0/2534883184 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ab40d2240 msgr2=0x7f0a98003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:09.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.146+0000 7f0ab9000640 1 --2- 172.21.15.133:0/2534883184 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ab40d2240 0x7f0a98003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.146+0000 7f0ab9000640 1 -- 172.21.15.133:0/2534883184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a98003ef0 msgr2=0x7f0a980047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:09.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.146+0000 7f0ab9000640 1 --2- 172.21.15.133:0/2534883184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a98003ef0 0x7f0a980047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.146+0000 7f0ab9000640 1 -- 172.21.15.133:0/2534883184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a98003520 con 0x7f0a98004d00 2024-03-30T01:52:09.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.147+0000 7f0ab9000640 1 --2- 172.21.15.133:0/2534883184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a98004d00 0x7f0a98005180 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00a840 tx=0x7f0a980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810943b28a543900 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:09.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.147+0000 7f0ab3400640 1 -- 172.21.15.133:0/2534883184 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac034630 con 0x7f0a98004d00 2024-03-30T01:52:09.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.147+0000 7f0ab3400640 1 -- 172.21.15.133:0/2534883184 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aac02f070 con 0x7f0a98004d00 2024-03-30T01:52:09.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.147+0000 7f0ab3400640 1 -- 172.21.15.133:0/2534883184 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac034a30 con 0x7f0a98004d00 2024-03-30T01:52:09.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.148+0000 7f0abb000640 1 -- 172.21.15.133:0/2534883184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a98004d00 msgr2=0x7f0a98005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:09.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.148+0000 7f0abb000640 1 --2- 172.21.15.133:0/2534883184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a98004d00 0x7f0a98005180 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00a840 tx=0x7f0a980057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.148+0000 7f0ab9000640 1 -- 172.21.15.133:0/2534883184 reap_dead start 2024-03-30T01:52:09.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.148+0000 7f0abb000640 1 -- 172.21.15.133:0/2534883184 shutdown_connections 2024-03-30T01:52:09.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.148+0000 7f0abb000640 1 -- 172.21.15.133:0/2534883184 >> 172.21.15.133:0/2534883184 conn(0x7f0ab4071a40 msgr2=0x7f0ab406b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:09.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.148+0000 7f0abb000640 1 -- 172.21.15.133:0/2534883184 shutdown_connections 2024-03-30T01:52:09.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.148+0000 7f0abb000640 1 -- 172.21.15.133:0/2534883184 wait complete. 2024-03-30T01:52:09.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.150+0000 7f0abb000640 1 Processor -- start 2024-03-30T01:52:09.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.150+0000 7f0abb000640 1 -- start start 2024-03-30T01:52:09.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.151+0000 7f0abb000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a98004d00 0x7f0ab40c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:09.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.151+0000 7f0abb000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ab4158770 0x7f0ab40b7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:09.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.151+0000 7f0abb000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ab40b8210 0x7f0ab4156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:09.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.151+0000 7f0abb000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab40b86a0 con 0x7f0ab40b8210 2024-03-30T01:52:09.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.151+0000 7f0abb000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab4158c70 con 0x7f0a98004d00 2024-03-30T01:52:09.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.151+0000 7f0abb000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab4155f50 con 0x7f0ab4158770 2024-03-30T01:52:09.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.151+0000 7f0ab9000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ab40b8210 0x7f0ab4156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:09.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.151+0000 7f0ab9000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ab40b8210 0x7f0ab4156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55290/0 (socket says 172.21.15.133:55290) 2024-03-30T01:52:09.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.151+0000 7f0ab9000640 1 -- 172.21.15.133:0/991882016 learned_addr learned my addr 172.21.15.133:0/991882016 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:09.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.152+0000 7f0ab3e00640 1 --2- 172.21.15.133:0/991882016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a98004d00 0x7f0ab40c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:09.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.152+0000 7f0aabe00640 1 --2- 172.21.15.133:0/991882016 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ab4158770 0x7f0ab40b7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:09.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.152+0000 7f0ab9000640 1 -- 172.21.15.133:0/991882016 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ab4158770 msgr2=0x7f0ab40b7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:09.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.152+0000 7f0ab9000640 1 --2- 172.21.15.133:0/991882016 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ab4158770 0x7f0ab40b7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.152+0000 7f0ab9000640 1 -- 172.21.15.133:0/991882016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a98004d00 msgr2=0x7f0ab40c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:09.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.152+0000 7f0ab9000640 1 --2- 172.21.15.133:0/991882016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a98004d00 0x7f0ab40c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.152+0000 7f0ab9000640 1 -- 172.21.15.133:0/991882016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab4156230 con 0x7f0ab40b8210 2024-03-30T01:52:09.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.152+0000 7f0ab3e00640 1 --2- 172.21.15.133:0/991882016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a98004d00 0x7f0ab40c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:52:09.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.152+0000 7f0ab9000640 1 --2- 172.21.15.133:0/991882016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ab40b8210 0x7f0ab4156d10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00a840 tx=0x7f0ab40b5c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:09.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.153+0000 7f0ab0c00640 1 -- 172.21.15.133:0/991882016 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac034840 con 0x7f0ab40b8210 2024-03-30T01:52:09.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.153+0000 7f0ab0c00640 1 -- 172.21.15.133:0/991882016 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aac0349a0 con 0x7f0ab40b8210 2024-03-30T01:52:09.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.153+0000 7f0ab0c00640 1 -- 172.21.15.133:0/991882016 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac034d10 con 0x7f0ab40b8210 2024-03-30T01:52:09.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.153+0000 7f0abb000640 1 -- 172.21.15.133:0/991882016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab4156510 con 0x7f0ab40b8210 2024-03-30T01:52:09.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.153+0000 7f0abb000640 1 -- 172.21.15.133:0/991882016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab4152c80 con 0x7f0ab40b8210 2024-03-30T01:52:09.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.154+0000 7f0abb000640 1 -- 172.21.15.133:0/991882016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab4156a30 con 0x7f0ab40b8210 2024-03-30T01:52:09.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.155+0000 7f0ab0c00640 1 -- 172.21.15.133:0/991882016 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0aac031030 con 0x7f0ab40b8210 2024-03-30T01:52:09.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.156+0000 7f0ab0c00640 1 --2- 172.21.15.133:0/991882016 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0a9006ac80 0x7f0a9006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:09.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.156+0000 7f0ab0c00640 1 -- 172.21.15.133:0/991882016 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0aac0ab4e0 con 0x7f0ab40b8210 2024-03-30T01:52:09.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.156+0000 7f0ab3e00640 1 --2- 172.21.15.133:0/991882016 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0a9006ac80 0x7f0a9006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:09.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.157+0000 7f0ab3e00640 1 --2- 172.21.15.133:0/991882016 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0a9006ac80 0x7f0a9006d140 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009b50 tx=0x7f0aa4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:09.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.160+0000 7f0ab0c00640 1 -- 172.21.15.133:0/991882016 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f0ab4156a30 con 0x7f0ab40b8210 2024-03-30T01:52:09.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.355+0000 7f0abb000640 1 -- 172.21.15.133:0/991882016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0ab4156a30 con 0x7f0ab40b8210 2024-03-30T01:52:09.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.356+0000 7f0ab0c00640 1 -- 172.21.15.133:0/991882016 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0ab4156a30 con 0x7f0ab40b8210 2024-03-30T01:52:09.362 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-03-30T01:52:09.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.358+0000 7f0abb000640 1 -- 172.21.15.133:0/991882016 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0a9006ac80 msgr2=0x7f0a9006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:09.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.358+0000 7f0abb000640 1 --2- 172.21.15.133:0/991882016 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0a9006ac80 0x7f0a9006d140 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009b50 tx=0x7f0aa4008040 comp rx=0 tx=0).stop 2024-03-30T01:52:09.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.359+0000 7f0abb000640 1 -- 172.21.15.133:0/991882016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ab40b8210 msgr2=0x7f0ab4156d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:09.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.359+0000 7f0abb000640 1 --2- 172.21.15.133:0/991882016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ab40b8210 0x7f0ab4156d10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00a840 tx=0x7f0ab40b5c80 comp rx=0 tx=0).stop 2024-03-30T01:52:09.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.359+0000 7f0abb000640 1 -- 172.21.15.133:0/991882016 shutdown_connections 2024-03-30T01:52:09.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.359+0000 7f0abb000640 1 --2- 172.21.15.133:0/991882016 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0a9006ac80 0x7f0a9006d140 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.359+0000 7f0abb000640 1 --2- 172.21.15.133:0/991882016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ab40b8210 0x7f0ab4156d10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.359+0000 7f0abb000640 1 --2- 172.21.15.133:0/991882016 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ab4158770 0x7f0ab40b7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.359+0000 7f0abb000640 1 --2- 172.21.15.133:0/991882016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a98004d00 0x7f0ab40c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.359+0000 7f0abb000640 1 -- 172.21.15.133:0/991882016 >> 172.21.15.133:0/991882016 conn(0x7f0ab4071a40 msgr2=0x7f0ab4072ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:09.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.359+0000 7f0abb000640 1 -- 172.21.15.133:0/991882016 shutdown_connections 2024-03-30T01:52:09.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.359+0000 7f0abb000640 1 -- 172.21.15.133:0/991882016 wait complete. 2024-03-30T01:52:09.382 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T01:52:09.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.573+0000 7fa27fe00640 1 Processor -- start 2024-03-30T01:52:09.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.574+0000 7fa27fe00640 1 -- start start 2024-03-30T01:52:09.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.575+0000 7fa27fe00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa2780d0af0 0x7fa2780cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:09.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.575+0000 7fa27fe00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa27815d030 con 0x7fa27815cc50 2024-03-30T01:52:09.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.575+0000 7fa27fe00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2780cfe20 con 0x7fa2780cf9b0 2024-03-30T01:52:09.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.575+0000 7fa27fe00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2780d1c50 con 0x7fa2780d0af0 2024-03-30T01:52:09.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.575+0000 7fa27ca00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa2780d0af0 0x7fa2780cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:09.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.576+0000 7fa27ca00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa2780d0af0 0x7fa2780cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55306/0 (socket says 172.21.15.133:55306) 2024-03-30T01:52:09.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.576+0000 7fa27ca00640 1 -- 172.21.15.133:0/241789734 learned_addr learned my addr 172.21.15.133:0/241789734 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:09.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.576+0000 7fa27ca00640 1 -- 172.21.15.133:0/241789734 >> v1:172.21.15.137:6789/0 conn(0x7fa2780cf9b0 legacy=0x7fa2780b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:09.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.576+0000 7fa27ca00640 1 -- 172.21.15.133:0/241789734 >> v1:172.21.15.133:6789/0 conn(0x7fa27815cc50 legacy=0x7fa2780d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:09.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.576+0000 7fa27ca00640 1 -- 172.21.15.133:0/241789734 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2780b5af0 con 0x7fa2780d0af0 2024-03-30T01:52:09.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.577+0000 7fa27ca00640 1 --2- 172.21.15.133:0/241789734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2780d0af0 0x7fa2780cf470 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa264009870 tx=0x7fa26402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4fd85388c7732ac server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:09.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.577+0000 7fa277e00640 1 -- 172.21.15.133:0/241789734 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa264030860 con 0x7fa2780d0af0 2024-03-30T01:52:09.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.577+0000 7fa277e00640 1 -- 172.21.15.133:0/241789734 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2640309c0 con 0x7fa2780d0af0 2024-03-30T01:52:09.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.577+0000 7fa277e00640 1 -- 172.21.15.133:0/241789734 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa264030d50 con 0x7fa2780d0af0 2024-03-30T01:52:09.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.578+0000 7fa27fe00640 1 -- 172.21.15.133:0/241789734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2780d0af0 msgr2=0x7fa2780cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:09.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.578+0000 7fa27fe00640 1 --2- 172.21.15.133:0/241789734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2780d0af0 0x7fa2780cf470 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa264009870 tx=0x7fa26402b9a0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.578+0000 7fa27fe00640 1 -- 172.21.15.133:0/241789734 shutdown_connections 2024-03-30T01:52:09.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.578+0000 7fa27fe00640 1 --2- 172.21.15.133:0/241789734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2780d0af0 0x7fa2780cf470 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.578+0000 7fa27fe00640 1 -- 172.21.15.133:0/241789734 >> 172.21.15.133:0/241789734 conn(0x7fa278071a40 msgr2=0x7fa27806b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:09.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.578+0000 7fa27fe00640 1 -- 172.21.15.133:0/241789734 shutdown_connections 2024-03-30T01:52:09.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.578+0000 7fa27fe00640 1 -- 172.21.15.133:0/241789734 wait complete. 2024-03-30T01:52:09.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.580+0000 7fa27fe00640 1 Processor -- start 2024-03-30T01:52:09.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.580+0000 7fa27fe00640 1 -- start start 2024-03-30T01:52:09.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.581+0000 7fa27fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2780cf9b0 0x7fa27814c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:09.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.581+0000 7fa27fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2780d0af0 0x7fa2781f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:09.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.581+0000 7fa27fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa27815cc50 0x7fa2780cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:09.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.581+0000 7fa27fe00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2781f2250 con 0x7fa27815cc50 2024-03-30T01:52:09.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.581+0000 7fa27fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2780aa3d0 con 0x7fa2780d0af0 2024-03-30T01:52:09.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.581+0000 7fa27fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2780aa6b0 con 0x7fa2780cf9b0 2024-03-30T01:52:09.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.581+0000 7fa27de00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa27815cc50 0x7fa2780cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:09.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.581+0000 7fa27de00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa27815cc50 0x7fa2780cbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55320/0 (socket says 172.21.15.133:55320) 2024-03-30T01:52:09.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.581+0000 7fa27de00640 1 -- 172.21.15.133:0/2280785442 learned_addr learned my addr 172.21.15.133:0/2280785442 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:09.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.582+0000 7fa27ca00640 1 --2- 172.21.15.133:0/2280785442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2780d0af0 0x7fa2781f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:09.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.582+0000 7fa27d400640 1 --2- 172.21.15.133:0/2280785442 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2780cf9b0 0x7fa27814c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:09.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.582+0000 7fa27de00640 1 -- 172.21.15.133:0/2280785442 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2780cf9b0 msgr2=0x7fa27814c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:09.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.582+0000 7fa27de00640 1 --2- 172.21.15.133:0/2280785442 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2780cf9b0 0x7fa27814c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.582+0000 7fa27de00640 1 -- 172.21.15.133:0/2280785442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2780d0af0 msgr2=0x7fa2781f1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:09.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.582+0000 7fa27de00640 1 --2- 172.21.15.133:0/2280785442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2780d0af0 0x7fa2781f1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.582+0000 7fa27de00640 1 -- 172.21.15.133:0/2280785442 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2640094d0 con 0x7fa27815cc50 2024-03-30T01:52:09.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.582+0000 7fa27d400640 1 --2- 172.21.15.133:0/2280785442 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2780cf9b0 0x7fa27814c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:09.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.582+0000 7fa27de00640 1 --2- 172.21.15.133:0/2280785442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa27815cc50 0x7fa2780cbd00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa27000c780 tx=0x7fa27000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:09.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.582+0000 7fa275600640 1 -- 172.21.15.133:0/2280785442 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa270004b60 con 0x7fa27815cc50 2024-03-30T01:52:09.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.582+0000 7fa275600640 1 -- 172.21.15.133:0/2280785442 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27000ce90 con 0x7fa27815cc50 2024-03-30T01:52:09.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.582+0000 7fa275600640 1 -- 172.21.15.133:0/2280785442 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27000a850 con 0x7fa27815cc50 2024-03-30T01:52:09.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.582+0000 7fa27fe00640 1 -- 172.21.15.133:0/2280785442 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2780aa990 con 0x7fa27815cc50 2024-03-30T01:52:09.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.583+0000 7fa27fe00640 1 -- 172.21.15.133:0/2280785442 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2780aaf50 con 0x7fa27815cc50 2024-03-30T01:52:09.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.584+0000 7fa27fe00640 1 -- 172.21.15.133:0/2280785442 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2780ab140 con 0x7fa27815cc50 2024-03-30T01:52:09.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.585+0000 7fa275600640 1 -- 172.21.15.133:0/2280785442 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fa27000a9b0 con 0x7fa27815cc50 2024-03-30T01:52:09.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.586+0000 7fa275600640 1 --2- 172.21.15.133:0/2280785442 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa25806ac00 0x7fa25806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:09.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.586+0000 7fa275600640 1 -- 172.21.15.133:0/2280785442 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa270089520 con 0x7fa27815cc50 2024-03-30T01:52:09.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.587+0000 7fa27d400640 1 --2- 172.21.15.133:0/2280785442 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa25806ac00 0x7fa25806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:09.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.587+0000 7fa27d400640 1 --2- 172.21.15.133:0/2280785442 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa25806ac00 0x7fa25806d0c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa26c000f60 tx=0x7fa26c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:09.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.591+0000 7fa275600640 1 -- 172.21.15.133:0/2280785442 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fa270054700 con 0x7fa27815cc50 2024-03-30T01:52:09.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.772+0000 7fa27fe00640 1 -- 172.21.15.133:0/2280785442 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa278066d80 con 0x7fa27815cc50 2024-03-30T01:52:09.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.772+0000 7fa275600640 1 -- 172.21.15.133:0/2280785442 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa270057d20 con 0x7fa27815cc50 2024-03-30T01:52:09.779 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-03-30T01:52:09.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.775+0000 7fa27fe00640 1 -- 172.21.15.133:0/2280785442 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa25806ac00 msgr2=0x7fa25806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:09.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.775+0000 7fa27fe00640 1 --2- 172.21.15.133:0/2280785442 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa25806ac00 0x7fa25806d0c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa26c000f60 tx=0x7fa26c009040 comp rx=0 tx=0).stop 2024-03-30T01:52:09.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.775+0000 7fa27fe00640 1 -- 172.21.15.133:0/2280785442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa27815cc50 msgr2=0x7fa2780cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:09.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.775+0000 7fa27fe00640 1 --2- 172.21.15.133:0/2280785442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa27815cc50 0x7fa2780cbd00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa27000c780 tx=0x7fa27000cc40 comp rx=0 tx=0).stop 2024-03-30T01:52:09.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.775+0000 7fa27fe00640 1 -- 172.21.15.133:0/2280785442 shutdown_connections 2024-03-30T01:52:09.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.775+0000 7fa27fe00640 1 --2- 172.21.15.133:0/2280785442 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa25806ac00 0x7fa25806d0c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.775+0000 7fa27fe00640 1 --2- 172.21.15.133:0/2280785442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa27815cc50 0x7fa2780cbd00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.775+0000 7fa27fe00640 1 --2- 172.21.15.133:0/2280785442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2780d0af0 0x7fa2781f1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.775+0000 7fa27fe00640 1 --2- 172.21.15.133:0/2280785442 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2780cf9b0 0x7fa27814c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.775+0000 7fa27fe00640 1 -- 172.21.15.133:0/2280785442 >> 172.21.15.133:0/2280785442 conn(0x7fa278071a40 msgr2=0x7fa27815e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:09.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.775+0000 7fa27fe00640 1 -- 172.21.15.133:0/2280785442 shutdown_connections 2024-03-30T01:52:09.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.775+0000 7fa27fe00640 1 -- 172.21.15.133:0/2280785442 wait complete. 2024-03-30T01:52:09.799 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:52:09.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.984+0000 7feb43e00640 1 Processor -- start 2024-03-30T01:52:09.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.984+0000 7feb43e00640 1 -- start start 2024-03-30T01:52:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.985+0000 7feb43e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb3c15cc50 0x7feb3c0d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.985+0000 7feb43e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7feb3c0d2240 0x7feb3c0cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.985+0000 7feb43e00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb3c15d030 con 0x7feb3c0cf9b0 2024-03-30T01:52:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.985+0000 7feb43e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb3c0d1c50 con 0x7feb3c0d2240 2024-03-30T01:52:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.985+0000 7feb43e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c0cfe40 con 0x7feb3c15cc50 2024-03-30T01:52:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.986+0000 7feb41e00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7feb3c0cf9b0 0x7feb3c0b14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43848/0 (socket says 172.21.15.133:43848) 2024-03-30T01:52:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.986+0000 7feb41e00640 1 -- 172.21.15.133:0/1057371891 learned_addr learned my addr 172.21.15.133:0/1057371891 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:09.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.986+0000 7feb41400640 1 --2- 172.21.15.133:0/1057371891 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb3c15cc50 0x7feb3c0d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:09.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.986+0000 7feb40a00640 1 --2- 172.21.15.133:0/1057371891 >> v2:172.21.15.137:3300/0 conn(0x7feb3c0d2240 0x7feb3c0cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:09.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.986+0000 7feb3be00640 1 -- 172.21.15.133:0/1057371891 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1493407256 0 0) 0x7feb3c15d030 con 0x7feb3c0cf9b0 2024-03-30T01:52:09.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.986+0000 7feb3be00640 1 -- 172.21.15.133:0/1057371891 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb24003520 con 0x7feb3c0cf9b0 2024-03-30T01:52:09.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.986+0000 7feb3be00640 1 -- 172.21.15.133:0/1057371891 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 853755176 0 0) 0x7feb24003520 con 0x7feb3c0cf9b0 2024-03-30T01:52:09.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.986+0000 7feb3be00640 1 -- 172.21.15.133:0/1057371891 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb3c15cc50 msgr2=0x7feb3c0d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:09.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.986+0000 7feb3be00640 1 --2- 172.21.15.133:0/1057371891 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb3c15cc50 0x7feb3c0d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.986+0000 7feb3be00640 1 -- 172.21.15.133:0/1057371891 >> v2:172.21.15.137:3300/0 conn(0x7feb3c0d2240 msgr2=0x7feb3c0cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:09.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.986+0000 7feb3be00640 1 --2- 172.21.15.133:0/1057371891 >> v2:172.21.15.137:3300/0 conn(0x7feb3c0d2240 0x7feb3c0cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.986+0000 7feb3be00640 1 -- 172.21.15.133:0/1057371891 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c0b5af0 con 0x7feb3c0cf9b0 2024-03-30T01:52:09.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.986+0000 7feb3be00640 1 -- 172.21.15.133:0/1057371891 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7feb340019f0 con 0x7feb3c0cf9b0 2024-03-30T01:52:09.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.987+0000 7feb3be00640 1 -- 172.21.15.133:0/1057371891 >> v1:172.21.15.133:6789/0 conn(0x7feb3c0cf9b0 legacy=0x7feb3c0b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:09.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.987+0000 7feb3be00640 1 --2- 172.21.15.133:0/1057371891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb24003970 0x7feb24003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:09.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.987+0000 7feb3be00640 1 --2- 172.21.15.133:0/1057371891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb240047c0 0x7feb24004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:09.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.987+0000 7feb3be00640 1 --2- 172.21.15.133:0/1057371891 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb3c15cc50 0x7feb24005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:09.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.987+0000 7feb3be00640 1 -- 172.21.15.133:0/1057371891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c0d1c50 con 0x7feb240047c0 2024-03-30T01:52:09.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.987+0000 7feb3be00640 1 -- 172.21.15.133:0/1057371891 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c0cfe40 con 0x7feb24003970 2024-03-30T01:52:09.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.987+0000 7feb3be00640 1 -- 172.21.15.133:0/1057371891 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2400ba30 con 0x7feb3c15cc50 2024-03-30T01:52:09.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.987+0000 7feb40a00640 1 --2- 172.21.15.133:0/1057371891 >> v2:172.21.15.137:3300/0 conn(0x7feb3c0d2240 0x7feb3c0cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:52:09.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.987+0000 7feb40a00640 1 --2- 172.21.15.133:0/1057371891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb240047c0 0x7feb24004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:09.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.987+0000 7feb41e00640 1 --2- 172.21.15.133:0/1057371891 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb3c15cc50 0x7feb24005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:09.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.987+0000 7feb41400640 1 --2- 172.21.15.133:0/1057371891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb24003970 0x7feb24003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:09.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.987+0000 7feb40a00640 1 -- 172.21.15.133:0/1057371891 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb3c15cc50 msgr2=0x7feb24005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:09.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.987+0000 7feb40a00640 1 --2- 172.21.15.133:0/1057371891 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb3c15cc50 0x7feb24005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.987+0000 7feb40a00640 1 -- 172.21.15.133:0/1057371891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb24003970 msgr2=0x7feb24003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:09.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.987+0000 7feb40a00640 1 --2- 172.21.15.133:0/1057371891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb24003970 0x7feb24003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.987+0000 7feb40a00640 1 -- 172.21.15.133:0/1057371891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb24003520 con 0x7feb240047c0 2024-03-30T01:52:09.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.988+0000 7feb40a00640 1 --2- 172.21.15.133:0/1057371891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb240047c0 0x7feb24004c40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7feb28006fd0 tx=0x7feb240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c619b7ce6c8aa5e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:09.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.989+0000 7feb3be00640 1 -- 172.21.15.133:0/1057371891 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb28030660 con 0x7feb240047c0 2024-03-30T01:52:09.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.989+0000 7feb3be00640 1 -- 172.21.15.133:0/1057371891 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb280307c0 con 0x7feb240047c0 2024-03-30T01:52:09.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.989+0000 7feb3be00640 1 -- 172.21.15.133:0/1057371891 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb28030b30 con 0x7feb240047c0 2024-03-30T01:52:09.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.989+0000 7feb43e00640 1 -- 172.21.15.133:0/1057371891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb240047c0 msgr2=0x7feb24004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:09.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.989+0000 7feb43e00640 1 --2- 172.21.15.133:0/1057371891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb240047c0 0x7feb24004c40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7feb28006fd0 tx=0x7feb240057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:09.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.989+0000 7feb41e00640 1 -- 172.21.15.133:0/1057371891 reap_dead start 2024-03-30T01:52:09.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.989+0000 7feb43e00640 1 -- 172.21.15.133:0/1057371891 shutdown_connections 2024-03-30T01:52:09.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.989+0000 7feb43e00640 1 -- 172.21.15.133:0/1057371891 >> 172.21.15.133:0/1057371891 conn(0x7feb3c071a40 msgr2=0x7feb3c06b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:09.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.989+0000 7feb43e00640 1 -- 172.21.15.133:0/1057371891 shutdown_connections 2024-03-30T01:52:09.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.989+0000 7feb43e00640 1 -- 172.21.15.133:0/1057371891 wait complete. 2024-03-30T01:52:09.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.991+0000 7feb43e00640 1 Processor -- start 2024-03-30T01:52:09.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.991+0000 7feb43e00640 1 -- start start 2024-03-30T01:52:09.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.992+0000 7feb43e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb240047c0 0x7feb3c157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:10.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.992+0000 7feb43e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb3c0b7190 0x7feb3c153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:10.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.992+0000 7feb43e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb3c0b7610 0x7feb3c0c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:10.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.992+0000 7feb43e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c157b50 con 0x7feb3c0b7190 2024-03-30T01:52:10.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.992+0000 7feb43e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c156f40 con 0x7feb3c0b7610 2024-03-30T01:52:10.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.992+0000 7feb43e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c157220 con 0x7feb240047c0 2024-03-30T01:52:10.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.992+0000 7feb40a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb3c0b7190 0x7feb3c153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:10.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.992+0000 7feb40a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb3c0b7190 0x7feb3c153090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55336/0 (socket says 172.21.15.133:55336) 2024-03-30T01:52:10.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.992+0000 7feb40a00640 1 -- 172.21.15.133:0/3914805436 learned_addr learned my addr 172.21.15.133:0/3914805436 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:10.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.993+0000 7feb41e00640 1 --2- 172.21.15.133:0/3914805436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb3c0b7610 0x7feb3c0c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:10.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.993+0000 7feb41400640 1 --2- 172.21.15.133:0/3914805436 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb240047c0 0x7feb3c157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:10.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.993+0000 7feb40a00640 1 -- 172.21.15.133:0/3914805436 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb240047c0 msgr2=0x7feb3c157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:10.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.993+0000 7feb40a00640 1 --2- 172.21.15.133:0/3914805436 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb240047c0 0x7feb3c157fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:10.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.993+0000 7feb40a00640 1 -- 172.21.15.133:0/3914805436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb3c0b7610 msgr2=0x7feb3c0c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:10.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.993+0000 7feb40a00640 1 --2- 172.21.15.133:0/3914805436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb3c0b7610 0x7feb3c0c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:10.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.993+0000 7feb40a00640 1 -- 172.21.15.133:0/3914805436 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c157500 con 0x7feb3c0b7190 2024-03-30T01:52:10.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.993+0000 7feb41e00640 1 --2- 172.21.15.133:0/3914805436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb3c0b7610 0x7feb3c0c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:10.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.993+0000 7feb40a00640 1 --2- 172.21.15.133:0/3914805436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb3c0b7190 0x7feb3c153090 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7feb2802bef0 tx=0x7feb28004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:10.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.993+0000 7feb39600640 1 -- 172.21.15.133:0/3914805436 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb280399e0 con 0x7feb3c0b7190 2024-03-30T01:52:10.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.993+0000 7feb39600640 1 -- 172.21.15.133:0/3914805436 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2803f040 con 0x7feb3c0b7190 2024-03-30T01:52:10.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.993+0000 7feb39600640 1 -- 172.21.15.133:0/3914805436 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb28039d60 con 0x7feb3c0b7190 2024-03-30T01:52:10.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.993+0000 7feb43e00640 1 -- 172.21.15.133:0/3914805436 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb3c1577e0 con 0x7feb3c0b7190 2024-03-30T01:52:10.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.994+0000 7feb43e00640 1 -- 172.21.15.133:0/3914805436 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3c158a20 con 0x7feb3c0b7190 2024-03-30T01:52:10.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.995+0000 7feb43e00640 1 -- 172.21.15.133:0/3914805436 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3c066d80 con 0x7feb3c0b7190 2024-03-30T01:52:10.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.995+0000 7feb39600640 1 -- 172.21.15.133:0/3914805436 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7feb2804c400 con 0x7feb3c0b7190 2024-03-30T01:52:10.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.996+0000 7feb39600640 1 --2- 172.21.15.133:0/3914805436 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7feb1c06ac00 0x7feb1c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:10.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.996+0000 7feb39600640 1 -- 172.21.15.133:0/3914805436 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb280ab990 con 0x7feb3c0b7190 2024-03-30T01:52:10.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.997+0000 7feb41400640 1 --2- 172.21.15.133:0/3914805436 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7feb1c06ac00 0x7feb1c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:10.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:09.997+0000 7feb41400640 1 --2- 172.21.15.133:0/3914805436 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7feb1c06ac00 0x7feb1c06d0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7feb30006fd0 tx=0x7feb30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:10.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.000+0000 7feb39600640 1 -- 172.21.15.133:0/3914805436 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7feb28076ad0 con 0x7feb3c0b7190 2024-03-30T01:52:10.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.183+0000 7feb43e00640 1 -- 172.21.15.133:0/3914805436 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb3c0cc660 con 0x7feb3c0b7190 2024-03-30T01:52:10.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.185+0000 7feb39600640 1 -- 172.21.15.133:0/3914805436 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7feb28034070 con 0x7feb3c0b7190 2024-03-30T01:52:10.191 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:10.191 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:51:33.780665+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:51:31.245378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T01:51:31.774247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:52:10.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.187+0000 7feb43e00640 1 -- 172.21.15.133:0/3914805436 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7feb1c06ac00 msgr2=0x7feb1c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:10.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.187+0000 7feb43e00640 1 --2- 172.21.15.133:0/3914805436 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7feb1c06ac00 0x7feb1c06d0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7feb30006fd0 tx=0x7feb30008040 comp rx=0 tx=0).stop 2024-03-30T01:52:10.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.187+0000 7feb43e00640 1 -- 172.21.15.133:0/3914805436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb3c0b7190 msgr2=0x7feb3c153090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:10.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.187+0000 7feb43e00640 1 --2- 172.21.15.133:0/3914805436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb3c0b7190 0x7feb3c153090 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7feb2802bef0 tx=0x7feb28004730 comp rx=0 tx=0).stop 2024-03-30T01:52:10.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.188+0000 7feb43e00640 1 -- 172.21.15.133:0/3914805436 shutdown_connections 2024-03-30T01:52:10.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.188+0000 7feb43e00640 1 --2- 172.21.15.133:0/3914805436 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7feb1c06ac00 0x7feb1c06d0c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:10.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.188+0000 7feb43e00640 1 --2- 172.21.15.133:0/3914805436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb3c0b7610 0x7feb3c0c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:10.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.188+0000 7feb43e00640 1 --2- 172.21.15.133:0/3914805436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb3c0b7190 0x7feb3c153090 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:10.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.188+0000 7feb43e00640 1 --2- 172.21.15.133:0/3914805436 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb240047c0 0x7feb3c157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:10.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.188+0000 7feb43e00640 1 -- 172.21.15.133:0/3914805436 >> 172.21.15.133:0/3914805436 conn(0x7feb3c071a40 msgr2=0x7feb3c0ca3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:10.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.188+0000 7feb43e00640 1 -- 172.21.15.133:0/3914805436 shutdown_connections 2024-03-30T01:52:10.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.188+0000 7feb43e00640 1 -- 172.21.15.133:0/3914805436 wait complete. 2024-03-30T01:52:10.211 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T01:51:21.771393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T01:51:31.245378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T01:51:31.774247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T01:52:10.212 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T01:52:10.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.407+0000 7f85d9e00640 1 Processor -- start 2024-03-30T01:52:10.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.407+0000 7f85d9e00640 1 -- start start 2024-03-30T01:52:10.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.408+0000 7f85d9e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f85d4143790 0x7f85d40cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:10.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.409+0000 7f85d9e00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d40a76a0 con 0x7f85d4070500 2024-03-30T01:52:10.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.409+0000 7f85d9e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d40b38e0 con 0x7f85d40ccc40 2024-03-30T01:52:10.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.409+0000 7f85d9e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d40cd180 con 0x7f85d4143790 2024-03-30T01:52:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.409+0000 7f85ca000640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f85d4070500 0x7f85d40cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43860/0 (socket says 172.21.15.133:43860) 2024-03-30T01:52:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.409+0000 7f85ca000640 1 -- 172.21.15.133:0/3125919559 learned_addr learned my addr 172.21.15.133:0/3125919559 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.409+0000 7f85d2a00640 1 --2- 172.21.15.133:0/3125919559 >> v2:172.21.15.137:3300/0 conn(0x7f85d4143790 0x7f85d40cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.409+0000 7f85d2000640 1 -- 172.21.15.133:0/3125919559 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391209958 0 0) 0x7f85d40a76a0 con 0x7f85d4070500 2024-03-30T01:52:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.409+0000 7f85d2000640 1 -- 172.21.15.133:0/3125919559 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85b8003520 con 0x7f85d4070500 2024-03-30T01:52:10.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.410+0000 7f85d2000640 1 -- 172.21.15.133:0/3125919559 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3595722825 0 0) 0x7f85b8003520 con 0x7f85d4070500 2024-03-30T01:52:10.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.410+0000 7f85d2000640 1 -- 172.21.15.133:0/3125919559 >> v2:172.21.15.137:3300/0 conn(0x7f85d4143790 msgr2=0x7f85d40cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:10.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.410+0000 7f85d2000640 1 --2- 172.21.15.133:0/3125919559 >> v2:172.21.15.137:3300/0 conn(0x7f85d4143790 0x7f85d40cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:10.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.410+0000 7f85d2000640 1 -- 172.21.15.133:0/3125919559 >> v1:172.21.15.137:6789/0 conn(0x7f85d40ccc40 legacy=0x7f85d415ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:10.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.410+0000 7f85d2000640 1 -- 172.21.15.133:0/3125919559 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d40cd460 con 0x7f85d4070500 2024-03-30T01:52:10.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.410+0000 7f85d2000640 1 -- 172.21.15.133:0/3125919559 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f85bc001670 con 0x7f85d4070500 2024-03-30T01:52:10.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.410+0000 7f85d2000640 1 -- 172.21.15.133:0/3125919559 >> v1:172.21.15.133:6789/0 conn(0x7f85d4070500 legacy=0x7f85d40cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:10.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.410+0000 7f85d2000640 1 --2- 172.21.15.133:0/3125919559 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85b8003970 0x7f85b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:10.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.410+0000 7f85d2000640 1 --2- 172.21.15.133:0/3125919559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85b80047c0 0x7f85b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:10.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.410+0000 7f85d2000640 1 --2- 172.21.15.133:0/3125919559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85b8005180 0x7f85b800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:10.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.410+0000 7f85d2000640 1 -- 172.21.15.133:0/3125919559 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d40cd180 con 0x7f85b8005180 2024-03-30T01:52:10.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.410+0000 7f85d2000640 1 -- 172.21.15.133:0/3125919559 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b800c030 con 0x7f85b80047c0 2024-03-30T01:52:10.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.410+0000 7f85d2000640 1 -- 172.21.15.133:0/3125919559 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b800c1f0 con 0x7f85b8003970 2024-03-30T01:52:10.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.410+0000 7f85d3400640 1 --2- 172.21.15.133:0/3125919559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85b8005180 0x7f85b800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:10.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.410+0000 7f85d2a00640 1 --2- 172.21.15.133:0/3125919559 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85b8003970 0x7f85b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:10.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.410+0000 7f85ca000640 1 --2- 172.21.15.133:0/3125919559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85b80047c0 0x7f85b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:10.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.411+0000 7f85d3400640 1 -- 172.21.15.133:0/3125919559 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85b8003970 msgr2=0x7f85b8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:10.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.411+0000 7f85d3400640 1 --2- 172.21.15.133:0/3125919559 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85b8003970 0x7f85b8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:10.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.411+0000 7f85d3400640 1 -- 172.21.15.133:0/3125919559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85b80047c0 msgr2=0x7f85b8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:10.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.411+0000 7f85d3400640 1 --2- 172.21.15.133:0/3125919559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85b80047c0 0x7f85b8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:10.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.411+0000 7f85d3400640 1 -- 172.21.15.133:0/3125919559 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b8003520 con 0x7f85b8005180 2024-03-30T01:52:10.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.411+0000 7f85ca000640 1 --2- 172.21.15.133:0/3125919559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85b80047c0 0x7f85b8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:10.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.412+0000 7f85d3400640 1 -- 172.21.15.133:0/3125919559 reap_dead start 2024-03-30T01:52:10.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.412+0000 7f85d3400640 1 --2- 172.21.15.133:0/3125919559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85b8005180 0x7f85b800b980 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f85cc001e20 tx=0x7f85b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9124fcbce208260f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:10.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.412+0000 7f85d2000640 1 -- 172.21.15.133:0/3125919559 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc003b70 con 0x7f85b8005180 2024-03-30T01:52:10.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.412+0000 7f85d2000640 1 -- 172.21.15.133:0/3125919559 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85cc003cd0 con 0x7f85b8005180 2024-03-30T01:52:10.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.412+0000 7f85d2000640 1 -- 172.21.15.133:0/3125919559 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc005310 con 0x7f85b8005180 2024-03-30T01:52:10.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.413+0000 7f85d9e00640 1 -- 172.21.15.133:0/3125919559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85b8005180 msgr2=0x7f85b800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:10.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.413+0000 7f85d9e00640 1 --2- 172.21.15.133:0/3125919559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85b8005180 0x7f85b800b980 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f85cc001e20 tx=0x7f85b80057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:10.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.413+0000 7f85d9e00640 1 -- 172.21.15.133:0/3125919559 shutdown_connections 2024-03-30T01:52:10.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.413+0000 7f85d9e00640 1 --2- 172.21.15.133:0/3125919559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85b8005180 0x7f85b800b980 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:10.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.413+0000 7f85d9e00640 1 -- 172.21.15.133:0/3125919559 >> 172.21.15.133:0/3125919559 conn(0x7f85d40b07a0 msgr2=0x7f85d40b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:10.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.413+0000 7f85d9e00640 1 -- 172.21.15.133:0/3125919559 shutdown_connections 2024-03-30T01:52:10.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.413+0000 7f85d9e00640 1 -- 172.21.15.133:0/3125919559 wait complete. 2024-03-30T01:52:10.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.414+0000 7f85d9e00640 1 Processor -- start 2024-03-30T01:52:10.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.414+0000 7f85d9e00640 1 -- start start 2024-03-30T01:52:10.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.415+0000 7f85d9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85b8005180 0x7f85d41f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:10.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.415+0000 7f85d9e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85d40c3aa0 0x7f85d415cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:10.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.415+0000 7f85d9e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85d40c3f00 0x7f85d415d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:10.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.415+0000 7f85d9e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d415c990 con 0x7f85b8005180 2024-03-30T01:52:10.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.415+0000 7f85d9e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d41f35e0 con 0x7f85d40c3aa0 2024-03-30T01:52:10.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.415+0000 7f85d9e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d415bd10 con 0x7f85d40c3f00 2024-03-30T01:52:10.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.416+0000 7f85d2a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85b8005180 0x7f85d41f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:10.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.416+0000 7f85d2a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85b8005180 0x7f85d41f30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55352/0 (socket says 172.21.15.133:55352) 2024-03-30T01:52:10.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.416+0000 7f85d2a00640 1 -- 172.21.15.133:0/1781526137 learned_addr learned my addr 172.21.15.133:0/1781526137 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:10.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.416+0000 7f85ca000640 1 --2- 172.21.15.133:0/1781526137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85d40c3aa0 0x7f85d415cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:10.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.416+0000 7f85d2a00640 1 -- 172.21.15.133:0/1781526137 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85d40c3f00 msgr2=0x7f85d415d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:10.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.416+0000 7f85d2a00640 1 --2- 172.21.15.133:0/1781526137 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85d40c3f00 0x7f85d415d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:10.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.416+0000 7f85d2a00640 1 -- 172.21.15.133:0/1781526137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85d40c3aa0 msgr2=0x7f85d415cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:10.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.416+0000 7f85d2a00640 1 --2- 172.21.15.133:0/1781526137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85d40c3aa0 0x7f85d415cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:10.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.416+0000 7f85d2a00640 1 -- 172.21.15.133:0/1781526137 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d415bff0 con 0x7f85b8005180 2024-03-30T01:52:10.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.416+0000 7f85ca000640 1 --2- 172.21.15.133:0/1781526137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85d40c3aa0 0x7f85d415cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:10.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.416+0000 7f85d2a00640 1 --2- 172.21.15.133:0/1781526137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85b8005180 0x7f85d41f30a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f85c4011540 tx=0x7f85c4011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:10.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.417+0000 7f85cbe00640 1 -- 172.21.15.133:0/1781526137 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c4015930 con 0x7f85b8005180 2024-03-30T01:52:10.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.417+0000 7f85cbe00640 1 -- 172.21.15.133:0/1781526137 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c4015a90 con 0x7f85b8005180 2024-03-30T01:52:10.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.417+0000 7f85cbe00640 1 -- 172.21.15.133:0/1781526137 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c4015e20 con 0x7f85b8005180 2024-03-30T01:52:10.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.417+0000 7f85d9e00640 1 -- 172.21.15.133:0/1781526137 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d415c2d0 con 0x7f85b8005180 2024-03-30T01:52:10.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.417+0000 7f85d9e00640 1 -- 172.21.15.133:0/1781526137 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d415d830 con 0x7f85b8005180 2024-03-30T01:52:10.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.418+0000 7f85d9e00640 1 -- 172.21.15.133:0/1781526137 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d4066d80 con 0x7f85b8005180 2024-03-30T01:52:10.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.419+0000 7f85cbe00640 1 -- 172.21.15.133:0/1781526137 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f85c400f460 con 0x7f85b8005180 2024-03-30T01:52:10.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.420+0000 7f85cbe00640 1 --2- 172.21.15.133:0/1781526137 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f85b006ac30 0x7f85b006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:10.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.420+0000 7f85cbe00640 1 -- 172.21.15.133:0/1781526137 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85c4089a80 con 0x7f85b8005180 2024-03-30T01:52:10.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.420+0000 7f85ca000640 1 --2- 172.21.15.133:0/1781526137 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f85b006ac30 0x7f85b006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:10.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.421+0000 7f85ca000640 1 --2- 172.21.15.133:0/1781526137 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f85b006ac30 0x7f85b006d0f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f85bc001eb0 tx=0x7f85bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:10.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.425+0000 7f85cbe00640 1 -- 172.21.15.133:0/1781526137 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f85c4054cf0 con 0x7f85b8005180 2024-03-30T01:52:10.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.621+0000 7f85d9e00640 1 -- 172.21.15.133:0/1781526137 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f85d40b0dd0 con 0x7f85b8005180 2024-03-30T01:52:10.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.622+0000 7f85cbe00640 1 -- 172.21.15.133:0/1781526137 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f85c4058310 con 0x7f85b8005180 2024-03-30T01:52:10.629 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-03-30T01:52:10.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.625+0000 7f85d9e00640 1 -- 172.21.15.133:0/1781526137 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f85b006ac30 msgr2=0x7f85b006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:10.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.625+0000 7f85d9e00640 1 --2- 172.21.15.133:0/1781526137 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f85b006ac30 0x7f85b006d0f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f85bc001eb0 tx=0x7f85bc009040 comp rx=0 tx=0).stop 2024-03-30T01:52:10.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.625+0000 7f85d9e00640 1 -- 172.21.15.133:0/1781526137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85b8005180 msgr2=0x7f85d41f30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:10.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.625+0000 7f85d9e00640 1 --2- 172.21.15.133:0/1781526137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85b8005180 0x7f85d41f30a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f85c4011540 tx=0x7f85c4011a00 comp rx=0 tx=0).stop 2024-03-30T01:52:10.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.625+0000 7f85d9e00640 1 -- 172.21.15.133:0/1781526137 shutdown_connections 2024-03-30T01:52:10.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.625+0000 7f85d9e00640 1 --2- 172.21.15.133:0/1781526137 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f85b006ac30 0x7f85b006d0f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:10.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.625+0000 7f85d9e00640 1 --2- 172.21.15.133:0/1781526137 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85d40c3f00 0x7f85d415d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:10.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.625+0000 7f85d9e00640 1 --2- 172.21.15.133:0/1781526137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85d40c3aa0 0x7f85d415cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:10.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.625+0000 7f85d9e00640 1 --2- 172.21.15.133:0/1781526137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85b8005180 0x7f85d41f30a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:10.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.625+0000 7f85d9e00640 1 -- 172.21.15.133:0/1781526137 >> 172.21.15.133:0/1781526137 conn(0x7f85d40b07a0 msgr2=0x7f85d40ae530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:10.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.625+0000 7f85d9e00640 1 -- 172.21.15.133:0/1781526137 shutdown_connections 2024-03-30T01:52:10.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.625+0000 7f85d9e00640 1 -- 172.21.15.133:0/1781526137 wait complete. 2024-03-30T01:52:10.649 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T01:52:10.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.846+0000 7f97a3e00640 1 Processor -- start 2024-03-30T01:52:10.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.846+0000 7f97a3e00640 1 -- start start 2024-03-30T01:52:10.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.847+0000 7f97a3e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f97a415cac0 0x7f97a4160670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:10.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.848+0000 7f97a3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97a4160bb0 0x7f97a40cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:10.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.848+0000 7f97a3e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a40ce030 con 0x7f97a40cdbe0 2024-03-30T01:52:10.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.848+0000 7f97a3e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a40d1020 con 0x7f97a415cac0 2024-03-30T01:52:10.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.848+0000 7f97a3e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a40b5b50 con 0x7f97a4160bb0 2024-03-30T01:52:10.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.848+0000 7f97a2a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f97a415cac0 0x7f97a4160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:10.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.848+0000 7f97a2000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97a4160bb0 0x7f97a40cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:10.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.848+0000 7f97a3400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f97a40cdbe0 0x7f97a406b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.133:58972/0 (socket says 172.21.15.133:58972) 2024-03-30T01:52:10.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.848+0000 7f97a3400640 1 -- 172.21.15.133:0/1090658547 learned_addr learned my addr 172.21.15.133:0/1090658547 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:10.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.849+0000 7f97a2a00640 1 -- 172.21.15.133:0/1090658547 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97a4160bb0 msgr2=0x7f97a40cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:10.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.849+0000 7f97a2a00640 1 --2- 172.21.15.133:0/1090658547 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97a4160bb0 0x7f97a40cd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:10.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.849+0000 7f97a2a00640 1 -- 172.21.15.133:0/1090658547 >> v1:172.21.15.137:6789/0 conn(0x7f97a40cdbe0 legacy=0x7f97a406b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:10.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.849+0000 7f97a2a00640 1 -- 172.21.15.133:0/1090658547 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a4161100 con 0x7f97a415cac0 2024-03-30T01:52:10.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.850+0000 7f97a2a00640 1 --2- 172.21.15.133:0/1090658547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97a415cac0 0x7f97a4160670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f97940097a0 tx=0x7f979402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63dd31ef0e82c04 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:10.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.851+0000 7f97a1600640 1 -- 172.21.15.133:0/1090658547 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9794031830 con 0x7f97a415cac0 2024-03-30T01:52:10.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.851+0000 7f97a1600640 1 -- 172.21.15.133:0/1090658547 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9794031990 con 0x7f97a415cac0 2024-03-30T01:52:10.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.851+0000 7f97a1600640 1 -- 172.21.15.133:0/1090658547 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9794031d20 con 0x7f97a415cac0 2024-03-30T01:52:10.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.852+0000 7f97a3e00640 1 -- 172.21.15.133:0/1090658547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97a415cac0 msgr2=0x7f97a4160670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:10.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.852+0000 7f97a3e00640 1 --2- 172.21.15.133:0/1090658547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97a415cac0 0x7f97a4160670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f97940097a0 tx=0x7f979402b8d0 comp rx=0 tx=0).stop 2024-03-30T01:52:10.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.852+0000 7f97a3e00640 1 -- 172.21.15.133:0/1090658547 shutdown_connections 2024-03-30T01:52:10.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.852+0000 7f97a3e00640 1 --2- 172.21.15.133:0/1090658547 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97a4160bb0 0x7f97a40cd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:10.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.852+0000 7f97a3e00640 1 --2- 172.21.15.133:0/1090658547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97a415cac0 0x7f97a4160670 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:10.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.852+0000 7f97a3e00640 1 -- 172.21.15.133:0/1090658547 >> 172.21.15.133:0/1090658547 conn(0x7f97a40cf770 msgr2=0x7f97a40cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:10.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.852+0000 7f97a3e00640 1 -- 172.21.15.133:0/1090658547 shutdown_connections 2024-03-30T01:52:10.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.852+0000 7f97a3e00640 1 -- 172.21.15.133:0/1090658547 wait complete. 2024-03-30T01:52:10.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.853+0000 7f97a3e00640 1 Processor -- start 2024-03-30T01:52:10.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.854+0000 7f97a3e00640 1 -- start start 2024-03-30T01:52:10.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.854+0000 7f97a3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97a40cdbe0 0x7f97a414b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:10.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.854+0000 7f97a3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97a415cac0 0x7f97a415ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:10.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.854+0000 7f97a3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97a4160bb0 0x7f97a40d1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:10.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.854+0000 7f97a3e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a40c9cf0 con 0x7f97a415cac0 2024-03-30T01:52:10.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.854+0000 7f97a3e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a40c99a0 con 0x7f97a4160bb0 2024-03-30T01:52:10.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.854+0000 7f97a3e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a414b950 con 0x7f97a40cdbe0 2024-03-30T01:52:10.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.855+0000 7f97a2000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97a415cac0 0x7f97a415ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:10.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.855+0000 7f97a2000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97a415cac0 0x7f97a415ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55362/0 (socket says 172.21.15.133:55362) 2024-03-30T01:52:10.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.855+0000 7f97a2000640 1 -- 172.21.15.133:0/70169415 learned_addr learned my addr 172.21.15.133:0/70169415 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:10.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.855+0000 7f97a3400640 1 --2- 172.21.15.133:0/70169415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97a4160bb0 0x7f97a40d1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:10.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.855+0000 7f97a2a00640 1 --2- 172.21.15.133:0/70169415 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97a40cdbe0 0x7f97a414b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:10.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.855+0000 7f97a2000640 1 -- 172.21.15.133:0/70169415 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97a40cdbe0 msgr2=0x7f97a414b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:10.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.855+0000 7f97a2000640 1 --2- 172.21.15.133:0/70169415 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97a40cdbe0 0x7f97a414b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:10.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.855+0000 7f97a2000640 1 -- 172.21.15.133:0/70169415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97a4160bb0 msgr2=0x7f97a40d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:10.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.855+0000 7f97a2000640 1 --2- 172.21.15.133:0/70169415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97a4160bb0 0x7f97a40d1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:10.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.855+0000 7f97a2000640 1 -- 172.21.15.133:0/70169415 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9794009400 con 0x7f97a415cac0 2024-03-30T01:52:10.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.855+0000 7f97a2a00640 1 --2- 172.21.15.133:0/70169415 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97a40cdbe0 0x7f97a414b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:10.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.855+0000 7f97a3400640 1 --2- 172.21.15.133:0/70169415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97a4160bb0 0x7f97a40d1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:10.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.855+0000 7f97a2000640 1 --2- 172.21.15.133:0/70169415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97a415cac0 0x7f97a415ebc0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f979000e870 tx=0x7f979000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:10.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.856+0000 7f979aa00640 1 -- 172.21.15.133:0/70169415 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97900094f0 con 0x7f97a415cac0 2024-03-30T01:52:10.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.856+0000 7f979aa00640 1 -- 172.21.15.133:0/70169415 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979000c940 con 0x7f97a415cac0 2024-03-30T01:52:10.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.856+0000 7f979aa00640 1 -- 172.21.15.133:0/70169415 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979000ccf0 con 0x7f97a415cac0 2024-03-30T01:52:10.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.856+0000 7f97a3e00640 1 -- 172.21.15.133:0/70169415 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a415d020 con 0x7f97a415cac0 2024-03-30T01:52:10.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.856+0000 7f97a3e00640 1 -- 172.21.15.133:0/70169415 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a415f870 con 0x7f97a415cac0 2024-03-30T01:52:10.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.857+0000 7f97a3e00640 1 -- 172.21.15.133:0/70169415 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a4073750 con 0x7f97a415cac0 2024-03-30T01:52:10.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.858+0000 7f979aa00640 1 -- 172.21.15.133:0/70169415 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9790013470 con 0x7f97a415cac0 2024-03-30T01:52:10.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.859+0000 7f979aa00640 1 --2- 172.21.15.133:0/70169415 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f978406ac00 0x7f978406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:10.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.859+0000 7f979aa00640 1 -- 172.21.15.133:0/70169415 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9790089430 con 0x7f97a415cac0 2024-03-30T01:52:10.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.859+0000 7f97a2a00640 1 --2- 172.21.15.133:0/70169415 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f978406ac00 0x7f978406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:10.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.859+0000 7f97a2a00640 1 --2- 172.21.15.133:0/70169415 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f978406ac00 0x7f978406d0c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9794036000 tx=0x7f9794008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:10.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:10.863+0000 7f979aa00640 1 -- 172.21.15.133:0/70169415 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f9790054620 con 0x7f97a415cac0 2024-03-30T01:52:11.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.042+0000 7f97a3e00640 1 -- 172.21.15.133:0/70169415 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f97a40d0570 con 0x7f97a415cac0 2024-03-30T01:52:11.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.043+0000 7f979aa00640 1 -- 172.21.15.133:0/70169415 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9790057c40 con 0x7f97a415cac0 2024-03-30T01:52:11.049 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-03-30T01:52:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.045+0000 7f97a3e00640 1 -- 172.21.15.133:0/70169415 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f978406ac00 msgr2=0x7f978406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.045+0000 7f97a3e00640 1 --2- 172.21.15.133:0/70169415 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f978406ac00 0x7f978406d0c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9794036000 tx=0x7f9794008030 comp rx=0 tx=0).stop 2024-03-30T01:52:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.045+0000 7f97a3e00640 1 -- 172.21.15.133:0/70169415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97a415cac0 msgr2=0x7f97a415ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.045+0000 7f97a3e00640 1 --2- 172.21.15.133:0/70169415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97a415cac0 0x7f97a415ebc0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f979000e870 tx=0x7f979000ed30 comp rx=0 tx=0).stop 2024-03-30T01:52:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.045+0000 7f97a3e00640 1 -- 172.21.15.133:0/70169415 shutdown_connections 2024-03-30T01:52:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.045+0000 7f97a3e00640 1 --2- 172.21.15.133:0/70169415 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f978406ac00 0x7f978406d0c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.045+0000 7f97a3e00640 1 --2- 172.21.15.133:0/70169415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97a4160bb0 0x7f97a40d1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.045+0000 7f97a3e00640 1 --2- 172.21.15.133:0/70169415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97a415cac0 0x7f97a415ebc0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.045+0000 7f97a3e00640 1 --2- 172.21.15.133:0/70169415 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97a40cdbe0 0x7f97a414b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.045+0000 7f97a3e00640 1 -- 172.21.15.133:0/70169415 >> 172.21.15.133:0/70169415 conn(0x7f97a40cf770 msgr2=0x7f97a406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.046+0000 7f97a3e00640 1 -- 172.21.15.133:0/70169415 shutdown_connections 2024-03-30T01:52:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.046+0000 7f97a3e00640 1 -- 172.21.15.133:0/70169415 wait complete. 2024-03-30T01:52:11.069 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T01:52:11.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.263+0000 7fb1eb000640 1 Processor -- start 2024-03-30T01:52:11.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.263+0000 7fb1eb000640 1 -- start start 2024-03-30T01:52:11.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.265+0000 7fb1eb000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb1e40b1640 0x7fb1e4070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:11.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.265+0000 7fb1eb000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb1e4071100 0x7fb1e406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:11.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.265+0000 7fb1eb000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e40cbfd0 con 0x7fb1e40cbbf0 2024-03-30T01:52:11.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.265+0000 7fb1eb000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e40cdbe0 con 0x7fb1e40b1640 2024-03-30T01:52:11.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.265+0000 7fb1eb000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e4070730 con 0x7fb1e4071100 2024-03-30T01:52:11.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.265+0000 7fb1e9200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb1e40b1640 0x7fb1e4070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:11.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.265+0000 7fb1e9200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb1e40b1640 0x7fb1e4070bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55372/0 (socket says 172.21.15.133:55372) 2024-03-30T01:52:11.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.265+0000 7fb1e9200640 1 -- 172.21.15.133:0/3825685516 learned_addr learned my addr 172.21.15.133:0/3825685516 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:11.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.265+0000 7fb1ea600640 1 --2- 172.21.15.133:0/3825685516 >> v2:172.21.15.137:3300/0 conn(0x7fb1e4071100 0x7fb1e406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:11.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.265+0000 7fb1e9200640 1 -- 172.21.15.133:0/3825685516 >> v2:172.21.15.137:3300/0 conn(0x7fb1e4071100 msgr2=0x7fb1e406d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:11.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.265+0000 7fb1e9200640 1 --2- 172.21.15.133:0/3825685516 >> v2:172.21.15.137:3300/0 conn(0x7fb1e4071100 0x7fb1e406d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.265+0000 7fb1e9200640 1 -- 172.21.15.133:0/3825685516 >> v1:172.21.15.137:6789/0 conn(0x7fb1e40cbbf0 legacy=0x7fb1e40cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:11.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.265+0000 7fb1e9200640 1 -- 172.21.15.133:0/3825685516 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e40ce3c0 con 0x7fb1e40b1640 2024-03-30T01:52:11.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.266+0000 7fb1e9200640 1 --2- 172.21.15.133:0/3825685516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1e40b1640 0x7fb1e4070bc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb1e406abe0 tx=0x7fb1d002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbdf478d9044cbd server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:11.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.267+0000 7fb1e3e00640 1 -- 172.21.15.133:0/3825685516 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0031870 con 0x7fb1e40b1640 2024-03-30T01:52:11.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.267+0000 7fb1e3e00640 1 -- 172.21.15.133:0/3825685516 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d00319d0 con 0x7fb1e40b1640 2024-03-30T01:52:11.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.267+0000 7fb1e3e00640 1 -- 172.21.15.133:0/3825685516 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0031d60 con 0x7fb1e40b1640 2024-03-30T01:52:11.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.267+0000 7fb1eb000640 1 -- 172.21.15.133:0/3825685516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1e40b1640 msgr2=0x7fb1e4070bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:11.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.267+0000 7fb1eb000640 1 --2- 172.21.15.133:0/3825685516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1e40b1640 0x7fb1e4070bc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb1e406abe0 tx=0x7fb1d002b910 comp rx=0 tx=0).stop 2024-03-30T01:52:11.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.267+0000 7fb1eb000640 1 -- 172.21.15.133:0/3825685516 shutdown_connections 2024-03-30T01:52:11.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.267+0000 7fb1eb000640 1 --2- 172.21.15.133:0/3825685516 >> v2:172.21.15.137:3300/0 conn(0x7fb1e4071100 0x7fb1e406d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.267+0000 7fb1eb000640 1 --2- 172.21.15.133:0/3825685516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1e40b1640 0x7fb1e4070bc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.267+0000 7fb1eb000640 1 -- 172.21.15.133:0/3825685516 >> 172.21.15.133:0/3825685516 conn(0x7fb1e4066080 msgr2=0x7fb1e4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:11.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.268+0000 7fb1eb000640 1 -- 172.21.15.133:0/3825685516 shutdown_connections 2024-03-30T01:52:11.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.268+0000 7fb1eb000640 1 -- 172.21.15.133:0/3825685516 wait complete. 2024-03-30T01:52:11.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.270+0000 7fb1eb000640 1 Processor -- start 2024-03-30T01:52:11.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.270+0000 7fb1eb000640 1 -- start start 2024-03-30T01:52:11.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.271+0000 7fb1eb000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1e40b1640 0x7fb1e4158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:11.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.271+0000 7fb1eb000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1e40cbbf0 0x7fb1e41561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:11.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.271+0000 7fb1eb000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1e41410f0 0x7fb1e41415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:11.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.271+0000 7fb1eb000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e4166850 con 0x7fb1e40b1640 2024-03-30T01:52:11.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.271+0000 7fb1eb000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40c3f90 con 0x7fb1e40cbbf0 2024-03-30T01:52:11.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.271+0000 7fb1eb000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40c4210 con 0x7fb1e41410f0 2024-03-30T01:52:11.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.271+0000 7fb1e9c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1e40b1640 0x7fb1e4158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:11.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.271+0000 7fb1e9c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1e40b1640 0x7fb1e4158ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55384/0 (socket says 172.21.15.133:55384) 2024-03-30T01:52:11.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.271+0000 7fb1e9c00640 1 -- 172.21.15.133:0/3580362001 learned_addr learned my addr 172.21.15.133:0/3580362001 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.272+0000 7fb1e9c00640 1 -- 172.21.15.133:0/3580362001 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1e41410f0 msgr2=0x7fb1e41415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.272+0000 7fb1e9c00640 1 --2- 172.21.15.133:0/3580362001 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1e41410f0 0x7fb1e41415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.272+0000 7fb1e9c00640 1 -- 172.21.15.133:0/3580362001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1e40cbbf0 msgr2=0x7fb1e41561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.272+0000 7fb1e9c00640 1 --2- 172.21.15.133:0/3580362001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1e40cbbf0 0x7fb1e41561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.272+0000 7fb1e9c00640 1 -- 172.21.15.133:0/3580362001 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d00094d0 con 0x7fb1e40b1640 2024-03-30T01:52:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.272+0000 7fb1e9c00640 1 --2- 172.21.15.133:0/3580362001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1e40b1640 0x7fb1e4158ea0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb1d800b3f0 tx=0x7fb1d800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.272+0000 7fb1e1600640 1 -- 172.21.15.133:0/3580362001 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8011830 con 0x7fb1e40b1640 2024-03-30T01:52:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.272+0000 7fb1e1600640 1 -- 172.21.15.133:0/3580362001 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d8011990 con 0x7fb1e40b1640 2024-03-30T01:52:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.272+0000 7fb1eb000640 1 -- 172.21.15.133:0/3580362001 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e40c44f0 con 0x7fb1e40b1640 2024-03-30T01:52:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.272+0000 7fb1e1600640 1 -- 172.21.15.133:0/3580362001 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8011d40 con 0x7fb1e40b1640 2024-03-30T01:52:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.272+0000 7fb1eb000640 1 -- 172.21.15.133:0/3580362001 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e40c4ab0 con 0x7fb1e40b1640 2024-03-30T01:52:11.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.273+0000 7fb1eb000640 1 -- 172.21.15.133:0/3580362001 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e406ac70 con 0x7fb1e40b1640 2024-03-30T01:52:11.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.274+0000 7fb1e1600640 1 -- 172.21.15.133:0/3580362001 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb1d801a400 con 0x7fb1e40b1640 2024-03-30T01:52:11.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.275+0000 7fb1e1600640 1 --2- 172.21.15.133:0/3580362001 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb1c406ac30 0x7fb1c406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:11.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.275+0000 7fb1e1600640 1 -- 172.21.15.133:0/3580362001 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1d80891a0 con 0x7fb1e40b1640 2024-03-30T01:52:11.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.275+0000 7fb1e9200640 1 --2- 172.21.15.133:0/3580362001 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb1c406ac30 0x7fb1c406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.276+0000 7fb1e9200640 1 --2- 172.21.15.133:0/3580362001 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb1c406ac30 0x7fb1c406d0f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0036000 tx=0x7fb1d0030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:11.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.280+0000 7fb1e1600640 1 -- 172.21.15.133:0/3580362001 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fb1d8054420 con 0x7fb1e40b1640 2024-03-30T01:52:11.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.456+0000 7fb1eb000640 1 -- 172.21.15.133:0/3580362001 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb1e4073750 con 0x7fb1e40b1640 2024-03-30T01:52:11.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.457+0000 7fb1e1600640 1 -- 172.21.15.133:0/3580362001 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb1d8057a40 con 0x7fb1e40b1640 2024-03-30T01:52:11.464 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-03-30T01:52:11.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.460+0000 7fb1eb000640 1 -- 172.21.15.133:0/3580362001 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb1c406ac30 msgr2=0x7fb1c406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:11.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.460+0000 7fb1eb000640 1 --2- 172.21.15.133:0/3580362001 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb1c406ac30 0x7fb1c406d0f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0036000 tx=0x7fb1d0030000 comp rx=0 tx=0).stop 2024-03-30T01:52:11.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.460+0000 7fb1eb000640 1 -- 172.21.15.133:0/3580362001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1e40b1640 msgr2=0x7fb1e4158ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:11.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.460+0000 7fb1eb000640 1 --2- 172.21.15.133:0/3580362001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1e40b1640 0x7fb1e4158ea0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb1d800b3f0 tx=0x7fb1d800b8b0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.460+0000 7fb1eb000640 1 -- 172.21.15.133:0/3580362001 shutdown_connections 2024-03-30T01:52:11.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.460+0000 7fb1eb000640 1 --2- 172.21.15.133:0/3580362001 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb1c406ac30 0x7fb1c406d0f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.460+0000 7fb1eb000640 1 --2- 172.21.15.133:0/3580362001 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1e41410f0 0x7fb1e41415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.460+0000 7fb1eb000640 1 --2- 172.21.15.133:0/3580362001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1e40cbbf0 0x7fb1e41561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.460+0000 7fb1eb000640 1 --2- 172.21.15.133:0/3580362001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1e40b1640 0x7fb1e4158ea0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.460+0000 7fb1eb000640 1 -- 172.21.15.133:0/3580362001 >> 172.21.15.133:0/3580362001 conn(0x7fb1e4066080 msgr2=0x7fb1e415a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:11.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.460+0000 7fb1eb000640 1 -- 172.21.15.133:0/3580362001 shutdown_connections 2024-03-30T01:52:11.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.460+0000 7fb1eb000640 1 -- 172.21.15.133:0/3580362001 wait complete. 2024-03-30T01:52:11.483 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:52:11.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.676+0000 7f2b85000640 1 Processor -- start 2024-03-30T01:52:11.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.676+0000 7f2b85000640 1 -- start start 2024-03-30T01:52:11.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.678+0000 7f2b85000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b8015cc50 0x7f2b800d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:11.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.678+0000 7f2b85000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2b800d2240 0x7f2b800cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:11.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.678+0000 7f2b85000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2b800cf9b0 0x7f2b800b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:11.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.678+0000 7f2b85000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b800d1c50 con 0x7f2b800cf9b0 2024-03-30T01:52:11.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.678+0000 7f2b85000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b8015d030 con 0x7f2b800d2240 2024-03-30T01:52:11.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.678+0000 7f2b85000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b800cfe40 con 0x7f2b8015cc50 2024-03-30T01:52:11.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.678+0000 7f2b7e800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2b800cf9b0 0x7f2b800b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:11.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.678+0000 7f2b7e800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2b800cf9b0 0x7f2b800b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55386/0 (socket says 172.21.15.133:55386) 2024-03-30T01:52:11.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.678+0000 7f2b7e800640 1 -- 172.21.15.133:0/1691453483 learned_addr learned my addr 172.21.15.133:0/1691453483 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:11.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.678+0000 7f2b7de00640 1 --2- 172.21.15.133:0/1691453483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b8015cc50 0x7f2b800d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:11.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.678+0000 7f2b75400640 1 --2- 172.21.15.133:0/1691453483 >> v2:172.21.15.137:3300/0 conn(0x7f2b800d2240 0x7f2b800cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:11.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.679+0000 7f2b7e800640 1 -- 172.21.15.133:0/1691453483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b8015cc50 msgr2=0x7f2b800d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:11.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.679+0000 7f2b7e800640 1 --2- 172.21.15.133:0/1691453483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b8015cc50 0x7f2b800d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.679+0000 7f2b7e800640 1 -- 172.21.15.133:0/1691453483 >> v2:172.21.15.137:3300/0 conn(0x7f2b800d2240 msgr2=0x7f2b800cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:11.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.679+0000 7f2b7e800640 1 --2- 172.21.15.133:0/1691453483 >> v2:172.21.15.137:3300/0 conn(0x7f2b800d2240 0x7f2b800cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.679+0000 7f2b7e800640 1 -- 172.21.15.133:0/1691453483 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b800b5af0 con 0x7f2b800cf9b0 2024-03-30T01:52:11.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.680+0000 7f2b7e800640 1 --2- 172.21.15.133:0/1691453483 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b800cf9b0 0x7f2b800b14f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2b800d3b20 tx=0x7f2b7802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5660b8d7f68d55a3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:11.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.680+0000 7f2b7d400640 1 -- 172.21.15.133:0/1691453483 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7802ca70 con 0x7f2b800cf9b0 2024-03-30T01:52:11.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.680+0000 7f2b7d400640 1 -- 172.21.15.133:0/1691453483 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7802cbd0 con 0x7f2b800cf9b0 2024-03-30T01:52:11.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.680+0000 7f2b7d400640 1 -- 172.21.15.133:0/1691453483 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b780343f0 con 0x7f2b800cf9b0 2024-03-30T01:52:11.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.680+0000 7f2b85000640 1 -- 172.21.15.133:0/1691453483 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b800cf9b0 msgr2=0x7f2b800b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:11.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.680+0000 7f2b85000640 1 --2- 172.21.15.133:0/1691453483 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b800cf9b0 0x7f2b800b14f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2b800d3b20 tx=0x7f2b7802bed0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.681+0000 7f2b85000640 1 -- 172.21.15.133:0/1691453483 shutdown_connections 2024-03-30T01:52:11.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.681+0000 7f2b85000640 1 --2- 172.21.15.133:0/1691453483 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b800cf9b0 0x7f2b800b14f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.681+0000 7f2b85000640 1 --2- 172.21.15.133:0/1691453483 >> v2:172.21.15.137:3300/0 conn(0x7f2b800d2240 0x7f2b800cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.681+0000 7f2b85000640 1 --2- 172.21.15.133:0/1691453483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b8015cc50 0x7f2b800d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.681+0000 7f2b85000640 1 -- 172.21.15.133:0/1691453483 >> 172.21.15.133:0/1691453483 conn(0x7f2b80071a40 msgr2=0x7f2b8006b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:11.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.681+0000 7f2b85000640 1 -- 172.21.15.133:0/1691453483 shutdown_connections 2024-03-30T01:52:11.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.681+0000 7f2b85000640 1 -- 172.21.15.133:0/1691453483 wait complete. 2024-03-30T01:52:11.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.682+0000 7f2b85000640 1 Processor -- start 2024-03-30T01:52:11.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.683+0000 7f2b85000640 1 -- start start 2024-03-30T01:52:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.683+0000 7f2b85000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b800cf9b0 0x7f2b800c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.683+0000 7f2b85000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b800d2240 0x7f2b800b75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.683+0000 7f2b85000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b8015cc50 0x7f2b800b7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.683+0000 7f2b85000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b800c8f40 con 0x7f2b800d2240 2024-03-30T01:52:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.683+0000 7f2b85000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b80159450 con 0x7f2b8015cc50 2024-03-30T01:52:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.683+0000 7f2b85000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b80158110 con 0x7f2b800cf9b0 2024-03-30T01:52:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.684+0000 7f2b75400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b800d2240 0x7f2b800b75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.684+0000 7f2b75400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b800d2240 0x7f2b800b75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55392/0 (socket says 172.21.15.133:55392) 2024-03-30T01:52:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.684+0000 7f2b75400640 1 -- 172.21.15.133:0/3197421727 learned_addr learned my addr 172.21.15.133:0/3197421727 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.684+0000 7f2b75400640 1 -- 172.21.15.133:0/3197421727 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b800cf9b0 msgr2=0x7f2b800c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.684+0000 7f2b75400640 1 --2- 172.21.15.133:0/3197421727 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b800cf9b0 0x7f2b800c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.684+0000 7f2b75400640 1 -- 172.21.15.133:0/3197421727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b8015cc50 msgr2=0x7f2b800b7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.684+0000 7f2b75400640 1 --2- 172.21.15.133:0/3197421727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b8015cc50 0x7f2b800b7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.684+0000 7f2b75400640 1 -- 172.21.15.133:0/3197421727 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b78009b30 con 0x7f2b800d2240 2024-03-30T01:52:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.684+0000 7f2b75400640 1 --2- 172.21.15.133:0/3197421727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b800d2240 0x7f2b800b75f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2b6800c820 tx=0x7f2b6800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:11.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.685+0000 7f2b76a00640 1 -- 172.21.15.133:0/3197421727 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b68004220 con 0x7f2b800d2240 2024-03-30T01:52:11.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.685+0000 7f2b76a00640 1 -- 172.21.15.133:0/3197421727 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b680043a0 con 0x7f2b800d2240 2024-03-30T01:52:11.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.685+0000 7f2b76a00640 1 -- 172.21.15.133:0/3197421727 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b68007a70 con 0x7f2b800d2240 2024-03-30T01:52:11.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.685+0000 7f2b85000640 1 -- 172.21.15.133:0/3197421727 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b801583b0 con 0x7f2b800d2240 2024-03-30T01:52:11.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.685+0000 7f2b85000640 1 -- 172.21.15.133:0/3197421727 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b80158970 con 0x7f2b800d2240 2024-03-30T01:52:11.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.686+0000 7f2b85000640 1 -- 172.21.15.133:0/3197421727 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b80066d80 con 0x7f2b800d2240 2024-03-30T01:52:11.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.687+0000 7f2b76a00640 1 -- 172.21.15.133:0/3197421727 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f2b68007bd0 con 0x7f2b800d2240 2024-03-30T01:52:11.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.688+0000 7f2b76a00640 1 --2- 172.21.15.133:0/3197421727 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f2b5c06ac00 0x7f2b5c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:11.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.688+0000 7f2b76a00640 1 -- 172.21.15.133:0/3197421727 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b68089040 con 0x7f2b800d2240 2024-03-30T01:52:11.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.688+0000 7f2b7de00640 1 --2- 172.21.15.133:0/3197421727 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f2b5c06ac00 0x7f2b5c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:11.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.688+0000 7f2b7de00640 1 --2- 172.21.15.133:0/3197421727 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f2b5c06ac00 0x7f2b5c06d0c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2b7000a770 tx=0x7f2b70008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:11.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.692+0000 7f2b76a00640 1 -- 172.21.15.133:0/3197421727 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f2b680542b0 con 0x7f2b800d2240 2024-03-30T01:52:11.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.886+0000 7f2b85000640 1 -- 172.21.15.133:0/3197421727 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b800d0c90 con 0x7f2b800d2240 2024-03-30T01:52:11.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.889+0000 7f2b76a00640 1 -- 172.21.15.133:0/3197421727 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f2b680578d0 con 0x7f2b800d2240 2024-03-30T01:52:11.896 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:11.896 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:51:33.780665+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:51:31.245378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T01:51:31.774247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:52:11.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.892+0000 7f2b85000640 1 -- 172.21.15.133:0/3197421727 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f2b5c06ac00 msgr2=0x7f2b5c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:11.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.892+0000 7f2b85000640 1 --2- 172.21.15.133:0/3197421727 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f2b5c06ac00 0x7f2b5c06d0c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2b7000a770 tx=0x7f2b70008040 comp rx=0 tx=0).stop 2024-03-30T01:52:11.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.892+0000 7f2b85000640 1 -- 172.21.15.133:0/3197421727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b800d2240 msgr2=0x7f2b800b75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:11.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.892+0000 7f2b85000640 1 --2- 172.21.15.133:0/3197421727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b800d2240 0x7f2b800b75f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2b6800c820 tx=0x7f2b6800cce0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.892+0000 7f2b85000640 1 -- 172.21.15.133:0/3197421727 shutdown_connections 2024-03-30T01:52:11.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.892+0000 7f2b85000640 1 --2- 172.21.15.133:0/3197421727 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f2b5c06ac00 0x7f2b5c06d0c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.892+0000 7f2b85000640 1 --2- 172.21.15.133:0/3197421727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b8015cc50 0x7f2b800b7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.892+0000 7f2b85000640 1 --2- 172.21.15.133:0/3197421727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b800d2240 0x7f2b800b75f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.892+0000 7f2b85000640 1 --2- 172.21.15.133:0/3197421727 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b800cf9b0 0x7f2b800c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:11.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.892+0000 7f2b85000640 1 -- 172.21.15.133:0/3197421727 >> 172.21.15.133:0/3197421727 conn(0x7f2b80071a40 msgr2=0x7f2b8015f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:11.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.892+0000 7f2b85000640 1 -- 172.21.15.133:0/3197421727 shutdown_connections 2024-03-30T01:52:11.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:11.892+0000 7f2b85000640 1 -- 172.21.15.133:0/3197421727 wait complete. 2024-03-30T01:52:11.916 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T01:51:21.771393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T01:51:31.245378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T01:51:31.774247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T01:52:11.917 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T01:52:12.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.118+0000 7fac40400640 1 Processor -- start 2024-03-30T01:52:12.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.118+0000 7fac40400640 1 -- start start 2024-03-30T01:52:12.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.119+0000 7fac40400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac380ccc40 0x7fac38070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:12.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.119+0000 7fac40400640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac380a76a0 con 0x7fac38143790 2024-03-30T01:52:12.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.119+0000 7fac40400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac380b38e0 con 0x7fac38070500 2024-03-30T01:52:12.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.119+0000 7fac40400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac38070ed0 con 0x7fac380ccc40 2024-03-30T01:52:12.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.120+0000 7fac3da00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fac38143790 0x7fac380cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43874/0 (socket says 172.21.15.133:43874) 2024-03-30T01:52:12.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.120+0000 7fac3da00640 1 -- 172.21.15.133:0/3953369215 learned_addr learned my addr 172.21.15.133:0/3953369215 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:12.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.120+0000 7fac3e400640 1 --2- 172.21.15.133:0/3953369215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac380ccc40 0x7fac38070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:12.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.120+0000 7fac37e00640 1 -- 172.21.15.133:0/3953369215 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936628101 0 0) 0x7fac380a76a0 con 0x7fac38143790 2024-03-30T01:52:12.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.120+0000 7fac37e00640 1 -- 172.21.15.133:0/3953369215 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac20003520 con 0x7fac38143790 2024-03-30T01:52:12.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.121+0000 7fac37e00640 1 -- 172.21.15.133:0/3953369215 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 860141832 0 0) 0x7fac20003520 con 0x7fac38143790 2024-03-30T01:52:12.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.121+0000 7fac37e00640 1 -- 172.21.15.133:0/3953369215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac380ccc40 msgr2=0x7fac38070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:12.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.121+0000 7fac37e00640 1 --2- 172.21.15.133:0/3953369215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac380ccc40 0x7fac38070990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.121+0000 7fac37e00640 1 -- 172.21.15.133:0/3953369215 >> v1:172.21.15.137:6789/0 conn(0x7fac38070500 legacy=0x7fac380cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:12.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.121+0000 7fac37e00640 1 -- 172.21.15.133:0/3953369215 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac380cd180 con 0x7fac38143790 2024-03-30T01:52:12.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.121+0000 7fac37e00640 1 -- 172.21.15.133:0/3953369215 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fac2c001670 con 0x7fac38143790 2024-03-30T01:52:12.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.121+0000 7fac37e00640 1 -- 172.21.15.133:0/3953369215 >> v1:172.21.15.133:6789/0 conn(0x7fac38143790 legacy=0x7fac380cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:12.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.121+0000 7fac37e00640 1 --2- 172.21.15.133:0/3953369215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac380ccc40 0x7fac200039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:12.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.121+0000 7fac37e00640 1 --2- 172.21.15.133:0/3953369215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac20003ee0 0x7fac200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:12.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.121+0000 7fac37e00640 1 --2- 172.21.15.133:0/3953369215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac20004d00 0x7fac20005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:12.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.121+0000 7fac37e00640 1 -- 172.21.15.133:0/3953369215 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac38070ed0 con 0x7fac20004d00 2024-03-30T01:52:12.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.121+0000 7fac37e00640 1 -- 172.21.15.133:0/3953369215 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2000ba30 con 0x7fac20003ee0 2024-03-30T01:52:12.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.121+0000 7fac37e00640 1 -- 172.21.15.133:0/3953369215 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2000bbf0 con 0x7fac380ccc40 2024-03-30T01:52:12.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.121+0000 7fac3e400640 1 --2- 172.21.15.133:0/3953369215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac20004d00 0x7fac20005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:12.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.121+0000 7fac3d000640 1 --2- 172.21.15.133:0/3953369215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac20003ee0 0x7fac200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:12.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.122+0000 7fac3e400640 1 -- 172.21.15.133:0/3953369215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac380ccc40 msgr2=0x7fac200039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:12.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.122+0000 7fac3e400640 1 --2- 172.21.15.133:0/3953369215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac380ccc40 0x7fac200039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.122+0000 7fac3e400640 1 -- 172.21.15.133:0/3953369215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac20003ee0 msgr2=0x7fac200047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:12.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.122+0000 7fac3e400640 1 --2- 172.21.15.133:0/3953369215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac20003ee0 0x7fac200047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.122+0000 7fac3e400640 1 -- 172.21.15.133:0/3953369215 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac20003520 con 0x7fac20004d00 2024-03-30T01:52:12.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.122+0000 7fac3d000640 1 --2- 172.21.15.133:0/3953369215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac20003ee0 0x7fac200047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:12.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.123+0000 7fac3e400640 1 --2- 172.21.15.133:0/3953369215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac20004d00 0x7fac20005180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fac30009f90 tx=0x7fac200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac619f53c8e9c2e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:12.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.123+0000 7fac37e00640 1 -- 172.21.15.133:0/3953369215 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3002cc20 con 0x7fac20004d00 2024-03-30T01:52:12.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.123+0000 7fac37e00640 1 -- 172.21.15.133:0/3953369215 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3000f040 con 0x7fac20004d00 2024-03-30T01:52:12.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.123+0000 7fac37e00640 1 -- 172.21.15.133:0/3953369215 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac30034440 con 0x7fac20004d00 2024-03-30T01:52:12.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.124+0000 7fac40400640 1 -- 172.21.15.133:0/3953369215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac20004d00 msgr2=0x7fac20005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:12.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.124+0000 7fac40400640 1 --2- 172.21.15.133:0/3953369215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac20004d00 0x7fac20005180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fac30009f90 tx=0x7fac200057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.124+0000 7fac3e400640 1 -- 172.21.15.133:0/3953369215 reap_dead start 2024-03-30T01:52:12.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.124+0000 7fac40400640 1 -- 172.21.15.133:0/3953369215 shutdown_connections 2024-03-30T01:52:12.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.124+0000 7fac40400640 1 -- 172.21.15.133:0/3953369215 >> 172.21.15.133:0/3953369215 conn(0x7fac380b07a0 msgr2=0x7fac380b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:12.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.124+0000 7fac40400640 1 -- 172.21.15.133:0/3953369215 shutdown_connections 2024-03-30T01:52:12.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.124+0000 7fac40400640 1 -- 172.21.15.133:0/3953369215 wait complete. 2024-03-30T01:52:12.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.126+0000 7fac40400640 1 Processor -- start 2024-03-30T01:52:12.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.126+0000 7fac40400640 1 -- start start 2024-03-30T01:52:12.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.127+0000 7fac40400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac20004d00 0x7fac381f1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:12.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.127+0000 7fac40400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac381f4b00 0x7fac381f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:12.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.127+0000 7fac40400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac380c3830 0x7fac380c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:12.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.127+0000 7fac40400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac380c41f0 con 0x7fac381f4b00 2024-03-30T01:52:12.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.127+0000 7fac40400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3813ba00 con 0x7fac380c3830 2024-03-30T01:52:12.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.127+0000 7fac40400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac381f2f00 con 0x7fac20004d00 2024-03-30T01:52:12.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.127+0000 7fac3d000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac381f4b00 0x7fac381f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:12.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.127+0000 7fac3d000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac381f4b00 0x7fac381f1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55404/0 (socket says 172.21.15.133:55404) 2024-03-30T01:52:12.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.127+0000 7fac3d000640 1 -- 172.21.15.133:0/2409306473 learned_addr learned my addr 172.21.15.133:0/2409306473 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:12.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.127+0000 7fac3d000640 1 -- 172.21.15.133:0/2409306473 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac20004d00 msgr2=0x7fac381f1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:12.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.127+0000 7fac3da00640 1 --2- 172.21.15.133:0/2409306473 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac20004d00 0x7fac381f1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:12.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.127+0000 7fac3d000640 1 --2- 172.21.15.133:0/2409306473 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac20004d00 0x7fac381f1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.127+0000 7fac3d000640 1 -- 172.21.15.133:0/2409306473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac380c3830 msgr2=0x7fac380c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:12.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.127+0000 7fac3d000640 1 --2- 172.21.15.133:0/2409306473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac380c3830 0x7fac380c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.128+0000 7fac3d000640 1 -- 172.21.15.133:0/2409306473 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac381f2560 con 0x7fac381f4b00 2024-03-30T01:52:12.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.128+0000 7fac3d000640 1 --2- 172.21.15.133:0/2409306473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac381f4b00 0x7fac381f1f40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fac2400d820 tx=0x7fac2400dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:12.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.128+0000 7fac35600640 1 -- 172.21.15.133:0/2409306473 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac24005480 con 0x7fac381f4b00 2024-03-30T01:52:12.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.128+0000 7fac35600640 1 -- 172.21.15.133:0/2409306473 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2400de10 con 0x7fac381f4b00 2024-03-30T01:52:12.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.128+0000 7fac35600640 1 -- 172.21.15.133:0/2409306473 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2400b850 con 0x7fac381f4b00 2024-03-30T01:52:12.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.128+0000 7fac40400640 1 -- 172.21.15.133:0/2409306473 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac381f2840 con 0x7fac381f4b00 2024-03-30T01:52:12.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.128+0000 7fac40400640 1 -- 172.21.15.133:0/2409306473 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac3806c280 con 0x7fac381f4b00 2024-03-30T01:52:12.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.129+0000 7fac40400640 1 -- 172.21.15.133:0/2409306473 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac38066d80 con 0x7fac381f4b00 2024-03-30T01:52:12.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.130+0000 7fac35600640 1 -- 172.21.15.133:0/2409306473 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fac2400b9b0 con 0x7fac381f4b00 2024-03-30T01:52:12.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.131+0000 7fac35600640 1 --2- 172.21.15.133:0/2409306473 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fac1806ac00 0x7fac1806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:12.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.132+0000 7fac35600640 1 -- 172.21.15.133:0/2409306473 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac240894b0 con 0x7fac381f4b00 2024-03-30T01:52:12.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.132+0000 7fac3da00640 1 --2- 172.21.15.133:0/2409306473 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fac1806ac00 0x7fac1806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:12.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.132+0000 7fac3da00640 1 --2- 172.21.15.133:0/2409306473 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fac1806ac00 0x7fac1806d0c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0079b0 tx=0x7fac2c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:12.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.136+0000 7fac35600640 1 -- 172.21.15.133:0/2409306473 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fac24058080 con 0x7fac381f4b00 2024-03-30T01:52:12.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.328+0000 7fac40400640 1 -- 172.21.15.133:0/2409306473 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac3806b4e0 con 0x7fac381f4b00 2024-03-30T01:52:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.329+0000 7fac35600640 1 -- 172.21.15.133:0/2409306473 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac24019310 con 0x7fac381f4b00 2024-03-30T01:52:12.335 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-03-30T01:52:12.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.332+0000 7fac40400640 1 -- 172.21.15.133:0/2409306473 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fac1806ac00 msgr2=0x7fac1806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:12.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.332+0000 7fac40400640 1 --2- 172.21.15.133:0/2409306473 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fac1806ac00 0x7fac1806d0c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0079b0 tx=0x7fac2c009040 comp rx=0 tx=0).stop 2024-03-30T01:52:12.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.332+0000 7fac40400640 1 -- 172.21.15.133:0/2409306473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac381f4b00 msgr2=0x7fac381f1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:12.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.332+0000 7fac40400640 1 --2- 172.21.15.133:0/2409306473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac381f4b00 0x7fac381f1f40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fac2400d820 tx=0x7fac2400dce0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.333+0000 7fac40400640 1 -- 172.21.15.133:0/2409306473 shutdown_connections 2024-03-30T01:52:12.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.333+0000 7fac40400640 1 --2- 172.21.15.133:0/2409306473 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fac1806ac00 0x7fac1806d0c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.333+0000 7fac40400640 1 --2- 172.21.15.133:0/2409306473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac380c3830 0x7fac380c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.333+0000 7fac40400640 1 --2- 172.21.15.133:0/2409306473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac381f4b00 0x7fac381f1f40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.333+0000 7fac40400640 1 --2- 172.21.15.133:0/2409306473 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac20004d00 0x7fac381f1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.333+0000 7fac40400640 1 -- 172.21.15.133:0/2409306473 >> 172.21.15.133:0/2409306473 conn(0x7fac380b07a0 msgr2=0x7fac38143b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:12.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.333+0000 7fac40400640 1 -- 172.21.15.133:0/2409306473 shutdown_connections 2024-03-30T01:52:12.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.333+0000 7fac40400640 1 -- 172.21.15.133:0/2409306473 wait complete. 2024-03-30T01:52:12.356 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T01:52:12.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.544+0000 7f86ce600640 1 Processor -- start 2024-03-30T01:52:12.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.544+0000 7f86ce600640 1 -- start start 2024-03-30T01:52:12.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.546+0000 7f86ce600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86c80cfb80 0x7f86c80b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:12.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.546+0000 7f86ce600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c815d030 con 0x7f86c815cc50 2024-03-30T01:52:12.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.546+0000 7f86ce600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c80b5af0 con 0x7f86c80d0af0 2024-03-30T01:52:12.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.546+0000 7f86ce600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80d1c50 con 0x7f86c80cfb80 2024-03-30T01:52:12.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.546+0000 7f86c7400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f86c815cc50 0x7f86c80d2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43886/0 (socket says 172.21.15.133:43886) 2024-03-30T01:52:12.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.546+0000 7f86c7400640 1 -- 172.21.15.133:0/1181536539 learned_addr learned my addr 172.21.15.133:0/1181536539 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:12.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.546+0000 7f86c7e00640 1 --2- 172.21.15.133:0/1181536539 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86c80cfb80 0x7f86c80b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:12.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.546+0000 7f86c6000640 1 -- 172.21.15.133:0/1181536539 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838667082 0 0) 0x7f86c815d030 con 0x7f86c815cc50 2024-03-30T01:52:12.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.546+0000 7f86c6000640 1 -- 172.21.15.133:0/1181536539 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86ac003520 con 0x7f86c815cc50 2024-03-30T01:52:12.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.547+0000 7f86c6000640 1 -- 172.21.15.133:0/1181536539 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 255706081 0 0) 0x7f86ac003520 con 0x7f86c815cc50 2024-03-30T01:52:12.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.547+0000 7f86c6000640 1 -- 172.21.15.133:0/1181536539 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86c80cfb80 msgr2=0x7f86c80b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:12.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.547+0000 7f86c6000640 1 --2- 172.21.15.133:0/1181536539 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86c80cfb80 0x7f86c80b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.547+0000 7f86c6000640 1 -- 172.21.15.133:0/1181536539 >> v1:172.21.15.137:6789/0 conn(0x7f86c80d0af0 legacy=0x7f86c80cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:12.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.547+0000 7f86c6000640 1 -- 172.21.15.133:0/1181536539 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c80d10d0 con 0x7f86c815cc50 2024-03-30T01:52:12.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.547+0000 7f86c6000640 1 -- 172.21.15.133:0/1181536539 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f86b8001670 con 0x7f86c815cc50 2024-03-30T01:52:12.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.547+0000 7f86c6000640 1 -- 172.21.15.133:0/1181536539 >> v1:172.21.15.133:6789/0 conn(0x7f86c815cc50 legacy=0x7f86c80d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:12.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.547+0000 7f86c6000640 1 --2- 172.21.15.133:0/1181536539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86ac0039a0 0x7f86ac003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:12.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.547+0000 7f86c6000640 1 --2- 172.21.15.133:0/1181536539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86ac0047c0 0x7f86ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:12.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.547+0000 7f86c6000640 1 --2- 172.21.15.133:0/1181536539 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86c80cfb80 0x7f86ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:12.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.547+0000 7f86c6000640 1 -- 172.21.15.133:0/1181536539 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80d1c50 con 0x7f86ac0047c0 2024-03-30T01:52:12.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.547+0000 7f86c6000640 1 -- 172.21.15.133:0/1181536539 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac00ba30 con 0x7f86ac0039a0 2024-03-30T01:52:12.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.547+0000 7f86c6000640 1 -- 172.21.15.133:0/1181536539 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac00bbf0 con 0x7f86c80cfb80 2024-03-30T01:52:12.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.547+0000 7f86c6a00640 1 --2- 172.21.15.133:0/1181536539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86ac0047c0 0x7f86ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:12.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.548+0000 7f86c7400640 1 --2- 172.21.15.133:0/1181536539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86ac0039a0 0x7f86ac003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:12.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.548+0000 7f86c6a00640 1 -- 172.21.15.133:0/1181536539 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86c80cfb80 msgr2=0x7f86ac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:12.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.548+0000 7f86c6a00640 1 --2- 172.21.15.133:0/1181536539 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86c80cfb80 0x7f86ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.548+0000 7f86c6a00640 1 -- 172.21.15.133:0/1181536539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86ac0039a0 msgr2=0x7f86ac003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:12.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.548+0000 7f86c6a00640 1 --2- 172.21.15.133:0/1181536539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86ac0039a0 0x7f86ac003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.548+0000 7f86c6a00640 1 -- 172.21.15.133:0/1181536539 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac003520 con 0x7f86ac0047c0 2024-03-30T01:52:12.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.549+0000 7f86c6a00640 1 --2- 172.21.15.133:0/1181536539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86ac0047c0 0x7f86ac004c40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f86b0001720 tx=0x7f86ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ff3b36ed1709bf server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:12.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.549+0000 7f86c6000640 1 -- 172.21.15.133:0/1181536539 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b00052d0 con 0x7f86ac0047c0 2024-03-30T01:52:12.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.549+0000 7f86c6000640 1 -- 172.21.15.133:0/1181536539 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b002e050 con 0x7f86ac0047c0 2024-03-30T01:52:12.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.549+0000 7f86c6000640 1 -- 172.21.15.133:0/1181536539 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b00035f0 con 0x7f86ac0047c0 2024-03-30T01:52:12.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.549+0000 7f86ce600640 1 -- 172.21.15.133:0/1181536539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86ac0047c0 msgr2=0x7f86ac004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:12.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.549+0000 7f86ce600640 1 --2- 172.21.15.133:0/1181536539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86ac0047c0 0x7f86ac004c40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f86b0001720 tx=0x7f86ac0057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.549+0000 7f86c7e00640 1 -- 172.21.15.133:0/1181536539 reap_dead start 2024-03-30T01:52:12.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.549+0000 7f86ce600640 1 -- 172.21.15.133:0/1181536539 shutdown_connections 2024-03-30T01:52:12.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.549+0000 7f86ce600640 1 -- 172.21.15.133:0/1181536539 >> 172.21.15.133:0/1181536539 conn(0x7f86c8071a40 msgr2=0x7f86c806b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:12.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.550+0000 7f86ce600640 1 -- 172.21.15.133:0/1181536539 shutdown_connections 2024-03-30T01:52:12.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.550+0000 7f86ce600640 1 -- 172.21.15.133:0/1181536539 wait complete. 2024-03-30T01:52:12.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.551+0000 7f86ce600640 1 Processor -- start 2024-03-30T01:52:12.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.551+0000 7f86ce600640 1 -- start start 2024-03-30T01:52:12.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.552+0000 7f86ce600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86ac0047c0 0x7f86c81560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:12.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.552+0000 7f86ce600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86c81f5730 0x7f86c81f5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:12.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.552+0000 7f86ce600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86c80cad80 0x7f86c80cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:12.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.552+0000 7f86ce600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80a9470 con 0x7f86ac0047c0 2024-03-30T01:52:12.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.552+0000 7f86ce600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80cb740 con 0x7f86c81f5730 2024-03-30T01:52:12.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.552+0000 7f86ce600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80a99f0 con 0x7f86c80cad80 2024-03-30T01:52:12.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.552+0000 7f86c7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86ac0047c0 0x7f86c81560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:12.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.553+0000 7f86c7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86ac0047c0 0x7f86c81560a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55432/0 (socket says 172.21.15.133:55432) 2024-03-30T01:52:12.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.553+0000 7f86c7400640 1 -- 172.21.15.133:0/2033800561 learned_addr learned my addr 172.21.15.133:0/2033800561 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:12.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.553+0000 7f86c6a00640 1 --2- 172.21.15.133:0/2033800561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86c81f5730 0x7f86c81f5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:12.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.553+0000 7f86c7e00640 1 --2- 172.21.15.133:0/2033800561 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86c80cad80 0x7f86c80cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:12.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.553+0000 7f86c7400640 1 -- 172.21.15.133:0/2033800561 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86c80cad80 msgr2=0x7f86c80cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:12.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.553+0000 7f86c7400640 1 --2- 172.21.15.133:0/2033800561 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86c80cad80 0x7f86c80cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.553+0000 7f86c7400640 1 -- 172.21.15.133:0/2033800561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86c81f5730 msgr2=0x7f86c81f5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:12.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.553+0000 7f86c7400640 1 --2- 172.21.15.133:0/2033800561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86c81f5730 0x7f86c81f5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.553+0000 7f86c7400640 1 -- 172.21.15.133:0/2033800561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c81f61f0 con 0x7f86ac0047c0 2024-03-30T01:52:12.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.553+0000 7f86c7e00640 1 --2- 172.21.15.133:0/2033800561 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86c80cad80 0x7f86c80cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:12.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.553+0000 7f86c6a00640 1 --2- 172.21.15.133:0/2033800561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86c81f5730 0x7f86c81f5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:12.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.553+0000 7f86c7400640 1 --2- 172.21.15.133:0/2033800561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86ac0047c0 0x7f86c81560a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f86b8000ff0 tx=0x7f86b800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:12.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.553+0000 7f86bf400640 1 -- 172.21.15.133:0/2033800561 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b80074e0 con 0x7f86ac0047c0 2024-03-30T01:52:12.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.553+0000 7f86bf400640 1 -- 172.21.15.133:0/2033800561 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b8007640 con 0x7f86ac0047c0 2024-03-30T01:52:12.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.553+0000 7f86bf400640 1 -- 172.21.15.133:0/2033800561 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b8004a00 con 0x7f86ac0047c0 2024-03-30T01:52:12.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.553+0000 7f86ce600640 1 -- 172.21.15.133:0/2033800561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c81f64d0 con 0x7f86ac0047c0 2024-03-30T01:52:12.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.554+0000 7f86ce600640 1 -- 172.21.15.133:0/2033800561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c81565e0 con 0x7f86ac0047c0 2024-03-30T01:52:12.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.555+0000 7f86ce600640 1 -- 172.21.15.133:0/2033800561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c80b55b0 con 0x7f86ac0047c0 2024-03-30T01:52:12.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.555+0000 7f86bf400640 1 -- 172.21.15.133:0/2033800561 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f86b8004b60 con 0x7f86ac0047c0 2024-03-30T01:52:12.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.556+0000 7f86bf400640 1 --2- 172.21.15.133:0/2033800561 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f86a406ac00 0x7f86a406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:12.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.556+0000 7f86bf400640 1 -- 172.21.15.133:0/2033800561 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86b8088e50 con 0x7f86ac0047c0 2024-03-30T01:52:12.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.556+0000 7f86c6a00640 1 --2- 172.21.15.133:0/2033800561 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f86a406ac00 0x7f86a406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:12.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.557+0000 7f86c6a00640 1 --2- 172.21.15.133:0/2033800561 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f86a406ac00 0x7f86a406d0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f86b0033000 tx=0x7f86b0009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:12.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.560+0000 7f86bf400640 1 -- 172.21.15.133:0/2033800561 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f86b80540d0 con 0x7f86ac0047c0 2024-03-30T01:52:12.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.739+0000 7f86ce600640 1 -- 172.21.15.133:0/2033800561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f86c8066d80 con 0x7f86ac0047c0 2024-03-30T01:52:12.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.740+0000 7f86bf400640 1 -- 172.21.15.133:0/2033800561 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f86b80190a0 con 0x7f86ac0047c0 2024-03-30T01:52:12.746 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-03-30T01:52:12.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.742+0000 7f86ce600640 1 -- 172.21.15.133:0/2033800561 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f86a406ac00 msgr2=0x7f86a406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:12.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.742+0000 7f86ce600640 1 --2- 172.21.15.133:0/2033800561 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f86a406ac00 0x7f86a406d0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f86b0033000 tx=0x7f86b0009030 comp rx=0 tx=0).stop 2024-03-30T01:52:12.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.742+0000 7f86ce600640 1 -- 172.21.15.133:0/2033800561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86ac0047c0 msgr2=0x7f86c81560a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:12.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.742+0000 7f86ce600640 1 --2- 172.21.15.133:0/2033800561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86ac0047c0 0x7f86c81560a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f86b8000ff0 tx=0x7f86b800dc00 comp rx=0 tx=0).stop 2024-03-30T01:52:12.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.743+0000 7f86ce600640 1 -- 172.21.15.133:0/2033800561 shutdown_connections 2024-03-30T01:52:12.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.743+0000 7f86ce600640 1 --2- 172.21.15.133:0/2033800561 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f86a406ac00 0x7f86a406d0c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.743+0000 7f86ce600640 1 --2- 172.21.15.133:0/2033800561 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86c80cad80 0x7f86c80cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.743+0000 7f86ce600640 1 --2- 172.21.15.133:0/2033800561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86c81f5730 0x7f86c81f5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.743+0000 7f86ce600640 1 --2- 172.21.15.133:0/2033800561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86ac0047c0 0x7f86c81560a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.743+0000 7f86ce600640 1 -- 172.21.15.133:0/2033800561 >> 172.21.15.133:0/2033800561 conn(0x7f86c8071a40 msgr2=0x7f86c80d2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:12.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.743+0000 7f86ce600640 1 -- 172.21.15.133:0/2033800561 shutdown_connections 2024-03-30T01:52:12.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.743+0000 7f86ce600640 1 -- 172.21.15.133:0/2033800561 wait complete. 2024-03-30T01:52:12.767 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T01:52:12.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.960+0000 7fa141800640 1 Processor -- start 2024-03-30T01:52:12.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.960+0000 7fa141800640 1 -- start start 2024-03-30T01:52:12.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.962+0000 7fa141800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa13c070500 0x7fa13c070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:12.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.962+0000 7fa141800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa13c0cc530 0x7fa13c0cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:12.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.962+0000 7fa141800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa13c0a76a0 con 0x7fa13c143790 2024-03-30T01:52:12.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.962+0000 7fa141800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa13c070ed0 con 0x7fa13c070500 2024-03-30T01:52:12.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.962+0000 7fa141800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c0b38e0 con 0x7fa13c0cc530 2024-03-30T01:52:12.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.962+0000 7fa13aa00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa13c143790 0x7fa13c0cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43902/0 (socket says 172.21.15.133:43902) 2024-03-30T01:52:12.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.962+0000 7fa13aa00640 1 -- 172.21.15.133:0/2321267465 learned_addr learned my addr 172.21.15.133:0/2321267465 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:12.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.962+0000 7fa13a000640 1 --2- 172.21.15.133:0/2321267465 >> v2:172.21.15.133:3300/0 conn(0x7fa13c070500 0x7fa13c070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:12.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.963+0000 7fa13b400640 1 --2- 172.21.15.133:0/2321267465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa13c0cc530 0x7fa13c0cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:12.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.963+0000 7fa139600640 1 -- 172.21.15.133:0/2321267465 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765336905 0 0) 0x7fa13c0a76a0 con 0x7fa13c143790 2024-03-30T01:52:12.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.963+0000 7fa139600640 1 -- 172.21.15.133:0/2321267465 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa120003520 con 0x7fa13c143790 2024-03-30T01:52:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.963+0000 7fa13a000640 1 -- 172.21.15.133:0/2321267465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa13c0cc530 msgr2=0x7fa13c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.963+0000 7fa13a000640 1 --2- 172.21.15.133:0/2321267465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa13c0cc530 0x7fa13c0cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.963+0000 7fa13a000640 1 -- 172.21.15.133:0/2321267465 >> v1:172.21.15.133:6789/0 conn(0x7fa13c143790 legacy=0x7fa13c0cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.963+0000 7fa13a000640 1 -- 172.21.15.133:0/2321267465 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13c0ccf00 con 0x7fa13c070500 2024-03-30T01:52:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.963+0000 7fa13b400640 1 --2- 172.21.15.133:0/2321267465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa13c0cc530 0x7fa13c0cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:12.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.964+0000 7fa13a000640 1 --2- 172.21.15.133:0/2321267465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa13c070500 0x7fa13c070990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa1280097a0 tx=0x7fa12802b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3fcd07ce5d1014 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:12.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.964+0000 7fa139600640 1 -- 172.21.15.133:0/2321267465 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128030800 con 0x7fa13c070500 2024-03-30T01:52:12.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.964+0000 7fa139600640 1 -- 172.21.15.133:0/2321267465 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa128030960 con 0x7fa13c070500 2024-03-30T01:52:12.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.964+0000 7fa139600640 1 -- 172.21.15.133:0/2321267465 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128030cf0 con 0x7fa13c070500 2024-03-30T01:52:12.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.965+0000 7fa141800640 1 -- 172.21.15.133:0/2321267465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa13c070500 msgr2=0x7fa13c070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:12.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.965+0000 7fa141800640 1 --2- 172.21.15.133:0/2321267465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa13c070500 0x7fa13c070990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa1280097a0 tx=0x7fa12802b940 comp rx=0 tx=0).stop 2024-03-30T01:52:12.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.965+0000 7fa141800640 1 -- 172.21.15.133:0/2321267465 shutdown_connections 2024-03-30T01:52:12.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.965+0000 7fa141800640 1 --2- 172.21.15.133:0/2321267465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa13c0cc530 0x7fa13c0cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.965+0000 7fa141800640 1 --2- 172.21.15.133:0/2321267465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa13c070500 0x7fa13c070990 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.965+0000 7fa141800640 1 -- 172.21.15.133:0/2321267465 >> 172.21.15.133:0/2321267465 conn(0x7fa13c0b07a0 msgr2=0x7fa13c0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:12.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.965+0000 7fa141800640 1 -- 172.21.15.133:0/2321267465 shutdown_connections 2024-03-30T01:52:12.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.965+0000 7fa141800640 1 -- 172.21.15.133:0/2321267465 wait complete. 2024-03-30T01:52:12.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.967+0000 7fa141800640 1 Processor -- start 2024-03-30T01:52:12.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.967+0000 7fa141800640 1 -- start start 2024-03-30T01:52:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.968+0000 7fa141800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa13c070500 0x7fa13c0c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.968+0000 7fa141800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa13c0cc530 0x7fa13c0c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.968+0000 7fa141800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa13c143790 0x7fa13c0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.968+0000 7fa141800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c13d770 con 0x7fa13c0cc530 2024-03-30T01:52:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.968+0000 7fa141800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c0c9780 con 0x7fa13c143790 2024-03-30T01:52:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.968+0000 7fa141800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c0c9a60 con 0x7fa13c070500 2024-03-30T01:52:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.968+0000 7fa13a000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa13c0cc530 0x7fa13c0c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.968+0000 7fa13a000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa13c0cc530 0x7fa13c0c6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55450/0 (socket says 172.21.15.133:55450) 2024-03-30T01:52:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.968+0000 7fa13a000640 1 -- 172.21.15.133:0/1128195680 learned_addr learned my addr 172.21.15.133:0/1128195680 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.969+0000 7fa13aa00640 1 --2- 172.21.15.133:0/1128195680 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa13c070500 0x7fa13c0c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.969+0000 7fa13a000640 1 -- 172.21.15.133:0/1128195680 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa13c070500 msgr2=0x7fa13c0c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.969+0000 7fa13a000640 1 --2- 172.21.15.133:0/1128195680 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa13c070500 0x7fa13c0c6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.969+0000 7fa13a000640 1 -- 172.21.15.133:0/1128195680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa13c143790 msgr2=0x7fa13c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.969+0000 7fa13b400640 1 --2- 172.21.15.133:0/1128195680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa13c143790 0x7fa13c0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.969+0000 7fa13a000640 1 --2- 172.21.15.133:0/1128195680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa13c143790 0x7fa13c0c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.969+0000 7fa13a000640 1 -- 172.21.15.133:0/1128195680 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa128009400 con 0x7fa13c0cc530 2024-03-30T01:52:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.969+0000 7fa13a000640 1 --2- 172.21.15.133:0/1128195680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa13c0cc530 0x7fa13c0c6ea0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa12802bf50 tx=0x7fa128004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:12.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.969+0000 7fa132a00640 1 -- 172.21.15.133:0/1128195680 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12803e040 con 0x7fa13c0cc530 2024-03-30T01:52:12.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.969+0000 7fa132a00640 1 -- 172.21.15.133:0/1128195680 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa128039cb0 con 0x7fa13c0cc530 2024-03-30T01:52:12.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.969+0000 7fa132a00640 1 -- 172.21.15.133:0/1128195680 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128044630 con 0x7fa13c0cc530 2024-03-30T01:52:12.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.969+0000 7fa141800640 1 -- 172.21.15.133:0/1128195680 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa13c0c9d40 con 0x7fa13c0cc530 2024-03-30T01:52:12.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.970+0000 7fa141800640 1 -- 172.21.15.133:0/1128195680 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa13c0ca300 con 0x7fa13c0cc530 2024-03-30T01:52:12.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.971+0000 7fa141800640 1 -- 172.21.15.133:0/1128195680 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa13c066d80 con 0x7fa13c0cc530 2024-03-30T01:52:12.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.971+0000 7fa132a00640 1 -- 172.21.15.133:0/1128195680 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fa128043390 con 0x7fa13c0cc530 2024-03-30T01:52:12.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.972+0000 7fa132a00640 1 --2- 172.21.15.133:0/1128195680 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa11c06ac00 0x7fa11c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:12.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.972+0000 7fa132a00640 1 -- 172.21.15.133:0/1128195680 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1280ab720 con 0x7fa13c0cc530 2024-03-30T01:52:12.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.973+0000 7fa13aa00640 1 --2- 172.21.15.133:0/1128195680 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa11c06ac00 0x7fa11c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:12.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.973+0000 7fa13aa00640 1 --2- 172.21.15.133:0/1128195680 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa11c06ac00 0x7fa11c06d0c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa12c0011e0 tx=0x7fa12c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:12.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:12.977+0000 7fa132a00640 1 -- 172.21.15.133:0/1128195680 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fa1280767d0 con 0x7fa13c0cc530 2024-03-30T01:52:13.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.155+0000 7fa141800640 1 -- 172.21.15.133:0/1128195680 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa13c139630 con 0x7fa13c0cc530 2024-03-30T01:52:13.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.155+0000 7fa132a00640 1 -- 172.21.15.133:0/1128195680 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa128079df0 con 0x7fa13c0cc530 2024-03-30T01:52:13.162 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-03-30T01:52:13.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.158+0000 7fa141800640 1 -- 172.21.15.133:0/1128195680 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa11c06ac00 msgr2=0x7fa11c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:13.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.158+0000 7fa141800640 1 --2- 172.21.15.133:0/1128195680 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa11c06ac00 0x7fa11c06d0c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa12c0011e0 tx=0x7fa12c009040 comp rx=0 tx=0).stop 2024-03-30T01:52:13.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.158+0000 7fa141800640 1 -- 172.21.15.133:0/1128195680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa13c0cc530 msgr2=0x7fa13c0c6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:13.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.158+0000 7fa141800640 1 --2- 172.21.15.133:0/1128195680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa13c0cc530 0x7fa13c0c6ea0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa12802bf50 tx=0x7fa128004730 comp rx=0 tx=0).stop 2024-03-30T01:52:13.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.158+0000 7fa141800640 1 -- 172.21.15.133:0/1128195680 shutdown_connections 2024-03-30T01:52:13.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.158+0000 7fa141800640 1 --2- 172.21.15.133:0/1128195680 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa11c06ac00 0x7fa11c06d0c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:13.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.158+0000 7fa141800640 1 --2- 172.21.15.133:0/1128195680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa13c143790 0x7fa13c0c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:13.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.158+0000 7fa141800640 1 --2- 172.21.15.133:0/1128195680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa13c0cc530 0x7fa13c0c6ea0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:13.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.158+0000 7fa141800640 1 --2- 172.21.15.133:0/1128195680 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa13c070500 0x7fa13c0c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:13.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.158+0000 7fa141800640 1 -- 172.21.15.133:0/1128195680 >> 172.21.15.133:0/1128195680 conn(0x7fa13c0b07a0 msgr2=0x7fa13c142500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:13.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.158+0000 7fa141800640 1 -- 172.21.15.133:0/1128195680 shutdown_connections 2024-03-30T01:52:13.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.158+0000 7fa141800640 1 -- 172.21.15.133:0/1128195680 wait complete. 2024-03-30T01:52:13.181 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:52:13.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.378+0000 7fc2ca600640 1 Processor -- start 2024-03-30T01:52:13.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.378+0000 7fc2ca600640 1 -- start start 2024-03-30T01:52:13.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.380+0000 7fc2ca600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2c4145d30 0x7fc2c4070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:13.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.380+0000 7fc2ca600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc2c4070a40 0x7fc2c40b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:13.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.380+0000 7fc2ca600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c406c320 con 0x7fc2c41457b0 2024-03-30T01:52:13.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.380+0000 7fc2ca600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c4070ed0 con 0x7fc2c4070a40 2024-03-30T01:52:13.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.380+0000 7fc2ca600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c4145b90 con 0x7fc2c4145d30 2024-03-30T01:52:13.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.380+0000 7fc2c3400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc2c41457b0 0x7fc2c40b3850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43908/0 (socket says 172.21.15.133:43908) 2024-03-30T01:52:13.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.380+0000 7fc2c3400640 1 -- 172.21.15.133:0/911434005 learned_addr learned my addr 172.21.15.133:0/911434005 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:13.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.381+0000 7fc2c3e00640 1 --2- 172.21.15.133:0/911434005 >> v2:172.21.15.137:3300/0 conn(0x7fc2c4070a40 0x7fc2c40b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:13.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.381+0000 7fc2baa00640 1 --2- 172.21.15.133:0/911434005 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2c4145d30 0x7fc2c4070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:13.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.381+0000 7fc2c2a00640 1 -- 172.21.15.133:0/911434005 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890052909 0 0) 0x7fc2c406c320 con 0x7fc2c41457b0 2024-03-30T01:52:13.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.381+0000 7fc2c2a00640 1 -- 172.21.15.133:0/911434005 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2a8003520 con 0x7fc2c41457b0 2024-03-30T01:52:13.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.381+0000 7fc2c2a00640 1 -- 172.21.15.133:0/911434005 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1336036452 0 0) 0x7fc2a8003520 con 0x7fc2c41457b0 2024-03-30T01:52:13.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.381+0000 7fc2c2a00640 1 -- 172.21.15.133:0/911434005 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2c4145d30 msgr2=0x7fc2c4070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:13.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.381+0000 7fc2c2a00640 1 --2- 172.21.15.133:0/911434005 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2c4145d30 0x7fc2c4070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:13.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.381+0000 7fc2c2a00640 1 -- 172.21.15.133:0/911434005 >> v2:172.21.15.137:3300/0 conn(0x7fc2c4070a40 msgr2=0x7fc2c40b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:13.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.381+0000 7fc2c2a00640 1 --2- 172.21.15.133:0/911434005 >> v2:172.21.15.137:3300/0 conn(0x7fc2c4070a40 0x7fc2c40b18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:13.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.381+0000 7fc2c2a00640 1 -- 172.21.15.133:0/911434005 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c406c600 con 0x7fc2c41457b0 2024-03-30T01:52:13.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.381+0000 7fc2c2a00640 1 -- 172.21.15.133:0/911434005 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fc2b4001670 con 0x7fc2c41457b0 2024-03-30T01:52:13.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.381+0000 7fc2c2a00640 1 -- 172.21.15.133:0/911434005 >> v1:172.21.15.133:6789/0 conn(0x7fc2c41457b0 legacy=0x7fc2c40b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:13.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.381+0000 7fc2c2a00640 1 --2- 172.21.15.133:0/911434005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a80039a0 0x7fc2a8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:13.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.381+0000 7fc2c2a00640 1 --2- 172.21.15.133:0/911434005 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2c4145d30 0x7fc2a80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:13.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.382+0000 7fc2c2a00640 1 --2- 172.21.15.133:0/911434005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2a8004d00 0x7fc2a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:13.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.382+0000 7fc2c2a00640 1 -- 172.21.15.133:0/911434005 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c4070ed0 con 0x7fc2a80039a0 2024-03-30T01:52:13.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.382+0000 7fc2c2a00640 1 -- 172.21.15.133:0/911434005 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c4145b90 con 0x7fc2a8004d00 2024-03-30T01:52:13.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.382+0000 7fc2c2a00640 1 -- 172.21.15.133:0/911434005 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a800b980 con 0x7fc2c4145d30 2024-03-30T01:52:13.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.382+0000 7fc2c3400640 1 --2- 172.21.15.133:0/911434005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a80039a0 0x7fc2a8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:13.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.382+0000 7fc2baa00640 1 --2- 172.21.15.133:0/911434005 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2c4145d30 0x7fc2a80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:13.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.382+0000 7fc2c3400640 1 -- 172.21.15.133:0/911434005 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2c4145d30 msgr2=0x7fc2a80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:13.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.382+0000 7fc2c3400640 1 --2- 172.21.15.133:0/911434005 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2c4145d30 0x7fc2a80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:13.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.382+0000 7fc2c3e00640 1 --2- 172.21.15.133:0/911434005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2a8004d00 0x7fc2a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:13.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.382+0000 7fc2c3400640 1 -- 172.21.15.133:0/911434005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2a8004d00 msgr2=0x7fc2a8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:13.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.382+0000 7fc2c3400640 1 --2- 172.21.15.133:0/911434005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2a8004d00 0x7fc2a8005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:13.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.382+0000 7fc2c3400640 1 -- 172.21.15.133:0/911434005 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a8003520 con 0x7fc2a80039a0 2024-03-30T01:52:13.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.384+0000 7fc2c3400640 1 --2- 172.21.15.133:0/911434005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a80039a0 0x7fc2a8003dc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc2b400c110 tx=0x7fc2a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86679cc1df6597d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:13.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.384+0000 7fc2c2a00640 1 -- 172.21.15.133:0/911434005 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4005ad0 con 0x7fc2a80039a0 2024-03-30T01:52:13.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.384+0000 7fc2c2a00640 1 -- 172.21.15.133:0/911434005 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b4005c30 con 0x7fc2a80039a0 2024-03-30T01:52:13.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.384+0000 7fc2c2a00640 1 -- 172.21.15.133:0/911434005 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b402c7c0 con 0x7fc2a80039a0 2024-03-30T01:52:13.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.385+0000 7fc2ca600640 1 -- 172.21.15.133:0/911434005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a80039a0 msgr2=0x7fc2a8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:13.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.385+0000 7fc2ca600640 1 --2- 172.21.15.133:0/911434005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a80039a0 0x7fc2a8003dc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc2b400c110 tx=0x7fc2a80057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:13.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.385+0000 7fc2c3e00640 1 -- 172.21.15.133:0/911434005 reap_dead start 2024-03-30T01:52:13.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.385+0000 7fc2ca600640 1 -- 172.21.15.133:0/911434005 shutdown_connections 2024-03-30T01:52:13.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.385+0000 7fc2ca600640 1 -- 172.21.15.133:0/911434005 >> 172.21.15.133:0/911434005 conn(0x7fc2c40b07a0 msgr2=0x7fc2c40b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:13.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.385+0000 7fc2ca600640 1 -- 172.21.15.133:0/911434005 shutdown_connections 2024-03-30T01:52:13.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.385+0000 7fc2ca600640 1 -- 172.21.15.133:0/911434005 wait complete. 2024-03-30T01:52:13.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.387+0000 7fc2ca600640 1 Processor -- start 2024-03-30T01:52:13.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.387+0000 7fc2ca600640 1 -- start start 2024-03-30T01:52:13.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.388+0000 7fc2ca600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2a80039a0 0x7fc2c41f1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:13.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.388+0000 7fc2ca600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2c40af5c0 0x7fc2c40afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:13.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.388+0000 7fc2ca600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2c4143320 0x7fc2c41437d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:13.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.388+0000 7fc2ca600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c40aff80 con 0x7fc2c40af5c0 2024-03-30T01:52:13.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.388+0000 7fc2ca600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c40cc030 con 0x7fc2a80039a0 2024-03-30T01:52:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.388+0000 7fc2ca600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c40cb420 con 0x7fc2c4143320 2024-03-30T01:52:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.388+0000 7fc2baa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2c40af5c0 0x7fc2c40afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.388+0000 7fc2baa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2c40af5c0 0x7fc2c40afa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55470/0 (socket says 172.21.15.133:55470) 2024-03-30T01:52:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.388+0000 7fc2baa00640 1 -- 172.21.15.133:0/969548718 learned_addr learned my addr 172.21.15.133:0/969548718 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.388+0000 7fc2c3400640 1 --2- 172.21.15.133:0/969548718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2a80039a0 0x7fc2c41f1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.388+0000 7fc2c3e00640 1 --2- 172.21.15.133:0/969548718 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2c4143320 0x7fc2c41437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.389+0000 7fc2baa00640 1 -- 172.21.15.133:0/969548718 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2c4143320 msgr2=0x7fc2c41437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.389+0000 7fc2baa00640 1 --2- 172.21.15.133:0/969548718 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2c4143320 0x7fc2c41437d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.389+0000 7fc2baa00640 1 -- 172.21.15.133:0/969548718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2a80039a0 msgr2=0x7fc2c41f1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.389+0000 7fc2baa00640 1 --2- 172.21.15.133:0/969548718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2a80039a0 0x7fc2c41f1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.389+0000 7fc2baa00640 1 -- 172.21.15.133:0/969548718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c40cb700 con 0x7fc2c40af5c0 2024-03-30T01:52:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.389+0000 7fc2c3400640 1 --2- 172.21.15.133:0/969548718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2a80039a0 0x7fc2c41f1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.389+0000 7fc2baa00640 1 --2- 172.21.15.133:0/969548718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2c40af5c0 0x7fc2c40afa40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac011630 tx=0x7fc2ac011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.389+0000 7fc2bbe00640 1 -- 172.21.15.133:0/969548718 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac00f920 con 0x7fc2c40af5c0 2024-03-30T01:52:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.389+0000 7fc2bbe00640 1 -- 172.21.15.133:0/969548718 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ac00fa80 con 0x7fc2c40af5c0 2024-03-30T01:52:13.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.389+0000 7fc2bbe00640 1 -- 172.21.15.133:0/969548718 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac00fdf0 con 0x7fc2c40af5c0 2024-03-30T01:52:13.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.389+0000 7fc2ca600640 1 -- 172.21.15.133:0/969548718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c40cb9e0 con 0x7fc2c40af5c0 2024-03-30T01:52:13.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.389+0000 7fc2ca600640 1 -- 172.21.15.133:0/969548718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c4143d10 con 0x7fc2c40af5c0 2024-03-30T01:52:13.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.391+0000 7fc2ca600640 1 -- 172.21.15.133:0/969548718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c4144ac0 con 0x7fc2c40af5c0 2024-03-30T01:52:13.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.391+0000 7fc2bbe00640 1 -- 172.21.15.133:0/969548718 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fc2ac015460 con 0x7fc2c40af5c0 2024-03-30T01:52:13.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.392+0000 7fc2bbe00640 1 --2- 172.21.15.133:0/969548718 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc2a006ac00 0x7fc2a006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:13.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.392+0000 7fc2bbe00640 1 -- 172.21.15.133:0/969548718 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2ac089900 con 0x7fc2c40af5c0 2024-03-30T01:52:13.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.392+0000 7fc2c3400640 1 --2- 172.21.15.133:0/969548718 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc2a006ac00 0x7fc2a006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:13.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.393+0000 7fc2c3400640 1 --2- 172.21.15.133:0/969548718 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc2a006ac00 0x7fc2a006d0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4034000 tx=0x7fc2b4037040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:13.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.397+0000 7fc2bbe00640 1 -- 172.21.15.133:0/969548718 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fc2ac054ae0 con 0x7fc2c40af5c0 2024-03-30T01:52:13.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.583+0000 7fc2ca600640 1 -- 172.21.15.133:0/969548718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2c4066d80 con 0x7fc2c40af5c0 2024-03-30T01:52:13.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.586+0000 7fc2bbe00640 1 -- 172.21.15.133:0/969548718 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7fc2ac022090 con 0x7fc2c40af5c0 2024-03-30T01:52:13.592 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:13.592 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:51:33.780665+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:51:31.245378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T01:51:31.774247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:52:13.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.589+0000 7fc2ca600640 1 -- 172.21.15.133:0/969548718 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc2a006ac00 msgr2=0x7fc2a006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:13.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.589+0000 7fc2ca600640 1 --2- 172.21.15.133:0/969548718 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc2a006ac00 0x7fc2a006d0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4034000 tx=0x7fc2b4037040 comp rx=0 tx=0).stop 2024-03-30T01:52:13.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.589+0000 7fc2ca600640 1 -- 172.21.15.133:0/969548718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2c40af5c0 msgr2=0x7fc2c40afa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:13.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.589+0000 7fc2ca600640 1 --2- 172.21.15.133:0/969548718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2c40af5c0 0x7fc2c40afa40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac011630 tx=0x7fc2ac011af0 comp rx=0 tx=0).stop 2024-03-30T01:52:13.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.589+0000 7fc2ca600640 1 -- 172.21.15.133:0/969548718 shutdown_connections 2024-03-30T01:52:13.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.589+0000 7fc2ca600640 1 --2- 172.21.15.133:0/969548718 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc2a006ac00 0x7fc2a006d0c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:13.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.589+0000 7fc2ca600640 1 --2- 172.21.15.133:0/969548718 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2c4143320 0x7fc2c41437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:13.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.589+0000 7fc2ca600640 1 --2- 172.21.15.133:0/969548718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2c40af5c0 0x7fc2c40afa40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:13.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.589+0000 7fc2ca600640 1 --2- 172.21.15.133:0/969548718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2a80039a0 0x7fc2c41f1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:13.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.589+0000 7fc2ca600640 1 -- 172.21.15.133:0/969548718 >> 172.21.15.133:0/969548718 conn(0x7fc2c40b07a0 msgr2=0x7fc2c40caab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:13.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.589+0000 7fc2ca600640 1 -- 172.21.15.133:0/969548718 shutdown_connections 2024-03-30T01:52:13.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.589+0000 7fc2ca600640 1 -- 172.21.15.133:0/969548718 wait complete. 2024-03-30T01:52:13.614 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T01:51:21.771393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T01:51:31.245378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T01:51:31.774247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T01:52:13.614 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T01:52:13.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.810+0000 7f4d82a00640 1 Processor -- start 2024-03-30T01:52:13.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.810+0000 7f4d82a00640 1 -- start start 2024-03-30T01:52:13.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.812+0000 7f4d82a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4d7c160c30 0x7f4d7c0b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:13.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.812+0000 7f4d82a00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7c0b3ca0 con 0x7f4d7c15a6e0 2024-03-30T01:52:13.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.812+0000 7f4d82a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7c0b3f80 con 0x7f4d7c15a300 2024-03-30T01:52:13.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.812+0000 7f4d82a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d7c0b4260 con 0x7f4d7c160c30 2024-03-30T01:52:13.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.812+0000 7f4d80c00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4d7c15a6e0 0x7f4d7c160520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43918/0 (socket says 172.21.15.133:43918) 2024-03-30T01:52:13.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.812+0000 7f4d80c00640 1 -- 172.21.15.133:0/2793420659 learned_addr learned my addr 172.21.15.133:0/2793420659 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:13.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.812+0000 7f4d82000640 1 --2- 172.21.15.133:0/2793420659 >> v2:172.21.15.137:3300/0 conn(0x7f4d7c160c30 0x7f4d7c0b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:13.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.813+0000 7f4d7be00640 1 -- 172.21.15.133:0/2793420659 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331574809 0 0) 0x7f4d7c0b3ca0 con 0x7f4d7c15a6e0 2024-03-30T01:52:13.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.813+0000 7f4d7be00640 1 -- 172.21.15.133:0/2793420659 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d64003520 con 0x7f4d7c15a6e0 2024-03-30T01:52:13.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.813+0000 7f4d7be00640 1 -- 172.21.15.133:0/2793420659 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2641767023 0 0) 0x7f4d64003520 con 0x7f4d7c15a6e0 2024-03-30T01:52:13.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.813+0000 7f4d7be00640 1 -- 172.21.15.133:0/2793420659 >> v2:172.21.15.137:3300/0 conn(0x7f4d7c160c30 msgr2=0x7f4d7c0b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:13.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.813+0000 7f4d7be00640 1 --2- 172.21.15.133:0/2793420659 >> v2:172.21.15.137:3300/0 conn(0x7f4d7c160c30 0x7f4d7c0b1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:13.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.813+0000 7f4d7be00640 1 -- 172.21.15.133:0/2793420659 >> v1:172.21.15.137:6789/0 conn(0x7f4d7c15a300 legacy=0x7f4d7c0b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:13.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.813+0000 7f4d7be00640 1 -- 172.21.15.133:0/2793420659 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c0b4540 con 0x7f4d7c15a6e0 2024-03-30T01:52:13.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.813+0000 7f4d7be00640 1 -- 172.21.15.133:0/2793420659 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f4d68001670 con 0x7f4d7c15a6e0 2024-03-30T01:52:13.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.813+0000 7f4d7be00640 1 -- 172.21.15.133:0/2793420659 >> v1:172.21.15.133:6789/0 conn(0x7f4d7c15a6e0 legacy=0x7f4d7c160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:13.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.813+0000 7f4d7be00640 1 --2- 172.21.15.133:0/2793420659 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d640039c0 0x7f4d64003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:13.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.813+0000 7f4d7be00640 1 --2- 172.21.15.133:0/2793420659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d640047c0 0x7f4d64004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:13.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.813+0000 7f4d7be00640 1 --2- 172.21.15.133:0/2793420659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d64005180 0x7f4d6400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:13.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.813+0000 7f4d7be00640 1 -- 172.21.15.133:0/2793420659 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0b4260 con 0x7f4d640047c0 2024-03-30T01:52:13.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.813+0000 7f4d7be00640 1 -- 172.21.15.133:0/2793420659 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6400c080 con 0x7f4d64005180 2024-03-30T01:52:13.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.813+0000 7f4d7be00640 1 -- 172.21.15.133:0/2793420659 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6400c240 con 0x7f4d640039c0 2024-03-30T01:52:13.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.813+0000 7f4d80c00640 1 --2- 172.21.15.133:0/2793420659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d640047c0 0x7f4d64004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:13.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.814+0000 7f4d82000640 1 --2- 172.21.15.133:0/2793420659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d64005180 0x7f4d6400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:13.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.814+0000 7f4d81600640 1 --2- 172.21.15.133:0/2793420659 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d640039c0 0x7f4d64003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:13.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.814+0000 7f4d80c00640 1 -- 172.21.15.133:0/2793420659 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d640039c0 msgr2=0x7f4d64003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:13.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.814+0000 7f4d80c00640 1 --2- 172.21.15.133:0/2793420659 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d640039c0 0x7f4d64003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:13.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.814+0000 7f4d80c00640 1 -- 172.21.15.133:0/2793420659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d64005180 msgr2=0x7f4d6400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:13.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.814+0000 7f4d80c00640 1 --2- 172.21.15.133:0/2793420659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d64005180 0x7f4d6400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:13.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.814+0000 7f4d80c00640 1 -- 172.21.15.133:0/2793420659 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d64003520 con 0x7f4d640047c0 2024-03-30T01:52:13.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.814+0000 7f4d82000640 1 --2- 172.21.15.133:0/2793420659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d64005180 0x7f4d6400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:52:13.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.814+0000 7f4d82000640 1 -- 172.21.15.133:0/2793420659 reap_dead start 2024-03-30T01:52:13.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.815+0000 7f4d80c00640 1 --2- 172.21.15.133:0/2793420659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d640047c0 0x7f4d64004c40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800c0e0 tx=0x7f4d640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52fcbe40526b5bde server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:13.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.815+0000 7f4d7be00640 1 -- 172.21.15.133:0/2793420659 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d68005ad0 con 0x7f4d640047c0 2024-03-30T01:52:13.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.815+0000 7f4d7be00640 1 -- 172.21.15.133:0/2793420659 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d68005c30 con 0x7f4d640047c0 2024-03-30T01:52:13.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.815+0000 7f4d7be00640 1 -- 172.21.15.133:0/2793420659 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6802ca00 con 0x7f4d640047c0 2024-03-30T01:52:13.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.816+0000 7f4d82a00640 1 -- 172.21.15.133:0/2793420659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d640047c0 msgr2=0x7f4d64004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:13.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.816+0000 7f4d82a00640 1 --2- 172.21.15.133:0/2793420659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d640047c0 0x7f4d64004c40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800c0e0 tx=0x7f4d640057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:13.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.816+0000 7f4d82a00640 1 -- 172.21.15.133:0/2793420659 shutdown_connections 2024-03-30T01:52:13.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.816+0000 7f4d82a00640 1 --2- 172.21.15.133:0/2793420659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d640047c0 0x7f4d64004c40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:13.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.816+0000 7f4d82a00640 1 -- 172.21.15.133:0/2793420659 >> 172.21.15.133:0/2793420659 conn(0x7f4d7c0b05a0 msgr2=0x7f4d7c0b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.816+0000 7f4d82a00640 1 -- 172.21.15.133:0/2793420659 shutdown_connections 2024-03-30T01:52:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.816+0000 7f4d82a00640 1 -- 172.21.15.133:0/2793420659 wait complete. 2024-03-30T01:52:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.818+0000 7f4d82a00640 1 Processor -- start 2024-03-30T01:52:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.818+0000 7f4d82a00640 1 -- start start 2024-03-30T01:52:13.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.819+0000 7f4d82a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d640047c0 0x7f4d7c1470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:13.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.819+0000 7f4d82a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d7c151d70 0x7f4d7c1521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:13.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.819+0000 7f4d82a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d7c0af540 0x7f4d7c0af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:13.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.819+0000 7f4d82a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0aff00 con 0x7f4d7c151d70 2024-03-30T01:52:13.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.819+0000 7f4d82a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c155840 con 0x7f4d640047c0 2024-03-30T01:52:13.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.819+0000 7f4d82a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c152830 con 0x7f4d7c0af540 2024-03-30T01:52:13.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.819+0000 7f4d80c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d7c151d70 0x7f4d7c1521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:13.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.819+0000 7f4d80c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d7c151d70 0x7f4d7c1521f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55478/0 (socket says 172.21.15.133:55478) 2024-03-30T01:52:13.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.819+0000 7f4d80c00640 1 -- 172.21.15.133:0/1199898762 learned_addr learned my addr 172.21.15.133:0/1199898762 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:13.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.819+0000 7f4d82000640 1 --2- 172.21.15.133:0/1199898762 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d7c0af540 0x7f4d7c0af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:13.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.819+0000 7f4d81600640 1 --2- 172.21.15.133:0/1199898762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d640047c0 0x7f4d7c1470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:13.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.819+0000 7f4d80c00640 1 -- 172.21.15.133:0/1199898762 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d7c0af540 msgr2=0x7f4d7c0af9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:13.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.819+0000 7f4d80c00640 1 --2- 172.21.15.133:0/1199898762 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d7c0af540 0x7f4d7c0af9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:13.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.819+0000 7f4d80c00640 1 -- 172.21.15.133:0/1199898762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d640047c0 msgr2=0x7f4d7c1470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:13.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.819+0000 7f4d80c00640 1 --2- 172.21.15.133:0/1199898762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d640047c0 0x7f4d7c1470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:13.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.819+0000 7f4d80c00640 1 -- 172.21.15.133:0/1199898762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c152b10 con 0x7f4d7c151d70 2024-03-30T01:52:13.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.819+0000 7f4d82000640 1 --2- 172.21.15.133:0/1199898762 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d7c0af540 0x7f4d7c0af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:13.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.819+0000 7f4d81600640 1 --2- 172.21.15.133:0/1199898762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d640047c0 0x7f4d7c1470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:13.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.820+0000 7f4d80c00640 1 --2- 172.21.15.133:0/1199898762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d7c151d70 0x7f4d7c1521f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4d68000c00 tx=0x7f4d6802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:13.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.820+0000 7f4d79600640 1 -- 172.21.15.133:0/1199898762 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6803c040 con 0x7f4d7c151d70 2024-03-30T01:52:13.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.820+0000 7f4d79600640 1 -- 172.21.15.133:0/1199898762 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6802ccb0 con 0x7f4d7c151d70 2024-03-30T01:52:13.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.820+0000 7f4d79600640 1 -- 172.21.15.133:0/1199898762 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d680072b0 con 0x7f4d7c151d70 2024-03-30T01:52:13.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.820+0000 7f4d82a00640 1 -- 172.21.15.133:0/1199898762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7c155a90 con 0x7f4d7c151d70 2024-03-30T01:52:13.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.820+0000 7f4d82a00640 1 -- 172.21.15.133:0/1199898762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7c1475f0 con 0x7f4d7c151d70 2024-03-30T01:52:13.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.821+0000 7f4d82a00640 1 -- 172.21.15.133:0/1199898762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d7c152d50 con 0x7f4d7c151d70 2024-03-30T01:52:13.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.822+0000 7f4d79600640 1 -- 172.21.15.133:0/1199898762 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f4d68032070 con 0x7f4d7c151d70 2024-03-30T01:52:13.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.823+0000 7f4d79600640 1 --2- 172.21.15.133:0/1199898762 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4d5c06ac30 0x7f4d5c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:13.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.823+0000 7f4d79600640 1 -- 172.21.15.133:0/1199898762 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d680aa6d0 con 0x7f4d7c151d70 2024-03-30T01:52:13.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.823+0000 7f4d81600640 1 --2- 172.21.15.133:0/1199898762 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4d5c06ac30 0x7f4d5c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:13.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.824+0000 7f4d81600640 1 --2- 172.21.15.133:0/1199898762 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4d5c06ac30 0x7f4d5c06d0f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4d700016f0 tx=0x7f4d70009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:13.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:13.828+0000 7f4d79600640 1 -- 172.21.15.133:0/1199898762 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f4d680758a0 con 0x7f4d7c151d70 2024-03-30T01:52:14.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.005+0000 7f4d82a00640 1 -- 172.21.15.133:0/1199898762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4d7c073750 con 0x7f4d7c151d70 2024-03-30T01:52:14.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.006+0000 7f4d79600640 1 -- 172.21.15.133:0/1199898762 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4d68078ec0 con 0x7f4d7c151d70 2024-03-30T01:52:14.012 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-03-30T01:52:14.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.008+0000 7f4d82a00640 1 -- 172.21.15.133:0/1199898762 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4d5c06ac30 msgr2=0x7f4d5c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:14.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.008+0000 7f4d82a00640 1 --2- 172.21.15.133:0/1199898762 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4d5c06ac30 0x7f4d5c06d0f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4d700016f0 tx=0x7f4d70009040 comp rx=0 tx=0).stop 2024-03-30T01:52:14.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.009+0000 7f4d82a00640 1 -- 172.21.15.133:0/1199898762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d7c151d70 msgr2=0x7f4d7c1521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:14.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.009+0000 7f4d82a00640 1 --2- 172.21.15.133:0/1199898762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d7c151d70 0x7f4d7c1521f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4d68000c00 tx=0x7f4d6802e070 comp rx=0 tx=0).stop 2024-03-30T01:52:14.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.009+0000 7f4d82a00640 1 -- 172.21.15.133:0/1199898762 shutdown_connections 2024-03-30T01:52:14.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.009+0000 7f4d82a00640 1 --2- 172.21.15.133:0/1199898762 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4d5c06ac30 0x7f4d5c06d0f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:14.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.009+0000 7f4d82a00640 1 --2- 172.21.15.133:0/1199898762 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d7c0af540 0x7f4d7c0af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:14.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.009+0000 7f4d82a00640 1 --2- 172.21.15.133:0/1199898762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d7c151d70 0x7f4d7c1521f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:14.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.009+0000 7f4d82a00640 1 --2- 172.21.15.133:0/1199898762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d640047c0 0x7f4d7c1470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:14.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.009+0000 7f4d82a00640 1 -- 172.21.15.133:0/1199898762 >> 172.21.15.133:0/1199898762 conn(0x7f4d7c0b05a0 msgr2=0x7f4d7c0ace90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:14.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.009+0000 7f4d82a00640 1 -- 172.21.15.133:0/1199898762 shutdown_connections 2024-03-30T01:52:14.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.009+0000 7f4d82a00640 1 -- 172.21.15.133:0/1199898762 wait complete. 2024-03-30T01:52:14.033 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T01:52:14.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.233+0000 7f7f69400640 1 Processor -- start 2024-03-30T01:52:14.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.233+0000 7f7f69400640 1 -- start start 2024-03-30T01:52:14.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.234+0000 7f7f69400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f640cd6a0 0x7f7f640cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:14.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.234+0000 7f7f69400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7f640d1440 0x7f7f640d18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:14.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.234+0000 7f7f69400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f640b5b50 con 0x7f7f6415cac0 2024-03-30T01:52:14.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.234+0000 7f7f69400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f640d1020 con 0x7f7f640d1440 2024-03-30T01:52:14.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.234+0000 7f7f69400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f640ce020 con 0x7f7f640cd6a0 2024-03-30T01:52:14.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.235+0000 7f7f5b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f640cd6a0 0x7f7f640cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:14.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.235+0000 7f7f5b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f640cd6a0 0x7f7f640cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.133:52022/0 (socket says 172.21.15.133:52022) 2024-03-30T01:52:14.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.235+0000 7f7f5b400640 1 -- 172.21.15.133:0/1709806401 learned_addr learned my addr 172.21.15.133:0/1709806401 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:14.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.235+0000 7f7f68a00640 1 --2- 172.21.15.133:0/1709806401 >> v2:172.21.15.137:3300/0 conn(0x7f7f640d1440 0x7f7f640d18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:14.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.236+0000 7f7f63400640 1 -- 172.21.15.133:0/1709806401 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2385854227 0 0) 0x7f7f640b5b50 con 0x7f7f6415cac0 2024-03-30T01:52:14.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.236+0000 7f7f63400640 1 -- 172.21.15.133:0/1709806401 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f48003520 con 0x7f7f6415cac0 2024-03-30T01:52:14.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.236+0000 7f7f5b400640 1 -- 172.21.15.133:0/1709806401 >> v2:172.21.15.137:3300/0 conn(0x7f7f640d1440 msgr2=0x7f7f640d18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:14.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.236+0000 7f7f5b400640 1 --2- 172.21.15.133:0/1709806401 >> v2:172.21.15.137:3300/0 conn(0x7f7f640d1440 0x7f7f640d18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:14.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.236+0000 7f7f5b400640 1 -- 172.21.15.133:0/1709806401 >> v1:172.21.15.137:6789/0 conn(0x7f7f6415cac0 legacy=0x7f7f64160670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:14.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.236+0000 7f7f5b400640 1 -- 172.21.15.133:0/1709806401 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f64161100 con 0x7f7f640cd6a0 2024-03-30T01:52:14.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.236+0000 7f7f68a00640 1 --2- 172.21.15.133:0/1709806401 >> v2:172.21.15.137:3300/0 conn(0x7f7f640d1440 0x7f7f640d18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T01:52:14.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.237+0000 7f7f5b400640 1 --2- 172.21.15.133:0/1709806401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f640cd6a0 0x7f7f640cdae0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c009870 tx=0x7f7f4c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cd0519cedfc542f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:14.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.238+0000 7f7f63400640 1 -- 172.21.15.133:0/1709806401 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c030840 con 0x7f7f640cd6a0 2024-03-30T01:52:14.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.238+0000 7f7f63400640 1 -- 172.21.15.133:0/1709806401 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4c0309a0 con 0x7f7f640cd6a0 2024-03-30T01:52:14.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.238+0000 7f7f63400640 1 -- 172.21.15.133:0/1709806401 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c030d30 con 0x7f7f640cd6a0 2024-03-30T01:52:14.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.239+0000 7f7f69400640 1 -- 172.21.15.133:0/1709806401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f640cd6a0 msgr2=0x7f7f640cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:14.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.239+0000 7f7f69400640 1 --2- 172.21.15.133:0/1709806401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f640cd6a0 0x7f7f640cdae0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c009870 tx=0x7f7f4c02b980 comp rx=0 tx=0).stop 2024-03-30T01:52:14.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.239+0000 7f7f69400640 1 -- 172.21.15.133:0/1709806401 shutdown_connections 2024-03-30T01:52:14.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.239+0000 7f7f69400640 1 --2- 172.21.15.133:0/1709806401 >> v2:172.21.15.137:3300/0 conn(0x7f7f640d1440 0x7f7f640d18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:14.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.239+0000 7f7f69400640 1 --2- 172.21.15.133:0/1709806401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f640cd6a0 0x7f7f640cdae0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:14.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.239+0000 7f7f69400640 1 -- 172.21.15.133:0/1709806401 >> 172.21.15.133:0/1709806401 conn(0x7f7f640cf770 msgr2=0x7f7f640cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:14.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.239+0000 7f7f69400640 1 -- 172.21.15.133:0/1709806401 shutdown_connections 2024-03-30T01:52:14.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.239+0000 7f7f69400640 1 -- 172.21.15.133:0/1709806401 wait complete. 2024-03-30T01:52:14.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.241+0000 7f7f69400640 1 Processor -- start 2024-03-30T01:52:14.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.241+0000 7f7f69400640 1 -- start start 2024-03-30T01:52:14.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.242+0000 7f7f69400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f640cd6a0 0x7f7f640b6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:14.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.242+0000 7f7f69400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f640d1440 0x7f7f64154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:14.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.242+0000 7f7f69400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f6415cac0 0x7f7f64154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:14.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.242+0000 7f7f69400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6415f670 con 0x7f7f640d1440 2024-03-30T01:52:14.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.242+0000 7f7f69400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6415f950 con 0x7f7f6415cac0 2024-03-30T01:52:14.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.242+0000 7f7f69400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6415fc30 con 0x7f7f640cd6a0 2024-03-30T01:52:14.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.242+0000 7f7f5b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f640d1440 0x7f7f64154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:14.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.242+0000 7f7f5b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f640d1440 0x7f7f64154600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55490/0 (socket says 172.21.15.133:55490) 2024-03-30T01:52:14.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.242+0000 7f7f5b400640 1 -- 172.21.15.133:0/492843046 learned_addr learned my addr 172.21.15.133:0/492843046 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:14.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.242+0000 7f7f63e00640 1 --2- 172.21.15.133:0/492843046 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f640cd6a0 0x7f7f640b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:14.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.242+0000 7f7f68a00640 1 --2- 172.21.15.133:0/492843046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f6415cac0 0x7f7f64154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:14.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.243+0000 7f7f5b400640 1 -- 172.21.15.133:0/492843046 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f640cd6a0 msgr2=0x7f7f640b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:14.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.243+0000 7f7f5b400640 1 --2- 172.21.15.133:0/492843046 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f640cd6a0 0x7f7f640b6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:14.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.243+0000 7f7f5b400640 1 -- 172.21.15.133:0/492843046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f6415cac0 msgr2=0x7f7f64154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:14.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.243+0000 7f7f5b400640 1 --2- 172.21.15.133:0/492843046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f6415cac0 0x7f7f64154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:14.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.243+0000 7f7f5b400640 1 -- 172.21.15.133:0/492843046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c009a70 con 0x7f7f640d1440 2024-03-30T01:52:14.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.243+0000 7f7f68a00640 1 --2- 172.21.15.133:0/492843046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f6415cac0 0x7f7f64154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:14.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.243+0000 7f7f5b400640 1 --2- 172.21.15.133:0/492843046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f640d1440 0x7f7f64154600 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c000c00 tx=0x7f7f4c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:14.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.243+0000 7f7f60c00640 1 -- 172.21.15.133:0/492843046 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c039c90 con 0x7f7f640d1440 2024-03-30T01:52:14.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.243+0000 7f7f60c00640 1 -- 172.21.15.133:0/492843046 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4c039e10 con 0x7f7f640d1440 2024-03-30T01:52:14.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.243+0000 7f7f69400640 1 -- 172.21.15.133:0/492843046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f4c0094d0 con 0x7f7f640d1440 2024-03-30T01:52:14.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.243+0000 7f7f60c00640 1 -- 172.21.15.133:0/492843046 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c043640 con 0x7f7f640d1440 2024-03-30T01:52:14.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.243+0000 7f7f69400640 1 -- 172.21.15.133:0/492843046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f640b6e70 con 0x7f7f640d1440 2024-03-30T01:52:14.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.244+0000 7f7f69400640 1 -- 172.21.15.133:0/492843046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f64073750 con 0x7f7f640d1440 2024-03-30T01:52:14.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.245+0000 7f7f60c00640 1 -- 172.21.15.133:0/492843046 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f7f4c0437a0 con 0x7f7f640d1440 2024-03-30T01:52:14.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.247+0000 7f7f60c00640 1 --2- 172.21.15.133:0/492843046 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7f4006ac00 0x7f7f4006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:14.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.247+0000 7f7f60c00640 1 -- 172.21.15.133:0/492843046 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f4c03e070 con 0x7f7f640d1440 2024-03-30T01:52:14.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.247+0000 7f7f63e00640 1 --2- 172.21.15.133:0/492843046 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7f4006ac00 0x7f7f4006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:14.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.248+0000 7f7f63e00640 1 --2- 172.21.15.133:0/492843046 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7f4006ac00 0x7f7f4006d0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7f540011e0 tx=0x7f7f54009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:14.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.251+0000 7f7f60c00640 1 -- 172.21.15.133:0/492843046 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f7f4c077420 con 0x7f7f640d1440 2024-03-30T01:52:14.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.442+0000 7f7f69400640 1 -- 172.21.15.133:0/492843046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f640d0570 con 0x7f7f640d1440 2024-03-30T01:52:14.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.443+0000 7f7f60c00640 1 -- 172.21.15.133:0/492843046 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f4c07aa40 con 0x7f7f640d1440 2024-03-30T01:52:14.449 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-03-30T01:52:14.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.446+0000 7f7f69400640 1 -- 172.21.15.133:0/492843046 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7f4006ac00 msgr2=0x7f7f4006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:14.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.446+0000 7f7f69400640 1 --2- 172.21.15.133:0/492843046 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7f4006ac00 0x7f7f4006d0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7f540011e0 tx=0x7f7f54009040 comp rx=0 tx=0).stop 2024-03-30T01:52:14.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.446+0000 7f7f69400640 1 -- 172.21.15.133:0/492843046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f640d1440 msgr2=0x7f7f64154600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:14.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.446+0000 7f7f69400640 1 --2- 172.21.15.133:0/492843046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f640d1440 0x7f7f64154600 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c000c00 tx=0x7f7f4c004730 comp rx=0 tx=0).stop 2024-03-30T01:52:14.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.446+0000 7f7f69400640 1 -- 172.21.15.133:0/492843046 shutdown_connections 2024-03-30T01:52:14.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.446+0000 7f7f69400640 1 --2- 172.21.15.133:0/492843046 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7f4006ac00 0x7f7f4006d0c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:14.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.446+0000 7f7f69400640 1 --2- 172.21.15.133:0/492843046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f6415cac0 0x7f7f64154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:14.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.446+0000 7f7f69400640 1 --2- 172.21.15.133:0/492843046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f640d1440 0x7f7f64154600 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:14.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.446+0000 7f7f69400640 1 --2- 172.21.15.133:0/492843046 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f640cd6a0 0x7f7f640b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:14.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.446+0000 7f7f69400640 1 -- 172.21.15.133:0/492843046 >> 172.21.15.133:0/492843046 conn(0x7f7f640cf770 msgr2=0x7f7f640b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:14.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.446+0000 7f7f69400640 1 -- 172.21.15.133:0/492843046 shutdown_connections 2024-03-30T01:52:14.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.446+0000 7f7f69400640 1 -- 172.21.15.133:0/492843046 wait complete. 2024-03-30T01:52:14.471 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T01:52:14.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.682+0000 7f5a02e00640 1 Processor -- start 2024-03-30T01:52:14.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.682+0000 7f5a02e00640 1 -- start start 2024-03-30T01:52:14.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.684+0000 7f5a02e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f59fc143790 0x7f59fc0cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:14.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.684+0000 7f5a02e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f59fc0ccc40 0x7f59fc070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:14.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.684+0000 7f5a02e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59fc0a76a0 con 0x7f59fc070500 2024-03-30T01:52:14.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.684+0000 7f5a02e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59fc070ed0 con 0x7f59fc143790 2024-03-30T01:52:14.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.684+0000 7f5a02e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc0b38e0 con 0x7f59fc0ccc40 2024-03-30T01:52:14.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.684+0000 7f59fbe00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f59fc143790 0x7f59fc0cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:14.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.684+0000 7f59fbe00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f59fc143790 0x7f59fc0cbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55492/0 (socket says 172.21.15.133:55492) 2024-03-30T01:52:14.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.684+0000 7f59fbe00640 1 -- 172.21.15.133:0/3320639630 learned_addr learned my addr 172.21.15.133:0/3320639630 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:14.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.685+0000 7f59fbe00640 1 -- 172.21.15.133:0/3320639630 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f59fc0ccc40 msgr2=0x7f59fc070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:14.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.685+0000 7f59fbe00640 1 --2- 172.21.15.133:0/3320639630 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f59fc0ccc40 0x7f59fc070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:14.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.685+0000 7f59fbe00640 1 -- 172.21.15.133:0/3320639630 >> v1:172.21.15.137:6789/0 conn(0x7f59fc070500 legacy=0x7f59fc0cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:14.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.685+0000 7f59fbe00640 1 -- 172.21.15.133:0/3320639630 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59fc0cd180 con 0x7f59fc143790 2024-03-30T01:52:14.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.686+0000 7f59fbe00640 1 --2- 172.21.15.133:0/3320639630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59fc143790 0x7f59fc0cbb10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009870 tx=0x7f59ec02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=784369fbc2ba5a73 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:14.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.686+0000 7f59fb400640 1 -- 172.21.15.133:0/3320639630 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec030840 con 0x7f59fc143790 2024-03-30T01:52:14.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.686+0000 7f59fb400640 1 -- 172.21.15.133:0/3320639630 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ec0309a0 con 0x7f59fc143790 2024-03-30T01:52:14.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.686+0000 7f59fb400640 1 -- 172.21.15.133:0/3320639630 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec030d30 con 0x7f59fc143790 2024-03-30T01:52:14.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.687+0000 7f5a02e00640 1 -- 172.21.15.133:0/3320639630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59fc143790 msgr2=0x7f59fc0cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:14.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.687+0000 7f5a02e00640 1 --2- 172.21.15.133:0/3320639630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59fc143790 0x7f59fc0cbb10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009870 tx=0x7f59ec02b980 comp rx=0 tx=0).stop 2024-03-30T01:52:14.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.687+0000 7f5a02e00640 1 -- 172.21.15.133:0/3320639630 shutdown_connections 2024-03-30T01:52:14.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.687+0000 7f5a02e00640 1 --2- 172.21.15.133:0/3320639630 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f59fc0ccc40 0x7f59fc070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:14.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.687+0000 7f5a02e00640 1 --2- 172.21.15.133:0/3320639630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59fc143790 0x7f59fc0cbb10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.687+0000 7f5a02e00640 1 -- 172.21.15.133:0/3320639630 >> 172.21.15.133:0/3320639630 conn(0x7f59fc0b07a0 msgr2=0x7f59fc0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.687+0000 7f5a02e00640 1 -- 172.21.15.133:0/3320639630 shutdown_connections 2024-03-30T01:52:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.687+0000 7f5a02e00640 1 -- 172.21.15.133:0/3320639630 wait complete. 2024-03-30T01:52:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.688+0000 7f5a02e00640 1 Processor -- start 2024-03-30T01:52:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.689+0000 7f5a02e00640 1 -- start start 2024-03-30T01:52:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.690+0000 7f5a02e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f59fc070500 0x7f59fc1544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.690+0000 7f5a02e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59fc0ccc40 0x7f59fc0a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.690+0000 7f5a02e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59fc143790 0x7f59fc0a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:14.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.690+0000 7f5a02e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc13b320 con 0x7f59fc143790 2024-03-30T01:52:14.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.690+0000 7f5a02e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc13bc10 con 0x7f59fc0ccc40 2024-03-30T01:52:14.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.690+0000 7f5a02e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc154a10 con 0x7f59fc070500 2024-03-30T01:52:14.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.690+0000 7f5a00e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59fc143790 0x7f59fc0a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:14.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.690+0000 7f5a00e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59fc143790 0x7f59fc0a9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55494/0 (socket says 172.21.15.133:55494) 2024-03-30T01:52:14.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.690+0000 7f5a00e00640 1 -- 172.21.15.133:0/3167330826 learned_addr learned my addr 172.21.15.133:0/3167330826 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:14.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.690+0000 7f59fbe00640 1 --2- 172.21.15.133:0/3167330826 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f59fc070500 0x7f59fc1544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:14.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.690+0000 7f59f3e00640 1 --2- 172.21.15.133:0/3167330826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59fc0ccc40 0x7f59fc0a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:14.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.690+0000 7f5a00e00640 1 -- 172.21.15.133:0/3167330826 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f59fc070500 msgr2=0x7f59fc1544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:14.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.690+0000 7f5a00e00640 1 --2- 172.21.15.133:0/3167330826 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f59fc070500 0x7f59fc1544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:14.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.690+0000 7f5a00e00640 1 -- 172.21.15.133:0/3167330826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59fc0ccc40 msgr2=0x7f59fc0a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:14.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.690+0000 7f5a00e00640 1 --2- 172.21.15.133:0/3167330826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59fc0ccc40 0x7f59fc0a98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.690+0000 7f5a00e00640 1 -- 172.21.15.133:0/3167330826 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ec0094d0 con 0x7f59fc143790 2024-03-30T01:52:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.690+0000 7f59f3e00640 1 --2- 172.21.15.133:0/3167330826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59fc0ccc40 0x7f59fc0a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.691+0000 7f5a00e00640 1 --2- 172.21.15.133:0/3167330826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59fc143790 0x7f59fc0a9e30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f59f400b9e0 tx=0x7f59f400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.691+0000 7f59f8c00640 1 -- 172.21.15.133:0/3167330826 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f400cb20 con 0x7f59fc143790 2024-03-30T01:52:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.691+0000 7f59f8c00640 1 -- 172.21.15.133:0/3167330826 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f400cca0 con 0x7f59fc143790 2024-03-30T01:52:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.691+0000 7f59f8c00640 1 -- 172.21.15.133:0/3167330826 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f4014680 con 0x7f59fc143790 2024-03-30T01:52:14.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.691+0000 7f5a02e00640 1 -- 172.21.15.133:0/3167330826 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59fc13a6a0 con 0x7f59fc143790 2024-03-30T01:52:14.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.691+0000 7f5a02e00640 1 -- 172.21.15.133:0/3167330826 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59fc13ac60 con 0x7f59fc143790 2024-03-30T01:52:14.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.692+0000 7f5a02e00640 1 -- 172.21.15.133:0/3167330826 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59fc13b460 con 0x7f59fc143790 2024-03-30T01:52:14.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.693+0000 7f59f8c00640 1 -- 172.21.15.133:0/3167330826 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f59f401d3b0 con 0x7f59fc143790 2024-03-30T01:52:14.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.694+0000 7f59f8c00640 1 --2- 172.21.15.133:0/3167330826 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f59d806ac30 0x7f59d806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:14.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.694+0000 7f59f8c00640 1 -- 172.21.15.133:0/3167330826 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f59f4089300 con 0x7f59fc143790 2024-03-30T01:52:14.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.694+0000 7f59fbe00640 1 --2- 172.21.15.133:0/3167330826 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f59d806ac30 0x7f59d806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:14.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.695+0000 7f59fbe00640 1 --2- 172.21.15.133:0/3167330826 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f59d806ac30 0x7f59d806d0f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f59ec036000 tx=0x7f59ec008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:14.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.698+0000 7f59f8c00640 1 -- 172.21.15.133:0/3167330826 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f59fc13b460 con 0x7f59fc143790 2024-03-30T01:52:14.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.892+0000 7f5a02e00640 1 -- 172.21.15.133:0/3167330826 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f59fc13b460 con 0x7f59fc143790 2024-03-30T01:52:14.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.893+0000 7f59f8c00640 1 -- 172.21.15.133:0/3167330826 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f59fc13b460 con 0x7f59fc143790 2024-03-30T01:52:14.899 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-03-30T01:52:14.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.895+0000 7f5a02e00640 1 -- 172.21.15.133:0/3167330826 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f59d806ac30 msgr2=0x7f59d806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:14.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.895+0000 7f5a02e00640 1 --2- 172.21.15.133:0/3167330826 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f59d806ac30 0x7f59d806d0f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f59ec036000 tx=0x7f59ec008030 comp rx=0 tx=0).stop 2024-03-30T01:52:14.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.895+0000 7f5a02e00640 1 -- 172.21.15.133:0/3167330826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59fc143790 msgr2=0x7f59fc0a9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:14.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.895+0000 7f5a02e00640 1 --2- 172.21.15.133:0/3167330826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59fc143790 0x7f59fc0a9e30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f59f400b9e0 tx=0x7f59f400bea0 comp rx=0 tx=0).stop 2024-03-30T01:52:14.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.896+0000 7f5a02e00640 1 -- 172.21.15.133:0/3167330826 shutdown_connections 2024-03-30T01:52:14.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.896+0000 7f5a02e00640 1 --2- 172.21.15.133:0/3167330826 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f59d806ac30 0x7f59d806d0f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:14.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.896+0000 7f5a02e00640 1 --2- 172.21.15.133:0/3167330826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59fc143790 0x7f59fc0a9e30 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:14.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.896+0000 7f5a02e00640 1 --2- 172.21.15.133:0/3167330826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59fc0ccc40 0x7f59fc0a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:14.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.896+0000 7f5a02e00640 1 --2- 172.21.15.133:0/3167330826 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f59fc070500 0x7f59fc1544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:14.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.896+0000 7f5a02e00640 1 -- 172.21.15.133:0/3167330826 >> 172.21.15.133:0/3167330826 conn(0x7f59fc0b07a0 msgr2=0x7f59fc13fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:14.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.896+0000 7f5a02e00640 1 -- 172.21.15.133:0/3167330826 shutdown_connections 2024-03-30T01:52:14.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:14.896+0000 7f5a02e00640 1 -- 172.21.15.133:0/3167330826 wait complete. 2024-03-30T01:52:14.963 INFO:tasks.cephfs_test_runner:Starting test: test_recover_fs_after_fsmap_removal (tasks.cephfs.test_recovery_fs.TestFSRecovery) 2024-03-30T01:52:14.964 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:52:15.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.165+0000 7f7ae9a00640 1 Processor -- start 2024-03-30T01:52:15.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.165+0000 7f7ae9a00640 1 -- start start 2024-03-30T01:52:15.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.166+0000 7f7ae9a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ae406e2e0 0x7f7ae4070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:15.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.166+0000 7f7ae9a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ae4070a40 0x7f7ae415d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:15.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.166+0000 7f7ae9a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae40ce400 con 0x7f7ae4143220 2024-03-30T01:52:15.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.166+0000 7f7ae9a00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae4070ef0 con 0x7f7ae4070a40 2024-03-30T01:52:15.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.166+0000 7f7ae9a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae40cc5c0 con 0x7f7ae406e2e0 2024-03-30T01:52:15.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.167+0000 7f7ae3400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ae4070a40 0x7f7ae415d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:15.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.167+0000 7f7ae3400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ae4070a40 0x7f7ae415d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55498/0 (socket says 172.21.15.133:55498) 2024-03-30T01:52:15.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.167+0000 7f7ae3400640 1 -- 172.21.15.133:0/3008470338 learned_addr learned my addr 172.21.15.133:0/3008470338 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:15.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.167+0000 7f7ada000640 1 --2- 172.21.15.133:0/3008470338 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ae406e2e0 0x7f7ae4070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:15.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.167+0000 7f7ae3400640 1 -- 172.21.15.133:0/3008470338 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ae406e2e0 msgr2=0x7f7ae4070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:15.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.167+0000 7f7ae3400640 1 --2- 172.21.15.133:0/3008470338 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ae406e2e0 0x7f7ae4070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:15.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.167+0000 7f7ae3400640 1 -- 172.21.15.133:0/3008470338 >> v1:172.21.15.137:6789/0 conn(0x7f7ae4143220 legacy=0x7f7ae40cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:15.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.167+0000 7f7ae3400640 1 -- 172.21.15.133:0/3008470338 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae406d0e0 con 0x7f7ae4070a40 2024-03-30T01:52:15.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.168+0000 7f7ae3400640 1 --2- 172.21.15.133:0/3008470338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae4070a40 0x7f7ae415d3b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009e50 tx=0x7f7adc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba300abae763973a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:15.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.169+0000 7f7ae2000640 1 -- 172.21.15.133:0/3008470338 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc02cb00 con 0x7f7ae4070a40 2024-03-30T01:52:15.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.169+0000 7f7ae2000640 1 -- 172.21.15.133:0/3008470338 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7adc02cc60 con 0x7f7ae4070a40 2024-03-30T01:52:15.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.169+0000 7f7ae2000640 1 -- 172.21.15.133:0/3008470338 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc0343f0 con 0x7f7ae4070a40 2024-03-30T01:52:15.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.169+0000 7f7ae9a00640 1 -- 172.21.15.133:0/3008470338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae4070a40 msgr2=0x7f7ae415d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:15.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.169+0000 7f7ae9a00640 1 --2- 172.21.15.133:0/3008470338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae4070a40 0x7f7ae415d3b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009e50 tx=0x7f7adc02bf60 comp rx=0 tx=0).stop 2024-03-30T01:52:15.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.169+0000 7f7ae9a00640 1 -- 172.21.15.133:0/3008470338 shutdown_connections 2024-03-30T01:52:15.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.169+0000 7f7ae9a00640 1 --2- 172.21.15.133:0/3008470338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae4070a40 0x7f7ae415d3b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:15.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.169+0000 7f7ae9a00640 1 --2- 172.21.15.133:0/3008470338 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ae406e2e0 0x7f7ae4070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:15.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.169+0000 7f7ae9a00640 1 -- 172.21.15.133:0/3008470338 >> 172.21.15.133:0/3008470338 conn(0x7f7ae40b07a0 msgr2=0x7f7ae40b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:15.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.170+0000 7f7ae9a00640 1 -- 172.21.15.133:0/3008470338 shutdown_connections 2024-03-30T01:52:15.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.170+0000 7f7ae9a00640 1 -- 172.21.15.133:0/3008470338 wait complete. 2024-03-30T01:52:15.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.171+0000 7f7ae9a00640 1 Processor -- start 2024-03-30T01:52:15.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.171+0000 7f7ae9a00640 1 -- start start 2024-03-30T01:52:15.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.172+0000 7f7ae9a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ae406e2e0 0x7f7ae415c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:15.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.172+0000 7f7ae9a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ae4070a40 0x7f7ae4139230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:15.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.172+0000 7f7ae9a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae4143220 0x7f7ae413d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:15.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.172+0000 7f7ae9a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae415aea0 con 0x7f7ae4143220 2024-03-30T01:52:15.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.172+0000 7f7ae9a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae415c9b0 con 0x7f7ae406e2e0 2024-03-30T01:52:15.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.172+0000 7f7ae9a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae415a850 con 0x7f7ae4070a40 2024-03-30T01:52:15.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.173+0000 7f7ae3400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae4143220 0x7f7ae413d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:15.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.173+0000 7f7ae3400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae4143220 0x7f7ae413d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55502/0 (socket says 172.21.15.133:55502) 2024-03-30T01:52:15.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.173+0000 7f7ae3400640 1 -- 172.21.15.133:0/2607932646 learned_addr learned my addr 172.21.15.133:0/2607932646 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:15.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.173+0000 7f7ada000640 1 --2- 172.21.15.133:0/2607932646 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ae4070a40 0x7f7ae4139230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:15.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.173+0000 7f7ae2a00640 1 --2- 172.21.15.133:0/2607932646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ae406e2e0 0x7f7ae415c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:15.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.173+0000 7f7ae3400640 1 -- 172.21.15.133:0/2607932646 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ae4070a40 msgr2=0x7f7ae4139230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:15.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.173+0000 7f7ae3400640 1 --2- 172.21.15.133:0/2607932646 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ae4070a40 0x7f7ae4139230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:15.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.173+0000 7f7ae3400640 1 -- 172.21.15.133:0/2607932646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ae406e2e0 msgr2=0x7f7ae415c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:15.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.173+0000 7f7ae3400640 1 --2- 172.21.15.133:0/2607932646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ae406e2e0 0x7f7ae415c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:15.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.173+0000 7f7ae3400640 1 -- 172.21.15.133:0/2607932646 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc009b30 con 0x7f7ae4143220 2024-03-30T01:52:15.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.174+0000 7f7ae3400640 1 --2- 172.21.15.133:0/2607932646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae4143220 0x7f7ae413d320 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7adc036040 tx=0x7f7adc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:15.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.174+0000 7f7adb400640 1 -- 172.21.15.133:0/2607932646 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc009510 con 0x7f7ae4143220 2024-03-30T01:52:15.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.174+0000 7f7adb400640 1 -- 172.21.15.133:0/2607932646 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7adc03e450 con 0x7f7ae4143220 2024-03-30T01:52:15.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.174+0000 7f7adb400640 1 -- 172.21.15.133:0/2607932646 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc03e800 con 0x7f7ae4143220 2024-03-30T01:52:15.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.174+0000 7f7ae9a00640 1 -- 172.21.15.133:0/2607932646 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae4139770 con 0x7f7ae4143220 2024-03-30T01:52:15.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.174+0000 7f7ae9a00640 1 -- 172.21.15.133:0/2607932646 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae415aac0 con 0x7f7ae4143220 2024-03-30T01:52:15.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.175+0000 7f7ae9a00640 1 -- 172.21.15.133:0/2607932646 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae4066d80 con 0x7f7ae4143220 2024-03-30T01:52:15.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.176+0000 7f7adb400640 1 -- 172.21.15.133:0/2607932646 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f7adc03e960 con 0x7f7ae4143220 2024-03-30T01:52:15.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.177+0000 7f7adb400640 1 --2- 172.21.15.133:0/2607932646 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7ac006ac30 0x7f7ac006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:15.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.177+0000 7f7adb400640 1 -- 172.21.15.133:0/2607932646 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7adc0ac1e0 con 0x7f7ae4143220 2024-03-30T01:52:15.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.177+0000 7f7ae2a00640 1 --2- 172.21.15.133:0/2607932646 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7ac006ac30 0x7f7ac006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:15.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.178+0000 7f7ae2a00640 1 --2- 172.21.15.133:0/2607932646 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7ac006ac30 0x7f7ac006d0f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4000f60 tx=0x7f7ad4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:15.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.182+0000 7f7adb400640 1 -- 172.21.15.133:0/2607932646 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f7adc0772a0 con 0x7f7ae4143220 2024-03-30T01:52:15.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.376+0000 7f7ae9a00640 1 -- 172.21.15.133:0/2607932646 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ae415d120 con 0x7f7ae4143220 2024-03-30T01:52:15.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.379+0000 7f7adb400640 1 -- 172.21.15.133:0/2607932646 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16335 (secure 0 0 0) 0x7f7adc07a8c0 con 0x7f7ae4143220 2024-03-30T01:52:15.386 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:15.386 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":21,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:52:14.511828+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:51:31.245378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T01:51:31.774247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:52:15.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.382+0000 7f7ae9a00640 1 -- 172.21.15.133:0/2607932646 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7ac006ac30 msgr2=0x7f7ac006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:15.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.382+0000 7f7ae9a00640 1 --2- 172.21.15.133:0/2607932646 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7ac006ac30 0x7f7ac006d0f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4000f60 tx=0x7f7ad4009040 comp rx=0 tx=0).stop 2024-03-30T01:52:15.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.382+0000 7f7ae9a00640 1 -- 172.21.15.133:0/2607932646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae4143220 msgr2=0x7f7ae413d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:15.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.382+0000 7f7ae9a00640 1 --2- 172.21.15.133:0/2607932646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae4143220 0x7f7ae413d320 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7adc036040 tx=0x7f7adc004a40 comp rx=0 tx=0).stop 2024-03-30T01:52:15.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.382+0000 7f7ae9a00640 1 -- 172.21.15.133:0/2607932646 shutdown_connections 2024-03-30T01:52:15.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.382+0000 7f7ae9a00640 1 --2- 172.21.15.133:0/2607932646 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7ac006ac30 0x7f7ac006d0f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:15.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.382+0000 7f7ae9a00640 1 --2- 172.21.15.133:0/2607932646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae4143220 0x7f7ae413d320 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:15.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.382+0000 7f7ae9a00640 1 --2- 172.21.15.133:0/2607932646 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ae4070a40 0x7f7ae4139230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:15.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.382+0000 7f7ae9a00640 1 --2- 172.21.15.133:0/2607932646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ae406e2e0 0x7f7ae415c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:15.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.382+0000 7f7ae9a00640 1 -- 172.21.15.133:0/2607932646 >> 172.21.15.133:0/2607932646 conn(0x7f7ae40b07a0 msgr2=0x7f7ae413f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:15.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.382+0000 7f7ae9a00640 1 -- 172.21.15.133:0/2607932646 shutdown_connections 2024-03-30T01:52:15.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.382+0000 7f7ae9a00640 1 -- 172.21.15.133:0/2607932646 wait complete. 2024-03-30T01:52:15.407 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T01:51:21.771393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T01:51:31.245378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T01:51:31.774247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T01:52:15.408 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T01:52:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.619+0000 7feeb3400640 1 Processor -- start 2024-03-30T01:52:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.619+0000 7feeb3400640 1 -- start start 2024-03-30T01:52:15.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.620+0000 7feeb3400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feeac070500 0x7feeac070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:15.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.620+0000 7feeb3400640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeac0a76a0 con 0x7feeac143790 2024-03-30T01:52:15.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.620+0000 7feeb3400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeac0b38e0 con 0x7feeac0cc530 2024-03-30T01:52:15.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.620+0000 7feeb3400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeac070ed0 con 0x7feeac070500 2024-03-30T01:52:15.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.621+0000 7feeb0a00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7feeac143790 0x7feeac0cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43926/0 (socket says 172.21.15.133:43926) 2024-03-30T01:52:15.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.621+0000 7feeb0a00640 1 -- 172.21.15.133:0/9285918 learned_addr learned my addr 172.21.15.133:0/9285918 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:15.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.621+0000 7feeabe00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feeac070500 0x7feeac070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:15.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.621+0000 7feeabe00640 1 -- 172.21.15.133:0/9285918 >> v1:172.21.15.137:6789/0 conn(0x7feeac0cc530 legacy=0x7feeac0cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:15.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.621+0000 7feeabe00640 1 -- 172.21.15.133:0/9285918 >> v1:172.21.15.133:6789/0 conn(0x7feeac143790 legacy=0x7feeac0cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:15.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.621+0000 7feeabe00640 1 -- 172.21.15.133:0/9285918 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac0cd180 con 0x7feeac070500 2024-03-30T01:52:15.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.621+0000 7feeab400640 1 -- 172.21.15.133:0/9285918 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538770241 0 0) 0x7feeac0a76a0 con 0x7feeac143790 2024-03-30T01:52:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.622+0000 7feeabe00640 1 --2- 172.21.15.133:0/9285918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feeac070500 0x7feeac070990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fee980097a0 tx=0x7fee9802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45f00d560e9aa5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.623+0000 7feeab400640 1 -- 172.21.15.133:0/9285918 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee98030610 con 0x7feeac070500 2024-03-30T01:52:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.623+0000 7feeab400640 1 -- 172.21.15.133:0/9285918 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee98030770 con 0x7feeac070500 2024-03-30T01:52:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.623+0000 7feeab400640 1 -- 172.21.15.133:0/9285918 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee98030b00 con 0x7feeac070500 2024-03-30T01:52:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.623+0000 7feeb3400640 1 -- 172.21.15.133:0/9285918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feeac070500 msgr2=0x7feeac070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.623+0000 7feeb3400640 1 --2- 172.21.15.133:0/9285918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feeac070500 0x7feeac070990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fee980097a0 tx=0x7fee9802b960 comp rx=0 tx=0).stop 2024-03-30T01:52:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.623+0000 7feeb3400640 1 -- 172.21.15.133:0/9285918 shutdown_connections 2024-03-30T01:52:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.623+0000 7feeb3400640 1 --2- 172.21.15.133:0/9285918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feeac070500 0x7feeac070990 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.623+0000 7feeb3400640 1 -- 172.21.15.133:0/9285918 >> 172.21.15.133:0/9285918 conn(0x7feeac0b07a0 msgr2=0x7feeac0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.624+0000 7feeb3400640 1 -- 172.21.15.133:0/9285918 shutdown_connections 2024-03-30T01:52:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.624+0000 7feeb3400640 1 -- 172.21.15.133:0/9285918 wait complete. 2024-03-30T01:52:15.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.625+0000 7feeb3400640 1 Processor -- start 2024-03-30T01:52:15.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.625+0000 7feeb3400640 1 -- start start 2024-03-30T01:52:15.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.626+0000 7feeb3400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feeac070500 0x7feeac0aba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:15.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.626+0000 7feeb3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feeac0cc530 0x7feeac13caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:15.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.626+0000 7feeb3400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feeac143790 0x7feeac0ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:15.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.626+0000 7feeb3400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac0ac340 con 0x7feeac070500 2024-03-30T01:52:15.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.626+0000 7feeb3400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac0ac620 con 0x7feeac0cc530 2024-03-30T01:52:15.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.626+0000 7feeb3400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeac0ac900 con 0x7feeac143790 2024-03-30T01:52:15.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.627+0000 7feeb0a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feeac070500 0x7feeac0aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:15.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.627+0000 7feeb0a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feeac070500 0x7feeac0aba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55516/0 (socket says 172.21.15.133:55516) 2024-03-30T01:52:15.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.627+0000 7feeb0a00640 1 -- 172.21.15.133:0/3895882074 learned_addr learned my addr 172.21.15.133:0/3895882074 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.627+0000 7feeb0a00640 1 -- 172.21.15.133:0/3895882074 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feeac143790 msgr2=0x7feeac0ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.627+0000 7feeb0a00640 1 --2- 172.21.15.133:0/3895882074 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feeac143790 0x7feeac0ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.627+0000 7feeb0a00640 1 -- 172.21.15.133:0/3895882074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feeac0cc530 msgr2=0x7feeac13caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.627+0000 7feeb0a00640 1 --2- 172.21.15.133:0/3895882074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feeac0cc530 0x7feeac13caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.627+0000 7feeb0a00640 1 -- 172.21.15.133:0/3895882074 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee98009400 con 0x7feeac070500 2024-03-30T01:52:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.627+0000 7feeb0a00640 1 --2- 172.21.15.133:0/3895882074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feeac070500 0x7feeac0aba40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00c7c0 tx=0x7fee9c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.628+0000 7feea8c00640 1 -- 172.21.15.133:0/3895882074 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c00a640 con 0x7feeac070500 2024-03-30T01:52:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.628+0000 7feea8c00640 1 -- 172.21.15.133:0/3895882074 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c00a7c0 con 0x7feeac070500 2024-03-30T01:52:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.628+0000 7feeb3400640 1 -- 172.21.15.133:0/3895882074 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeac0acbe0 con 0x7feeac070500 2024-03-30T01:52:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.628+0000 7feea8c00640 1 -- 172.21.15.133:0/3895882074 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c00ab70 con 0x7feeac070500 2024-03-30T01:52:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.628+0000 7feeb3400640 1 -- 172.21.15.133:0/3895882074 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeac0abf80 con 0x7feeac070500 2024-03-30T01:52:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.629+0000 7feeb3400640 1 -- 172.21.15.133:0/3895882074 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeac0ad100 con 0x7feeac070500 2024-03-30T01:52:15.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.630+0000 7feea8c00640 1 -- 172.21.15.133:0/3895882074 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fee9c00acd0 con 0x7feeac070500 2024-03-30T01:52:15.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.631+0000 7feea8c00640 1 --2- 172.21.15.133:0/3895882074 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fee8c06ac00 0x7fee8c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:15.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.631+0000 7feea8c00640 1 -- 172.21.15.133:0/3895882074 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fee9c0889a0 con 0x7feeac070500 2024-03-30T01:52:15.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.631+0000 7feeabe00640 1 --2- 172.21.15.133:0/3895882074 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fee8c06ac00 0x7fee8c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:15.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.632+0000 7feeabe00640 1 --2- 172.21.15.133:0/3895882074 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fee8c06ac00 0x7fee8c06d0c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fee98036000 tx=0x7fee9803b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:15.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.636+0000 7feea8c00640 1 -- 172.21.15.133:0/3895882074 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fee9c053b00 con 0x7feeac070500 2024-03-30T01:52:15.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.834+0000 7feeb3400640 1 -- 172.21.15.133:0/3895882074 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feeac066d80 con 0x7feeac070500 2024-03-30T01:52:15.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.835+0000 7feea8c00640 1 -- 172.21.15.133:0/3895882074 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fee9c018070 con 0x7feeac070500 2024-03-30T01:52:15.842 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-03-30T01:52:15.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.838+0000 7feeb3400640 1 -- 172.21.15.133:0/3895882074 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fee8c06ac00 msgr2=0x7fee8c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:15.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.838+0000 7feeb3400640 1 --2- 172.21.15.133:0/3895882074 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fee8c06ac00 0x7fee8c06d0c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fee98036000 tx=0x7fee9803b040 comp rx=0 tx=0).stop 2024-03-30T01:52:15.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.838+0000 7feeb3400640 1 -- 172.21.15.133:0/3895882074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feeac070500 msgr2=0x7feeac0aba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:15.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.838+0000 7feeb3400640 1 --2- 172.21.15.133:0/3895882074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feeac070500 0x7feeac0aba40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00c7c0 tx=0x7fee9c00cc80 comp rx=0 tx=0).stop 2024-03-30T01:52:15.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.838+0000 7feeb3400640 1 -- 172.21.15.133:0/3895882074 shutdown_connections 2024-03-30T01:52:15.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.838+0000 7feeb3400640 1 --2- 172.21.15.133:0/3895882074 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fee8c06ac00 0x7fee8c06d0c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:15.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.838+0000 7feeb3400640 1 --2- 172.21.15.133:0/3895882074 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feeac143790 0x7feeac0ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:15.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.838+0000 7feeb3400640 1 --2- 172.21.15.133:0/3895882074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feeac0cc530 0x7feeac13caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:15.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.838+0000 7feeb3400640 1 --2- 172.21.15.133:0/3895882074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feeac070500 0x7feeac0aba40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:15.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.838+0000 7feeb3400640 1 -- 172.21.15.133:0/3895882074 >> 172.21.15.133:0/3895882074 conn(0x7feeac0b07a0 msgr2=0x7feeac0ae510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:15.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.839+0000 7feeb3400640 1 -- 172.21.15.133:0/3895882074 shutdown_connections 2024-03-30T01:52:15.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:15.839+0000 7feeb3400640 1 -- 172.21.15.133:0/3895882074 wait complete. 2024-03-30T01:52:15.864 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T01:52:16.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.071+0000 7f6227400640 1 Processor -- start 2024-03-30T01:52:16.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.072+0000 7f6227400640 1 -- start start 2024-03-30T01:52:16.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.073+0000 7f6227400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f622006e2e0 0x7f6220070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:16.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.073+0000 7f6227400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6220070a40 0x7f622015d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:16.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.073+0000 7f6227400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6220070e50 con 0x7f6220143220 2024-03-30T01:52:16.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.073+0000 7f6227400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62200cc5c0 con 0x7f6220070a40 2024-03-30T01:52:16.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.073+0000 7f6227400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62200ce400 con 0x7f622006e2e0 2024-03-30T01:52:16.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.073+0000 7f6225400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6220070a40 0x7f622015d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:16.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.073+0000 7f6225400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6220070a40 0x7f622015d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38306/0 (socket says 172.21.15.133:38306) 2024-03-30T01:52:16.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.073+0000 7f6225400640 1 -- 172.21.15.133:0/395795745 learned_addr learned my addr 172.21.15.133:0/395795745 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:16.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.074+0000 7f6225400640 1 -- 172.21.15.133:0/395795745 >> v2:172.21.15.137:3300/0 conn(0x7f622006e2e0 msgr2=0x7f6220070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:16.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.074+0000 7f6225400640 1 --2- 172.21.15.133:0/395795745 >> v2:172.21.15.137:3300/0 conn(0x7f622006e2e0 0x7f6220070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.074+0000 7f6225400640 1 -- 172.21.15.133:0/395795745 >> v1:172.21.15.137:6789/0 conn(0x7f6220143220 legacy=0x7f62200cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:16.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.074+0000 7f6225400640 1 -- 172.21.15.133:0/395795745 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622006d0e0 con 0x7f6220070a40 2024-03-30T01:52:16.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.075+0000 7f6225400640 1 --2- 172.21.15.133:0/395795745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6220070a40 0x7f622015d3b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f62200cd740 tx=0x7f621802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea603aeafe0b336 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:16.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.075+0000 7f621f400640 1 -- 172.21.15.133:0/395795745 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621802ca80 con 0x7f6220070a40 2024-03-30T01:52:16.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.075+0000 7f621f400640 1 -- 172.21.15.133:0/395795745 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621802cbe0 con 0x7f6220070a40 2024-03-30T01:52:16.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.075+0000 7f621f400640 1 -- 172.21.15.133:0/395795745 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62180343f0 con 0x7f6220070a40 2024-03-30T01:52:16.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.076+0000 7f6227400640 1 -- 172.21.15.133:0/395795745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6220070a40 msgr2=0x7f622015d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:16.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.076+0000 7f6227400640 1 --2- 172.21.15.133:0/395795745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6220070a40 0x7f622015d3b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f62200cd740 tx=0x7f621802bee0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.076+0000 7f6227400640 1 -- 172.21.15.133:0/395795745 shutdown_connections 2024-03-30T01:52:16.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.076+0000 7f6227400640 1 --2- 172.21.15.133:0/395795745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6220070a40 0x7f622015d3b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.076+0000 7f6227400640 1 --2- 172.21.15.133:0/395795745 >> v2:172.21.15.137:3300/0 conn(0x7f622006e2e0 0x7f6220070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.076+0000 7f6227400640 1 -- 172.21.15.133:0/395795745 >> 172.21.15.133:0/395795745 conn(0x7f62200b07a0 msgr2=0x7f62200b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:16.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.076+0000 7f6227400640 1 -- 172.21.15.133:0/395795745 shutdown_connections 2024-03-30T01:52:16.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.076+0000 7f6227400640 1 -- 172.21.15.133:0/395795745 wait complete. 2024-03-30T01:52:16.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.077+0000 7f6227400640 1 Processor -- start 2024-03-30T01:52:16.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.078+0000 7f6227400640 1 -- start start 2024-03-30T01:52:16.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.078+0000 7f6227400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f622006e2e0 0x7f62200c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:16.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.079+0000 7f6227400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6220070a40 0x7f622013a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:16.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.079+0000 7f6227400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6220143220 0x7f622013b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:16.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.079+0000 7f6227400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62200c9700 con 0x7f6220070a40 2024-03-30T01:52:16.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.079+0000 7f6227400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62200c8120 con 0x7f6220143220 2024-03-30T01:52:16.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.079+0000 7f6227400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62200c8400 con 0x7f622006e2e0 2024-03-30T01:52:16.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.079+0000 7f621fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6220070a40 0x7f622013a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:16.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.079+0000 7f621fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6220070a40 0x7f622013a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38308/0 (socket says 172.21.15.133:38308) 2024-03-30T01:52:16.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.079+0000 7f621fe00640 1 -- 172.21.15.133:0/1387535573 learned_addr learned my addr 172.21.15.133:0/1387535573 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.079+0000 7f621fe00640 1 -- 172.21.15.133:0/1387535573 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f622006e2e0 msgr2=0x7f62200c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.079+0000 7f6224a00640 1 --2- 172.21.15.133:0/1387535573 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f622006e2e0 0x7f62200c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.079+0000 7f621fe00640 1 --2- 172.21.15.133:0/1387535573 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f622006e2e0 0x7f62200c91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.079+0000 7f621fe00640 1 -- 172.21.15.133:0/1387535573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6220143220 msgr2=0x7f622013b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.079+0000 7f6225400640 1 --2- 172.21.15.133:0/1387535573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6220143220 0x7f622013b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.079+0000 7f621fe00640 1 --2- 172.21.15.133:0/1387535573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6220143220 0x7f622013b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.079+0000 7f621fe00640 1 -- 172.21.15.133:0/1387535573 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6218009b30 con 0x7f6220070a40 2024-03-30T01:52:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.080+0000 7f621fe00640 1 --2- 172.21.15.133:0/1387535573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6220070a40 0x7f622013a720 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f620c00b410 tx=0x7f620c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.080+0000 7f621cc00640 1 -- 172.21.15.133:0/1387535573 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c011830 con 0x7f6220070a40 2024-03-30T01:52:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.080+0000 7f621cc00640 1 -- 172.21.15.133:0/1387535573 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620c0119b0 con 0x7f6220070a40 2024-03-30T01:52:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.080+0000 7f6227400640 1 -- 172.21.15.133:0/1387535573 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62200c86e0 con 0x7f6220070a40 2024-03-30T01:52:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.080+0000 7f621cc00640 1 -- 172.21.15.133:0/1387535573 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c011d60 con 0x7f6220070a40 2024-03-30T01:52:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.080+0000 7f6227400640 1 -- 172.21.15.133:0/1387535573 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62200c8ca0 con 0x7f6220070a40 2024-03-30T01:52:16.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.081+0000 7f6227400640 1 -- 172.21.15.133:0/1387535573 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6220066d80 con 0x7f6220070a40 2024-03-30T01:52:16.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.082+0000 7f621cc00640 1 -- 172.21.15.133:0/1387535573 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f620c01a400 con 0x7f6220070a40 2024-03-30T01:52:16.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.083+0000 7f621cc00640 1 --2- 172.21.15.133:0/1387535573 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f620006ac00 0x7f620006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:16.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.083+0000 7f621cc00640 1 -- 172.21.15.133:0/1387535573 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f620c0895f0 con 0x7f6220070a40 2024-03-30T01:52:16.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.083+0000 7f6224a00640 1 --2- 172.21.15.133:0/1387535573 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f620006ac00 0x7f620006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:16.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.084+0000 7f6224a00640 1 --2- 172.21.15.133:0/1387535573 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f620006ac00 0x7f620006d0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f62140015d0 tx=0x7f6214009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:16.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.087+0000 7f621cc00640 1 -- 172.21.15.133:0/1387535573 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f620c054620 con 0x7f6220070a40 2024-03-30T01:52:16.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.282+0000 7f6227400640 1 -- 172.21.15.133:0/1387535573 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f622015d120 con 0x7f6220070a40 2024-03-30T01:52:16.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.283+0000 7f621cc00640 1 -- 172.21.15.133:0/1387535573 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f620c015020 con 0x7f6220070a40 2024-03-30T01:52:16.289 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-03-30T01:52:16.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.285+0000 7f6227400640 1 -- 172.21.15.133:0/1387535573 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f620006ac00 msgr2=0x7f620006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:16.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.285+0000 7f6227400640 1 --2- 172.21.15.133:0/1387535573 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f620006ac00 0x7f620006d0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f62140015d0 tx=0x7f6214009040 comp rx=0 tx=0).stop 2024-03-30T01:52:16.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.285+0000 7f6227400640 1 -- 172.21.15.133:0/1387535573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6220070a40 msgr2=0x7f622013a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:16.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.285+0000 7f6227400640 1 --2- 172.21.15.133:0/1387535573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6220070a40 0x7f622013a720 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f620c00b410 tx=0x7f620c00b8d0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.286+0000 7f6227400640 1 -- 172.21.15.133:0/1387535573 shutdown_connections 2024-03-30T01:52:16.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.286+0000 7f6227400640 1 --2- 172.21.15.133:0/1387535573 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f620006ac00 0x7f620006d0c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.286+0000 7f6227400640 1 --2- 172.21.15.133:0/1387535573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6220143220 0x7f622013b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.286+0000 7f6227400640 1 --2- 172.21.15.133:0/1387535573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6220070a40 0x7f622013a720 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.286+0000 7f6227400640 1 --2- 172.21.15.133:0/1387535573 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f622006e2e0 0x7f62200c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.286+0000 7f6227400640 1 -- 172.21.15.133:0/1387535573 >> 172.21.15.133:0/1387535573 conn(0x7f62200b07a0 msgr2=0x7f6220140810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:16.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.286+0000 7f6227400640 1 -- 172.21.15.133:0/1387535573 shutdown_connections 2024-03-30T01:52:16.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.286+0000 7f6227400640 1 -- 172.21.15.133:0/1387535573 wait complete. 2024-03-30T01:52:16.311 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T01:52:16.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.511+0000 7f5c74c00640 1 Processor -- start 2024-03-30T01:52:16.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.511+0000 7f5c74c00640 1 -- start start 2024-03-30T01:52:16.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.512+0000 7f5c74c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c701457b0 0x7f5c700b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:16.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.512+0000 7f5c74c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5c70145d30 0x7f5c70070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:16.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.512+0000 7f5c74c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c700b28d0 con 0x7f5c70070a40 2024-03-30T01:52:16.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.512+0000 7f5c74c00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c70070ed0 con 0x7f5c70145d30 2024-03-30T01:52:16.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.512+0000 7f5c74c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c70145b90 con 0x7f5c701457b0 2024-03-30T01:52:16.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.513+0000 7f5c67e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5c70145d30 0x7f5c70070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:16.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.513+0000 7f5c67e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5c70145d30 0x7f5c70070500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38316/0 (socket says 172.21.15.133:38316) 2024-03-30T01:52:16.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.513+0000 7f5c67e00640 1 -- 172.21.15.133:0/254000757 learned_addr learned my addr 172.21.15.133:0/254000757 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:16.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.513+0000 7f5c6de00640 1 --2- 172.21.15.133:0/254000757 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c701457b0 0x7f5c700b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:16.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.513+0000 7f5c67e00640 1 -- 172.21.15.133:0/254000757 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c701457b0 msgr2=0x7f5c700b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:16.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.513+0000 7f5c67e00640 1 --2- 172.21.15.133:0/254000757 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c701457b0 0x7f5c700b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.513+0000 7f5c67e00640 1 -- 172.21.15.133:0/254000757 >> v1:172.21.15.137:6789/0 conn(0x7f5c70070a40 legacy=0x7f5c70160620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:16.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.513+0000 7f5c67e00640 1 -- 172.21.15.133:0/254000757 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7006c320 con 0x7f5c70145d30 2024-03-30T01:52:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.514+0000 7f5c67e00640 1 --2- 172.21.15.133:0/254000757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c70145d30 0x7f5c70070500 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5c580098a0 tx=0x7f5c5802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f208c01570d6511e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.515+0000 7f5c6d400640 1 -- 172.21.15.133:0/254000757 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c58030840 con 0x7f5c70145d30 2024-03-30T01:52:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.515+0000 7f5c6d400640 1 -- 172.21.15.133:0/254000757 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c580309a0 con 0x7f5c70145d30 2024-03-30T01:52:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.515+0000 7f5c6d400640 1 -- 172.21.15.133:0/254000757 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c58030d30 con 0x7f5c70145d30 2024-03-30T01:52:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.515+0000 7f5c74c00640 1 -- 172.21.15.133:0/254000757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c70145d30 msgr2=0x7f5c70070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.515+0000 7f5c74c00640 1 --2- 172.21.15.133:0/254000757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c70145d30 0x7f5c70070500 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5c580098a0 tx=0x7f5c5802b980 comp rx=0 tx=0).stop 2024-03-30T01:52:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.515+0000 7f5c74c00640 1 -- 172.21.15.133:0/254000757 shutdown_connections 2024-03-30T01:52:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.515+0000 7f5c74c00640 1 --2- 172.21.15.133:0/254000757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c70145d30 0x7f5c70070500 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.515+0000 7f5c74c00640 1 --2- 172.21.15.133:0/254000757 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c701457b0 0x7f5c700b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.515+0000 7f5c74c00640 1 -- 172.21.15.133:0/254000757 >> 172.21.15.133:0/254000757 conn(0x7f5c700b07a0 msgr2=0x7f5c700b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.515+0000 7f5c74c00640 1 -- 172.21.15.133:0/254000757 shutdown_connections 2024-03-30T01:52:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.516+0000 7f5c74c00640 1 -- 172.21.15.133:0/254000757 wait complete. 2024-03-30T01:52:16.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.517+0000 7f5c74c00640 1 Processor -- start 2024-03-30T01:52:16.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.517+0000 7f5c74c00640 1 -- start start 2024-03-30T01:52:16.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.518+0000 7f5c74c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c70070a40 0x7f5c701f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:16.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.518+0000 7f5c74c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c701457b0 0x7f5c7012fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:16.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.518+0000 7f5c74c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c70145d30 0x7f5c7015ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:16.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.518+0000 7f5c74c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c70142e40 con 0x7f5c70145d30 2024-03-30T01:52:16.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.518+0000 7f5c74c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c70143120 con 0x7f5c701457b0 2024-03-30T01:52:16.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.518+0000 7f5c74c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c70143400 con 0x7f5c70070a40 2024-03-30T01:52:16.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.519+0000 7f5c6e800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c70145d30 0x7f5c7015ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:16.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.519+0000 7f5c6e800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c70145d30 0x7f5c7015ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38328/0 (socket says 172.21.15.133:38328) 2024-03-30T01:52:16.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.519+0000 7f5c6e800640 1 -- 172.21.15.133:0/16961160 learned_addr learned my addr 172.21.15.133:0/16961160 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:16.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.519+0000 7f5c67e00640 1 --2- 172.21.15.133:0/16961160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c701457b0 0x7f5c7012fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:16.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.519+0000 7f5c6de00640 1 --2- 172.21.15.133:0/16961160 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c70070a40 0x7f5c701f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:16.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.519+0000 7f5c6e800640 1 -- 172.21.15.133:0/16961160 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c70070a40 msgr2=0x7f5c701f5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:16.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.519+0000 7f5c6e800640 1 --2- 172.21.15.133:0/16961160 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c70070a40 0x7f5c701f5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.519+0000 7f5c6e800640 1 -- 172.21.15.133:0/16961160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c701457b0 msgr2=0x7f5c7012fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:16.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.519+0000 7f5c6e800640 1 --2- 172.21.15.133:0/16961160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c701457b0 0x7f5c7012fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.519+0000 7f5c6e800640 1 -- 172.21.15.133:0/16961160 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c580094d0 con 0x7f5c70145d30 2024-03-30T01:52:16.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.519+0000 7f5c6e800640 1 --2- 172.21.15.133:0/16961160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c70145d30 0x7f5c7015ccd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5c6800c7a0 tx=0x7f5c6800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:16.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.520+0000 7f5c66000640 1 -- 172.21.15.133:0/16961160 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c68003b70 con 0x7f5c70145d30 2024-03-30T01:52:16.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.520+0000 7f5c66000640 1 -- 172.21.15.133:0/16961160 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c68003cf0 con 0x7f5c70145d30 2024-03-30T01:52:16.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.520+0000 7f5c66000640 1 -- 172.21.15.133:0/16961160 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c68003ea0 con 0x7f5c70145d30 2024-03-30T01:52:16.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.520+0000 7f5c74c00640 1 -- 172.21.15.133:0/16961160 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c701436e0 con 0x7f5c70145d30 2024-03-30T01:52:16.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.520+0000 7f5c74c00640 1 -- 172.21.15.133:0/16961160 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c701f6240 con 0x7f5c70145d30 2024-03-30T01:52:16.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.521+0000 7f5c74c00640 1 -- 172.21.15.133:0/16961160 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c70143c00 con 0x7f5c70145d30 2024-03-30T01:52:16.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.522+0000 7f5c66000640 1 -- 172.21.15.133:0/16961160 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f5c6800aa90 con 0x7f5c70145d30 2024-03-30T01:52:16.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.523+0000 7f5c66000640 1 --2- 172.21.15.133:0/16961160 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f5c4c06ac30 0x7f5c4c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:16.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.523+0000 7f5c66000640 1 -- 172.21.15.133:0/16961160 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5c68089220 con 0x7f5c70145d30 2024-03-30T01:52:16.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.523+0000 7f5c6de00640 1 --2- 172.21.15.133:0/16961160 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f5c4c06ac30 0x7f5c4c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:16.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.524+0000 7f5c6de00640 1 --2- 172.21.15.133:0/16961160 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f5c4c06ac30 0x7f5c4c06d0f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5c60006fd0 tx=0x7f5c60008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:16.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.527+0000 7f5c66000640 1 -- 172.21.15.133:0/16961160 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f5c70143c00 con 0x7f5c70145d30 2024-03-30T01:52:16.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.721+0000 7f5c74c00640 1 -- 172.21.15.133:0/16961160 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5c70143c00 con 0x7f5c70145d30 2024-03-30T01:52:16.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.722+0000 7f5c66000640 1 -- 172.21.15.133:0/16961160 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5c70143c00 con 0x7f5c70145d30 2024-03-30T01:52:16.729 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-03-30T01:52:16.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.725+0000 7f5c74c00640 1 -- 172.21.15.133:0/16961160 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f5c4c06ac30 msgr2=0x7f5c4c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:16.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.725+0000 7f5c74c00640 1 --2- 172.21.15.133:0/16961160 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f5c4c06ac30 0x7f5c4c06d0f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5c60006fd0 tx=0x7f5c60008040 comp rx=0 tx=0).stop 2024-03-30T01:52:16.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.726+0000 7f5c74c00640 1 -- 172.21.15.133:0/16961160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c70145d30 msgr2=0x7f5c7015ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:16.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.726+0000 7f5c74c00640 1 --2- 172.21.15.133:0/16961160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c70145d30 0x7f5c7015ccd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5c6800c7a0 tx=0x7f5c6800cc60 comp rx=0 tx=0).stop 2024-03-30T01:52:16.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.726+0000 7f5c74c00640 1 -- 172.21.15.133:0/16961160 shutdown_connections 2024-03-30T01:52:16.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.726+0000 7f5c74c00640 1 --2- 172.21.15.133:0/16961160 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f5c4c06ac30 0x7f5c4c06d0f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.726+0000 7f5c74c00640 1 --2- 172.21.15.133:0/16961160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c70145d30 0x7f5c7015ccd0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.726+0000 7f5c74c00640 1 --2- 172.21.15.133:0/16961160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c701457b0 0x7f5c7012fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.726+0000 7f5c74c00640 1 --2- 172.21.15.133:0/16961160 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c70070a40 0x7f5c701f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.726+0000 7f5c74c00640 1 -- 172.21.15.133:0/16961160 >> 172.21.15.133:0/16961160 conn(0x7f5c700b07a0 msgr2=0x7f5c70141560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:16.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.726+0000 7f5c74c00640 1 -- 172.21.15.133:0/16961160 shutdown_connections 2024-03-30T01:52:16.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.726+0000 7f5c74c00640 1 -- 172.21.15.133:0/16961160 wait complete. 2024-03-30T01:52:16.752 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal' 2024-03-30T01:52:16.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.946+0000 7fd734a00640 1 Processor -- start 2024-03-30T01:52:16.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.946+0000 7fd734a00640 1 -- start start 2024-03-30T01:52:16.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.948+0000 7fd734a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7300cfb80 0x7fd7300b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:16.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.948+0000 7fd734a00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd73015d030 con 0x7fd73015cc50 2024-03-30T01:52:16.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.948+0000 7fd734a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7300b5af0 con 0x7fd7300d0af0 2024-03-30T01:52:16.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.948+0000 7fd734a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7300d1c50 con 0x7fd7300cfb80 2024-03-30T01:52:16.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.948+0000 7fd72de00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd73015cc50 0x7fd7300d2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43888/0 (socket says 172.21.15.133:43888) 2024-03-30T01:52:16.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.948+0000 7fd72de00640 1 -- 172.21.15.133:0/1671222841 learned_addr learned my addr 172.21.15.133:0/1671222841 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:16.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.949+0000 7fd72ca00640 1 -- 172.21.15.133:0/1671222841 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2433420151 0 0) 0x7fd73015d030 con 0x7fd73015cc50 2024-03-30T01:52:16.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.949+0000 7fd72ca00640 1 -- 172.21.15.133:0/1671222841 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd714003520 con 0x7fd73015cc50 2024-03-30T01:52:16.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.949+0000 7fd72e800640 1 --2- 172.21.15.133:0/1671222841 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7300cfb80 0x7fd7300b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:16.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.949+0000 7fd72ca00640 1 -- 172.21.15.133:0/1671222841 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 275507437 0 0) 0x7fd714003520 con 0x7fd73015cc50 2024-03-30T01:52:16.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.949+0000 7fd72ca00640 1 -- 172.21.15.133:0/1671222841 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7300cfb80 msgr2=0x7fd7300b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:16.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.949+0000 7fd72ca00640 1 --2- 172.21.15.133:0/1671222841 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7300cfb80 0x7fd7300b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.949+0000 7fd72ca00640 1 -- 172.21.15.133:0/1671222841 >> v1:172.21.15.137:6789/0 conn(0x7fd7300d0af0 legacy=0x7fd7300cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:16.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.949+0000 7fd72ca00640 1 -- 172.21.15.133:0/1671222841 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7300d10d0 con 0x7fd73015cc50 2024-03-30T01:52:16.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.949+0000 7fd72ca00640 1 -- 172.21.15.133:0/1671222841 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fd720001670 con 0x7fd73015cc50 2024-03-30T01:52:16.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.949+0000 7fd72ca00640 1 -- 172.21.15.133:0/1671222841 >> v1:172.21.15.133:6789/0 conn(0x7fd73015cc50 legacy=0x7fd7300d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:16.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.949+0000 7fd72ca00640 1 --2- 172.21.15.133:0/1671222841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7140039a0 0x7fd714003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:16.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.949+0000 7fd72ca00640 1 --2- 172.21.15.133:0/1671222841 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7300cfb80 0x7fd7140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:16.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.949+0000 7fd72ca00640 1 --2- 172.21.15.133:0/1671222841 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd714004d00 0x7fd714005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:16.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.949+0000 7fd72ca00640 1 -- 172.21.15.133:0/1671222841 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7300d1c50 con 0x7fd7140039a0 2024-03-30T01:52:16.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.949+0000 7fd72ca00640 1 -- 172.21.15.133:0/1671222841 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71400bb60 con 0x7fd714004d00 2024-03-30T01:52:16.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.949+0000 7fd72ca00640 1 -- 172.21.15.133:0/1671222841 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71400bd20 con 0x7fd7300cfb80 2024-03-30T01:52:16.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.950+0000 7fd72de00640 1 --2- 172.21.15.133:0/1671222841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7140039a0 0x7fd714003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:16.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.950+0000 7fd72de00640 1 -- 172.21.15.133:0/1671222841 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7300cfb80 msgr2=0x7fd7140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:16.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.950+0000 7fd72de00640 1 --2- 172.21.15.133:0/1671222841 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7300cfb80 0x7fd7140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.950+0000 7fd72de00640 1 -- 172.21.15.133:0/1671222841 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd714004d00 msgr2=0x7fd714005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:16.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.950+0000 7fd72de00640 1 --2- 172.21.15.133:0/1671222841 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd714004d00 0x7fd714005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.950+0000 7fd72de00640 1 -- 172.21.15.133:0/1671222841 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd714003520 con 0x7fd7140039a0 2024-03-30T01:52:16.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.951+0000 7fd72de00640 1 --2- 172.21.15.133:0/1671222841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7140039a0 0x7fd714003dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd72000c190 tx=0x7fd7140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c6d67b8d3d83e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:16.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.951+0000 7fd72ca00640 1 -- 172.21.15.133:0/1671222841 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd720005ad0 con 0x7fd7140039a0 2024-03-30T01:52:16.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.951+0000 7fd72ca00640 1 -- 172.21.15.133:0/1671222841 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd720005c30 con 0x7fd7140039a0 2024-03-30T01:52:16.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.951+0000 7fd72ca00640 1 -- 172.21.15.133:0/1671222841 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72002c810 con 0x7fd7140039a0 2024-03-30T01:52:16.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.952+0000 7fd734a00640 1 -- 172.21.15.133:0/1671222841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7140039a0 msgr2=0x7fd714003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:16.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.952+0000 7fd734a00640 1 --2- 172.21.15.133:0/1671222841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7140039a0 0x7fd714003dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd72000c190 tx=0x7fd7140057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.952+0000 7fd72e800640 1 -- 172.21.15.133:0/1671222841 reap_dead start 2024-03-30T01:52:16.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.952+0000 7fd734a00640 1 -- 172.21.15.133:0/1671222841 shutdown_connections 2024-03-30T01:52:16.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.952+0000 7fd734a00640 1 -- 172.21.15.133:0/1671222841 >> 172.21.15.133:0/1671222841 conn(0x7fd730071a40 msgr2=0x7fd73006b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:16.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.952+0000 7fd734a00640 1 -- 172.21.15.133:0/1671222841 shutdown_connections 2024-03-30T01:52:16.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.952+0000 7fd734a00640 1 -- 172.21.15.133:0/1671222841 wait complete. 2024-03-30T01:52:16.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.954+0000 7fd734a00640 1 Processor -- start 2024-03-30T01:52:16.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.954+0000 7fd734a00640 1 -- start start 2024-03-30T01:52:16.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.955+0000 7fd734a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7140039a0 0x7fd7300b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:16.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.955+0000 7fd734a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7300cb0d0 0x7fd7301f3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:16.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.955+0000 7fd734a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7301f4e20 0x7fd7300d2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:16.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.955+0000 7fd734a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7301f3d80 con 0x7fd7140039a0 2024-03-30T01:52:16.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.955+0000 7fd734a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7301f4060 con 0x7fd7301f4e20 2024-03-30T01:52:16.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.955+0000 7fd734a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7301f4340 con 0x7fd7300cb0d0 2024-03-30T01:52:16.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.955+0000 7fd72de00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7140039a0 0x7fd7300b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:16.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.955+0000 7fd72de00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7140039a0 0x7fd7300b4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38338/0 (socket says 172.21.15.133:38338) 2024-03-30T01:52:16.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.955+0000 7fd72de00640 1 -- 172.21.15.133:0/1657888649 learned_addr learned my addr 172.21.15.133:0/1657888649 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:16.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.955+0000 7fd72de00640 1 -- 172.21.15.133:0/1657888649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7300cb0d0 msgr2=0x7fd7301f3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:16.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.955+0000 7fd72de00640 1 --2- 172.21.15.133:0/1657888649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7300cb0d0 0x7fd7301f3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.955+0000 7fd72de00640 1 -- 172.21.15.133:0/1657888649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7301f4e20 msgr2=0x7fd7300d2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:16.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.956+0000 7fd72de00640 1 --2- 172.21.15.133:0/1657888649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7301f4e20 0x7fd7300d2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:16.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.956+0000 7fd72de00640 1 -- 172.21.15.133:0/1657888649 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7301f4620 con 0x7fd7140039a0 2024-03-30T01:52:16.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.956+0000 7fd72de00640 1 --2- 172.21.15.133:0/1657888649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7140039a0 0x7fd7300b4f70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd72000c190 tx=0x7fd720001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:16.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.956+0000 7fd726000640 1 -- 172.21.15.133:0/1657888649 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72003c040 con 0x7fd7140039a0 2024-03-30T01:52:16.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.956+0000 7fd726000640 1 -- 172.21.15.133:0/1657888649 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72002dcd0 con 0x7fd7140039a0 2024-03-30T01:52:16.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.956+0000 7fd726000640 1 -- 172.21.15.133:0/1657888649 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7200072b0 con 0x7fd7140039a0 2024-03-30T01:52:16.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.956+0000 7fd734a00640 1 -- 172.21.15.133:0/1657888649 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7301f4900 con 0x7fd7140039a0 2024-03-30T01:52:16.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.956+0000 7fd734a00640 1 -- 172.21.15.133:0/1657888649 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7301f3b30 con 0x7fd7140039a0 2024-03-30T01:52:16.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.957+0000 7fd734a00640 1 -- 172.21.15.133:0/1657888649 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd730066d80 con 0x7fd7140039a0 2024-03-30T01:52:16.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.958+0000 7fd726000640 1 -- 172.21.15.133:0/1657888649 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd720032070 con 0x7fd7140039a0 2024-03-30T01:52:16.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.959+0000 7fd726000640 1 --2- 172.21.15.133:0/1657888649 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd70c06ac00 0x7fd70c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:16.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.959+0000 7fd726000640 1 -- 172.21.15.133:0/1657888649 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd7200aaea0 con 0x7fd7140039a0 2024-03-30T01:52:16.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.959+0000 7fd72d400640 1 --2- 172.21.15.133:0/1657888649 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd70c06ac00 0x7fd70c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:16.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.960+0000 7fd72d400640 1 --2- 172.21.15.133:0/1657888649 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd70c06ac00 0x7fd70c06d0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd718007fd0 tx=0x7fd718007900 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:16.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:16.963+0000 7fd726000640 1 -- 172.21.15.133:0/1657888649 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fd720075ff0 con 0x7fd7140039a0 2024-03-30T01:52:17.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.222+0000 7fd734a00640 1 -- 172.21.15.133:0/1657888649 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal"]} v 0) v1 -- 0x7fd73015c1c0 con 0x7fd7140039a0 2024-03-30T01:52:17.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.550+0000 7fd726000640 1 -- 172.21.15.133:0/1657888649 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal"]}]=0 v63) v1 ==== 162+0+0 (secure 0 0 0) 0x7fd720079610 con 0x7fd7140039a0 2024-03-30T01:52:17.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.553+0000 7fd734a00640 1 -- 172.21.15.133:0/1657888649 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd70c06ac00 msgr2=0x7fd70c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:17.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.553+0000 7fd734a00640 1 --2- 172.21.15.133:0/1657888649 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd70c06ac00 0x7fd70c06d0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd718007fd0 tx=0x7fd718007900 comp rx=0 tx=0).stop 2024-03-30T01:52:17.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.553+0000 7fd734a00640 1 -- 172.21.15.133:0/1657888649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7140039a0 msgr2=0x7fd7300b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:17.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.553+0000 7fd734a00640 1 --2- 172.21.15.133:0/1657888649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7140039a0 0x7fd7300b4f70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd72000c190 tx=0x7fd720001930 comp rx=0 tx=0).stop 2024-03-30T01:52:17.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.553+0000 7fd734a00640 1 -- 172.21.15.133:0/1657888649 shutdown_connections 2024-03-30T01:52:17.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.553+0000 7fd734a00640 1 --2- 172.21.15.133:0/1657888649 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd70c06ac00 0x7fd70c06d0c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:17.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.553+0000 7fd734a00640 1 --2- 172.21.15.133:0/1657888649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7301f4e20 0x7fd7300d2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:17.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.553+0000 7fd734a00640 1 --2- 172.21.15.133:0/1657888649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7300cb0d0 0x7fd7301f3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:17.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.553+0000 7fd734a00640 1 --2- 172.21.15.133:0/1657888649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7140039a0 0x7fd7300b4f70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:17.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.553+0000 7fd734a00640 1 -- 172.21.15.133:0/1657888649 >> 172.21.15.133:0/1657888649 conn(0x7fd730071a40 msgr2=0x7fd73015fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:17.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.553+0000 7fd734a00640 1 -- 172.21.15.133:0/1657888649 shutdown_connections 2024-03-30T01:52:17.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.553+0000 7fd734a00640 1 -- 172.21.15.133:0/1657888649 wait complete. 2024-03-30T01:52:17.580 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-30T01:52:17.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.786+0000 7fc14c200640 1 Processor -- start 2024-03-30T01:52:17.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.786+0000 7fc14c200640 1 -- start start 2024-03-30T01:52:17.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.788+0000 7fc14c200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc144070500 0x7fc144070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:17.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.788+0000 7fc14c200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1440cc530 0x7fc1440cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:17.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.788+0000 7fc14c200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1440a76a0 con 0x7fc144143790 2024-03-30T01:52:17.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.788+0000 7fc14c200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc144070ed0 con 0x7fc1440cc530 2024-03-30T01:52:17.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.788+0000 7fc14c200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1440b38e0 con 0x7fc144070500 2024-03-30T01:52:17.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.788+0000 7fc149800640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc144143790 0x7fc1440cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43900/0 (socket says 172.21.15.133:43900) 2024-03-30T01:52:17.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.788+0000 7fc149800640 1 -- 172.21.15.133:0/2198583809 learned_addr learned my addr 172.21.15.133:0/2198583809 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:17.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.788+0000 7fc14a200640 1 --2- 172.21.15.133:0/2198583809 >> v2:172.21.15.133:3300/0 conn(0x7fc1440cc530 0x7fc1440cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:17.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.788+0000 7fc148e00640 1 --2- 172.21.15.133:0/2198583809 >> v2:172.21.15.137:3300/0 conn(0x7fc144070500 0x7fc144070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:17.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.788+0000 7fc143e00640 1 -- 172.21.15.133:0/2198583809 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1184136958 0 0) 0x7fc1440a76a0 con 0x7fc144143790 2024-03-30T01:52:17.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.788+0000 7fc143e00640 1 -- 172.21.15.133:0/2198583809 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc12c003520 con 0x7fc144143790 2024-03-30T01:52:17.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.789+0000 7fc14a200640 1 -- 172.21.15.133:0/2198583809 >> v2:172.21.15.137:3300/0 conn(0x7fc144070500 msgr2=0x7fc144070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:17.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.789+0000 7fc14a200640 1 --2- 172.21.15.133:0/2198583809 >> v2:172.21.15.137:3300/0 conn(0x7fc144070500 0x7fc144070990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:17.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.789+0000 7fc14a200640 1 -- 172.21.15.133:0/2198583809 >> v1:172.21.15.133:6789/0 conn(0x7fc144143790 legacy=0x7fc1440cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:17.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.789+0000 7fc14a200640 1 -- 172.21.15.133:0/2198583809 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1440ccee0 con 0x7fc1440cc530 2024-03-30T01:52:17.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.790+0000 7fc14a200640 1 --2- 172.21.15.133:0/2198583809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1440cc530 0x7fc1440cc9a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc14406e6a0 tx=0x7fc13c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffafe200e981afb2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:17.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.790+0000 7fc143e00640 1 -- 172.21.15.133:0/2198583809 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c02cd00 con 0x7fc1440cc530 2024-03-30T01:52:17.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.790+0000 7fc143e00640 1 -- 172.21.15.133:0/2198583809 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c02ce60 con 0x7fc1440cc530 2024-03-30T01:52:17.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.790+0000 7fc143e00640 1 -- 172.21.15.133:0/2198583809 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c034660 con 0x7fc1440cc530 2024-03-30T01:52:17.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.790+0000 7fc14c200640 1 -- 172.21.15.133:0/2198583809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1440cc530 msgr2=0x7fc1440cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:17.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.790+0000 7fc14c200640 1 --2- 172.21.15.133:0/2198583809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1440cc530 0x7fc1440cc9a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc14406e6a0 tx=0x7fc13c02bf50 comp rx=0 tx=0).stop 2024-03-30T01:52:17.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.791+0000 7fc14c200640 1 -- 172.21.15.133:0/2198583809 shutdown_connections 2024-03-30T01:52:17.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.791+0000 7fc14c200640 1 --2- 172.21.15.133:0/2198583809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1440cc530 0x7fc1440cc9a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:17.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.791+0000 7fc14c200640 1 --2- 172.21.15.133:0/2198583809 >> v2:172.21.15.137:3300/0 conn(0x7fc144070500 0x7fc144070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:17.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.791+0000 7fc14c200640 1 -- 172.21.15.133:0/2198583809 >> 172.21.15.133:0/2198583809 conn(0x7fc1440b07a0 msgr2=0x7fc1440b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:17.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.791+0000 7fc14c200640 1 -- 172.21.15.133:0/2198583809 shutdown_connections 2024-03-30T01:52:17.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.791+0000 7fc14c200640 1 -- 172.21.15.133:0/2198583809 wait complete. 2024-03-30T01:52:17.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.792+0000 7fc14c200640 1 Processor -- start 2024-03-30T01:52:17.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.792+0000 7fc14c200640 1 -- start start 2024-03-30T01:52:17.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.793+0000 7fc14c200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc144070500 0x7fc14406d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:17.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.793+0000 7fc14c200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1440cc530 0x7fc1440ac450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:17.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.793+0000 7fc14c200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc144143790 0x7fc1441f1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:17.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.793+0000 7fc14c200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1440c3830 con 0x7fc1440cc530 2024-03-30T01:52:17.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.793+0000 7fc14c200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1440ca890 con 0x7fc144143790 2024-03-30T01:52:17.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.793+0000 7fc14c200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1440ac990 con 0x7fc144070500 2024-03-30T01:52:17.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.794+0000 7fc148e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1440cc530 0x7fc1440ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:17.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.794+0000 7fc148e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1440cc530 0x7fc1440ac450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38356/0 (socket says 172.21.15.133:38356) 2024-03-30T01:52:17.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.794+0000 7fc148e00640 1 -- 172.21.15.133:0/226371464 learned_addr learned my addr 172.21.15.133:0/226371464 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:17.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.794+0000 7fc148e00640 1 -- 172.21.15.133:0/226371464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc144070500 msgr2=0x7fc14406d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:17.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.794+0000 7fc148e00640 1 --2- 172.21.15.133:0/226371464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc144070500 0x7fc14406d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:17.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.794+0000 7fc148e00640 1 -- 172.21.15.133:0/226371464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc144143790 msgr2=0x7fc1441f1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:17.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.794+0000 7fc148e00640 1 --2- 172.21.15.133:0/226371464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc144143790 0x7fc1441f1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:17.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.794+0000 7fc148e00640 1 -- 172.21.15.133:0/226371464 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13c009a70 con 0x7fc1440cc530 2024-03-30T01:52:17.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.794+0000 7fc148e00640 1 --2- 172.21.15.133:0/226371464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1440cc530 0x7fc1440ac450 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc13800e9b0 tx=0x7fc13800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:17.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.794+0000 7fc141600640 1 -- 172.21.15.133:0/226371464 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138009670 con 0x7fc1440cc530 2024-03-30T01:52:17.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.794+0000 7fc141600640 1 -- 172.21.15.133:0/226371464 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13800c9a0 con 0x7fc1440cc530 2024-03-30T01:52:17.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.794+0000 7fc14c200640 1 -- 172.21.15.133:0/226371464 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1440acc60 con 0x7fc1440cc530 2024-03-30T01:52:17.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.795+0000 7fc141600640 1 -- 172.21.15.133:0/226371464 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13800cd50 con 0x7fc1440cc530 2024-03-30T01:52:17.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.795+0000 7fc14c200640 1 -- 172.21.15.133:0/226371464 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1440ad220 con 0x7fc1440cc530 2024-03-30T01:52:17.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.796+0000 7fc14c200640 1 -- 172.21.15.133:0/226371464 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc144066d80 con 0x7fc1440cc530 2024-03-30T01:52:17.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.797+0000 7fc141600640 1 -- 172.21.15.133:0/226371464 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fc138013470 con 0x7fc1440cc530 2024-03-30T01:52:17.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.798+0000 7fc141600640 1 --2- 172.21.15.133:0/226371464 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc12806ac00 0x7fc12806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:17.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.798+0000 7fc141600640 1 -- 172.21.15.133:0/226371464 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc138089670 con 0x7fc1440cc530 2024-03-30T01:52:17.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.798+0000 7fc149800640 1 --2- 172.21.15.133:0/226371464 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc12806ac00 0x7fc12806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:17.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.799+0000 7fc149800640 1 --2- 172.21.15.133:0/226371464 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc12806ac00 0x7fc12806d0c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc1440af830 tx=0x7fc134007930 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:17.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.802+0000 7fc141600640 1 -- 172.21.15.133:0/226371464 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fc1380547d0 con 0x7fc1440cc530 2024-03-30T01:52:18.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:17.995+0000 7fc14c200640 1 -- 172.21.15.133:0/226371464 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc1440737b0 con 0x7fc1440cc530 2024-03-30T01:52:18.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.004+0000 7fc141600640 1 -- 172.21.15.133:0/226371464 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc138057df0 con 0x7fc1440cc530 2024-03-30T01:52:18.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.007+0000 7fc14c200640 1 -- 172.21.15.133:0/226371464 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc12806ac00 msgr2=0x7fc12806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:18.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.007+0000 7fc14c200640 1 --2- 172.21.15.133:0/226371464 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc12806ac00 0x7fc12806d0c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc1440af830 tx=0x7fc134007930 comp rx=0 tx=0).stop 2024-03-30T01:52:18.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.007+0000 7fc14c200640 1 -- 172.21.15.133:0/226371464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1440cc530 msgr2=0x7fc1440ac450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:18.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.007+0000 7fc14c200640 1 --2- 172.21.15.133:0/226371464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1440cc530 0x7fc1440ac450 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc13800e9b0 tx=0x7fc13800ee70 comp rx=0 tx=0).stop 2024-03-30T01:52:18.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.008+0000 7fc14c200640 1 -- 172.21.15.133:0/226371464 shutdown_connections 2024-03-30T01:52:18.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.008+0000 7fc14c200640 1 --2- 172.21.15.133:0/226371464 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc12806ac00 0x7fc12806d0c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:18.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.008+0000 7fc14c200640 1 --2- 172.21.15.133:0/226371464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc144143790 0x7fc1441f1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:18.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.008+0000 7fc14c200640 1 --2- 172.21.15.133:0/226371464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1440cc530 0x7fc1440ac450 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:18.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.008+0000 7fc14c200640 1 --2- 172.21.15.133:0/226371464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc144070500 0x7fc14406d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:18.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.008+0000 7fc14c200640 1 -- 172.21.15.133:0/226371464 >> 172.21.15.133:0/226371464 conn(0x7fc1440b07a0 msgr2=0x7fc1441428c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:18.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.008+0000 7fc14c200640 1 -- 172.21.15.133:0/226371464 shutdown_connections 2024-03-30T01:52:18.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.008+0000 7fc14c200640 1 -- 172.21.15.133:0/226371464 wait complete. 2024-03-30T01:52:18.033 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-30T01:52:18.034 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-30T01:52:18.150 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-30T01:52:18.273 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-30T01:52:18.273 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:52:18.274 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:52:18.331 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:52:18.331 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:52:18.381 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:52:18.382 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:52:18.433 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:52:18.494 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T01:52:18.526 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T01:52:18.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.667+0000 7f1b45e00640 1 Processor -- start 2024-03-30T01:52:18.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.668+0000 7f1b45e00640 1 -- start start 2024-03-30T01:52:18.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.669+0000 7f1b45e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1b40143790 0x7f1b400cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:18.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.669+0000 7f1b45e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b400ccc40 0x7f1b40070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:18.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.669+0000 7f1b45e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b400a76a0 con 0x7f1b40070500 2024-03-30T01:52:18.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.669+0000 7f1b45e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b40070ed0 con 0x7f1b40143790 2024-03-30T01:52:18.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.669+0000 7f1b45e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b400b38e0 con 0x7f1b400ccc40 2024-03-30T01:52:18.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.670+0000 7f1b3f400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b400ccc40 0x7f1b40070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:18.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.670+0000 7f1b3f400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b400ccc40 0x7f1b40070990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.133:59344/0 (socket says 172.21.15.133:59344) 2024-03-30T01:52:18.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.670+0000 7f1b3f400640 1 -- 172.21.15.133:0/2372263880 learned_addr learned my addr 172.21.15.133:0/2372263880 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:18.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.670+0000 7f1b3ea00640 1 --2- 172.21.15.133:0/2372263880 >> v2:172.21.15.137:3300/0 conn(0x7f1b40143790 0x7f1b400cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:18.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.671+0000 7f1b3f400640 1 -- 172.21.15.133:0/2372263880 >> v2:172.21.15.137:3300/0 conn(0x7f1b40143790 msgr2=0x7f1b400cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:18.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.671+0000 7f1b3f400640 1 --2- 172.21.15.133:0/2372263880 >> v2:172.21.15.137:3300/0 conn(0x7f1b40143790 0x7f1b400cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:18.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.671+0000 7f1b3f400640 1 -- 172.21.15.133:0/2372263880 >> v1:172.21.15.137:6789/0 conn(0x7f1b40070500 legacy=0x7f1b400cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:18.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.671+0000 7f1b3f400640 1 -- 172.21.15.133:0/2372263880 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b400cd180 con 0x7f1b400ccc40 2024-03-30T01:52:18.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.672+0000 7f1b3f400640 1 --2- 172.21.15.133:0/2372263880 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b400ccc40 0x7f1b40070990 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1b38009870 tx=0x7f1b3802ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a39fd524164cde7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:18.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.672+0000 7f1b3e000640 1 -- 172.21.15.133:0/2372263880 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3802f830 con 0x7f1b400ccc40 2024-03-30T01:52:18.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.673+0000 7f1b3e000640 1 -- 172.21.15.133:0/2372263880 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3802f990 con 0x7f1b400ccc40 2024-03-30T01:52:18.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.673+0000 7f1b3e000640 1 -- 172.21.15.133:0/2372263880 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3802fd20 con 0x7f1b400ccc40 2024-03-30T01:52:18.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.673+0000 7f1b45e00640 1 -- 172.21.15.133:0/2372263880 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b400ccc40 msgr2=0x7f1b40070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:18.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.673+0000 7f1b45e00640 1 --2- 172.21.15.133:0/2372263880 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b400ccc40 0x7f1b40070990 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1b38009870 tx=0x7f1b3802ba10 comp rx=0 tx=0).stop 2024-03-30T01:52:18.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.673+0000 7f1b45e00640 1 -- 172.21.15.133:0/2372263880 shutdown_connections 2024-03-30T01:52:18.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.673+0000 7f1b45e00640 1 --2- 172.21.15.133:0/2372263880 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b400ccc40 0x7f1b40070990 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:18.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.673+0000 7f1b45e00640 1 --2- 172.21.15.133:0/2372263880 >> v2:172.21.15.137:3300/0 conn(0x7f1b40143790 0x7f1b400cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:18.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.673+0000 7f1b45e00640 1 -- 172.21.15.133:0/2372263880 >> 172.21.15.133:0/2372263880 conn(0x7f1b400b07a0 msgr2=0x7f1b400b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:18.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.673+0000 7f1b45e00640 1 -- 172.21.15.133:0/2372263880 shutdown_connections 2024-03-30T01:52:18.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.674+0000 7f1b45e00640 1 -- 172.21.15.133:0/2372263880 wait complete. 2024-03-30T01:52:18.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.675+0000 7f1b45e00640 1 Processor -- start 2024-03-30T01:52:18.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.675+0000 7f1b45e00640 1 -- start start 2024-03-30T01:52:18.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.676+0000 7f1b45e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b40070500 0x7f1b40159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:18.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.676+0000 7f1b45e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b400ccc40 0x7f1b4013c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:18.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.676+0000 7f1b45e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b40143790 0x7f1b40142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:18.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.676+0000 7f1b45e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4013d980 con 0x7f1b400ccc40 2024-03-30T01:52:18.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.676+0000 7f1b45e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4013b990 con 0x7f1b40143790 2024-03-30T01:52:18.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.676+0000 7f1b45e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4013dd80 con 0x7f1b40070500 2024-03-30T01:52:18.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.677+0000 7f1b36000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b400ccc40 0x7f1b4013c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:18.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.677+0000 7f1b36000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b400ccc40 0x7f1b4013c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38370/0 (socket says 172.21.15.133:38370) 2024-03-30T01:52:18.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.677+0000 7f1b36000640 1 -- 172.21.15.133:0/96550452 learned_addr learned my addr 172.21.15.133:0/96550452 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:18.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.677+0000 7f1b3ea00640 1 --2- 172.21.15.133:0/96550452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b40070500 0x7f1b40159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:18.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.677+0000 7f1b3f400640 1 --2- 172.21.15.133:0/96550452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b40143790 0x7f1b40142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:18.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.677+0000 7f1b36000640 1 -- 172.21.15.133:0/96550452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b40070500 msgr2=0x7f1b40159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:18.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.677+0000 7f1b36000640 1 --2- 172.21.15.133:0/96550452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b40070500 0x7f1b40159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:18.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.677+0000 7f1b36000640 1 -- 172.21.15.133:0/96550452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b40143790 msgr2=0x7f1b40142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:18.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.677+0000 7f1b36000640 1 --2- 172.21.15.133:0/96550452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b40143790 0x7f1b40142130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:18.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.677+0000 7f1b36000640 1 -- 172.21.15.133:0/96550452 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b380094d0 con 0x7f1b400ccc40 2024-03-30T01:52:18.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.678+0000 7f1b36000640 1 --2- 172.21.15.133:0/96550452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b400ccc40 0x7f1b4013c800 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800c400 tx=0x7f1b2800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:18.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.678+0000 7f1b37e00640 1 -- 172.21.15.133:0/96550452 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b280052d0 con 0x7f1b400ccc40 2024-03-30T01:52:18.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.678+0000 7f1b37e00640 1 -- 172.21.15.133:0/96550452 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b28005430 con 0x7f1b400ccc40 2024-03-30T01:52:18.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.678+0000 7f1b37e00640 1 -- 172.21.15.133:0/96550452 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28003830 con 0x7f1b400ccc40 2024-03-30T01:52:18.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.678+0000 7f1b45e00640 1 -- 172.21.15.133:0/96550452 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b40159d70 con 0x7f1b400ccc40 2024-03-30T01:52:18.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.678+0000 7f1b45e00640 1 -- 172.21.15.133:0/96550452 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4013d3c0 con 0x7f1b400ccc40 2024-03-30T01:52:18.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.679+0000 7f1b45e00640 1 -- 172.21.15.133:0/96550452 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4013db50 con 0x7f1b400ccc40 2024-03-30T01:52:18.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.680+0000 7f1b37e00640 1 -- 172.21.15.133:0/96550452 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1b28003990 con 0x7f1b400ccc40 2024-03-30T01:52:18.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.681+0000 7f1b37e00640 1 --2- 172.21.15.133:0/96550452 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f1b1c06ac30 0x7f1b1c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:18.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.681+0000 7f1b37e00640 1 -- 172.21.15.133:0/96550452 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1b280889d0 con 0x7f1b400ccc40 2024-03-30T01:52:18.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.681+0000 7f1b3ea00640 1 --2- 172.21.15.133:0/96550452 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f1b1c06ac30 0x7f1b1c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:18.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.682+0000 7f1b3ea00640 1 --2- 172.21.15.133:0/96550452 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f1b1c06ac30 0x7f1b1c06d0f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1b30009a60 tx=0x7f1b30003990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:18.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.686+0000 7f1b37e00640 1 -- 172.21.15.133:0/96550452 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f1b4013db50 con 0x7f1b400ccc40 2024-03-30T01:52:18.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.880+0000 7f1b45e00640 1 -- 172.21.15.133:0/96550452 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b4013db50 con 0x7f1b400ccc40 2024-03-30T01:52:18.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.883+0000 7f1b37e00640 1 -- 172.21.15.133:0/96550452 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16335 (secure 0 0 0) 0x7f1b4013db50 con 0x7f1b400ccc40 2024-03-30T01:52:18.889 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:18.890 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:52:15.520675+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:51:31.245378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T01:51:31.774247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:52:18.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.885+0000 7f1b45e00640 1 -- 172.21.15.133:0/96550452 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f1b1c06ac30 msgr2=0x7f1b1c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:18.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.885+0000 7f1b45e00640 1 --2- 172.21.15.133:0/96550452 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f1b1c06ac30 0x7f1b1c06d0f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1b30009a60 tx=0x7f1b30003990 comp rx=0 tx=0).stop 2024-03-30T01:52:18.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.885+0000 7f1b45e00640 1 -- 172.21.15.133:0/96550452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b400ccc40 msgr2=0x7f1b4013c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:18.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.885+0000 7f1b45e00640 1 --2- 172.21.15.133:0/96550452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b400ccc40 0x7f1b4013c800 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800c400 tx=0x7f1b2800c8c0 comp rx=0 tx=0).stop 2024-03-30T01:52:18.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.886+0000 7f1b45e00640 1 -- 172.21.15.133:0/96550452 shutdown_connections 2024-03-30T01:52:18.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.886+0000 7f1b45e00640 1 --2- 172.21.15.133:0/96550452 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f1b1c06ac30 0x7f1b1c06d0f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:18.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.886+0000 7f1b45e00640 1 --2- 172.21.15.133:0/96550452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b40143790 0x7f1b40142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:18.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.886+0000 7f1b45e00640 1 --2- 172.21.15.133:0/96550452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b400ccc40 0x7f1b4013c800 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:18.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.886+0000 7f1b45e00640 1 --2- 172.21.15.133:0/96550452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b40070500 0x7f1b40159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:18.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.886+0000 7f1b45e00640 1 -- 172.21.15.133:0/96550452 >> 172.21.15.133:0/96550452 conn(0x7f1b400b07a0 msgr2=0x7f1b40140820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:18.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.886+0000 7f1b45e00640 1 -- 172.21.15.133:0/96550452 shutdown_connections 2024-03-30T01:52:18.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:18.886+0000 7f1b45e00640 1 -- 172.21.15.133:0/96550452 wait complete. 2024-03-30T01:52:18.911 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T01:51:21.771393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T01:51:31.245378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T01:51:31.774247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T01:52:18.911 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T01:52:19.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.119+0000 7f3a33200640 1 Processor -- start 2024-03-30T01:52:19.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.119+0000 7f3a33200640 1 -- start start 2024-03-30T01:52:19.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.121+0000 7f3a33200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a2c143790 0x7f3a2c0cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:19.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.121+0000 7f3a33200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3a2c070500 0x7f3a2c070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:19.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.121+0000 7f3a33200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3a2c0cc530 0x7f3a2c0cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:19.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.121+0000 7f3a33200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a2c0a76a0 con 0x7f3a2c070500 2024-03-30T01:52:19.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.121+0000 7f3a33200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a2c070ea0 con 0x7f3a2c0cc530 2024-03-30T01:52:19.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.121+0000 7f3a33200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c0b38e0 con 0x7f3a2c143790 2024-03-30T01:52:19.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.121+0000 7f3a23400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3a2c070500 0x7f3a2c070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:19.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.122+0000 7f3a23400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3a2c070500 0x7f3a2c070960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38380/0 (socket says 172.21.15.133:38380) 2024-03-30T01:52:19.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.122+0000 7f3a23400640 1 -- 172.21.15.133:0/3061918985 learned_addr learned my addr 172.21.15.133:0/3061918985 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.122+0000 7f3a2be00640 1 --2- 172.21.15.133:0/3061918985 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a2c143790 0x7f3a2c0cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.122+0000 7f3a31200640 1 --2- 172.21.15.133:0/3061918985 >> v2:172.21.15.137:3300/0 conn(0x7f3a2c0cc530 0x7f3a2c0cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.122+0000 7f3a23400640 1 -- 172.21.15.133:0/3061918985 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a2c143790 msgr2=0x7f3a2c0cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.122+0000 7f3a23400640 1 --2- 172.21.15.133:0/3061918985 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a2c143790 0x7f3a2c0cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.122+0000 7f3a23400640 1 -- 172.21.15.133:0/3061918985 >> v2:172.21.15.137:3300/0 conn(0x7f3a2c0cc530 msgr2=0x7f3a2c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.122+0000 7f3a23400640 1 --2- 172.21.15.133:0/3061918985 >> v2:172.21.15.137:3300/0 conn(0x7f3a2c0cc530 0x7f3a2c0cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.122+0000 7f3a23400640 1 -- 172.21.15.133:0/3061918985 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c0ccf00 con 0x7f3a2c070500 2024-03-30T01:52:19.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.123+0000 7f3a23400640 1 --2- 172.21.15.133:0/3061918985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2c070500 0x7f3a2c070960 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c0b3070 tx=0x7f3a1402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84f4ea87c30542a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.124+0000 7f3a2b400640 1 -- 172.21.15.133:0/3061918985 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a14030860 con 0x7f3a2c070500 2024-03-30T01:52:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.124+0000 7f3a2b400640 1 -- 172.21.15.133:0/3061918985 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a140309c0 con 0x7f3a2c070500 2024-03-30T01:52:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.124+0000 7f3a2b400640 1 -- 172.21.15.133:0/3061918985 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a14030d50 con 0x7f3a2c070500 2024-03-30T01:52:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.124+0000 7f3a33200640 1 -- 172.21.15.133:0/3061918985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2c070500 msgr2=0x7f3a2c070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.124+0000 7f3a33200640 1 --2- 172.21.15.133:0/3061918985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2c070500 0x7f3a2c070960 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c0b3070 tx=0x7f3a1402b9a0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.125+0000 7f3a33200640 1 -- 172.21.15.133:0/3061918985 shutdown_connections 2024-03-30T01:52:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.125+0000 7f3a33200640 1 --2- 172.21.15.133:0/3061918985 >> v2:172.21.15.137:3300/0 conn(0x7f3a2c0cc530 0x7f3a2c0cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.125+0000 7f3a33200640 1 --2- 172.21.15.133:0/3061918985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2c070500 0x7f3a2c070960 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.125+0000 7f3a33200640 1 --2- 172.21.15.133:0/3061918985 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a2c143790 0x7f3a2c0cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.125+0000 7f3a33200640 1 -- 172.21.15.133:0/3061918985 >> 172.21.15.133:0/3061918985 conn(0x7f3a2c0b07a0 msgr2=0x7f3a2c0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.125+0000 7f3a33200640 1 -- 172.21.15.133:0/3061918985 shutdown_connections 2024-03-30T01:52:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.125+0000 7f3a33200640 1 -- 172.21.15.133:0/3061918985 wait complete. 2024-03-30T01:52:19.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.127+0000 7f3a33200640 1 Processor -- start 2024-03-30T01:52:19.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.127+0000 7f3a33200640 1 -- start start 2024-03-30T01:52:19.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.128+0000 7f3a33200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2c070500 0x7f3a2c0a9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.128+0000 7f3a33200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a2c0cc530 0x7f3a2c0c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.128+0000 7f3a33200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a2c143790 0x7f3a2c15b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.128+0000 7f3a33200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c0c8b90 con 0x7f3a2c070500 2024-03-30T01:52:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.128+0000 7f3a33200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c0c7f10 con 0x7f3a2c0cc530 2024-03-30T01:52:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.128+0000 7f3a33200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c0c81f0 con 0x7f3a2c143790 2024-03-30T01:52:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.128+0000 7f3a2be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2c070500 0x7f3a2c0a9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.128+0000 7f3a2be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2c070500 0x7f3a2c0a9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38382/0 (socket says 172.21.15.133:38382) 2024-03-30T01:52:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.128+0000 7f3a2be00640 1 -- 172.21.15.133:0/3998473421 learned_addr learned my addr 172.21.15.133:0/3998473421 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.129+0000 7f3a2be00640 1 -- 172.21.15.133:0/3998473421 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a2c143790 msgr2=0x7f3a2c15b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.129+0000 7f3a2be00640 1 --2- 172.21.15.133:0/3998473421 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a2c143790 0x7f3a2c15b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.129+0000 7f3a2be00640 1 -- 172.21.15.133:0/3998473421 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a2c0cc530 msgr2=0x7f3a2c0c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.129+0000 7f3a2be00640 1 --2- 172.21.15.133:0/3998473421 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a2c0cc530 0x7f3a2c0c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.129+0000 7f3a2be00640 1 -- 172.21.15.133:0/3998473421 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a140094d0 con 0x7f3a2c070500 2024-03-30T01:52:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.129+0000 7f3a2be00640 1 --2- 172.21.15.133:0/3998473421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2c070500 0x7f3a2c0a9e00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00d5f0 tx=0x7f3a1c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:19.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.129+0000 7f3a28c00640 1 -- 172.21.15.133:0/3998473421 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c0125f0 con 0x7f3a2c070500 2024-03-30T01:52:19.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.129+0000 7f3a28c00640 1 -- 172.21.15.133:0/3998473421 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1c012750 con 0x7f3a2c070500 2024-03-30T01:52:19.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.129+0000 7f3a28c00640 1 -- 172.21.15.133:0/3998473421 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c012b00 con 0x7f3a2c070500 2024-03-30T01:52:19.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.129+0000 7f3a33200640 1 -- 172.21.15.133:0/3998473421 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2c0c84d0 con 0x7f3a2c070500 2024-03-30T01:52:19.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.129+0000 7f3a33200640 1 -- 172.21.15.133:0/3998473421 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2c142950 con 0x7f3a2c070500 2024-03-30T01:52:19.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.131+0000 7f3a33200640 1 -- 172.21.15.133:0/3998473421 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2c0cb010 con 0x7f3a2c070500 2024-03-30T01:52:19.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.131+0000 7f3a28c00640 1 -- 172.21.15.133:0/3998473421 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f3a1c012c60 con 0x7f3a2c070500 2024-03-30T01:52:19.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.132+0000 7f3a28c00640 1 --2- 172.21.15.133:0/3998473421 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3a0806ac00 0x7f3a0806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:19.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.132+0000 7f3a28c00640 1 -- 172.21.15.133:0/3998473421 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3a1c089870 con 0x7f3a2c070500 2024-03-30T01:52:19.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.133+0000 7f3a23400640 1 --2- 172.21.15.133:0/3998473421 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3a0806ac00 0x7f3a0806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:19.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.133+0000 7f3a23400640 1 --2- 172.21.15.133:0/3998473421 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3a0806ac00 0x7f3a0806d0c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3a14036000 tx=0x7f3a1403b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:19.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.137+0000 7f3a28c00640 1 -- 172.21.15.133:0/3998473421 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f3a2c0cb010 con 0x7f3a2c070500 2024-03-30T01:52:19.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.330+0000 7f3a33200640 1 -- 172.21.15.133:0/3998473421 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a2c0cb010 con 0x7f3a2c070500 2024-03-30T01:52:19.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.331+0000 7f3a28c00640 1 -- 172.21.15.133:0/3998473421 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a2c0cb010 con 0x7f3a2c070500 2024-03-30T01:52:19.338 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-03-30T01:52:19.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.333+0000 7f3a33200640 1 -- 172.21.15.133:0/3998473421 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3a0806ac00 msgr2=0x7f3a0806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:19.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.333+0000 7f3a33200640 1 --2- 172.21.15.133:0/3998473421 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3a0806ac00 0x7f3a0806d0c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3a14036000 tx=0x7f3a1403b040 comp rx=0 tx=0).stop 2024-03-30T01:52:19.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.333+0000 7f3a33200640 1 -- 172.21.15.133:0/3998473421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2c070500 msgr2=0x7f3a2c0a9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:19.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.333+0000 7f3a33200640 1 --2- 172.21.15.133:0/3998473421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2c070500 0x7f3a2c0a9e00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00d5f0 tx=0x7f3a1c00dab0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.334+0000 7f3a33200640 1 -- 172.21.15.133:0/3998473421 shutdown_connections 2024-03-30T01:52:19.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.334+0000 7f3a33200640 1 --2- 172.21.15.133:0/3998473421 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3a0806ac00 0x7f3a0806d0c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.334+0000 7f3a33200640 1 --2- 172.21.15.133:0/3998473421 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a2c143790 0x7f3a2c15b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.334+0000 7f3a33200640 1 --2- 172.21.15.133:0/3998473421 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a2c0cc530 0x7f3a2c0c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.334+0000 7f3a33200640 1 --2- 172.21.15.133:0/3998473421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2c070500 0x7f3a2c0a9e00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.334+0000 7f3a33200640 1 -- 172.21.15.133:0/3998473421 >> 172.21.15.133:0/3998473421 conn(0x7f3a2c0b07a0 msgr2=0x7f3a2c15c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:19.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.334+0000 7f3a33200640 1 -- 172.21.15.133:0/3998473421 shutdown_connections 2024-03-30T01:52:19.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.334+0000 7f3a33200640 1 -- 172.21.15.133:0/3998473421 wait complete. 2024-03-30T01:52:19.358 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T01:52:19.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.563+0000 7f9b22200640 1 Processor -- start 2024-03-30T01:52:19.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.563+0000 7f9b22200640 1 -- start start 2024-03-30T01:52:19.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.564+0000 7f9b22200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b1c15cc20 0x7f9b1c0b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:19.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.564+0000 7f9b22200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9b1c06b200 0x7f9b1c0ace80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:19.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.565+0000 7f9b22200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9b1c0ad3c0 0x7f9b1c0713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:19.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.565+0000 7f9b22200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1c15d000 con 0x7f9b1c06b200 2024-03-30T01:52:19.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.565+0000 7f9b22200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1c160800 con 0x7f9b1c0ad3c0 2024-03-30T01:52:19.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.565+0000 7f9b22200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c0b2680 con 0x7f9b1c15cc20 2024-03-30T01:52:19.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.565+0000 7f9b1aa00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9b1c06b200 0x7f9b1c0ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:19.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.565+0000 7f9b1aa00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9b1c06b200 0x7f9b1c0ace80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38384/0 (socket says 172.21.15.133:38384) 2024-03-30T01:52:19.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.565+0000 7f9b1aa00640 1 -- 172.21.15.133:0/1248947679 learned_addr learned my addr 172.21.15.133:0/1248947679 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:19.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.565+0000 7f9b1b400640 1 --2- 172.21.15.133:0/1248947679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b1c15cc20 0x7f9b1c0b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:19.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.565+0000 7f9b1be00640 1 --2- 172.21.15.133:0/1248947679 >> v2:172.21.15.137:3300/0 conn(0x7f9b1c0ad3c0 0x7f9b1c0713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:19.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.565+0000 7f9b1aa00640 1 -- 172.21.15.133:0/1248947679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b1c15cc20 msgr2=0x7f9b1c0b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:19.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.565+0000 7f9b1aa00640 1 --2- 172.21.15.133:0/1248947679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b1c15cc20 0x7f9b1c0b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.565+0000 7f9b1aa00640 1 -- 172.21.15.133:0/1248947679 >> v2:172.21.15.137:3300/0 conn(0x7f9b1c0ad3c0 msgr2=0x7f9b1c0713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:19.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.565+0000 7f9b1aa00640 1 --2- 172.21.15.133:0/1248947679 >> v2:172.21.15.137:3300/0 conn(0x7f9b1c0ad3c0 0x7f9b1c0713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.565+0000 7f9b1aa00640 1 -- 172.21.15.133:0/1248947679 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c0b2960 con 0x7f9b1c06b200 2024-03-30T01:52:19.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.565+0000 7f9b1be00640 1 --2- 172.21.15.133:0/1248947679 >> v2:172.21.15.137:3300/0 conn(0x7f9b1c0ad3c0 0x7f9b1c0713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:19.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.566+0000 7f9b1aa00640 1 --2- 172.21.15.133:0/1248947679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c06b200 0x7f9b1c0ace80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c06b120 tx=0x7f9b0402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934ea19d5170b2ac server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:19.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.567+0000 7f9b1a000640 1 -- 172.21.15.133:0/1248947679 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04031860 con 0x7f9b1c06b200 2024-03-30T01:52:19.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.567+0000 7f9b1a000640 1 -- 172.21.15.133:0/1248947679 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b040319c0 con 0x7f9b1c06b200 2024-03-30T01:52:19.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.567+0000 7f9b1a000640 1 -- 172.21.15.133:0/1248947679 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04031d50 con 0x7f9b1c06b200 2024-03-30T01:52:19.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.567+0000 7f9b22200640 1 -- 172.21.15.133:0/1248947679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c06b200 msgr2=0x7f9b1c0ace80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:19.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.567+0000 7f9b22200640 1 --2- 172.21.15.133:0/1248947679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c06b200 0x7f9b1c0ace80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c06b120 tx=0x7f9b0402b900 comp rx=0 tx=0).stop 2024-03-30T01:52:19.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.567+0000 7f9b22200640 1 -- 172.21.15.133:0/1248947679 shutdown_connections 2024-03-30T01:52:19.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.567+0000 7f9b22200640 1 --2- 172.21.15.133:0/1248947679 >> v2:172.21.15.137:3300/0 conn(0x7f9b1c0ad3c0 0x7f9b1c0713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.567+0000 7f9b22200640 1 --2- 172.21.15.133:0/1248947679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c06b200 0x7f9b1c0ace80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.567+0000 7f9b22200640 1 --2- 172.21.15.133:0/1248947679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b1c15cc20 0x7f9b1c0b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.567+0000 7f9b22200640 1 -- 172.21.15.133:0/1248947679 >> 172.21.15.133:0/1248947679 conn(0x7f9b1c06da20 msgr2=0x7f9b1c070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:19.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.568+0000 7f9b22200640 1 -- 172.21.15.133:0/1248947679 shutdown_connections 2024-03-30T01:52:19.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.568+0000 7f9b22200640 1 -- 172.21.15.133:0/1248947679 wait complete. 2024-03-30T01:52:19.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.569+0000 7f9b22200640 1 Processor -- start 2024-03-30T01:52:19.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.569+0000 7f9b22200640 1 -- start start 2024-03-30T01:52:19.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.570+0000 7f9b22200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c06b200 0x7f9b1c157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:19.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.570+0000 7f9b22200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b1c0ad3c0 0x7f9b1c1e7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:19.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.570+0000 7f9b22200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c15cc20 0x7f9b1c159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:19.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.570+0000 7f9b22200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c159860 con 0x7f9b1c15cc20 2024-03-30T01:52:19.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.570+0000 7f9b22200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c1587c0 con 0x7f9b1c06b200 2024-03-30T01:52:19.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.570+0000 7f9b22200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c158aa0 con 0x7f9b1c0ad3c0 2024-03-30T01:52:19.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.571+0000 7f9b1be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c15cc20 0x7f9b1c159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:19.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.571+0000 7f9b1be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c15cc20 0x7f9b1c159fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38392/0 (socket says 172.21.15.133:38392) 2024-03-30T01:52:19.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.571+0000 7f9b1be00640 1 -- 172.21.15.133:0/3623227180 learned_addr learned my addr 172.21.15.133:0/3623227180 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:19.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.571+0000 7f9b1aa00640 1 --2- 172.21.15.133:0/3623227180 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b1c0ad3c0 0x7f9b1c1e7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:19.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.571+0000 7f9b1b400640 1 --2- 172.21.15.133:0/3623227180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c06b200 0x7f9b1c157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:19.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.571+0000 7f9b1be00640 1 -- 172.21.15.133:0/3623227180 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b1c0ad3c0 msgr2=0x7f9b1c1e7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:19.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.571+0000 7f9b1be00640 1 --2- 172.21.15.133:0/3623227180 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b1c0ad3c0 0x7f9b1c1e7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.571+0000 7f9b1be00640 1 -- 172.21.15.133:0/3623227180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c06b200 msgr2=0x7f9b1c157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:19.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.571+0000 7f9b1be00640 1 --2- 172.21.15.133:0/3623227180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c06b200 0x7f9b1c157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.571+0000 7f9b1be00640 1 -- 172.21.15.133:0/3623227180 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b040094d0 con 0x7f9b1c15cc20 2024-03-30T01:52:19.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.571+0000 7f9b1aa00640 1 --2- 172.21.15.133:0/3623227180 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b1c0ad3c0 0x7f9b1c1e7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:19.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.571+0000 7f9b1be00640 1 --2- 172.21.15.133:0/3623227180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c15cc20 0x7f9b1c159fe0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400c7f0 tx=0x7f9b1400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:19.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.572+0000 7f9b13400640 1 -- 172.21.15.133:0/3623227180 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b14007820 con 0x7f9b1c15cc20 2024-03-30T01:52:19.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.572+0000 7f9b13400640 1 -- 172.21.15.133:0/3623227180 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b14007980 con 0x7f9b1c15cc20 2024-03-30T01:52:19.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.572+0000 7f9b13400640 1 -- 172.21.15.133:0/3623227180 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b14007d30 con 0x7f9b1c15cc20 2024-03-30T01:52:19.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.572+0000 7f9b22200640 1 -- 172.21.15.133:0/3623227180 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1c158d80 con 0x7f9b1c15cc20 2024-03-30T01:52:19.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.572+0000 7f9b22200640 1 -- 172.21.15.133:0/3623227180 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1c159340 con 0x7f9b1c15cc20 2024-03-30T01:52:19.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.573+0000 7f9b22200640 1 -- 172.21.15.133:0/3623227180 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b1c159530 con 0x7f9b1c15cc20 2024-03-30T01:52:19.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.574+0000 7f9b13400640 1 -- 172.21.15.133:0/3623227180 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9b140113f0 con 0x7f9b1c15cc20 2024-03-30T01:52:19.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.575+0000 7f9b13400640 1 --2- 172.21.15.133:0/3623227180 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9af806ac00 0x7f9af806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:19.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.575+0000 7f9b13400640 1 -- 172.21.15.133:0/3623227180 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9b14089760 con 0x7f9b1c15cc20 2024-03-30T01:52:19.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.575+0000 7f9b1b400640 1 --2- 172.21.15.133:0/3623227180 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9af806ac00 0x7f9af806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:19.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.576+0000 7f9b1b400640 1 --2- 172.21.15.133:0/3623227180 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9af806ac00 0x7f9af806d0c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c008e50 tx=0x7f9b0c0083a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:19.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.579+0000 7f9b13400640 1 -- 172.21.15.133:0/3623227180 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f9b140548e0 con 0x7f9b1c15cc20 2024-03-30T01:52:19.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.775+0000 7f9b22200640 1 -- 172.21.15.133:0/3623227180 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9b1c066d80 con 0x7f9b1c15cc20 2024-03-30T01:52:19.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.776+0000 7f9b13400640 1 -- 172.21.15.133:0/3623227180 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9b14057f00 con 0x7f9b1c15cc20 2024-03-30T01:52:19.782 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-03-30T01:52:19.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.779+0000 7f9b22200640 1 -- 172.21.15.133:0/3623227180 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9af806ac00 msgr2=0x7f9af806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.779+0000 7f9b22200640 1 --2- 172.21.15.133:0/3623227180 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9af806ac00 0x7f9af806d0c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c008e50 tx=0x7f9b0c0083a0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.779+0000 7f9b22200640 1 -- 172.21.15.133:0/3623227180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c15cc20 msgr2=0x7f9b1c159fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.779+0000 7f9b22200640 1 --2- 172.21.15.133:0/3623227180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c15cc20 0x7f9b1c159fe0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400c7f0 tx=0x7f9b1400ccb0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.779+0000 7f9b22200640 1 -- 172.21.15.133:0/3623227180 shutdown_connections 2024-03-30T01:52:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.779+0000 7f9b22200640 1 --2- 172.21.15.133:0/3623227180 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9af806ac00 0x7f9af806d0c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.779+0000 7f9b22200640 1 --2- 172.21.15.133:0/3623227180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c15cc20 0x7f9b1c159fe0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.779+0000 7f9b22200640 1 --2- 172.21.15.133:0/3623227180 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b1c0ad3c0 0x7f9b1c1e7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.779+0000 7f9b22200640 1 --2- 172.21.15.133:0/3623227180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c06b200 0x7f9b1c157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.779+0000 7f9b22200640 1 -- 172.21.15.133:0/3623227180 >> 172.21.15.133:0/3623227180 conn(0x7f9b1c06da20 msgr2=0x7f9b1c0ab9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.779+0000 7f9b22200640 1 -- 172.21.15.133:0/3623227180 shutdown_connections 2024-03-30T01:52:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:19.779+0000 7f9b22200640 1 -- 172.21.15.133:0/3623227180 wait complete. 2024-03-30T01:52:19.804 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T01:52:20.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.009+0000 7f2f4cc00640 1 Processor -- start 2024-03-30T01:52:20.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.009+0000 7f2f4cc00640 1 -- start start 2024-03-30T01:52:20.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.010+0000 7f2f4cc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2f4806e2e0 0x7f2f48070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:20.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.010+0000 7f2f4cc00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f48070e50 con 0x7f2f48070a40 2024-03-30T01:52:20.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.010+0000 7f2f4cc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f480ce400 con 0x7f2f48143220 2024-03-30T01:52:20.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.010+0000 7f2f4cc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f480cc5c0 con 0x7f2f4806e2e0 2024-03-30T01:52:20.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.011+0000 7f2f46800640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2f48070a40 0x7f2f4815d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43904/0 (socket says 172.21.15.133:43904) 2024-03-30T01:52:20.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.011+0000 7f2f46800640 1 -- 172.21.15.133:0/3327870133 learned_addr learned my addr 172.21.15.133:0/3327870133 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:20.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.011+0000 7f2f3fe00640 1 --2- 172.21.15.133:0/3327870133 >> v2:172.21.15.137:3300/0 conn(0x7f2f4806e2e0 0x7f2f48070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:20.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.011+0000 7f2f45400640 1 -- 172.21.15.133:0/3327870133 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1079268656 0 0) 0x7f2f48070e50 con 0x7f2f48070a40 2024-03-30T01:52:20.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.011+0000 7f2f45400640 1 -- 172.21.15.133:0/3327870133 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f2c005730 con 0x7f2f48070a40 2024-03-30T01:52:20.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.012+0000 7f2f45400640 1 -- 172.21.15.133:0/3327870133 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3626966733 0 0) 0x7f2f2c005730 con 0x7f2f48070a40 2024-03-30T01:52:20.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.012+0000 7f2f45400640 1 -- 172.21.15.133:0/3327870133 >> v2:172.21.15.137:3300/0 conn(0x7f2f4806e2e0 msgr2=0x7f2f48070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:20.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.012+0000 7f2f45400640 1 --2- 172.21.15.133:0/3327870133 >> v2:172.21.15.137:3300/0 conn(0x7f2f4806e2e0 0x7f2f48070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:20.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.012+0000 7f2f45400640 1 -- 172.21.15.133:0/3327870133 >> v1:172.21.15.137:6789/0 conn(0x7f2f48143220 legacy=0x7f2f480cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:20.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.012+0000 7f2f45400640 1 -- 172.21.15.133:0/3327870133 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4806d0e0 con 0x7f2f48070a40 2024-03-30T01:52:20.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.012+0000 7f2f45400640 1 -- 172.21.15.133:0/3327870133 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f2f400019f0 con 0x7f2f48070a40 2024-03-30T01:52:20.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.012+0000 7f2f45400640 1 -- 172.21.15.133:0/3327870133 >> v1:172.21.15.133:6789/0 conn(0x7f2f48070a40 legacy=0x7f2f4815d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:20.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.012+0000 7f2f45400640 1 --2- 172.21.15.133:0/3327870133 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f2c005b80 0x7f2f2c005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:20.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.012+0000 7f2f45400640 1 --2- 172.21.15.133:0/3327870133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f2c0069d0 0x7f2f2c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:20.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.012+0000 7f2f45400640 1 --2- 172.21.15.133:0/3327870133 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f2c007390 0x7f2f2c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:20.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.012+0000 7f2f45400640 1 -- 172.21.15.133:0/3327870133 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c00e200 con 0x7f2f2c0069d0 2024-03-30T01:52:20.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.012+0000 7f2f45400640 1 -- 172.21.15.133:0/3327870133 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c00e370 con 0x7f2f2c007390 2024-03-30T01:52:20.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.012+0000 7f2f45400640 1 -- 172.21.15.133:0/3327870133 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c00e530 con 0x7f2f2c005b80 2024-03-30T01:52:20.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.012+0000 7f2f3fe00640 1 --2- 172.21.15.133:0/3327870133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f2c0069d0 0x7f2f2c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:20.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.013+0000 7f2f45e00640 1 --2- 172.21.15.133:0/3327870133 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f2c005b80 0x7f2f2c005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:20.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.013+0000 7f2f3fe00640 1 -- 172.21.15.133:0/3327870133 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f2c005b80 msgr2=0x7f2f2c005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:20.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.013+0000 7f2f3fe00640 1 --2- 172.21.15.133:0/3327870133 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f2c005b80 0x7f2f2c005fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:20.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.013+0000 7f2f3fe00640 1 -- 172.21.15.133:0/3327870133 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f2c007390 msgr2=0x7f2f2c00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:20.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.013+0000 7f2f3fe00640 1 --2- 172.21.15.133:0/3327870133 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f2c007390 0x7f2f2c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:20.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.013+0000 7f2f3fe00640 1 -- 172.21.15.133:0/3327870133 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c005730 con 0x7f2f2c0069d0 2024-03-30T01:52:20.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.013+0000 7f2f46800640 1 -- 172.21.15.133:0/3327870133 reap_dead start 2024-03-30T01:52:20.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.014+0000 7f2f3fe00640 1 --2- 172.21.15.133:0/3327870133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f2c0069d0 0x7f2f2c006e50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2f30009ac0 tx=0x7f2f2c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9c3a0d62e07d02 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:20.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.014+0000 7f2f45400640 1 -- 172.21.15.133:0/3327870133 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3002c6b0 con 0x7f2f2c0069d0 2024-03-30T01:52:20.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.014+0000 7f2f45400640 1 -- 172.21.15.133:0/3327870133 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3002c810 con 0x7f2f2c0069d0 2024-03-30T01:52:20.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.014+0000 7f2f45400640 1 -- 172.21.15.133:0/3327870133 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3002cba0 con 0x7f2f2c0069d0 2024-03-30T01:52:20.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.015+0000 7f2f4cc00640 1 -- 172.21.15.133:0/3327870133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f2c0069d0 msgr2=0x7f2f2c006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:20.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.015+0000 7f2f4cc00640 1 --2- 172.21.15.133:0/3327870133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f2c0069d0 0x7f2f2c006e50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2f30009ac0 tx=0x7f2f2c007a00 comp rx=0 tx=0).stop 2024-03-30T01:52:20.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.015+0000 7f2f4cc00640 1 -- 172.21.15.133:0/3327870133 shutdown_connections 2024-03-30T01:52:20.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.015+0000 7f2f4cc00640 1 --2- 172.21.15.133:0/3327870133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f2c0069d0 0x7f2f2c006e50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:20.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.015+0000 7f2f4cc00640 1 -- 172.21.15.133:0/3327870133 >> 172.21.15.133:0/3327870133 conn(0x7f2f480b07a0 msgr2=0x7f2f480b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:20.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.015+0000 7f2f4cc00640 1 -- 172.21.15.133:0/3327870133 shutdown_connections 2024-03-30T01:52:20.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.015+0000 7f2f4cc00640 1 -- 172.21.15.133:0/3327870133 wait complete. 2024-03-30T01:52:20.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.017+0000 7f2f4cc00640 1 Processor -- start 2024-03-30T01:52:20.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.017+0000 7f2f4cc00640 1 -- start start 2024-03-30T01:52:20.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.018+0000 7f2f4cc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f2c0069d0 0x7f2f48139220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:20.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.018+0000 7f2f4cc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f481ee650 0x7f2f4813e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:20.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.018+0000 7f2f4cc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f481eead0 0x7f2f4813eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:20.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.018+0000 7f2f4cc00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4813f060 con 0x7f2f481eead0 2024-03-30T01:52:20.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.018+0000 7f2f4cc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4813bad0 con 0x7f2f2c0069d0 2024-03-30T01:52:20.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.018+0000 7f2f4cc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4813f5e0 con 0x7f2f481ee650 2024-03-30T01:52:20.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.018+0000 7f2f46800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f481eead0 0x7f2f4813eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:20.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.018+0000 7f2f46800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f481eead0 0x7f2f4813eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38396/0 (socket says 172.21.15.133:38396) 2024-03-30T01:52:20.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.018+0000 7f2f46800640 1 -- 172.21.15.133:0/3344668059 learned_addr learned my addr 172.21.15.133:0/3344668059 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:20.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.018+0000 7f2f45e00640 1 --2- 172.21.15.133:0/3344668059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f2c0069d0 0x7f2f48139220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:20.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.018+0000 7f2f3fe00640 1 --2- 172.21.15.133:0/3344668059 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f481ee650 0x7f2f4813e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:20.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.018+0000 7f2f46800640 1 -- 172.21.15.133:0/3344668059 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f481ee650 msgr2=0x7f2f4813e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:20.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.018+0000 7f2f46800640 1 --2- 172.21.15.133:0/3344668059 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f481ee650 0x7f2f4813e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:20.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.018+0000 7f2f46800640 1 -- 172.21.15.133:0/3344668059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f2c0069d0 msgr2=0x7f2f48139220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:20.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.018+0000 7f2f46800640 1 --2- 172.21.15.133:0/3344668059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f2c0069d0 0x7f2f48139220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:20.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.018+0000 7f2f46800640 1 -- 172.21.15.133:0/3344668059 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4813f8c0 con 0x7f2f481eead0 2024-03-30T01:52:20.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.019+0000 7f2f46800640 1 --2- 172.21.15.133:0/3344668059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f481eead0 0x7f2f4813eb20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2f480cb580 tx=0x7f2f4000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:20.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.019+0000 7f2f3e000640 1 -- 172.21.15.133:0/3344668059 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4000a610 con 0x7f2f481eead0 2024-03-30T01:52:20.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.019+0000 7f2f3e000640 1 -- 172.21.15.133:0/3344668059 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4000a770 con 0x7f2f481eead0 2024-03-30T01:52:20.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.019+0000 7f2f3e000640 1 -- 172.21.15.133:0/3344668059 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4000ab00 con 0x7f2f481eead0 2024-03-30T01:52:20.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.019+0000 7f2f4cc00640 1 -- 172.21.15.133:0/3344668059 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4813fba0 con 0x7f2f481eead0 2024-03-30T01:52:20.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.019+0000 7f2f4cc00640 1 -- 172.21.15.133:0/3344668059 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f481403a0 con 0x7f2f481eead0 2024-03-30T01:52:20.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.020+0000 7f2f4cc00640 1 -- 172.21.15.133:0/3344668059 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4815cd60 con 0x7f2f481eead0 2024-03-30T01:52:20.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.021+0000 7f2f3e000640 1 -- 172.21.15.133:0/3344668059 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f2f4000ac60 con 0x7f2f481eead0 2024-03-30T01:52:20.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.022+0000 7f2f3e000640 1 --2- 172.21.15.133:0/3344668059 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f2f2406ac00 0x7f2f2406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:20.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.022+0000 7f2f3e000640 1 -- 172.21.15.133:0/3344668059 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2f400888f0 con 0x7f2f481eead0 2024-03-30T01:52:20.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.022+0000 7f2f45e00640 1 --2- 172.21.15.133:0/3344668059 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f2f2406ac00 0x7f2f2406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:20.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.023+0000 7f2f45e00640 1 --2- 172.21.15.133:0/3344668059 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f2f2406ac00 0x7f2f2406d0c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2f480694d0 tx=0x7f2f38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:20.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.027+0000 7f2f3e000640 1 -- 172.21.15.133:0/3344668059 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f2f400539d0 con 0x7f2f481eead0 2024-03-30T01:52:20.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.222+0000 7f2f4cc00640 1 -- 172.21.15.133:0/3344668059 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2f481400c0 con 0x7f2f481eead0 2024-03-30T01:52:20.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.223+0000 7f2f3e000640 1 -- 172.21.15.133:0/3344668059 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2f481400c0 con 0x7f2f481eead0 2024-03-30T01:52:20.230 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-03-30T01:52:20.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.226+0000 7f2f4cc00640 1 -- 172.21.15.133:0/3344668059 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f2f2406ac00 msgr2=0x7f2f2406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:20.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.226+0000 7f2f4cc00640 1 --2- 172.21.15.133:0/3344668059 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f2f2406ac00 0x7f2f2406d0c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2f480694d0 tx=0x7f2f38009040 comp rx=0 tx=0).stop 2024-03-30T01:52:20.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.226+0000 7f2f4cc00640 1 -- 172.21.15.133:0/3344668059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f481eead0 msgr2=0x7f2f4813eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:20.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.226+0000 7f2f4cc00640 1 --2- 172.21.15.133:0/3344668059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f481eead0 0x7f2f4813eb20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2f480cb580 tx=0x7f2f4000ccd0 comp rx=0 tx=0).stop 2024-03-30T01:52:20.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.227+0000 7f2f4cc00640 1 -- 172.21.15.133:0/3344668059 shutdown_connections 2024-03-30T01:52:20.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.227+0000 7f2f4cc00640 1 --2- 172.21.15.133:0/3344668059 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f2f2406ac00 0x7f2f2406d0c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:20.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.227+0000 7f2f4cc00640 1 --2- 172.21.15.133:0/3344668059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f481eead0 0x7f2f4813eb20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:20.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.227+0000 7f2f4cc00640 1 --2- 172.21.15.133:0/3344668059 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f481ee650 0x7f2f4813e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:20.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.227+0000 7f2f4cc00640 1 --2- 172.21.15.133:0/3344668059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f2c0069d0 0x7f2f48139220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:20.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.227+0000 7f2f4cc00640 1 -- 172.21.15.133:0/3344668059 >> 172.21.15.133:0/3344668059 conn(0x7f2f480b07a0 msgr2=0x7f2f48158010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:20.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.227+0000 7f2f4cc00640 1 -- 172.21.15.133:0/3344668059 shutdown_connections 2024-03-30T01:52:20.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.227+0000 7f2f4cc00640 1 -- 172.21.15.133:0/3344668059 wait complete. 2024-03-30T01:52:20.253 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T01:52:20.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.458+0000 7fefe5600640 1 Processor -- start 2024-03-30T01:52:20.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.458+0000 7fefe5600640 1 -- start start 2024-03-30T01:52:20.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.460+0000 7fefe5600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fefe00cfb80 0x7fefe00b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:20.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.460+0000 7fefe5600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe015d030 con 0x7fefe00d0af0 2024-03-30T01:52:20.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.460+0000 7fefe5600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe00b5af0 con 0x7fefe015cc50 2024-03-30T01:52:20.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.460+0000 7fefe5600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe00d1c50 con 0x7fefe00cfb80 2024-03-30T01:52:20.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.460+0000 7fefd6000640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fefe00d0af0 0x7fefe00cf470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43912/0 (socket says 172.21.15.133:43912) 2024-03-30T01:52:20.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.460+0000 7fefd6000640 1 -- 172.21.15.133:0/3221185391 learned_addr learned my addr 172.21.15.133:0/3221185391 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:20.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.461+0000 7fefdf400640 1 --2- 172.21.15.133:0/3221185391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fefe00cfb80 0x7fefe00b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:20.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.461+0000 7fefde000640 1 -- 172.21.15.133:0/3221185391 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1549204527 0 0) 0x7fefe015d030 con 0x7fefe00d0af0 2024-03-30T01:52:20.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.461+0000 7fefde000640 1 -- 172.21.15.133:0/3221185391 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefc4003520 con 0x7fefe00d0af0 2024-03-30T01:52:20.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.461+0000 7fefde000640 1 -- 172.21.15.133:0/3221185391 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3152779440 0 0) 0x7fefc4003520 con 0x7fefe00d0af0 2024-03-30T01:52:20.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.461+0000 7fefde000640 1 -- 172.21.15.133:0/3221185391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fefe00cfb80 msgr2=0x7fefe00b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:20.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.461+0000 7fefde000640 1 --2- 172.21.15.133:0/3221185391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fefe00cfb80 0x7fefe00b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:20.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.461+0000 7fefde000640 1 -- 172.21.15.133:0/3221185391 >> v1:172.21.15.137:6789/0 conn(0x7fefe015cc50 legacy=0x7fefe00d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:20.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.461+0000 7fefde000640 1 -- 172.21.15.133:0/3221185391 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe00d10d0 con 0x7fefe00d0af0 2024-03-30T01:52:20.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.461+0000 7fefde000640 1 -- 172.21.15.133:0/3221185391 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fefc8001670 con 0x7fefe00d0af0 2024-03-30T01:52:20.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.461+0000 7fefde000640 1 -- 172.21.15.133:0/3221185391 >> v1:172.21.15.133:6789/0 conn(0x7fefe00d0af0 legacy=0x7fefe00cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:20.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.461+0000 7fefde000640 1 --2- 172.21.15.133:0/3221185391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefc40039a0 0x7fefc4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:20.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.461+0000 7fefde000640 1 --2- 172.21.15.133:0/3221185391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefc40047c0 0x7fefc4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:20.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.461+0000 7fefde000640 1 --2- 172.21.15.133:0/3221185391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fefe00cfb80 0x7fefc4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:20.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.461+0000 7fefde000640 1 -- 172.21.15.133:0/3221185391 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe00d1c50 con 0x7fefc40047c0 2024-03-30T01:52:20.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.461+0000 7fefde000640 1 -- 172.21.15.133:0/3221185391 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc400ba60 con 0x7fefc40039a0 2024-03-30T01:52:20.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.461+0000 7fefde000640 1 -- 172.21.15.133:0/3221185391 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc400bc20 con 0x7fefe00cfb80 2024-03-30T01:52:20.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.461+0000 7fefd6000640 1 --2- 172.21.15.133:0/3221185391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefc40047c0 0x7fefc4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:20.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.462+0000 7fefdf400640 1 --2- 172.21.15.133:0/3221185391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fefe00cfb80 0x7fefc4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:20.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.462+0000 7fefdea00640 1 --2- 172.21.15.133:0/3221185391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefc40039a0 0x7fefc4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:20.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.462+0000 7fefd6000640 1 -- 172.21.15.133:0/3221185391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fefe00cfb80 msgr2=0x7fefc4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:20.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.462+0000 7fefd6000640 1 --2- 172.21.15.133:0/3221185391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fefe00cfb80 0x7fefc4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:20.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.462+0000 7fefd6000640 1 -- 172.21.15.133:0/3221185391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefc40039a0 msgr2=0x7fefc4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:20.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.462+0000 7fefd6000640 1 --2- 172.21.15.133:0/3221185391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefc40039a0 0x7fefc4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:20.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.462+0000 7fefd6000640 1 -- 172.21.15.133:0/3221185391 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc4003520 con 0x7fefc40047c0 2024-03-30T01:52:20.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.462+0000 7fefdea00640 1 --2- 172.21.15.133:0/3221185391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefc40039a0 0x7fefc4003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:20.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.462+0000 7fefdf400640 1 --2- 172.21.15.133:0/3221185391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fefe00cfb80 0x7fefc4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:20.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.463+0000 7fefd6000640 1 --2- 172.21.15.133:0/3221185391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefc40047c0 0x7fefc4004c40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fefc8001eb0 tx=0x7fefc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c89ffd15dd6030 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:20.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.463+0000 7fefde000640 1 -- 172.21.15.133:0/3221185391 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc8005ad0 con 0x7fefc40047c0 2024-03-30T01:52:20.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.463+0000 7fefde000640 1 -- 172.21.15.133:0/3221185391 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc8005c30 con 0x7fefc40047c0 2024-03-30T01:52:20.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.463+0000 7fefde000640 1 -- 172.21.15.133:0/3221185391 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc802c7c0 con 0x7fefc40047c0 2024-03-30T01:52:20.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.464+0000 7fefe5600640 1 -- 172.21.15.133:0/3221185391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefc40047c0 msgr2=0x7fefc4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:20.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.464+0000 7fefe5600640 1 --2- 172.21.15.133:0/3221185391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefc40047c0 0x7fefc4004c40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fefc8001eb0 tx=0x7fefc40057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:20.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.464+0000 7fefdf400640 1 -- 172.21.15.133:0/3221185391 reap_dead start 2024-03-30T01:52:20.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.464+0000 7fefe5600640 1 -- 172.21.15.133:0/3221185391 shutdown_connections 2024-03-30T01:52:20.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.464+0000 7fefe5600640 1 -- 172.21.15.133:0/3221185391 >> 172.21.15.133:0/3221185391 conn(0x7fefe0071a40 msgr2=0x7fefe006b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:20.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.464+0000 7fefe5600640 1 -- 172.21.15.133:0/3221185391 shutdown_connections 2024-03-30T01:52:20.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.464+0000 7fefe5600640 1 -- 172.21.15.133:0/3221185391 wait complete. 2024-03-30T01:52:20.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.466+0000 7fefe5600640 1 Processor -- start 2024-03-30T01:52:20.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.466+0000 7fefe5600640 1 -- start start 2024-03-30T01:52:20.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.467+0000 7fefe5600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefc40047c0 0x7fefe00b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:20.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.467+0000 7fefe5600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefe0156ad0 0x7fefe0156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:20.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.467+0000 7fefe5600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fefe0158710 0x7fefe0158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:20.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.467+0000 7fefe5600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe0153ac0 con 0x7fefe0156ad0 2024-03-30T01:52:20.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.467+0000 7fefe5600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe00b52b0 con 0x7fefc40047c0 2024-03-30T01:52:20.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.467+0000 7fefe5600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe0152eb0 con 0x7fefe0158710 2024-03-30T01:52:20.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.467+0000 7fefd6000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefe0156ad0 0x7fefe0156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:20.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.467+0000 7fefd6000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefe0156ad0 0x7fefe0156f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38404/0 (socket says 172.21.15.133:38404) 2024-03-30T01:52:20.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.467+0000 7fefd6000640 1 -- 172.21.15.133:0/3565758864 learned_addr learned my addr 172.21.15.133:0/3565758864 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:20.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.467+0000 7fefdf400640 1 --2- 172.21.15.133:0/3565758864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fefe0158710 0x7fefe0158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:20.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.467+0000 7fefdea00640 1 --2- 172.21.15.133:0/3565758864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefc40047c0 0x7fefe00b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:20.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.468+0000 7fefd6000640 1 -- 172.21.15.133:0/3565758864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fefe0158710 msgr2=0x7fefe0158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:20.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.468+0000 7fefd6000640 1 --2- 172.21.15.133:0/3565758864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fefe0158710 0x7fefe0158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:20.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.468+0000 7fefd6000640 1 -- 172.21.15.133:0/3565758864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefc40047c0 msgr2=0x7fefe00b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:20.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.468+0000 7fefd6000640 1 --2- 172.21.15.133:0/3565758864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefc40047c0 0x7fefe00b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:20.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.468+0000 7fefd6000640 1 -- 172.21.15.133:0/3565758864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe0153190 con 0x7fefe0156ad0 2024-03-30T01:52:20.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.468+0000 7fefd6000640 1 --2- 172.21.15.133:0/3565758864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefe0156ad0 0x7fefe0156f50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fefc8001eb0 tx=0x7fefc8001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:20.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.468+0000 7fefd7400640 1 -- 172.21.15.133:0/3565758864 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc8039070 con 0x7fefe0156ad0 2024-03-30T01:52:20.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.468+0000 7fefd7400640 1 -- 172.21.15.133:0/3565758864 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc802cbd0 con 0x7fefe0156ad0 2024-03-30T01:52:20.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.468+0000 7fefe5600640 1 -- 172.21.15.133:0/3565758864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe0153470 con 0x7fefe0156ad0 2024-03-30T01:52:20.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.468+0000 7fefd7400640 1 -- 172.21.15.133:0/3565758864 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc803c040 con 0x7fefe0156ad0 2024-03-30T01:52:20.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.468+0000 7fefe5600640 1 -- 172.21.15.133:0/3565758864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe01590d0 con 0x7fefe0156ad0 2024-03-30T01:52:20.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.469+0000 7fefe5600640 1 -- 172.21.15.133:0/3565758864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe00675a0 con 0x7fefe0156ad0 2024-03-30T01:52:20.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.470+0000 7fefd7400640 1 -- 172.21.15.133:0/3565758864 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fefc8032070 con 0x7fefe0156ad0 2024-03-30T01:52:20.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.471+0000 7fefd7400640 1 --2- 172.21.15.133:0/3565758864 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fefbc06ac00 0x7fefbc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:20.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.471+0000 7fefd7400640 1 -- 172.21.15.133:0/3565758864 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fefc80aa680 con 0x7fefe0156ad0 2024-03-30T01:52:20.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.471+0000 7fefdea00640 1 --2- 172.21.15.133:0/3565758864 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fefbc06ac00 0x7fefbc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:20.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.472+0000 7fefdea00640 1 --2- 172.21.15.133:0/3565758864 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fefbc06ac00 0x7fefbc06d0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fefd0001590 tx=0x7fefd0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:20.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.476+0000 7fefd7400640 1 -- 172.21.15.133:0/3565758864 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fefc8075740 con 0x7fefe0156ad0 2024-03-30T01:52:20.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.684+0000 7fefe5600640 1 -- 172.21.15.133:0/3565758864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fefe006bf40 con 0x7fefe0156ad0 2024-03-30T01:52:20.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.685+0000 7fefd7400640 1 -- 172.21.15.133:0/3565758864 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fefc8078d60 con 0x7fefe0156ad0 2024-03-30T01:52:20.692 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2024-03-30T01:52:20.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.687+0000 7fefe5600640 1 -- 172.21.15.133:0/3565758864 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fefbc06ac00 msgr2=0x7fefbc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:20.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.687+0000 7fefe5600640 1 --2- 172.21.15.133:0/3565758864 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fefbc06ac00 0x7fefbc06d0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fefd0001590 tx=0x7fefd0009040 comp rx=0 tx=0).stop 2024-03-30T01:52:20.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.687+0000 7fefe5600640 1 -- 172.21.15.133:0/3565758864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefe0156ad0 msgr2=0x7fefe0156f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:20.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.687+0000 7fefe5600640 1 --2- 172.21.15.133:0/3565758864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefe0156ad0 0x7fefe0156f50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fefc8001eb0 tx=0x7fefc8001930 comp rx=0 tx=0).stop 2024-03-30T01:52:20.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.688+0000 7fefe5600640 1 -- 172.21.15.133:0/3565758864 shutdown_connections 2024-03-30T01:52:20.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.688+0000 7fefe5600640 1 --2- 172.21.15.133:0/3565758864 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fefbc06ac00 0x7fefbc06d0c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:20.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.688+0000 7fefe5600640 1 --2- 172.21.15.133:0/3565758864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fefe0158710 0x7fefe0158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:20.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.688+0000 7fefe5600640 1 --2- 172.21.15.133:0/3565758864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefe0156ad0 0x7fefe0156f50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:20.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.688+0000 7fefe5600640 1 --2- 172.21.15.133:0/3565758864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefc40047c0 0x7fefe00b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:20.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.688+0000 7fefe5600640 1 -- 172.21.15.133:0/3565758864 >> 172.21.15.133:0/3565758864 conn(0x7fefe0071a40 msgr2=0x7fefe006b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:20.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.688+0000 7fefe5600640 1 -- 172.21.15.133:0/3565758864 shutdown_connections 2024-03-30T01:52:20.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:20.688+0000 7fefe5600640 1 -- 172.21.15.133:0/3565758864 wait complete. 2024-03-30T01:52:20.714 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-30T01:52:20.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:20.715 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-03-30T01:52:20.812 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2024-03-30T01:52:20.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:20.813 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-30T01:52:20.867 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:52:20.867 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:52:20.923 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:52:20.923 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:52:20.972 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:52:20.972 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:52:21.068 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:52:21.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.278+0000 7f880e800640 1 Processor -- start 2024-03-30T01:52:21.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.279+0000 7f880e800640 1 -- start start 2024-03-30T01:52:21.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.280+0000 7f880e800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8808143790 0x7f88080cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:21.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.280+0000 7f880e800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88080ccc40 0x7f8808070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:21.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.280+0000 7f880e800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88080a76a0 con 0x7f8808070500 2024-03-30T01:52:21.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.280+0000 7f880e800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88080b38e0 con 0x7f88080ccc40 2024-03-30T01:52:21.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.280+0000 7f880e800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88080cd180 con 0x7f8808143790 2024-03-30T01:52:21.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.281+0000 7f8807e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88080ccc40 0x7f8808070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:21.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.281+0000 7f8807e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88080ccc40 0x7f8808070960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38408/0 (socket says 172.21.15.133:38408) 2024-03-30T01:52:21.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.281+0000 7f8807e00640 1 -- 172.21.15.133:0/3766696266 learned_addr learned my addr 172.21.15.133:0/3766696266 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:21.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.281+0000 7f8807400640 1 --2- 172.21.15.133:0/3766696266 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8808143790 0x7f88080cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:21.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.281+0000 7f8807e00640 1 -- 172.21.15.133:0/3766696266 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8808143790 msgr2=0x7f88080cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:21.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.281+0000 7f8807e00640 1 --2- 172.21.15.133:0/3766696266 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8808143790 0x7f88080cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:21.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.281+0000 7f8807e00640 1 -- 172.21.15.133:0/3766696266 >> v1:172.21.15.137:6789/0 conn(0x7f8808070500 legacy=0x7f88080cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:21.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.281+0000 7f8807e00640 1 -- 172.21.15.133:0/3766696266 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8808070ea0 con 0x7f88080ccc40 2024-03-30T01:52:21.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.282+0000 7f8807e00640 1 --2- 172.21.15.133:0/3766696266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88080ccc40 0x7f8808070960 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8800009e50 tx=0x7f880002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d6fa9ab4654b63 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:21.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.282+0000 7f8806a00640 1 -- 172.21.15.133:0/3766696266 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880002cb00 con 0x7f88080ccc40 2024-03-30T01:52:21.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.282+0000 7f8806a00640 1 -- 172.21.15.133:0/3766696266 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880002cc60 con 0x7f88080ccc40 2024-03-30T01:52:21.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.283+0000 7f8806a00640 1 -- 172.21.15.133:0/3766696266 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88000343f0 con 0x7f88080ccc40 2024-03-30T01:52:21.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.283+0000 7f880e800640 1 -- 172.21.15.133:0/3766696266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88080ccc40 msgr2=0x7f8808070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:21.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.283+0000 7f880e800640 1 --2- 172.21.15.133:0/3766696266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88080ccc40 0x7f8808070960 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8800009e50 tx=0x7f880002bf60 comp rx=0 tx=0).stop 2024-03-30T01:52:21.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.283+0000 7f880e800640 1 -- 172.21.15.133:0/3766696266 shutdown_connections 2024-03-30T01:52:21.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.283+0000 7f880e800640 1 --2- 172.21.15.133:0/3766696266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88080ccc40 0x7f8808070960 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:21.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.283+0000 7f880e800640 1 --2- 172.21.15.133:0/3766696266 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8808143790 0x7f88080cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:21.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.283+0000 7f880e800640 1 -- 172.21.15.133:0/3766696266 >> 172.21.15.133:0/3766696266 conn(0x7f88080b07a0 msgr2=0x7f88080b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:21.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.283+0000 7f880e800640 1 -- 172.21.15.133:0/3766696266 shutdown_connections 2024-03-30T01:52:21.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.283+0000 7f880e800640 1 -- 172.21.15.133:0/3766696266 wait complete. 2024-03-30T01:52:21.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.285+0000 7f880e800640 1 Processor -- start 2024-03-30T01:52:21.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.285+0000 7f880e800640 1 -- start start 2024-03-30T01:52:21.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.286+0000 7f880e800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8808070500 0x7f8808133dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:21.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.286+0000 7f880e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88080ccc40 0x7f8808135b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:21.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.286+0000 7f880e800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8808143790 0x7f8808136420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:21.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.286+0000 7f880e800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88080c3830 con 0x7f8808070500 2024-03-30T01:52:21.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.286+0000 7f880e800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88080c43b0 con 0x7f88080ccc40 2024-03-30T01:52:21.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.286+0000 7f880e800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88080c3a80 con 0x7f8808143790 2024-03-30T01:52:21.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.286+0000 7f8807400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8808070500 0x7f8808133dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:21.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.286+0000 7f8807400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8808070500 0x7f8808133dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38410/0 (socket says 172.21.15.133:38410) 2024-03-30T01:52:21.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.286+0000 7f8807400640 1 -- 172.21.15.133:0/794783777 learned_addr learned my addr 172.21.15.133:0/794783777 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:21.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.287+0000 7f8807400640 1 -- 172.21.15.133:0/794783777 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8808143790 msgr2=0x7f8808136420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:21.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.287+0000 7f8807400640 1 --2- 172.21.15.133:0/794783777 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8808143790 0x7f8808136420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:21.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.287+0000 7f8807400640 1 -- 172.21.15.133:0/794783777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88080ccc40 msgr2=0x7f8808135b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:21.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.287+0000 7f8807400640 1 --2- 172.21.15.133:0/794783777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88080ccc40 0x7f8808135b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:21.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.287+0000 7f8807400640 1 -- 172.21.15.133:0/794783777 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8800009b30 con 0x7f8808070500 2024-03-30T01:52:21.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.287+0000 7f8807400640 1 --2- 172.21.15.133:0/794783777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8808070500 0x7f8808133dc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f87f800d830 tx=0x7f87f800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:21.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.287+0000 7f87ffe00640 1 -- 172.21.15.133:0/794783777 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f800b6c0 con 0x7f8808070500 2024-03-30T01:52:21.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.287+0000 7f87ffe00640 1 -- 172.21.15.133:0/794783777 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f800b820 con 0x7f8808070500 2024-03-30T01:52:21.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.287+0000 7f87ffe00640 1 -- 172.21.15.133:0/794783777 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f800bbb0 con 0x7f8808070500 2024-03-30T01:52:21.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.287+0000 7f880e800640 1 -- 172.21.15.133:0/794783777 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88080c3d60 con 0x7f8808070500 2024-03-30T01:52:21.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.288+0000 7f880e800640 1 -- 172.21.15.133:0/794783777 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88081360d0 con 0x7f8808070500 2024-03-30T01:52:21.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.289+0000 7f880e800640 1 -- 172.21.15.133:0/794783777 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8808066d80 con 0x7f8808070500 2024-03-30T01:52:21.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.289+0000 7f87ffe00640 1 -- 172.21.15.133:0/794783777 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f87f801e460 con 0x7f8808070500 2024-03-30T01:52:21.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.290+0000 7f87ffe00640 1 --2- 172.21.15.133:0/794783777 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f87e406ac00 0x7f87e406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:21.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.290+0000 7f87ffe00640 1 -- 172.21.15.133:0/794783777 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f87f8089c30 con 0x7f8808070500 2024-03-30T01:52:21.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.291+0000 7f87fea00640 1 --2- 172.21.15.133:0/794783777 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f87e406ac00 0x7f87e406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:21.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.291+0000 7f87fea00640 1 --2- 172.21.15.133:0/794783777 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f87e406ac00 0x7f87e406d0c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f87f0006fd0 tx=0x7f87f0006bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:21.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.295+0000 7f87ffe00640 1 -- 172.21.15.133:0/794783777 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f87f8054cf0 con 0x7f8808070500 2024-03-30T01:52:21.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.487+0000 7f880e800640 1 -- 172.21.15.133:0/794783777 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f880806b4e0 con 0x7f8808070500 2024-03-30T01:52:21.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.490+0000 7f87ffe00640 1 -- 172.21.15.133:0/794783777 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16335 (secure 0 0 0) 0x7f87f8058310 con 0x7f8808070500 2024-03-30T01:52:21.497 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:21.497 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:52:15.520675+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:51:31.245378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T01:51:31.774247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:52:21.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.493+0000 7f880e800640 1 -- 172.21.15.133:0/794783777 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f87e406ac00 msgr2=0x7f87e406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:21.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.493+0000 7f880e800640 1 --2- 172.21.15.133:0/794783777 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f87e406ac00 0x7f87e406d0c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f87f0006fd0 tx=0x7f87f0006bc0 comp rx=0 tx=0).stop 2024-03-30T01:52:21.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.493+0000 7f880e800640 1 -- 172.21.15.133:0/794783777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8808070500 msgr2=0x7f8808133dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:21.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.493+0000 7f880e800640 1 --2- 172.21.15.133:0/794783777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8808070500 0x7f8808133dc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f87f800d830 tx=0x7f87f800dcf0 comp rx=0 tx=0).stop 2024-03-30T01:52:21.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.493+0000 7f880e800640 1 -- 172.21.15.133:0/794783777 shutdown_connections 2024-03-30T01:52:21.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.493+0000 7f880e800640 1 --2- 172.21.15.133:0/794783777 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f87e406ac00 0x7f87e406d0c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:21.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.493+0000 7f880e800640 1 --2- 172.21.15.133:0/794783777 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8808143790 0x7f8808136420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:21.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.493+0000 7f880e800640 1 --2- 172.21.15.133:0/794783777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88080ccc40 0x7f8808135b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:21.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.493+0000 7f880e800640 1 --2- 172.21.15.133:0/794783777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8808070500 0x7f8808133dc0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:21.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.493+0000 7f880e800640 1 -- 172.21.15.133:0/794783777 >> 172.21.15.133:0/794783777 conn(0x7f88080b07a0 msgr2=0x7f88080b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:21.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.493+0000 7f880e800640 1 -- 172.21.15.133:0/794783777 shutdown_connections 2024-03-30T01:52:21.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.493+0000 7f880e800640 1 -- 172.21.15.133:0/794783777 wait complete. 2024-03-30T01:52:21.520 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T01:51:21.771393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T01:51:31.245378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T01:51:31.774247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T01:52:21.520 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T01:52:21.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.717+0000 7f0003200640 1 Processor -- start 2024-03-30T01:52:21.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.718+0000 7f0003200640 1 -- start start 2024-03-30T01:52:21.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.719+0000 7f0003200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efffc143220 0x7efffc0cd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:21.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.719+0000 7f0003200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efffc0ce400 con 0x7efffc070c10 2024-03-30T01:52:21.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.719+0000 7f0003200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efffc06d0e0 con 0x7efffc06e2e0 2024-03-30T01:52:21.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.719+0000 7f0003200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efffc0cc5c0 con 0x7efffc143220 2024-03-30T01:52:21.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.719+0000 7f0001200640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7efffc070c10 0x7efffc15d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43920/0 (socket says 172.21.15.133:43920) 2024-03-30T01:52:21.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.719+0000 7f0001200640 1 -- 172.21.15.133:0/3983357324 learned_addr learned my addr 172.21.15.133:0/3983357324 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:21.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.719+0000 7efffbe00640 1 --2- 172.21.15.133:0/3983357324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efffc143220 0x7efffc0cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:21.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.719+0000 7efffb400640 1 -- 172.21.15.133:0/3983357324 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3534255242 0 0) 0x7efffc0ce400 con 0x7efffc070c10 2024-03-30T01:52:21.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.720+0000 7efffb400640 1 -- 172.21.15.133:0/3983357324 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effe0003520 con 0x7efffc070c10 2024-03-30T01:52:21.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.720+0000 7efffb400640 1 -- 172.21.15.133:0/3983357324 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 103481447 0 0) 0x7effe0003520 con 0x7efffc070c10 2024-03-30T01:52:21.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.720+0000 7efffb400640 1 -- 172.21.15.133:0/3983357324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efffc143220 msgr2=0x7efffc0cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:21.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.720+0000 7efffb400640 1 --2- 172.21.15.133:0/3983357324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efffc143220 0x7efffc0cd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:21.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.720+0000 7efffb400640 1 -- 172.21.15.133:0/3983357324 >> v1:172.21.15.137:6789/0 conn(0x7efffc06e2e0 legacy=0x7efffc070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:21.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.720+0000 7efffb400640 1 -- 172.21.15.133:0/3983357324 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc06d3c0 con 0x7efffc070c10 2024-03-30T01:52:21.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.720+0000 7efffb400640 1 -- 172.21.15.133:0/3983357324 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7efff40019f0 con 0x7efffc070c10 2024-03-30T01:52:21.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.720+0000 7efffb400640 1 -- 172.21.15.133:0/3983357324 >> v1:172.21.15.133:6789/0 conn(0x7efffc070c10 legacy=0x7efffc15d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:21.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.720+0000 7efffb400640 1 --2- 172.21.15.133:0/3983357324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effe00039a0 0x7effe0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:21.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.720+0000 7efffb400640 1 --2- 172.21.15.133:0/3983357324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efffc143220 0x7effe00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:21.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.720+0000 7efffb400640 1 --2- 172.21.15.133:0/3983357324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effe0004d00 0x7effe0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:21.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.720+0000 7efffb400640 1 -- 172.21.15.133:0/3983357324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe000ba30 con 0x7effe0004d00 2024-03-30T01:52:21.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.720+0000 7efffb400640 1 -- 172.21.15.133:0/3983357324 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe000bb70 con 0x7effe00039a0 2024-03-30T01:52:21.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.720+0000 7efffb400640 1 -- 172.21.15.133:0/3983357324 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe000bd30 con 0x7efffc143220 2024-03-30T01:52:21.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.720+0000 7f0001200640 1 --2- 172.21.15.133:0/3983357324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effe0004d00 0x7effe0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:21.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.721+0000 7efffbe00640 1 --2- 172.21.15.133:0/3983357324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effe00039a0 0x7effe0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:21.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.721+0000 7efff3400640 1 --2- 172.21.15.133:0/3983357324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efffc143220 0x7effe00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:21.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.721+0000 7f0001200640 1 -- 172.21.15.133:0/3983357324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efffc143220 msgr2=0x7effe00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:21.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.721+0000 7f0001200640 1 --2- 172.21.15.133:0/3983357324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efffc143220 0x7effe00047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:21.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.721+0000 7f0001200640 1 -- 172.21.15.133:0/3983357324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effe00039a0 msgr2=0x7effe0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:21.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.721+0000 7f0001200640 1 --2- 172.21.15.133:0/3983357324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effe00039a0 0x7effe0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:21.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.721+0000 7f0001200640 1 -- 172.21.15.133:0/3983357324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe0003520 con 0x7effe0004d00 2024-03-30T01:52:21.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.721+0000 7efffbe00640 1 --2- 172.21.15.133:0/3983357324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effe00039a0 0x7effe0003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:21.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.722+0000 7f0001200640 1 --2- 172.21.15.133:0/3983357324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effe0004d00 0x7effe0005180 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efff4002230 tx=0x7effe00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227947fc06e56981 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:21.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.722+0000 7efffb400640 1 -- 172.21.15.133:0/3983357324 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4034630 con 0x7effe0004d00 2024-03-30T01:52:21.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.722+0000 7efffb400640 1 -- 172.21.15.133:0/3983357324 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff402f070 con 0x7effe0004d00 2024-03-30T01:52:21.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.722+0000 7efffb400640 1 -- 172.21.15.133:0/3983357324 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff40349b0 con 0x7effe0004d00 2024-03-30T01:52:21.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.723+0000 7f0003200640 1 -- 172.21.15.133:0/3983357324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effe0004d00 msgr2=0x7effe0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:21.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.723+0000 7f0003200640 1 --2- 172.21.15.133:0/3983357324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effe0004d00 0x7effe0005180 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efff4002230 tx=0x7effe00057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:21.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.723+0000 7f0001200640 1 -- 172.21.15.133:0/3983357324 reap_dead start 2024-03-30T01:52:21.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.723+0000 7f0003200640 1 -- 172.21.15.133:0/3983357324 shutdown_connections 2024-03-30T01:52:21.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.723+0000 7f0003200640 1 -- 172.21.15.133:0/3983357324 >> 172.21.15.133:0/3983357324 conn(0x7efffc0b07a0 msgr2=0x7efffc0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:21.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.723+0000 7f0003200640 1 -- 172.21.15.133:0/3983357324 shutdown_connections 2024-03-30T01:52:21.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.723+0000 7f0003200640 1 -- 172.21.15.133:0/3983357324 wait complete. 2024-03-30T01:52:21.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.725+0000 7f0003200640 1 Processor -- start 2024-03-30T01:52:21.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.725+0000 7f0003200640 1 -- start start 2024-03-30T01:52:21.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.726+0000 7f0003200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effe0004d00 0x7efffc14e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:21.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.726+0000 7f0003200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efffc14ee00 0x7efffc136a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:21.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.726+0000 7f0003200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efffc15a920 0x7efffc136f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:21.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.726+0000 7f0003200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc12fb50 con 0x7efffc15a920 2024-03-30T01:52:21.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.726+0000 7f0003200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc12efd0 con 0x7efffc14ee00 2024-03-30T01:52:21.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.726+0000 7f0003200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efffc12f2b0 con 0x7effe0004d00 2024-03-30T01:52:21.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.726+0000 7f0001200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efffc15a920 0x7efffc136f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:21.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.726+0000 7f0001200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efffc15a920 0x7efffc136f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38414/0 (socket says 172.21.15.133:38414) 2024-03-30T01:52:21.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.726+0000 7f0001200640 1 -- 172.21.15.133:0/422075193 learned_addr learned my addr 172.21.15.133:0/422075193 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:21.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.726+0000 7efffbe00640 1 --2- 172.21.15.133:0/422075193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effe0004d00 0x7efffc14e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:21.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.726+0000 7efff3400640 1 --2- 172.21.15.133:0/422075193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efffc14ee00 0x7efffc136a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:21.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.727+0000 7f0001200640 1 -- 172.21.15.133:0/422075193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effe0004d00 msgr2=0x7efffc14e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:21.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.727+0000 7f0001200640 1 --2- 172.21.15.133:0/422075193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effe0004d00 0x7efffc14e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:21.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.727+0000 7f0001200640 1 -- 172.21.15.133:0/422075193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efffc14ee00 msgr2=0x7efffc136a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:21.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.727+0000 7f0001200640 1 --2- 172.21.15.133:0/422075193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efffc14ee00 0x7efffc136a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:21.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.727+0000 7f0001200640 1 -- 172.21.15.133:0/422075193 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc12f590 con 0x7efffc15a920 2024-03-30T01:52:21.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.727+0000 7f0001200640 1 --2- 172.21.15.133:0/422075193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efffc15a920 0x7efffc136f80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efff402cad0 tx=0x7efff4001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:21.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.727+0000 7efff8c00640 1 -- 172.21.15.133:0/422075193 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4004d60 con 0x7efffc15a920 2024-03-30T01:52:21.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.727+0000 7efff8c00640 1 -- 172.21.15.133:0/422075193 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff4001a60 con 0x7efffc15a920 2024-03-30T01:52:21.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.727+0000 7efff8c00640 1 -- 172.21.15.133:0/422075193 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff403f670 con 0x7efffc15a920 2024-03-30T01:52:21.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.727+0000 7f0003200640 1 -- 172.21.15.133:0/422075193 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efffc12f870 con 0x7efffc15a920 2024-03-30T01:52:21.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.727+0000 7f0003200640 1 -- 172.21.15.133:0/422075193 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efffc15b960 con 0x7efffc15a920 2024-03-30T01:52:21.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.728+0000 7f0003200640 1 -- 172.21.15.133:0/422075193 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efffc1ee720 con 0x7efffc15a920 2024-03-30T01:52:21.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.730+0000 7efff8c00640 1 -- 172.21.15.133:0/422075193 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7efff4031030 con 0x7efffc15a920 2024-03-30T01:52:21.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.731+0000 7efff8c00640 1 --2- 172.21.15.133:0/422075193 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7effd806ac30 0x7effd806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:21.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.731+0000 7efff8c00640 1 -- 172.21.15.133:0/422075193 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7efff40aa650 con 0x7efffc15a920 2024-03-30T01:52:21.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.731+0000 7efffbe00640 1 --2- 172.21.15.133:0/422075193 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7effd806ac30 0x7effd806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:21.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.732+0000 7efffbe00640 1 --2- 172.21.15.133:0/422075193 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7effd806ac30 0x7effd806d0f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efffc1336a0 tx=0x7effec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:21.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.736+0000 7efff8c00640 1 -- 172.21.15.133:0/422075193 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7efffc1ee720 con 0x7efffc15a920 2024-03-30T01:52:21.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.930+0000 7f0003200640 1 -- 172.21.15.133:0/422075193 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efffc1ee720 con 0x7efffc15a920 2024-03-30T01:52:21.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.931+0000 7efff8c00640 1 -- 172.21.15.133:0/422075193 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7efffc1ee720 con 0x7efffc15a920 2024-03-30T01:52:21.937 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-03-30T01:52:21.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.933+0000 7f0003200640 1 -- 172.21.15.133:0/422075193 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7effd806ac30 msgr2=0x7effd806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:21.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.933+0000 7f0003200640 1 --2- 172.21.15.133:0/422075193 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7effd806ac30 0x7effd806d0f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efffc1336a0 tx=0x7effec008040 comp rx=0 tx=0).stop 2024-03-30T01:52:21.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.933+0000 7f0003200640 1 -- 172.21.15.133:0/422075193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efffc15a920 msgr2=0x7efffc136f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:21.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.933+0000 7f0003200640 1 --2- 172.21.15.133:0/422075193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efffc15a920 0x7efffc136f80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efff402cad0 tx=0x7efff4001d80 comp rx=0 tx=0).stop 2024-03-30T01:52:21.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.933+0000 7f0003200640 1 -- 172.21.15.133:0/422075193 shutdown_connections 2024-03-30T01:52:21.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.933+0000 7f0003200640 1 --2- 172.21.15.133:0/422075193 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7effd806ac30 0x7effd806d0f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:21.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.933+0000 7f0003200640 1 --2- 172.21.15.133:0/422075193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efffc15a920 0x7efffc136f80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:21.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.933+0000 7f0003200640 1 --2- 172.21.15.133:0/422075193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efffc14ee00 0x7efffc136a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:21.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.933+0000 7f0003200640 1 --2- 172.21.15.133:0/422075193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effe0004d00 0x7efffc14e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:21.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.933+0000 7f0003200640 1 -- 172.21.15.133:0/422075193 >> 172.21.15.133:0/422075193 conn(0x7efffc0b07a0 msgr2=0x7efffc0cb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:21.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.934+0000 7f0003200640 1 -- 172.21.15.133:0/422075193 shutdown_connections 2024-03-30T01:52:21.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:21.934+0000 7f0003200640 1 -- 172.21.15.133:0/422075193 wait complete. 2024-03-30T01:52:21.958 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T01:52:22.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.166+0000 7fbc34600640 1 Processor -- start 2024-03-30T01:52:22.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.166+0000 7fbc34600640 1 -- start start 2024-03-30T01:52:22.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.168+0000 7fbc34600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbc2c143790 0x7fbc2c0cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:22.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.168+0000 7fbc34600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbc2c0ccc40 0x7fbc2c070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:22.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.168+0000 7fbc34600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc2c0a76a0 con 0x7fbc2c070500 2024-03-30T01:52:22.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.168+0000 7fbc34600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc2c070ed0 con 0x7fbc2c143790 2024-03-30T01:52:22.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.168+0000 7fbc34600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc2c0b38e0 con 0x7fbc2c0ccc40 2024-03-30T01:52:22.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.168+0000 7fbc31c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbc2c143790 0x7fbc2c0cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:22.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.168+0000 7fbc31200640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbc2c070500 0x7fbc2c0cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43922/0 (socket says 172.21.15.133:43922) 2024-03-30T01:52:22.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.168+0000 7fbc31200640 1 -- 172.21.15.133:0/1418964939 learned_addr learned my addr 172.21.15.133:0/1418964939 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:22.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.168+0000 7fbc32600640 1 --2- 172.21.15.133:0/1418964939 >> v2:172.21.15.137:3300/0 conn(0x7fbc2c0ccc40 0x7fbc2c070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:22.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.168+0000 7fbc31c00640 1 -- 172.21.15.133:0/1418964939 >> v2:172.21.15.137:3300/0 conn(0x7fbc2c0ccc40 msgr2=0x7fbc2c070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:22.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.168+0000 7fbc31c00640 1 --2- 172.21.15.133:0/1418964939 >> v2:172.21.15.137:3300/0 conn(0x7fbc2c0ccc40 0x7fbc2c070990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:22.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.168+0000 7fbc31c00640 1 -- 172.21.15.133:0/1418964939 >> v1:172.21.15.133:6789/0 conn(0x7fbc2c070500 legacy=0x7fbc2c0cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:22.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.169+0000 7fbc31c00640 1 -- 172.21.15.133:0/1418964939 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2c0cd180 con 0x7fbc2c143790 2024-03-30T01:52:22.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.169+0000 7fbc2be00640 1 -- 172.21.15.133:0/1418964939 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2530663884 0 0) 0x7fbc2c0a76a0 con 0x7fbc2c070500 2024-03-30T01:52:22.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.169+0000 7fbc32600640 1 --2- 172.21.15.133:0/1418964939 >> v2:172.21.15.137:3300/0 conn(0x7fbc2c0ccc40 0x7fbc2c070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:22.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.170+0000 7fbc31c00640 1 --2- 172.21.15.133:0/1418964939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc2c143790 0x7fbc2c0cbb10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0b2aa0 tx=0x7fbc2402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789149f532d9c562 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:22.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.170+0000 7fbc2be00640 1 -- 172.21.15.133:0/1418964939 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc24030610 con 0x7fbc2c143790 2024-03-30T01:52:22.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.170+0000 7fbc2be00640 1 -- 172.21.15.133:0/1418964939 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc24030770 con 0x7fbc2c143790 2024-03-30T01:52:22.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.170+0000 7fbc2be00640 1 -- 172.21.15.133:0/1418964939 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc24030b00 con 0x7fbc2c143790 2024-03-30T01:52:22.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.170+0000 7fbc34600640 1 -- 172.21.15.133:0/1418964939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc2c143790 msgr2=0x7fbc2c0cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:22.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.170+0000 7fbc34600640 1 --2- 172.21.15.133:0/1418964939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc2c143790 0x7fbc2c0cbb10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0b2aa0 tx=0x7fbc2402b960 comp rx=0 tx=0).stop 2024-03-30T01:52:22.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.171+0000 7fbc34600640 1 -- 172.21.15.133:0/1418964939 shutdown_connections 2024-03-30T01:52:22.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.171+0000 7fbc34600640 1 --2- 172.21.15.133:0/1418964939 >> v2:172.21.15.137:3300/0 conn(0x7fbc2c0ccc40 0x7fbc2c070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:22.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.171+0000 7fbc34600640 1 --2- 172.21.15.133:0/1418964939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc2c143790 0x7fbc2c0cbb10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:22.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.171+0000 7fbc34600640 1 -- 172.21.15.133:0/1418964939 >> 172.21.15.133:0/1418964939 conn(0x7fbc2c0b07a0 msgr2=0x7fbc2c0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:22.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.171+0000 7fbc34600640 1 -- 172.21.15.133:0/1418964939 shutdown_connections 2024-03-30T01:52:22.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.171+0000 7fbc34600640 1 -- 172.21.15.133:0/1418964939 wait complete. 2024-03-30T01:52:22.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.172+0000 7fbc34600640 1 Processor -- start 2024-03-30T01:52:22.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.173+0000 7fbc34600640 1 -- start start 2024-03-30T01:52:22.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.173+0000 7fbc34600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc2c070500 0x7fbc2c0abb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:22.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.173+0000 7fbc34600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc2c0ccc40 0x7fbc2c0a7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:22.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.173+0000 7fbc34600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc2c143790 0x7fbc2c13bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:22.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.174+0000 7fbc34600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c0a8700 con 0x7fbc2c0ccc40 2024-03-30T01:52:22.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.174+0000 7fbc34600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c0a8cd0 con 0x7fbc2c143790 2024-03-30T01:52:22.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.174+0000 7fbc34600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c0a7e60 con 0x7fbc2c070500 2024-03-30T01:52:22.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.174+0000 7fbc31200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc2c0ccc40 0x7fbc2c0a7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:22.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.174+0000 7fbc31200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc2c0ccc40 0x7fbc2c0a7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38422/0 (socket says 172.21.15.133:38422) 2024-03-30T01:52:22.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.174+0000 7fbc31200640 1 -- 172.21.15.133:0/1250846606 learned_addr learned my addr 172.21.15.133:0/1250846606 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:22.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.174+0000 7fbc31c00640 1 --2- 172.21.15.133:0/1250846606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc2c070500 0x7fbc2c0abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:22.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.174+0000 7fbc32600640 1 --2- 172.21.15.133:0/1250846606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc2c143790 0x7fbc2c13bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:22.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.174+0000 7fbc31200640 1 -- 172.21.15.133:0/1250846606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc2c070500 msgr2=0x7fbc2c0abb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:22.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.174+0000 7fbc31200640 1 --2- 172.21.15.133:0/1250846606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc2c070500 0x7fbc2c0abb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:22.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.174+0000 7fbc31200640 1 -- 172.21.15.133:0/1250846606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc2c143790 msgr2=0x7fbc2c13bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:22.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.174+0000 7fbc31200640 1 --2- 172.21.15.133:0/1250846606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc2c143790 0x7fbc2c13bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:22.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.174+0000 7fbc31200640 1 -- 172.21.15.133:0/1250846606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc24009400 con 0x7fbc2c0ccc40 2024-03-30T01:52:22.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.175+0000 7fbc31200640 1 --2- 172.21.15.133:0/1250846606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc2c0ccc40 0x7fbc2c0a7630 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800c890 tx=0x7fbc1800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:22.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.175+0000 7fbc29600640 1 -- 172.21.15.133:0/1250846606 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1800a640 con 0x7fbc2c0ccc40 2024-03-30T01:52:22.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.175+0000 7fbc29600640 1 -- 172.21.15.133:0/1250846606 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1800a7c0 con 0x7fbc2c0ccc40 2024-03-30T01:52:22.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.175+0000 7fbc29600640 1 -- 172.21.15.133:0/1250846606 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1800ab70 con 0x7fbc2c0ccc40 2024-03-30T01:52:22.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.175+0000 7fbc34600640 1 -- 172.21.15.133:0/1250846606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc2c0a8140 con 0x7fbc2c0ccc40 2024-03-30T01:52:22.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.175+0000 7fbc34600640 1 -- 172.21.15.133:0/1250846606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc2c0a7b70 con 0x7fbc2c0ccc40 2024-03-30T01:52:22.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.176+0000 7fbc34600640 1 -- 172.21.15.133:0/1250846606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc2c066d80 con 0x7fbc2c0ccc40 2024-03-30T01:52:22.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.177+0000 7fbc29600640 1 -- 172.21.15.133:0/1250846606 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fbc1800acd0 con 0x7fbc2c0ccc40 2024-03-30T01:52:22.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.178+0000 7fbc29600640 1 --2- 172.21.15.133:0/1250846606 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbc0c06ac00 0x7fbc0c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:22.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.178+0000 7fbc29600640 1 -- 172.21.15.133:0/1250846606 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fbc180889b0 con 0x7fbc2c0ccc40 2024-03-30T01:52:22.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.178+0000 7fbc31c00640 1 --2- 172.21.15.133:0/1250846606 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbc0c06ac00 0x7fbc0c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:22.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.179+0000 7fbc31c00640 1 --2- 172.21.15.133:0/1250846606 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbc0c06ac00 0x7fbc0c06d0c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbc24036000 tx=0x7fbc2403b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:22.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.182+0000 7fbc29600640 1 -- 172.21.15.133:0/1250846606 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fbc18053b00 con 0x7fbc2c0ccc40 2024-03-30T01:52:22.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.375+0000 7fbc34600640 1 -- 172.21.15.133:0/1250846606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbc2c06b4e0 con 0x7fbc2c0ccc40 2024-03-30T01:52:22.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.376+0000 7fbc29600640 1 -- 172.21.15.133:0/1250846606 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbc180180a0 con 0x7fbc2c0ccc40 2024-03-30T01:52:22.382 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-03-30T01:52:22.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.379+0000 7fbc34600640 1 -- 172.21.15.133:0/1250846606 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbc0c06ac00 msgr2=0x7fbc0c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:22.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.379+0000 7fbc34600640 1 --2- 172.21.15.133:0/1250846606 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbc0c06ac00 0x7fbc0c06d0c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbc24036000 tx=0x7fbc2403b040 comp rx=0 tx=0).stop 2024-03-30T01:52:22.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.379+0000 7fbc34600640 1 -- 172.21.15.133:0/1250846606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc2c0ccc40 msgr2=0x7fbc2c0a7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:22.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.379+0000 7fbc34600640 1 --2- 172.21.15.133:0/1250846606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc2c0ccc40 0x7fbc2c0a7630 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800c890 tx=0x7fbc1800cd50 comp rx=0 tx=0).stop 2024-03-30T01:52:22.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.379+0000 7fbc34600640 1 -- 172.21.15.133:0/1250846606 shutdown_connections 2024-03-30T01:52:22.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.379+0000 7fbc34600640 1 --2- 172.21.15.133:0/1250846606 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbc0c06ac00 0x7fbc0c06d0c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:22.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.379+0000 7fbc34600640 1 --2- 172.21.15.133:0/1250846606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc2c143790 0x7fbc2c13bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:22.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.379+0000 7fbc34600640 1 --2- 172.21.15.133:0/1250846606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc2c0ccc40 0x7fbc2c0a7630 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:22.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.379+0000 7fbc34600640 1 --2- 172.21.15.133:0/1250846606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc2c070500 0x7fbc2c0abb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:22.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.379+0000 7fbc34600640 1 -- 172.21.15.133:0/1250846606 >> 172.21.15.133:0/1250846606 conn(0x7fbc2c0b07a0 msgr2=0x7fbc2c141f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:22.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.379+0000 7fbc34600640 1 -- 172.21.15.133:0/1250846606 shutdown_connections 2024-03-30T01:52:22.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.379+0000 7fbc34600640 1 -- 172.21.15.133:0/1250846606 wait complete. 2024-03-30T01:52:22.405 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T01:52:22.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.611+0000 7f1aa3000640 1 Processor -- start 2024-03-30T01:52:22.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.611+0000 7f1aa3000640 1 -- start start 2024-03-30T01:52:22.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.613+0000 7f1aa3000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1a9c06e2e0 0x7f1a9c070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:22.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.613+0000 7f1aa3000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1a9c070a40 0x7f1a9c15d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:22.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.613+0000 7f1aa3000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a9c070e50 con 0x7f1a9c143220 2024-03-30T01:52:22.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.613+0000 7f1aa3000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a9c0cc5c0 con 0x7f1a9c06e2e0 2024-03-30T01:52:22.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.613+0000 7f1aa3000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a9c0ce400 con 0x7f1a9c070a40 2024-03-30T01:52:22.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.613+0000 7f1a9b400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1a9c06e2e0 0x7f1a9c070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:22.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.613+0000 7f1a9b400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1a9c06e2e0 0x7f1a9c070500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38428/0 (socket says 172.21.15.133:38428) 2024-03-30T01:52:22.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.613+0000 7f1a9b400640 1 -- 172.21.15.133:0/3230307797 learned_addr learned my addr 172.21.15.133:0/3230307797 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:22.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.613+0000 7f1aa1000640 1 --2- 172.21.15.133:0/3230307797 >> v2:172.21.15.137:3300/0 conn(0x7f1a9c070a40 0x7f1a9c15d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:22.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.613+0000 7f1a9b400640 1 -- 172.21.15.133:0/3230307797 >> v2:172.21.15.137:3300/0 conn(0x7f1a9c070a40 msgr2=0x7f1a9c15d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:22.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.613+0000 7f1a9b400640 1 --2- 172.21.15.133:0/3230307797 >> v2:172.21.15.137:3300/0 conn(0x7f1a9c070a40 0x7f1a9c15d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:22.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.613+0000 7f1a9b400640 1 -- 172.21.15.133:0/3230307797 >> v1:172.21.15.137:6789/0 conn(0x7f1a9c143220 legacy=0x7f1a9c0cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:22.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.613+0000 7f1a9b400640 1 -- 172.21.15.133:0/3230307797 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9c06d0e0 con 0x7f1a9c06e2e0 2024-03-30T01:52:22.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.613+0000 7f1aa1000640 1 --2- 172.21.15.133:0/3230307797 >> v2:172.21.15.137:3300/0 conn(0x7f1a9c070a40 0x7f1a9c15d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:22.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.615+0000 7f1a9b400640 1 --2- 172.21.15.133:0/3230307797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a9c06e2e0 0x7f1a9c070500 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c0711e0 tx=0x7f1a8802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c302812f26d7bd1b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:22.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.615+0000 7f1a9aa00640 1 -- 172.21.15.133:0/3230307797 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88031870 con 0x7f1a9c06e2e0 2024-03-30T01:52:22.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.615+0000 7f1a9aa00640 1 -- 172.21.15.133:0/3230307797 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a880319d0 con 0x7f1a9c06e2e0 2024-03-30T01:52:22.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.615+0000 7f1a9aa00640 1 -- 172.21.15.133:0/3230307797 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88031d60 con 0x7f1a9c06e2e0 2024-03-30T01:52:22.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.616+0000 7f1aa3000640 1 -- 172.21.15.133:0/3230307797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a9c06e2e0 msgr2=0x7f1a9c070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:22.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.616+0000 7f1aa3000640 1 --2- 172.21.15.133:0/3230307797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a9c06e2e0 0x7f1a9c070500 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c0711e0 tx=0x7f1a8802b910 comp rx=0 tx=0).stop 2024-03-30T01:52:22.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.616+0000 7f1aa3000640 1 -- 172.21.15.133:0/3230307797 shutdown_connections 2024-03-30T01:52:22.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.616+0000 7f1aa3000640 1 --2- 172.21.15.133:0/3230307797 >> v2:172.21.15.137:3300/0 conn(0x7f1a9c070a40 0x7f1a9c15d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:22.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.616+0000 7f1aa3000640 1 --2- 172.21.15.133:0/3230307797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a9c06e2e0 0x7f1a9c070500 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:22.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.616+0000 7f1aa3000640 1 -- 172.21.15.133:0/3230307797 >> 172.21.15.133:0/3230307797 conn(0x7f1a9c0b07a0 msgr2=0x7f1a9c0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:22.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.616+0000 7f1aa3000640 1 -- 172.21.15.133:0/3230307797 shutdown_connections 2024-03-30T01:52:22.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.616+0000 7f1aa3000640 1 -- 172.21.15.133:0/3230307797 wait complete. 2024-03-30T01:52:22.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.618+0000 7f1aa3000640 1 Processor -- start 2024-03-30T01:52:22.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.618+0000 7f1aa3000640 1 -- start start 2024-03-30T01:52:22.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.619+0000 7f1aa3000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1a9c06e2e0 0x7f1a9c138340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:22.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.619+0000 7f1aa3000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a9c070a40 0x7f1a9c15b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:22.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.619+0000 7f1aa3000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a9c143220 0x7f1a9c13c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:22.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.619+0000 7f1aa3000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c13be90 con 0x7f1a9c070a40 2024-03-30T01:52:22.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.619+0000 7f1aa3000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c15b5c0 con 0x7f1a9c143220 2024-03-30T01:52:22.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.619+0000 7f1aa3000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c13b0f0 con 0x7f1a9c06e2e0 2024-03-30T01:52:22.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.620+0000 7f1a9b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a9c070a40 0x7f1a9c15b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:22.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.620+0000 7f1a9b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a9c070a40 0x7f1a9c15b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38430/0 (socket says 172.21.15.133:38430) 2024-03-30T01:52:22.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.620+0000 7f1a9b400640 1 -- 172.21.15.133:0/1543808176 learned_addr learned my addr 172.21.15.133:0/1543808176 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:22.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.620+0000 7f1a9b400640 1 -- 172.21.15.133:0/1543808176 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1a9c06e2e0 msgr2=0x7f1a9c138340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:22.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.620+0000 7f1aa1000640 1 --2- 172.21.15.133:0/1543808176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a9c143220 0x7f1a9c13c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:22.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.620+0000 7f1a9be00640 1 --2- 172.21.15.133:0/1543808176 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1a9c06e2e0 0x7f1a9c138340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:22.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.620+0000 7f1a9b400640 1 --2- 172.21.15.133:0/1543808176 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1a9c06e2e0 0x7f1a9c138340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:22.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.620+0000 7f1a9b400640 1 -- 172.21.15.133:0/1543808176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a9c143220 msgr2=0x7f1a9c13c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:22.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.620+0000 7f1a9b400640 1 --2- 172.21.15.133:0/1543808176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a9c143220 0x7f1a9c13c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:22.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.620+0000 7f1a9b400640 1 -- 172.21.15.133:0/1543808176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a880094d0 con 0x7f1a9c070a40 2024-03-30T01:52:22.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.620+0000 7f1aa1000640 1 --2- 172.21.15.133:0/1543808176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a9c143220 0x7f1a9c13c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:22.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.621+0000 7f1a9b400640 1 --2- 172.21.15.133:0/1543808176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a9c070a40 0x7f1a9c15b080 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1a8802b950 tx=0x7f1a880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:22.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.621+0000 7f1a93e00640 1 -- 172.21.15.133:0/1543808176 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88031840 con 0x7f1a9c070a40 2024-03-30T01:52:22.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.621+0000 7f1a93e00640 1 -- 172.21.15.133:0/1543808176 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a880443f0 con 0x7f1a9c070a40 2024-03-30T01:52:22.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.621+0000 7f1aa3000640 1 -- 172.21.15.133:0/1543808176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9c13b3d0 con 0x7f1a9c070a40 2024-03-30T01:52:22.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.621+0000 7f1a93e00640 1 -- 172.21.15.133:0/1543808176 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a880447a0 con 0x7f1a9c070a40 2024-03-30T01:52:22.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.621+0000 7f1aa3000640 1 -- 172.21.15.133:0/1543808176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a9c13b6b0 con 0x7f1a9c070a40 2024-03-30T01:52:22.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.622+0000 7f1aa3000640 1 -- 172.21.15.133:0/1543808176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a9c0704e0 con 0x7f1a9c070a40 2024-03-30T01:52:22.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.623+0000 7f1a93e00640 1 -- 172.21.15.133:0/1543808176 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1a88044900 con 0x7f1a9c070a40 2024-03-30T01:52:22.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.624+0000 7f1a93e00640 1 --2- 172.21.15.133:0/1543808176 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f1a7c06ac00 0x7f1a7c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:22.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.624+0000 7f1a93e00640 1 -- 172.21.15.133:0/1543808176 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1a8802d040 con 0x7f1a9c070a40 2024-03-30T01:52:22.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.624+0000 7f1a9be00640 1 --2- 172.21.15.133:0/1543808176 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f1a7c06ac00 0x7f1a7c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:22.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.625+0000 7f1a9be00640 1 --2- 172.21.15.133:0/1543808176 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f1a7c06ac00 0x7f1a7c06d0c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1a94007bf0 tx=0x7f1a94007240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:22.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.628+0000 7f1a93e00640 1 -- 172.21.15.133:0/1543808176 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f1a88076df0 con 0x7f1a9c070a40 2024-03-30T01:52:22.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.820+0000 7f1aa3000640 1 -- 172.21.15.133:0/1543808176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1a9c066d80 con 0x7f1a9c070a40 2024-03-30T01:52:22.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.821+0000 7f1a93e00640 1 -- 172.21.15.133:0/1543808176 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1a88035020 con 0x7f1a9c070a40 2024-03-30T01:52:22.827 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-03-30T01:52:22.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.824+0000 7f1aa3000640 1 -- 172.21.15.133:0/1543808176 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f1a7c06ac00 msgr2=0x7f1a7c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:22.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.824+0000 7f1aa3000640 1 --2- 172.21.15.133:0/1543808176 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f1a7c06ac00 0x7f1a7c06d0c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1a94007bf0 tx=0x7f1a94007240 comp rx=0 tx=0).stop 2024-03-30T01:52:22.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.824+0000 7f1aa3000640 1 -- 172.21.15.133:0/1543808176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a9c070a40 msgr2=0x7f1a9c15b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:22.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.824+0000 7f1aa3000640 1 --2- 172.21.15.133:0/1543808176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a9c070a40 0x7f1a9c15b080 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1a8802b950 tx=0x7f1a880046c0 comp rx=0 tx=0).stop 2024-03-30T01:52:22.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.824+0000 7f1aa3000640 1 -- 172.21.15.133:0/1543808176 shutdown_connections 2024-03-30T01:52:22.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.824+0000 7f1aa3000640 1 --2- 172.21.15.133:0/1543808176 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f1a7c06ac00 0x7f1a7c06d0c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:22.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.824+0000 7f1aa3000640 1 --2- 172.21.15.133:0/1543808176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a9c143220 0x7f1a9c13c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:22.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.824+0000 7f1aa3000640 1 --2- 172.21.15.133:0/1543808176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a9c070a40 0x7f1a9c15b080 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:22.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.824+0000 7f1aa3000640 1 --2- 172.21.15.133:0/1543808176 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1a9c06e2e0 0x7f1a9c138340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:22.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.824+0000 7f1aa3000640 1 -- 172.21.15.133:0/1543808176 >> 172.21.15.133:0/1543808176 conn(0x7f1a9c0b07a0 msgr2=0x7f1a9c158bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:22.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.824+0000 7f1aa3000640 1 -- 172.21.15.133:0/1543808176 shutdown_connections 2024-03-30T01:52:22.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:22.824+0000 7f1aa3000640 1 -- 172.21.15.133:0/1543808176 wait complete. 2024-03-30T01:52:22.849 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T01:52:23.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.031+0000 7f533da00640 1 Processor -- start 2024-03-30T01:52:23.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.031+0000 7f533da00640 1 -- start start 2024-03-30T01:52:23.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.033+0000 7f533da00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f533806e2e0 0x7f5338070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:23.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.033+0000 7f533da00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5338070a40 0x7f533815d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:23.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.033+0000 7f533da00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5338070e90 con 0x7f5338143220 2024-03-30T01:52:23.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.033+0000 7f533da00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53380cc5c0 con 0x7f533806e2e0 2024-03-30T01:52:23.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.033+0000 7f533da00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53380ce400 con 0x7f5338070a40 2024-03-30T01:52:23.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.033+0000 7f5336a00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5338143220 0x7f53380cd990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43928/0 (socket says 172.21.15.133:43928) 2024-03-30T01:52:23.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.033+0000 7f5336a00640 1 -- 172.21.15.133:0/3461585338 learned_addr learned my addr 172.21.15.133:0/3461585338 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:23.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.033+0000 7f5336000640 1 -- 172.21.15.133:0/3461585338 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922055722 0 0) 0x7f5328001110 con 0x7f5338143220 2024-03-30T01:52:23.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.034+0000 7f5336000640 1 -- 172.21.15.133:0/3461585338 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f531c005730 con 0x7f5338143220 2024-03-30T01:52:23.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.034+0000 7f532e000640 1 --2- 172.21.15.133:0/3461585338 >> v2:172.21.15.137:3300/0 conn(0x7f533806e2e0 0x7f5338070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:23.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.034+0000 7f5337400640 1 --2- 172.21.15.133:0/3461585338 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5338070a40 0x7f533815d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:23.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.034+0000 7f5336000640 1 -- 172.21.15.133:0/3461585338 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3273496066 0 0) 0x7f531c005730 con 0x7f5338143220 2024-03-30T01:52:23.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.034+0000 7f5336000640 1 -- 172.21.15.133:0/3461585338 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5338070a40 msgr2=0x7f533815d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:23.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.034+0000 7f5336000640 1 --2- 172.21.15.133:0/3461585338 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5338070a40 0x7f533815d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:23.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.034+0000 7f5336000640 1 -- 172.21.15.133:0/3461585338 >> v2:172.21.15.137:3300/0 conn(0x7f533806e2e0 msgr2=0x7f5338070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:23.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.034+0000 7f5336000640 1 --2- 172.21.15.133:0/3461585338 >> v2:172.21.15.137:3300/0 conn(0x7f533806e2e0 0x7f5338070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:23.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.034+0000 7f5336000640 1 -- 172.21.15.133:0/3461585338 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533806d0e0 con 0x7f5338143220 2024-03-30T01:52:23.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.034+0000 7f5336000640 1 -- 172.21.15.133:0/3461585338 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f5328001800 con 0x7f5338143220 2024-03-30T01:52:23.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.034+0000 7f5336000640 1 -- 172.21.15.133:0/3461585338 >> v1:172.21.15.133:6789/0 conn(0x7f5338143220 legacy=0x7f53380cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:23.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.034+0000 7f5336000640 1 --2- 172.21.15.133:0/3461585338 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5338070a40 0x7f531c005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:23.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.034+0000 7f5336000640 1 --2- 172.21.15.133:0/3461585338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f531c006200 0x7f531c0069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:23.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.034+0000 7f5336000640 1 --2- 172.21.15.133:0/3461585338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f531c006f10 0x7f531c007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:23.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.034+0000 7f5336000640 1 -- 172.21.15.133:0/3461585338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53380ce400 con 0x7f531c006f10 2024-03-30T01:52:23.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.034+0000 7f5336000640 1 -- 172.21.15.133:0/3461585338 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c00dc70 con 0x7f531c006200 2024-03-30T01:52:23.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.034+0000 7f5336000640 1 -- 172.21.15.133:0/3461585338 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531c00de30 con 0x7f5338070a40 2024-03-30T01:52:23.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.034+0000 7f5337400640 1 --2- 172.21.15.133:0/3461585338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f531c006f10 0x7f531c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:23.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.035+0000 7f532e000640 1 --2- 172.21.15.133:0/3461585338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f531c006200 0x7f531c0069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:23.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.035+0000 7f5337400640 1 -- 172.21.15.133:0/3461585338 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5338070a40 msgr2=0x7f531c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:23.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.035+0000 7f5337400640 1 --2- 172.21.15.133:0/3461585338 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5338070a40 0x7f531c005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:23.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.035+0000 7f5337400640 1 -- 172.21.15.133:0/3461585338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f531c006200 msgr2=0x7f531c0069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:23.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.035+0000 7f5337400640 1 --2- 172.21.15.133:0/3461585338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f531c006200 0x7f531c0069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:23.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.035+0000 7f5337400640 1 -- 172.21.15.133:0/3461585338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c005730 con 0x7f531c006f10 2024-03-30T01:52:23.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.036+0000 7f5337400640 1 --2- 172.21.15.133:0/3461585338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f531c006f10 0x7f531c007390 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5330007360 tx=0x7f531c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31670585ffcda09 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:23.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.036+0000 7f5336000640 1 -- 172.21.15.133:0/3461585338 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533002ccd0 con 0x7f531c006f10 2024-03-30T01:52:23.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.036+0000 7f5336000640 1 -- 172.21.15.133:0/3461585338 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533002ce50 con 0x7f531c006f10 2024-03-30T01:52:23.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.036+0000 7f5336000640 1 -- 172.21.15.133:0/3461585338 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330034680 con 0x7f531c006f10 2024-03-30T01:52:23.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.036+0000 7f533da00640 1 -- 172.21.15.133:0/3461585338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f531c006f10 msgr2=0x7f531c007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:23.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.037+0000 7f533da00640 1 --2- 172.21.15.133:0/3461585338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f531c006f10 0x7f531c007390 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5330007360 tx=0x7f531c007a00 comp rx=0 tx=0).stop 2024-03-30T01:52:23.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.037+0000 7f5337400640 1 -- 172.21.15.133:0/3461585338 reap_dead start 2024-03-30T01:52:23.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.037+0000 7f533da00640 1 -- 172.21.15.133:0/3461585338 shutdown_connections 2024-03-30T01:52:23.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.037+0000 7f533da00640 1 -- 172.21.15.133:0/3461585338 >> 172.21.15.133:0/3461585338 conn(0x7f53380b07a0 msgr2=0x7f53380b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:23.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.037+0000 7f533da00640 1 -- 172.21.15.133:0/3461585338 shutdown_connections 2024-03-30T01:52:23.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.037+0000 7f533da00640 1 -- 172.21.15.133:0/3461585338 wait complete. 2024-03-30T01:52:23.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.038+0000 7f533da00640 1 Processor -- start 2024-03-30T01:52:23.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.038+0000 7f533da00640 1 -- start start 2024-03-30T01:52:23.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.039+0000 7f533da00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f531c006f10 0x7f533806ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:23.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.039+0000 7f533da00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5338153300 0x7f533815c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:23.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.039+0000 7f533da00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5338154f50 0x7f53381f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:23.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.039+0000 7f533da00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5338153c60 con 0x7f5338153300 2024-03-30T01:52:23.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.039+0000 7f533da00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5338153eb0 con 0x7f531c006f10 2024-03-30T01:52:23.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.039+0000 7f533da00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5338154190 con 0x7f5338154f50 2024-03-30T01:52:23.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.040+0000 7f532e000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5338153300 0x7f533815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:23.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.040+0000 7f532e000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5338153300 0x7f533815c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38460/0 (socket says 172.21.15.133:38460) 2024-03-30T01:52:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.040+0000 7f532e000640 1 -- 172.21.15.133:0/1197928947 learned_addr learned my addr 172.21.15.133:0/1197928947 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.040+0000 7f5336a00640 1 --2- 172.21.15.133:0/1197928947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f531c006f10 0x7f533806ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.040+0000 7f532e000640 1 -- 172.21.15.133:0/1197928947 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5338154f50 msgr2=0x7f53381f1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.040+0000 7f532e000640 1 --2- 172.21.15.133:0/1197928947 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5338154f50 0x7f53381f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.040+0000 7f532e000640 1 -- 172.21.15.133:0/1197928947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f531c006f10 msgr2=0x7f533806ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.040+0000 7f532e000640 1 --2- 172.21.15.133:0/1197928947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f531c006f10 0x7f533806ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.040+0000 7f532e000640 1 -- 172.21.15.133:0/1197928947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5338154470 con 0x7f5338153300 2024-03-30T01:52:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.040+0000 7f5336a00640 1 --2- 172.21.15.133:0/1197928947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f531c006f10 0x7f533806ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.040+0000 7f532e000640 1 --2- 172.21.15.133:0/1197928947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5338153300 0x7f533815c230 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f532000e760 tx=0x7f532000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.041+0000 7f532f400640 1 -- 172.21.15.133:0/1197928947 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532000c6d0 con 0x7f5338153300 2024-03-30T01:52:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.041+0000 7f532f400640 1 -- 172.21.15.133:0/1197928947 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532000c830 con 0x7f5338153300 2024-03-30T01:52:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.041+0000 7f532f400640 1 -- 172.21.15.133:0/1197928947 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532000cba0 con 0x7f5338153300 2024-03-30T01:52:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.041+0000 7f533da00640 1 -- 172.21.15.133:0/1197928947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5338154750 con 0x7f5338153300 2024-03-30T01:52:23.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.041+0000 7f533da00640 1 -- 172.21.15.133:0/1197928947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533815c770 con 0x7f5338153300 2024-03-30T01:52:23.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.042+0000 7f533da00640 1 -- 172.21.15.133:0/1197928947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5338066d80 con 0x7f5338153300 2024-03-30T01:52:23.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.043+0000 7f532f400640 1 -- 172.21.15.133:0/1197928947 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f532000cd00 con 0x7f5338153300 2024-03-30T01:52:23.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.044+0000 7f532f400640 1 --2- 172.21.15.133:0/1197928947 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f531406ac00 0x7f531406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:23.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.044+0000 7f532f400640 1 -- 172.21.15.133:0/1197928947 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f53200891c0 con 0x7f5338153300 2024-03-30T01:52:23.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.044+0000 7f5336a00640 1 --2- 172.21.15.133:0/1197928947 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f531406ac00 0x7f531406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:23.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.044+0000 7f5336a00640 1 --2- 172.21.15.133:0/1197928947 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f531406ac00 0x7f531406d0c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5328001eb0 tx=0x7f5328009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:23.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.048+0000 7f532f400640 1 -- 172.21.15.133:0/1197928947 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f5320054280 con 0x7f5338153300 2024-03-30T01:52:23.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.253+0000 7f533da00640 1 -- 172.21.15.133:0/1197928947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f533815d120 con 0x7f5338153300 2024-03-30T01:52:23.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.254+0000 7f532f400640 1 -- 172.21.15.133:0/1197928947 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f53200578a0 con 0x7f5338153300 2024-03-30T01:52:23.260 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2024-03-30T01:52:23.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.256+0000 7f533da00640 1 -- 172.21.15.133:0/1197928947 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f531406ac00 msgr2=0x7f531406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:23.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.256+0000 7f533da00640 1 --2- 172.21.15.133:0/1197928947 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f531406ac00 0x7f531406d0c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5328001eb0 tx=0x7f5328009040 comp rx=0 tx=0).stop 2024-03-30T01:52:23.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.256+0000 7f533da00640 1 -- 172.21.15.133:0/1197928947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5338153300 msgr2=0x7f533815c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:23.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.256+0000 7f533da00640 1 --2- 172.21.15.133:0/1197928947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5338153300 0x7f533815c230 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f532000e760 tx=0x7f532000ec20 comp rx=0 tx=0).stop 2024-03-30T01:52:23.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.256+0000 7f533da00640 1 -- 172.21.15.133:0/1197928947 shutdown_connections 2024-03-30T01:52:23.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.256+0000 7f533da00640 1 --2- 172.21.15.133:0/1197928947 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f531406ac00 0x7f531406d0c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:23.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.256+0000 7f533da00640 1 --2- 172.21.15.133:0/1197928947 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5338154f50 0x7f53381f1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:23.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.256+0000 7f533da00640 1 --2- 172.21.15.133:0/1197928947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5338153300 0x7f533815c230 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:23.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.256+0000 7f533da00640 1 --2- 172.21.15.133:0/1197928947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f531c006f10 0x7f533806ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:23.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.257+0000 7f533da00640 1 -- 172.21.15.133:0/1197928947 >> 172.21.15.133:0/1197928947 conn(0x7f53380b07a0 msgr2=0x7f5338140f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:23.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.257+0000 7f533da00640 1 -- 172.21.15.133:0/1197928947 shutdown_connections 2024-03-30T01:52:23.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.257+0000 7f533da00640 1 -- 172.21.15.133:0/1197928947 wait complete. 2024-03-30T01:52:23.282 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-03-30T01:52:23.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:23.282 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-03-30T01:52:23.390 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-03-30T01:52:23.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:23.391 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-30T01:52:23.456 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:52:23.456 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:52:23.513 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:52:23.513 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:52:23.564 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:52:23.564 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:52:23.615 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:52:23.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.816+0000 7fc802e00640 1 Processor -- start 2024-03-30T01:52:23.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.817+0000 7fc802e00640 1 -- start start 2024-03-30T01:52:23.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.818+0000 7fc802e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc7fc15cbd0 0x7fc7fc0cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:23.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.818+0000 7fc802e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7fc0b5ac0 0x7fc7fc0b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:23.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.818+0000 7fc802e00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7fc15cfb0 con 0x7fc7fc0d1750 2024-03-30T01:52:23.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.818+0000 7fc802e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7fc0d1ef0 con 0x7fc7fc15cbd0 2024-03-30T01:52:23.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.818+0000 7fc802e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc0d21d0 con 0x7fc7fc0b5ac0 2024-03-30T01:52:23.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.818+0000 7fc7fb400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc7fc0d1750 0x7fc7fc0d2f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43930/0 (socket says 172.21.15.133:43930) 2024-03-30T01:52:23.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.818+0000 7fc7fb400640 1 -- 172.21.15.133:0/2503032987 learned_addr learned my addr 172.21.15.133:0/2503032987 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:23.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.819+0000 7fc7fbe00640 1 --2- 172.21.15.133:0/2503032987 >> v2:172.21.15.137:3300/0 conn(0x7fc7fc15cbd0 0x7fc7fc0cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:23.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.819+0000 7fc800e00640 1 --2- 172.21.15.133:0/2503032987 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7fc0b5ac0 0x7fc7fc0b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:23.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.819+0000 7fc7faa00640 1 -- 172.21.15.133:0/2503032987 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3603899276 0 0) 0x7fc7fc15cfb0 con 0x7fc7fc0d1750 2024-03-30T01:52:23.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.819+0000 7fc7faa00640 1 -- 172.21.15.133:0/2503032987 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7dc003520 con 0x7fc7fc0d1750 2024-03-30T01:52:23.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.819+0000 7fc7faa00640 1 -- 172.21.15.133:0/2503032987 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2534591772 0 0) 0x7fc7dc003520 con 0x7fc7fc0d1750 2024-03-30T01:52:23.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.819+0000 7fc7faa00640 1 -- 172.21.15.133:0/2503032987 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7fc0b5ac0 msgr2=0x7fc7fc0b5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:23.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.819+0000 7fc7faa00640 1 --2- 172.21.15.133:0/2503032987 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7fc0b5ac0 0x7fc7fc0b5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:23.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.819+0000 7fc7faa00640 1 -- 172.21.15.133:0/2503032987 >> v2:172.21.15.137:3300/0 conn(0x7fc7fc15cbd0 msgr2=0x7fc7fc0cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:23.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.819+0000 7fc7faa00640 1 --2- 172.21.15.133:0/2503032987 >> v2:172.21.15.137:3300/0 conn(0x7fc7fc15cbd0 0x7fc7fc0cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:23.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.819+0000 7fc7faa00640 1 -- 172.21.15.133:0/2503032987 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7fc0d24b0 con 0x7fc7fc0d1750 2024-03-30T01:52:23.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.819+0000 7fc7faa00640 1 -- 172.21.15.133:0/2503032987 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fc7e40019f0 con 0x7fc7fc0d1750 2024-03-30T01:52:23.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.819+0000 7fc7fbe00640 1 --2- 172.21.15.133:0/2503032987 >> v2:172.21.15.137:3300/0 conn(0x7fc7fc15cbd0 0x7fc7fc0cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:52:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.819+0000 7fc7faa00640 1 -- 172.21.15.133:0/2503032987 >> v1:172.21.15.133:6789/0 conn(0x7fc7fc0d1750 legacy=0x7fc7fc0d2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.819+0000 7fc7faa00640 1 --2- 172.21.15.133:0/2503032987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7dc003970 0x7fc7dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.819+0000 7fc7faa00640 1 --2- 172.21.15.133:0/2503032987 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7dc0047c0 0x7fc7dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.819+0000 7fc7faa00640 1 --2- 172.21.15.133:0/2503032987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7dc005180 0x7fc7dc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.819+0000 7fc7faa00640 1 -- 172.21.15.133:0/2503032987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc0d1ef0 con 0x7fc7dc005180 2024-03-30T01:52:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.819+0000 7fc7faa00640 1 -- 172.21.15.133:0/2503032987 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc0d21d0 con 0x7fc7dc003970 2024-03-30T01:52:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.819+0000 7fc7faa00640 1 -- 172.21.15.133:0/2503032987 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc00c000 con 0x7fc7dc0047c0 2024-03-30T01:52:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.819+0000 7fc800e00640 1 --2- 172.21.15.133:0/2503032987 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7fc0b5ac0 0x7fc7fc0b5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:52:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.820+0000 7fc800e00640 1 --2- 172.21.15.133:0/2503032987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7dc005180 0x7fc7dc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.820+0000 7fc7fbe00640 1 --2- 172.21.15.133:0/2503032987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7dc003970 0x7fc7dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.820+0000 7fc7fb400640 1 --2- 172.21.15.133:0/2503032987 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7dc0047c0 0x7fc7dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.820+0000 7fc800e00640 1 -- 172.21.15.133:0/2503032987 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7dc0047c0 msgr2=0x7fc7dc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.820+0000 7fc800e00640 1 --2- 172.21.15.133:0/2503032987 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7dc0047c0 0x7fc7dc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.820+0000 7fc800e00640 1 -- 172.21.15.133:0/2503032987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7dc003970 msgr2=0x7fc7dc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.820+0000 7fc800e00640 1 --2- 172.21.15.133:0/2503032987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7dc003970 0x7fc7dc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:23.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.820+0000 7fc800e00640 1 -- 172.21.15.133:0/2503032987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7dc003520 con 0x7fc7dc005180 2024-03-30T01:52:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.822+0000 7fc800e00640 1 --2- 172.21.15.133:0/2503032987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7dc005180 0x7fc7dc00b980 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4006fd0 tx=0x7fc7dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458a938b0390151c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.822+0000 7fc7faa00640 1 -- 172.21.15.133:0/2503032987 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4033600 con 0x7fc7dc005180 2024-03-30T01:52:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.822+0000 7fc7faa00640 1 -- 172.21.15.133:0/2503032987 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f402f050 con 0x7fc7dc005180 2024-03-30T01:52:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.822+0000 7fc7faa00640 1 -- 172.21.15.133:0/2503032987 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4033980 con 0x7fc7dc005180 2024-03-30T01:52:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.823+0000 7fc802e00640 1 -- 172.21.15.133:0/2503032987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7dc005180 msgr2=0x7fc7dc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.823+0000 7fc802e00640 1 --2- 172.21.15.133:0/2503032987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7dc005180 0x7fc7dc00b980 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4006fd0 tx=0x7fc7dc0057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.823+0000 7fc800e00640 1 -- 172.21.15.133:0/2503032987 reap_dead start 2024-03-30T01:52:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.823+0000 7fc802e00640 1 -- 172.21.15.133:0/2503032987 shutdown_connections 2024-03-30T01:52:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.823+0000 7fc802e00640 1 -- 172.21.15.133:0/2503032987 >> 172.21.15.133:0/2503032987 conn(0x7fc7fc071830 msgr2=0x7fc7fc071c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.823+0000 7fc802e00640 1 -- 172.21.15.133:0/2503032987 shutdown_connections 2024-03-30T01:52:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.823+0000 7fc802e00640 1 -- 172.21.15.133:0/2503032987 wait complete. 2024-03-30T01:52:23.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.825+0000 7fc802e00640 1 Processor -- start 2024-03-30T01:52:23.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.825+0000 7fc802e00640 1 -- start start 2024-03-30T01:52:23.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.826+0000 7fc802e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7fc150ed0 0x7fc7fc0c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:23.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.826+0000 7fc802e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7fc15cfb0 0x7fc7fc15d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:23.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.826+0000 7fc802e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7fc15d970 0x7fc7fc0c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:23.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.826+0000 7fc802e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc15ead0 con 0x7fc7fc15cfb0 2024-03-30T01:52:23.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.826+0000 7fc802e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc0c9bc0 con 0x7fc7fc150ed0 2024-03-30T01:52:23.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.826+0000 7fc802e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc15ed20 con 0x7fc7fc15d970 2024-03-30T01:52:23.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.826+0000 7fc7fb400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7fc15cfb0 0x7fc7fc15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:23.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.826+0000 7fc7fb400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7fc15cfb0 0x7fc7fc15d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38482/0 (socket says 172.21.15.133:38482) 2024-03-30T01:52:23.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.826+0000 7fc7fb400640 1 -- 172.21.15.133:0/682243023 learned_addr learned my addr 172.21.15.133:0/682243023 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:23.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.827+0000 7fc7fb400640 1 -- 172.21.15.133:0/682243023 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7fc15d970 msgr2=0x7fc7fc0c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:23.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.827+0000 7fc7fb400640 1 --2- 172.21.15.133:0/682243023 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7fc15d970 0x7fc7fc0c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:23.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.827+0000 7fc7fb400640 1 -- 172.21.15.133:0/682243023 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7fc150ed0 msgr2=0x7fc7fc0c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:23.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.827+0000 7fc7fb400640 1 --2- 172.21.15.133:0/682243023 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7fc150ed0 0x7fc7fc0c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:23.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.827+0000 7fc7fb400640 1 -- 172.21.15.133:0/682243023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7fc15f000 con 0x7fc7fc15cfb0 2024-03-30T01:52:23.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.827+0000 7fc7fb400640 1 --2- 172.21.15.133:0/682243023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7fc15cfb0 0x7fc7fc15d430 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc7e40079f0 tx=0x7fc7e400a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:23.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.827+0000 7fc7f3e00640 1 -- 172.21.15.133:0/682243023 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e400ae80 con 0x7fc7fc15cfb0 2024-03-30T01:52:23.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.827+0000 7fc7f3e00640 1 -- 172.21.15.133:0/682243023 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e40133f0 con 0x7fc7fc15cfb0 2024-03-30T01:52:23.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.827+0000 7fc802e00640 1 -- 172.21.15.133:0/682243023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7fc15f2e0 con 0x7fc7fc15cfb0 2024-03-30T01:52:23.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.828+0000 7fc7f3e00640 1 -- 172.21.15.133:0/682243023 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4013780 con 0x7fc7fc15cfb0 2024-03-30T01:52:23.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.828+0000 7fc802e00640 1 -- 172.21.15.133:0/682243023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7fc1512b0 con 0x7fc7fc15cfb0 2024-03-30T01:52:23.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.829+0000 7fc802e00640 1 -- 172.21.15.133:0/682243023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7fc1514a0 con 0x7fc7fc15cfb0 2024-03-30T01:52:23.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.830+0000 7fc7f3e00640 1 -- 172.21.15.133:0/682243023 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fc7e40138e0 con 0x7fc7fc15cfb0 2024-03-30T01:52:23.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.831+0000 7fc7f3e00640 1 --2- 172.21.15.133:0/682243023 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc7d806ac00 0x7fc7d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:23.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.831+0000 7fc7f3e00640 1 -- 172.21.15.133:0/682243023 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc7e408a140 con 0x7fc7fc15cfb0 2024-03-30T01:52:23.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.831+0000 7fc7fbe00640 1 --2- 172.21.15.133:0/682243023 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc7d806ac00 0x7fc7d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:23.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.831+0000 7fc7fbe00640 1 --2- 172.21.15.133:0/682243023 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc7d806ac00 0x7fc7d806d0c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc0cfed0 tx=0x7fc7ec009540 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:23.835+0000 7fc7f3e00640 1 -- 172.21.15.133:0/682243023 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fc7e40552a0 con 0x7fc7fc15cfb0 2024-03-30T01:52:24.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.031+0000 7fc802e00640 1 -- 172.21.15.133:0/682243023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7fc066d80 con 0x7fc7fc15cfb0 2024-03-30T01:52:24.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.033+0000 7fc7f3e00640 1 -- 172.21.15.133:0/682243023 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16335 (secure 0 0 0) 0x7fc7e40588c0 con 0x7fc7fc15cfb0 2024-03-30T01:52:24.040 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:24.040 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:52:15.520675+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:51:31.245378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T01:51:31.774247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:52:24.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.036+0000 7fc802e00640 1 -- 172.21.15.133:0/682243023 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc7d806ac00 msgr2=0x7fc7d806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:24.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.036+0000 7fc802e00640 1 --2- 172.21.15.133:0/682243023 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc7d806ac00 0x7fc7d806d0c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc0cfed0 tx=0x7fc7ec009540 comp rx=0 tx=0).stop 2024-03-30T01:52:24.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.036+0000 7fc802e00640 1 -- 172.21.15.133:0/682243023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7fc15cfb0 msgr2=0x7fc7fc15d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:24.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.036+0000 7fc802e00640 1 --2- 172.21.15.133:0/682243023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7fc15cfb0 0x7fc7fc15d430 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc7e40079f0 tx=0x7fc7e400a640 comp rx=0 tx=0).stop 2024-03-30T01:52:24.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.036+0000 7fc802e00640 1 -- 172.21.15.133:0/682243023 shutdown_connections 2024-03-30T01:52:24.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.036+0000 7fc802e00640 1 --2- 172.21.15.133:0/682243023 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc7d806ac00 0x7fc7d806d0c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.036+0000 7fc802e00640 1 --2- 172.21.15.133:0/682243023 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7fc15d970 0x7fc7fc0c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.036+0000 7fc802e00640 1 --2- 172.21.15.133:0/682243023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7fc15cfb0 0x7fc7fc15d430 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.036+0000 7fc802e00640 1 --2- 172.21.15.133:0/682243023 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7fc150ed0 0x7fc7fc0c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.036+0000 7fc802e00640 1 -- 172.21.15.133:0/682243023 >> 172.21.15.133:0/682243023 conn(0x7fc7fc071830 msgr2=0x7fc7fc15afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:24.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.036+0000 7fc802e00640 1 -- 172.21.15.133:0/682243023 shutdown_connections 2024-03-30T01:52:24.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.036+0000 7fc802e00640 1 -- 172.21.15.133:0/682243023 wait complete. 2024-03-30T01:52:24.062 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T01:51:21.771393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T01:51:31.245378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T01:51:31.774247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T01:52:24.063 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T01:52:24.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.267+0000 7fdd16600640 1 Processor -- start 2024-03-30T01:52:24.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.268+0000 7fdd16600640 1 -- start start 2024-03-30T01:52:24.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.269+0000 7fdd16600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdd1015cc50 0x7fdd100d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:24.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.269+0000 7fdd16600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdd100d2240 0x7fdd100cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:24.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.269+0000 7fdd16600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1015d030 con 0x7fdd100cf9b0 2024-03-30T01:52:24.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.269+0000 7fdd16600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd100d1c50 con 0x7fdd1015cc50 2024-03-30T01:52:24.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.269+0000 7fdd16600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd100cfe20 con 0x7fdd100d2240 2024-03-30T01:52:24.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.269+0000 7fdd0f400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdd1015cc50 0x7fdd100d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:24.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.270+0000 7fdd0f400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdd1015cc50 0x7fdd100d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38498/0 (socket says 172.21.15.133:38498) 2024-03-30T01:52:24.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.270+0000 7fdd0f400640 1 -- 172.21.15.133:0/756045990 learned_addr learned my addr 172.21.15.133:0/756045990 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:24.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.270+0000 7fdd0ea00640 1 --2- 172.21.15.133:0/756045990 >> v2:172.21.15.137:3300/0 conn(0x7fdd100d2240 0x7fdd100cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:24.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.270+0000 7fdd0f400640 1 -- 172.21.15.133:0/756045990 >> v2:172.21.15.137:3300/0 conn(0x7fdd100d2240 msgr2=0x7fdd100cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:24.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.270+0000 7fdd0f400640 1 --2- 172.21.15.133:0/756045990 >> v2:172.21.15.137:3300/0 conn(0x7fdd100d2240 0x7fdd100cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.270+0000 7fdd0f400640 1 -- 172.21.15.133:0/756045990 >> v1:172.21.15.137:6789/0 conn(0x7fdd100cf9b0 legacy=0x7fdd100b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:24.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.270+0000 7fdd0f400640 1 -- 172.21.15.133:0/756045990 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd100b5af0 con 0x7fdd1015cc50 2024-03-30T01:52:24.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.270+0000 7fdd0ea00640 1 --2- 172.21.15.133:0/756045990 >> v2:172.21.15.137:3300/0 conn(0x7fdd100d2240 0x7fdd100cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:24.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.271+0000 7fdd0f400640 1 --2- 172.21.15.133:0/756045990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd1015cc50 0x7fdd100d0af0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdd100b5620 tx=0x7fdd0002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a34ec50683a3fc6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:24.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.272+0000 7fdd0e000640 1 -- 172.21.15.133:0/756045990 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd00031640 con 0x7fdd1015cc50 2024-03-30T01:52:24.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.272+0000 7fdd0e000640 1 -- 172.21.15.133:0/756045990 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd000317a0 con 0x7fdd1015cc50 2024-03-30T01:52:24.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.272+0000 7fdd0e000640 1 -- 172.21.15.133:0/756045990 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd00031b30 con 0x7fdd1015cc50 2024-03-30T01:52:24.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.272+0000 7fdd16600640 1 -- 172.21.15.133:0/756045990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd1015cc50 msgr2=0x7fdd100d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:24.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.272+0000 7fdd16600640 1 --2- 172.21.15.133:0/756045990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd1015cc50 0x7fdd100d0af0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdd100b5620 tx=0x7fdd0002b8f0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.272+0000 7fdd16600640 1 -- 172.21.15.133:0/756045990 shutdown_connections 2024-03-30T01:52:24.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.272+0000 7fdd16600640 1 --2- 172.21.15.133:0/756045990 >> v2:172.21.15.137:3300/0 conn(0x7fdd100d2240 0x7fdd100cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.272+0000 7fdd16600640 1 --2- 172.21.15.133:0/756045990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd1015cc50 0x7fdd100d0af0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.272+0000 7fdd16600640 1 -- 172.21.15.133:0/756045990 >> 172.21.15.133:0/756045990 conn(0x7fdd10071a40 msgr2=0x7fdd1006b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:24.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.273+0000 7fdd16600640 1 -- 172.21.15.133:0/756045990 shutdown_connections 2024-03-30T01:52:24.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.273+0000 7fdd16600640 1 -- 172.21.15.133:0/756045990 wait complete. 2024-03-30T01:52:24.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.274+0000 7fdd16600640 1 Processor -- start 2024-03-30T01:52:24.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.274+0000 7fdd16600640 1 -- start start 2024-03-30T01:52:24.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.275+0000 7fdd16600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd100cf9b0 0x7fdd10151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:24.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.275+0000 7fdd16600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd100d2240 0x7fdd10154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:24.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.275+0000 7fdd16600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdd1015cc50 0x7fdd101529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:24.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.275+0000 7fdd16600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd101558a0 con 0x7fdd100cf9b0 2024-03-30T01:52:24.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.275+0000 7fdd16600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd101524a0 con 0x7fdd100d2240 2024-03-30T01:52:24.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.275+0000 7fdd16600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd101552e0 con 0x7fdd1015cc50 2024-03-30T01:52:24.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.275+0000 7fdd0f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd100cf9b0 0x7fdd10151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:24.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.276+0000 7fdd0f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd100cf9b0 0x7fdd10151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38502/0 (socket says 172.21.15.133:38502) 2024-03-30T01:52:24.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.276+0000 7fdd0f400640 1 -- 172.21.15.133:0/2865990751 learned_addr learned my addr 172.21.15.133:0/2865990751 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:24.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.276+0000 7fdd0f400640 1 -- 172.21.15.133:0/2865990751 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdd1015cc50 msgr2=0x7fdd101529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:24.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.276+0000 7fdd0ea00640 1 --2- 172.21.15.133:0/2865990751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd100d2240 0x7fdd10154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:24.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.276+0000 7fdd0fe00640 1 --2- 172.21.15.133:0/2865990751 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdd1015cc50 0x7fdd101529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:24.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.276+0000 7fdd0f400640 1 --2- 172.21.15.133:0/2865990751 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdd1015cc50 0x7fdd101529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.276+0000 7fdd0f400640 1 -- 172.21.15.133:0/2865990751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd100d2240 msgr2=0x7fdd10154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:24.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.276+0000 7fdd0f400640 1 --2- 172.21.15.133:0/2865990751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd100d2240 0x7fdd10154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.276+0000 7fdd0f400640 1 -- 172.21.15.133:0/2865990751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd000094d0 con 0x7fdd100cf9b0 2024-03-30T01:52:24.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.276+0000 7fdd0ea00640 1 --2- 172.21.15.133:0/2865990751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd100d2240 0x7fdd10154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:24.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.276+0000 7fdd0f400640 1 --2- 172.21.15.133:0/2865990751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd100cf9b0 0x7fdd10151c50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdd00000c00 tx=0x7fdd000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:24.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.277+0000 7fdd07400640 1 -- 172.21.15.133:0/2865990751 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0003ac60 con 0x7fdd100cf9b0 2024-03-30T01:52:24.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.277+0000 7fdd07400640 1 -- 172.21.15.133:0/2865990751 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0003adc0 con 0x7fdd100cf9b0 2024-03-30T01:52:24.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.277+0000 7fdd07400640 1 -- 172.21.15.133:0/2865990751 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd00044630 con 0x7fdd100cf9b0 2024-03-30T01:52:24.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.277+0000 7fdd16600640 1 -- 172.21.15.133:0/2865990751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd101555c0 con 0x7fdd100cf9b0 2024-03-30T01:52:24.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.277+0000 7fdd16600640 1 -- 172.21.15.133:0/2865990751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd10156de0 con 0x7fdd100cf9b0 2024-03-30T01:52:24.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.278+0000 7fdd16600640 1 -- 172.21.15.133:0/2865990751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd10156960 con 0x7fdd100cf9b0 2024-03-30T01:52:24.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.279+0000 7fdd07400640 1 -- 172.21.15.133:0/2865990751 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fdd0002f050 con 0x7fdd100cf9b0 2024-03-30T01:52:24.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.280+0000 7fdd07400640 1 --2- 172.21.15.133:0/2865990751 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdcf006ac00 0x7fdcf006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:24.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.280+0000 7fdd07400640 1 -- 172.21.15.133:0/2865990751 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fdd000ab5e0 con 0x7fdd100cf9b0 2024-03-30T01:52:24.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.280+0000 7fdd0ea00640 1 --2- 172.21.15.133:0/2865990751 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdcf006ac00 0x7fdcf006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:24.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.281+0000 7fdd0ea00640 1 --2- 172.21.15.133:0/2865990751 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdcf006ac00 0x7fdcf006d0c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc006fd0 tx=0x7fdcfc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:24.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.284+0000 7fdd07400640 1 -- 172.21.15.133:0/2865990751 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fdd10156960 con 0x7fdd100cf9b0 2024-03-30T01:52:24.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.477+0000 7fdd16600640 1 -- 172.21.15.133:0/2865990751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdd10156960 con 0x7fdd100cf9b0 2024-03-30T01:52:24.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.478+0000 7fdd07400640 1 -- 172.21.15.133:0/2865990751 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdd10156960 con 0x7fdd100cf9b0 2024-03-30T01:52:24.484 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-03-30T01:52:24.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.481+0000 7fdd16600640 1 -- 172.21.15.133:0/2865990751 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdcf006ac00 msgr2=0x7fdcf006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:24.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.481+0000 7fdd16600640 1 --2- 172.21.15.133:0/2865990751 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdcf006ac00 0x7fdcf006d0c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc006fd0 tx=0x7fdcfc008040 comp rx=0 tx=0).stop 2024-03-30T01:52:24.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.481+0000 7fdd16600640 1 -- 172.21.15.133:0/2865990751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd100cf9b0 msgr2=0x7fdd10151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:24.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.481+0000 7fdd16600640 1 --2- 172.21.15.133:0/2865990751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd100cf9b0 0x7fdd10151c50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdd00000c00 tx=0x7fdd000046c0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.481+0000 7fdd16600640 1 -- 172.21.15.133:0/2865990751 shutdown_connections 2024-03-30T01:52:24.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.481+0000 7fdd16600640 1 --2- 172.21.15.133:0/2865990751 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdcf006ac00 0x7fdcf006d0c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.481+0000 7fdd16600640 1 --2- 172.21.15.133:0/2865990751 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdd1015cc50 0x7fdd101529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.481+0000 7fdd16600640 1 --2- 172.21.15.133:0/2865990751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd100d2240 0x7fdd10154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.481+0000 7fdd16600640 1 --2- 172.21.15.133:0/2865990751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd100cf9b0 0x7fdd10151c50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.481+0000 7fdd16600640 1 -- 172.21.15.133:0/2865990751 >> 172.21.15.133:0/2865990751 conn(0x7fdd10071a40 msgr2=0x7fdd10072ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:24.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.481+0000 7fdd16600640 1 -- 172.21.15.133:0/2865990751 shutdown_connections 2024-03-30T01:52:24.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.481+0000 7fdd16600640 1 -- 172.21.15.133:0/2865990751 wait complete. 2024-03-30T01:52:24.505 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T01:52:24.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.712+0000 7f45d8a00640 1 Processor -- start 2024-03-30T01:52:24.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.713+0000 7f45d8a00640 1 -- start start 2024-03-30T01:52:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.714+0000 7f45d8a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45d40d0af0 0x7f45d40cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.714+0000 7f45d8a00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d415d030 con 0x7f45d415cc50 2024-03-30T01:52:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.714+0000 7f45d8a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d40cfe40 con 0x7f45d40cf9b0 2024-03-30T01:52:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.714+0000 7f45d8a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d40d1c50 con 0x7f45d40d0af0 2024-03-30T01:52:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.714+0000 7f45d1e00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f45d415cc50 0x7f45d40d2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43942/0 (socket says 172.21.15.133:43942) 2024-03-30T01:52:24.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.714+0000 7f45d1e00640 1 -- 172.21.15.133:0/2669065397 learned_addr learned my addr 172.21.15.133:0/2669065397 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.715+0000 7f45d0a00640 1 -- 172.21.15.133:0/2669065397 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313231776 0 0) 0x7f45d415d030 con 0x7f45d415cc50 2024-03-30T01:52:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.715+0000 7f45d0a00640 1 -- 172.21.15.133:0/2669065397 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45b4003520 con 0x7f45d415cc50 2024-03-30T01:52:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.715+0000 7f45d1400640 1 --2- 172.21.15.133:0/2669065397 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45d40d0af0 0x7f45d40cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:24.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.715+0000 7f45d0a00640 1 -- 172.21.15.133:0/2669065397 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3729810136 0 0) 0x7f45b4003520 con 0x7f45d415cc50 2024-03-30T01:52:24.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.715+0000 7f45d0a00640 1 -- 172.21.15.133:0/2669065397 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45d40d0af0 msgr2=0x7f45d40cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:24.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.715+0000 7f45d0a00640 1 --2- 172.21.15.133:0/2669065397 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45d40d0af0 0x7f45d40cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.715+0000 7f45d0a00640 1 -- 172.21.15.133:0/2669065397 >> v1:172.21.15.137:6789/0 conn(0x7f45d40cf9b0 legacy=0x7f45d40b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:24.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.715+0000 7f45d0a00640 1 -- 172.21.15.133:0/2669065397 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d40b5af0 con 0x7f45d415cc50 2024-03-30T01:52:24.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.715+0000 7f45d0a00640 1 -- 172.21.15.133:0/2669065397 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f45c4001670 con 0x7f45d415cc50 2024-03-30T01:52:24.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.715+0000 7f45d0a00640 1 -- 172.21.15.133:0/2669065397 >> v1:172.21.15.133:6789/0 conn(0x7f45d415cc50 legacy=0x7f45d40d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:24.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.715+0000 7f45d0a00640 1 --2- 172.21.15.133:0/2669065397 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45d40d0af0 0x7f45b40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:24.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.715+0000 7f45d0a00640 1 --2- 172.21.15.133:0/2669065397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45b4003fd0 0x7f45b40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:24.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.715+0000 7f45d0a00640 1 --2- 172.21.15.133:0/2669065397 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45b4004d00 0x7f45b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:24.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.715+0000 7f45d0a00640 1 -- 172.21.15.133:0/2669065397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d40d1c50 con 0x7f45b4003fd0 2024-03-30T01:52:24.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.715+0000 7f45d0a00640 1 -- 172.21.15.133:0/2669065397 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b400bb40 con 0x7f45b4004d00 2024-03-30T01:52:24.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.715+0000 7f45d0a00640 1 -- 172.21.15.133:0/2669065397 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b400bd00 con 0x7f45d40d0af0 2024-03-30T01:52:24.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.716+0000 7f45d1400640 1 --2- 172.21.15.133:0/2669065397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45b4003fd0 0x7f45b40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:24.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.716+0000 7f45d1e00640 1 --2- 172.21.15.133:0/2669065397 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45d40d0af0 0x7f45b40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:24.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.716+0000 7f45d2800640 1 --2- 172.21.15.133:0/2669065397 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45b4004d00 0x7f45b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:24.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.716+0000 7f45d1400640 1 -- 172.21.15.133:0/2669065397 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45d40d0af0 msgr2=0x7f45b40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:24.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.716+0000 7f45d1400640 1 --2- 172.21.15.133:0/2669065397 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45d40d0af0 0x7f45b40039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.716+0000 7f45d1400640 1 -- 172.21.15.133:0/2669065397 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45b4004d00 msgr2=0x7f45b4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:24.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.716+0000 7f45d1400640 1 --2- 172.21.15.133:0/2669065397 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45b4004d00 0x7f45b4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.716+0000 7f45d1400640 1 -- 172.21.15.133:0/2669065397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b4003520 con 0x7f45b4003fd0 2024-03-30T01:52:24.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.717+0000 7f45d1400640 1 --2- 172.21.15.133:0/2669065397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45b4003fd0 0x7f45b40047c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00ba30 tx=0x7f45b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7197cd43847a2b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:24.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.718+0000 7f45d0a00640 1 -- 172.21.15.133:0/2669065397 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc032640 con 0x7f45b4003fd0 2024-03-30T01:52:24.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.718+0000 7f45d0a00640 1 -- 172.21.15.133:0/2669065397 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc0327a0 con 0x7f45b4003fd0 2024-03-30T01:52:24.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.718+0000 7f45d0a00640 1 -- 172.21.15.133:0/2669065397 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc032b30 con 0x7f45b4003fd0 2024-03-30T01:52:24.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.718+0000 7f45d8a00640 1 -- 172.21.15.133:0/2669065397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45b4003fd0 msgr2=0x7f45b40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:24.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.718+0000 7f45d8a00640 1 --2- 172.21.15.133:0/2669065397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45b4003fd0 0x7f45b40047c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00ba30 tx=0x7f45b40057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.718+0000 7f45d2800640 1 -- 172.21.15.133:0/2669065397 reap_dead start 2024-03-30T01:52:24.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.718+0000 7f45d8a00640 1 -- 172.21.15.133:0/2669065397 shutdown_connections 2024-03-30T01:52:24.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.718+0000 7f45d8a00640 1 -- 172.21.15.133:0/2669065397 >> 172.21.15.133:0/2669065397 conn(0x7f45d4071a40 msgr2=0x7f45d406b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:24.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.718+0000 7f45d8a00640 1 -- 172.21.15.133:0/2669065397 shutdown_connections 2024-03-30T01:52:24.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.718+0000 7f45d8a00640 1 -- 172.21.15.133:0/2669065397 wait complete. 2024-03-30T01:52:24.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.720+0000 7f45d8a00640 1 Processor -- start 2024-03-30T01:52:24.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.720+0000 7f45d8a00640 1 -- start start 2024-03-30T01:52:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.721+0000 7f45d8a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45b4003fd0 0x7f45d4158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.721+0000 7f45d8a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45d41520f0 0x7f45d4155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.721+0000 7f45d8a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45d41530a0 0x7f45d4153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.721+0000 7f45d8a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d4152570 con 0x7f45d41520f0 2024-03-30T01:52:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.721+0000 7f45d8a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d4152930 con 0x7f45d41530a0 2024-03-30T01:52:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.721+0000 7f45d8a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d4152c10 con 0x7f45b4003fd0 2024-03-30T01:52:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.722+0000 7f45d1400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45d41520f0 0x7f45d4155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.722+0000 7f45d1400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45d41520f0 0x7f45d4155eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38520/0 (socket says 172.21.15.133:38520) 2024-03-30T01:52:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.722+0000 7f45d1400640 1 -- 172.21.15.133:0/1987967371 learned_addr learned my addr 172.21.15.133:0/1987967371 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.722+0000 7f45d1e00640 1 --2- 172.21.15.133:0/1987967371 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45b4003fd0 0x7f45d4158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.722+0000 7f45d2800640 1 --2- 172.21.15.133:0/1987967371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45d41530a0 0x7f45d4153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.722+0000 7f45d1400640 1 -- 172.21.15.133:0/1987967371 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45b4003fd0 msgr2=0x7f45d4158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.722+0000 7f45d1400640 1 --2- 172.21.15.133:0/1987967371 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45b4003fd0 0x7f45d4158e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.722+0000 7f45d1400640 1 -- 172.21.15.133:0/1987967371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45d41530a0 msgr2=0x7f45d4153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.722+0000 7f45d1400640 1 --2- 172.21.15.133:0/1987967371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45d41530a0 0x7f45d4153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.722+0000 7f45d1400640 1 -- 172.21.15.133:0/1987967371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d41569b0 con 0x7f45d41520f0 2024-03-30T01:52:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.722+0000 7f45d2800640 1 --2- 172.21.15.133:0/1987967371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45d41530a0 0x7f45d4153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.722+0000 7f45d1400640 1 --2- 172.21.15.133:0/1987967371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45d41520f0 0x7f45d4155eb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f45bc035040 tx=0x7f45bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.723+0000 7f45ca000640 1 -- 172.21.15.133:0/1987967371 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc004220 con 0x7f45d41520f0 2024-03-30T01:52:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.723+0000 7f45ca000640 1 -- 172.21.15.133:0/1987967371 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc004380 con 0x7f45d41520f0 2024-03-30T01:52:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.723+0000 7f45ca000640 1 -- 172.21.15.133:0/1987967371 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc03ba70 con 0x7f45d41520f0 2024-03-30T01:52:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.723+0000 7f45d8a00640 1 -- 172.21.15.133:0/1987967371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d4156c90 con 0x7f45d41520f0 2024-03-30T01:52:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.723+0000 7f45d8a00640 1 -- 172.21.15.133:0/1987967371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d4153ff0 con 0x7f45d41520f0 2024-03-30T01:52:24.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.724+0000 7f45d8a00640 1 -- 172.21.15.133:0/1987967371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d4066d80 con 0x7f45d41520f0 2024-03-30T01:52:24.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.725+0000 7f45ca000640 1 -- 172.21.15.133:0/1987967371 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f45bc03bbd0 con 0x7f45d41520f0 2024-03-30T01:52:24.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.726+0000 7f45ca000640 1 --2- 172.21.15.133:0/1987967371 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f45b006ac30 0x7f45b006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:24.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.726+0000 7f45ca000640 1 -- 172.21.15.133:0/1987967371 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f45bc0abce0 con 0x7f45d41520f0 2024-03-30T01:52:24.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.726+0000 7f45d1e00640 1 --2- 172.21.15.133:0/1987967371 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f45b006ac30 0x7f45b006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:24.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.727+0000 7f45d1e00640 1 --2- 172.21.15.133:0/1987967371 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f45b006ac30 0x7f45b006d0f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f45c4001eb0 tx=0x7f45c4000ff0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:24.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.730+0000 7f45ca000640 1 -- 172.21.15.133:0/1987967371 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f45bc076e30 con 0x7f45d41520f0 2024-03-30T01:52:24.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.923+0000 7f45d8a00640 1 -- 172.21.15.133:0/1987967371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45d4066d80 con 0x7f45d41520f0 2024-03-30T01:52:24.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.924+0000 7f45ca000640 1 -- 172.21.15.133:0/1987967371 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45bc07a450 con 0x7f45d41520f0 2024-03-30T01:52:24.933 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-03-30T01:52:24.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.927+0000 7f45d8a00640 1 -- 172.21.15.133:0/1987967371 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f45b006ac30 msgr2=0x7f45b006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:24.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.927+0000 7f45d8a00640 1 --2- 172.21.15.133:0/1987967371 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f45b006ac30 0x7f45b006d0f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f45c4001eb0 tx=0x7f45c4000ff0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.927+0000 7f45d8a00640 1 -- 172.21.15.133:0/1987967371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45d41520f0 msgr2=0x7f45d4155eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:24.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.927+0000 7f45d8a00640 1 --2- 172.21.15.133:0/1987967371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45d41520f0 0x7f45d4155eb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f45bc035040 tx=0x7f45bc004730 comp rx=0 tx=0).stop 2024-03-30T01:52:24.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.927+0000 7f45d8a00640 1 -- 172.21.15.133:0/1987967371 shutdown_connections 2024-03-30T01:52:24.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.927+0000 7f45d8a00640 1 --2- 172.21.15.133:0/1987967371 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f45b006ac30 0x7f45b006d0f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.927+0000 7f45d8a00640 1 --2- 172.21.15.133:0/1987967371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45d41530a0 0x7f45d4153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.927+0000 7f45d8a00640 1 --2- 172.21.15.133:0/1987967371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45d41520f0 0x7f45d4155eb0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.927+0000 7f45d8a00640 1 --2- 172.21.15.133:0/1987967371 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45b4003fd0 0x7f45d4158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:24.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.927+0000 7f45d8a00640 1 -- 172.21.15.133:0/1987967371 >> 172.21.15.133:0/1987967371 conn(0x7f45d4071a40 msgr2=0x7f45d4072ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:24.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.928+0000 7f45d8a00640 1 -- 172.21.15.133:0/1987967371 shutdown_connections 2024-03-30T01:52:24.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:24.928+0000 7f45d8a00640 1 -- 172.21.15.133:0/1987967371 wait complete. 2024-03-30T01:52:24.951 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T01:52:25.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.147+0000 7fcc21c00640 1 Processor -- start 2024-03-30T01:52:25.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.147+0000 7fcc21c00640 1 -- start start 2024-03-30T01:52:25.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.149+0000 7fcc21c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcc1c143790 0x7fcc1c0cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:25.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.149+0000 7fcc21c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcc1c070500 0x7fcc1c070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:25.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.149+0000 7fcc21c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc1c0cc530 0x7fcc1c0cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:25.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.149+0000 7fcc21c00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc1c070ed0 con 0x7fcc1c070500 2024-03-30T01:52:25.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.149+0000 7fcc21c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc1c0a76a0 con 0x7fcc1c143790 2024-03-30T01:52:25.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.149+0000 7fcc21c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c0b38e0 con 0x7fcc1c0cc530 2024-03-30T01:52:25.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.149+0000 7fcc1a000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcc1c070500 0x7fcc1c070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:25.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.149+0000 7fcc1a000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcc1c070500 0x7fcc1c070990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38522/0 (socket says 172.21.15.133:38522) 2024-03-30T01:52:25.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.149+0000 7fcc1a000640 1 -- 172.21.15.133:0/2107426182 learned_addr learned my addr 172.21.15.133:0/2107426182 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:25.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.149+0000 7fcc1b400640 1 --2- 172.21.15.133:0/2107426182 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc1c0cc530 0x7fcc1c0cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:25.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.149+0000 7fcc1aa00640 1 --2- 172.21.15.133:0/2107426182 >> v2:172.21.15.137:3300/0 conn(0x7fcc1c143790 0x7fcc1c0cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:25.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.150+0000 7fcc1a000640 1 -- 172.21.15.133:0/2107426182 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc1c0cc530 msgr2=0x7fcc1c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:25.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.150+0000 7fcc1a000640 1 --2- 172.21.15.133:0/2107426182 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc1c0cc530 0x7fcc1c0cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.150+0000 7fcc1a000640 1 -- 172.21.15.133:0/2107426182 >> v2:172.21.15.137:3300/0 conn(0x7fcc1c143790 msgr2=0x7fcc1c0cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:25.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.150+0000 7fcc1a000640 1 --2- 172.21.15.133:0/2107426182 >> v2:172.21.15.137:3300/0 conn(0x7fcc1c143790 0x7fcc1c0cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.150+0000 7fcc1a000640 1 -- 172.21.15.133:0/2107426182 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c0ccf00 con 0x7fcc1c070500 2024-03-30T01:52:25.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.151+0000 7fcc1a000640 1 --2- 172.21.15.133:0/2107426182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc1c070500 0x7fcc1c070990 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c06ea10 tx=0x7fcc0402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=765fb7fe32d42cbc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:25.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.151+0000 7fcc19600640 1 -- 172.21.15.133:0/2107426182 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc04030860 con 0x7fcc1c070500 2024-03-30T01:52:25.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.152+0000 7fcc19600640 1 -- 172.21.15.133:0/2107426182 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc040309c0 con 0x7fcc1c070500 2024-03-30T01:52:25.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.152+0000 7fcc19600640 1 -- 172.21.15.133:0/2107426182 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc04030d50 con 0x7fcc1c070500 2024-03-30T01:52:25.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.152+0000 7fcc21c00640 1 -- 172.21.15.133:0/2107426182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc1c070500 msgr2=0x7fcc1c070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:25.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.152+0000 7fcc21c00640 1 --2- 172.21.15.133:0/2107426182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc1c070500 0x7fcc1c070990 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c06ea10 tx=0x7fcc0402b9a0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.152+0000 7fcc21c00640 1 -- 172.21.15.133:0/2107426182 shutdown_connections 2024-03-30T01:52:25.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.152+0000 7fcc21c00640 1 --2- 172.21.15.133:0/2107426182 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc1c0cc530 0x7fcc1c0cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.152+0000 7fcc21c00640 1 --2- 172.21.15.133:0/2107426182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc1c070500 0x7fcc1c070990 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.152+0000 7fcc21c00640 1 --2- 172.21.15.133:0/2107426182 >> v2:172.21.15.137:3300/0 conn(0x7fcc1c143790 0x7fcc1c0cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.152+0000 7fcc21c00640 1 -- 172.21.15.133:0/2107426182 >> 172.21.15.133:0/2107426182 conn(0x7fcc1c0b07a0 msgr2=0x7fcc1c0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:25.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.153+0000 7fcc21c00640 1 -- 172.21.15.133:0/2107426182 shutdown_connections 2024-03-30T01:52:25.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.153+0000 7fcc21c00640 1 -- 172.21.15.133:0/2107426182 wait complete. 2024-03-30T01:52:25.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.154+0000 7fcc21c00640 1 Processor -- start 2024-03-30T01:52:25.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.154+0000 7fcc21c00640 1 -- start start 2024-03-30T01:52:25.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.155+0000 7fcc21c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc1c070500 0x7fcc1c15a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:25.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.155+0000 7fcc21c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc1c0cc530 0x7fcc1c0c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:25.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.155+0000 7fcc21c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc1c143790 0x7fcc1c0c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:25.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.155+0000 7fcc21c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c13f330 con 0x7fcc1c143790 2024-03-30T01:52:25.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.155+0000 7fcc21c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c0c6460 con 0x7fcc1c070500 2024-03-30T01:52:25.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.155+0000 7fcc21c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c0c4600 con 0x7fcc1c0cc530 2024-03-30T01:52:25.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.156+0000 7fcc1b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc1c143790 0x7fcc1c0c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:25.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.156+0000 7fcc1b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc1c143790 0x7fcc1c0c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38530/0 (socket says 172.21.15.133:38530) 2024-03-30T01:52:25.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.156+0000 7fcc1b400640 1 -- 172.21.15.133:0/3594638999 learned_addr learned my addr 172.21.15.133:0/3594638999 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:25.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.156+0000 7fcc1aa00640 1 --2- 172.21.15.133:0/3594638999 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc1c070500 0x7fcc1c15a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:25.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.156+0000 7fcc1a000640 1 --2- 172.21.15.133:0/3594638999 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc1c0cc530 0x7fcc1c0c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.156+0000 7fcc1b400640 1 -- 172.21.15.133:0/3594638999 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc1c0cc530 msgr2=0x7fcc1c0c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.156+0000 7fcc1b400640 1 --2- 172.21.15.133:0/3594638999 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc1c0cc530 0x7fcc1c0c5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.156+0000 7fcc1b400640 1 -- 172.21.15.133:0/3594638999 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc1c070500 msgr2=0x7fcc1c15a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.156+0000 7fcc1b400640 1 --2- 172.21.15.133:0/3594638999 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc1c070500 0x7fcc1c15a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.156+0000 7fcc1b400640 1 -- 172.21.15.133:0/3594638999 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc040094d0 con 0x7fcc1c143790 2024-03-30T01:52:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.156+0000 7fcc1aa00640 1 --2- 172.21.15.133:0/3594638999 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc1c070500 0x7fcc1c15a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:52:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.157+0000 7fcc1b400640 1 --2- 172.21.15.133:0/3594638999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc1c143790 0x7fcc1c0c8910 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400d800 tx=0x7fcc1400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.157+0000 7fcc12a00640 1 -- 172.21.15.133:0/3594638999 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1400b6c0 con 0x7fcc1c143790 2024-03-30T01:52:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.157+0000 7fcc12a00640 1 -- 172.21.15.133:0/3594638999 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1400b840 con 0x7fcc1c143790 2024-03-30T01:52:25.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.157+0000 7fcc12a00640 1 -- 172.21.15.133:0/3594638999 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1400bbf0 con 0x7fcc1c143790 2024-03-30T01:52:25.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.157+0000 7fcc21c00640 1 -- 172.21.15.133:0/3594638999 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1c0c48e0 con 0x7fcc1c143790 2024-03-30T01:52:25.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.157+0000 7fcc21c00640 1 -- 172.21.15.133:0/3594638999 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1c0c4ea0 con 0x7fcc1c143790 2024-03-30T01:52:25.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.158+0000 7fcc21c00640 1 -- 172.21.15.133:0/3594638999 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc1c066d80 con 0x7fcc1c143790 2024-03-30T01:52:25.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.159+0000 7fcc12a00640 1 -- 172.21.15.133:0/3594638999 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fcc1400bd50 con 0x7fcc1c143790 2024-03-30T01:52:25.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.160+0000 7fcc12a00640 1 --2- 172.21.15.133:0/3594638999 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fcbf806ac30 0x7fcbf806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:25.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.160+0000 7fcc12a00640 1 -- 172.21.15.133:0/3594638999 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fcc14089980 con 0x7fcc1c143790 2024-03-30T01:52:25.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.161+0000 7fcc1aa00640 1 --2- 172.21.15.133:0/3594638999 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fcbf806ac30 0x7fcbf806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:25.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.162+0000 7fcc1aa00640 1 --2- 172.21.15.133:0/3594638999 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fcbf806ac30 0x7fcbf806d0f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c009a00 tx=0x7fcc0c003990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:25.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.165+0000 7fcc12a00640 1 -- 172.21.15.133:0/3594638999 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fcc14054a40 con 0x7fcc1c143790 2024-03-30T01:52:25.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.357+0000 7fcc21c00640 1 -- 172.21.15.133:0/3594638999 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcc1c0b2640 con 0x7fcc1c143790 2024-03-30T01:52:25.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.358+0000 7fcc12a00640 1 -- 172.21.15.133:0/3594638999 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcc14058060 con 0x7fcc1c143790 2024-03-30T01:52:25.364 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-03-30T01:52:25.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.361+0000 7fcc21c00640 1 -- 172.21.15.133:0/3594638999 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fcbf806ac30 msgr2=0x7fcbf806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:25.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.361+0000 7fcc21c00640 1 --2- 172.21.15.133:0/3594638999 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fcbf806ac30 0x7fcbf806d0f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c009a00 tx=0x7fcc0c003990 comp rx=0 tx=0).stop 2024-03-30T01:52:25.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.361+0000 7fcc21c00640 1 -- 172.21.15.133:0/3594638999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc1c143790 msgr2=0x7fcc1c0c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:25.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.361+0000 7fcc21c00640 1 --2- 172.21.15.133:0/3594638999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc1c143790 0x7fcc1c0c8910 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400d800 tx=0x7fcc1400dcc0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.361+0000 7fcc21c00640 1 -- 172.21.15.133:0/3594638999 shutdown_connections 2024-03-30T01:52:25.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.361+0000 7fcc21c00640 1 --2- 172.21.15.133:0/3594638999 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fcbf806ac30 0x7fcbf806d0f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.361+0000 7fcc21c00640 1 --2- 172.21.15.133:0/3594638999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc1c143790 0x7fcc1c0c8910 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.361+0000 7fcc21c00640 1 --2- 172.21.15.133:0/3594638999 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc1c0cc530 0x7fcc1c0c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.361+0000 7fcc21c00640 1 --2- 172.21.15.133:0/3594638999 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc1c070500 0x7fcc1c15a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.361+0000 7fcc21c00640 1 -- 172.21.15.133:0/3594638999 >> 172.21.15.133:0/3594638999 conn(0x7fcc1c0b07a0 msgr2=0x7fcc1c0b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:25.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.361+0000 7fcc21c00640 1 -- 172.21.15.133:0/3594638999 shutdown_connections 2024-03-30T01:52:25.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.361+0000 7fcc21c00640 1 -- 172.21.15.133:0/3594638999 wait complete. 2024-03-30T01:52:25.387 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T01:52:25.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.587+0000 7fbf02000640 1 Processor -- start 2024-03-30T01:52:25.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.587+0000 7fbf02000640 1 -- start start 2024-03-30T01:52:25.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.588+0000 7fbf02000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbefc15cac0 0x7fbefc160670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:25.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.588+0000 7fbf02000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbefc160bb0 0x7fbefc0cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:25.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.589+0000 7fbf02000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbefc0b5b50 con 0x7fbefc0cdbe0 2024-03-30T01:52:25.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.589+0000 7fbf02000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbefc0d1020 con 0x7fbefc15cac0 2024-03-30T01:52:25.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.589+0000 7fbf02000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbefc0ce010 con 0x7fbefc160bb0 2024-03-30T01:52:25.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.589+0000 7fbf00c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbefc15cac0 0x7fbefc160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:25.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.589+0000 7fbf01600640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbefc0cdbe0 0x7fbefc06b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43958/0 (socket says 172.21.15.133:43958) 2024-03-30T01:52:25.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.589+0000 7fbf01600640 1 -- 172.21.15.133:0/3655221722 learned_addr learned my addr 172.21.15.133:0/3655221722 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.589+0000 7fbefbe00640 1 --2- 172.21.15.133:0/3655221722 >> v2:172.21.15.137:3300/0 conn(0x7fbefc160bb0 0x7fbefc0cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.589+0000 7fbf00c00640 1 -- 172.21.15.133:0/3655221722 >> v2:172.21.15.137:3300/0 conn(0x7fbefc160bb0 msgr2=0x7fbefc0cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.589+0000 7fbf00c00640 1 --2- 172.21.15.133:0/3655221722 >> v2:172.21.15.137:3300/0 conn(0x7fbefc160bb0 0x7fbefc0cd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.589+0000 7fbf00c00640 1 -- 172.21.15.133:0/3655221722 >> v1:172.21.15.133:6789/0 conn(0x7fbefc0cdbe0 legacy=0x7fbefc06b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.589+0000 7fbf00c00640 1 -- 172.21.15.133:0/3655221722 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc161100 con 0x7fbefc15cac0 2024-03-30T01:52:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.589+0000 7fbefbe00640 1 --2- 172.21.15.133:0/3655221722 >> v2:172.21.15.137:3300/0 conn(0x7fbefc160bb0 0x7fbefc0cd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:25.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.591+0000 7fbf00c00640 1 --2- 172.21.15.133:0/3655221722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbefc15cac0 0x7fbefc160670 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbefc06c230 tx=0x7fbef002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4840d98e92141f67 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:25.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.593+0000 7fbefb400640 1 -- 172.21.15.133:0/3655221722 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef0031830 con 0x7fbefc15cac0 2024-03-30T01:52:25.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.593+0000 7fbefb400640 1 -- 172.21.15.133:0/3655221722 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef0031990 con 0x7fbefc15cac0 2024-03-30T01:52:25.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.593+0000 7fbefb400640 1 -- 172.21.15.133:0/3655221722 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef0031d20 con 0x7fbefc15cac0 2024-03-30T01:52:25.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.594+0000 7fbf02000640 1 -- 172.21.15.133:0/3655221722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbefc15cac0 msgr2=0x7fbefc160670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:25.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.594+0000 7fbf02000640 1 --2- 172.21.15.133:0/3655221722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbefc15cac0 0x7fbefc160670 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbefc06c230 tx=0x7fbef002b8d0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.594+0000 7fbf02000640 1 -- 172.21.15.133:0/3655221722 shutdown_connections 2024-03-30T01:52:25.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.594+0000 7fbf02000640 1 --2- 172.21.15.133:0/3655221722 >> v2:172.21.15.137:3300/0 conn(0x7fbefc160bb0 0x7fbefc0cd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.594+0000 7fbf02000640 1 --2- 172.21.15.133:0/3655221722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbefc15cac0 0x7fbefc160670 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.594+0000 7fbf02000640 1 -- 172.21.15.133:0/3655221722 >> 172.21.15.133:0/3655221722 conn(0x7fbefc0cf770 msgr2=0x7fbefc0cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:25.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.594+0000 7fbf02000640 1 -- 172.21.15.133:0/3655221722 shutdown_connections 2024-03-30T01:52:25.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.594+0000 7fbf02000640 1 -- 172.21.15.133:0/3655221722 wait complete. 2024-03-30T01:52:25.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.596+0000 7fbf02000640 1 Processor -- start 2024-03-30T01:52:25.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.596+0000 7fbf02000640 1 -- start start 2024-03-30T01:52:25.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.597+0000 7fbf02000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbefc0cdbe0 0x7fbefc153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:25.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.597+0000 7fbf02000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbefc15cac0 0x7fbefc0b6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:25.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.597+0000 7fbf02000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbefc160bb0 0x7fbefc1509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:25.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.597+0000 7fbf02000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc156310 con 0x7fbefc15cac0 2024-03-30T01:52:25.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.597+0000 7fbf02000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc1f3420 con 0x7fbefc0cdbe0 2024-03-30T01:52:25.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.597+0000 7fbf02000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc1f28a0 con 0x7fbefc160bb0 2024-03-30T01:52:25.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.597+0000 7fbefbe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbefc15cac0 0x7fbefc0b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:25.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.597+0000 7fbefbe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbefc15cac0 0x7fbefc0b6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38548/0 (socket says 172.21.15.133:38548) 2024-03-30T01:52:25.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.597+0000 7fbefbe00640 1 -- 172.21.15.133:0/1887273722 learned_addr learned my addr 172.21.15.133:0/1887273722 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:25.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.598+0000 7fbf00c00640 1 --2- 172.21.15.133:0/1887273722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbefc0cdbe0 0x7fbefc153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:25.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.598+0000 7fbefbe00640 1 -- 172.21.15.133:0/1887273722 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbefc160bb0 msgr2=0x7fbefc1509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:25.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.598+0000 7fbefbe00640 1 --2- 172.21.15.133:0/1887273722 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbefc160bb0 0x7fbefc1509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.598+0000 7fbefbe00640 1 -- 172.21.15.133:0/1887273722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbefc0cdbe0 msgr2=0x7fbefc153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:25.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.598+0000 7fbefbe00640 1 --2- 172.21.15.133:0/1887273722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbefc0cdbe0 0x7fbefc153a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.598+0000 7fbefbe00640 1 -- 172.21.15.133:0/1887273722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef0009400 con 0x7fbefc15cac0 2024-03-30T01:52:25.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.598+0000 7fbefbe00640 1 --2- 172.21.15.133:0/1887273722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbefc15cac0 0x7fbefc0b6210 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbee800c820 tx=0x7fbee800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:25.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.598+0000 7fbef8c00640 1 -- 172.21.15.133:0/1887273722 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee8007a30 con 0x7fbefc15cac0 2024-03-30T01:52:25.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.598+0000 7fbef8c00640 1 -- 172.21.15.133:0/1887273722 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee8007b90 con 0x7fbefc15cac0 2024-03-30T01:52:25.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.598+0000 7fbf02000640 1 -- 172.21.15.133:0/1887273722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbefc15d020 con 0x7fbefc15cac0 2024-03-30T01:52:25.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.598+0000 7fbef8c00640 1 -- 172.21.15.133:0/1887273722 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee800ce10 con 0x7fbefc15cac0 2024-03-30T01:52:25.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.598+0000 7fbf02000640 1 -- 172.21.15.133:0/1887273722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbefc1f3140 con 0x7fbefc15cac0 2024-03-30T01:52:25.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.600+0000 7fbf02000640 1 -- 172.21.15.133:0/1887273722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbefc1f2c90 con 0x7fbefc15cac0 2024-03-30T01:52:25.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.601+0000 7fbef8c00640 1 -- 172.21.15.133:0/1887273722 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fbee80113f0 con 0x7fbefc15cac0 2024-03-30T01:52:25.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.601+0000 7fbef8c00640 1 --2- 172.21.15.133:0/1887273722 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbedc06ac00 0x7fbedc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:25.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.602+0000 7fbef8c00640 1 -- 172.21.15.133:0/1887273722 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fbee80894e0 con 0x7fbefc15cac0 2024-03-30T01:52:25.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.602+0000 7fbf00c00640 1 --2- 172.21.15.133:0/1887273722 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbedc06ac00 0x7fbedc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:25.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.603+0000 7fbf00c00640 1 --2- 172.21.15.133:0/1887273722 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbedc06ac00 0x7fbedc06d0c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbef0036000 tx=0x7fbef0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:25.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.606+0000 7fbef8c00640 1 -- 172.21.15.133:0/1887273722 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fbee8054630 con 0x7fbefc15cac0 2024-03-30T01:52:25.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.809+0000 7fbf02000640 1 -- 172.21.15.133:0/1887273722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbefc073750 con 0x7fbefc15cac0 2024-03-30T01:52:25.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.810+0000 7fbef8c00640 1 -- 172.21.15.133:0/1887273722 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbee8057c50 con 0x7fbefc15cac0 2024-03-30T01:52:25.816 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2024-03-30T01:52:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.812+0000 7fbf02000640 1 -- 172.21.15.133:0/1887273722 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbedc06ac00 msgr2=0x7fbedc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.812+0000 7fbf02000640 1 --2- 172.21.15.133:0/1887273722 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbedc06ac00 0x7fbedc06d0c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbef0036000 tx=0x7fbef0008030 comp rx=0 tx=0).stop 2024-03-30T01:52:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.812+0000 7fbf02000640 1 -- 172.21.15.133:0/1887273722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbefc15cac0 msgr2=0x7fbefc0b6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.812+0000 7fbf02000640 1 --2- 172.21.15.133:0/1887273722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbefc15cac0 0x7fbefc0b6210 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbee800c820 tx=0x7fbee800cce0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.812+0000 7fbf02000640 1 -- 172.21.15.133:0/1887273722 shutdown_connections 2024-03-30T01:52:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.812+0000 7fbf02000640 1 --2- 172.21.15.133:0/1887273722 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbedc06ac00 0x7fbedc06d0c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.812+0000 7fbf02000640 1 --2- 172.21.15.133:0/1887273722 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbefc160bb0 0x7fbefc1509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.812+0000 7fbf02000640 1 --2- 172.21.15.133:0/1887273722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbefc15cac0 0x7fbefc0b6210 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.812+0000 7fbf02000640 1 --2- 172.21.15.133:0/1887273722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbefc0cdbe0 0x7fbefc153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.812+0000 7fbf02000640 1 -- 172.21.15.133:0/1887273722 >> 172.21.15.133:0/1887273722 conn(0x7fbefc0cf770 msgr2=0x7fbefc0d2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.812+0000 7fbf02000640 1 -- 172.21.15.133:0/1887273722 shutdown_connections 2024-03-30T01:52:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:25.812+0000 7fbf02000640 1 -- 172.21.15.133:0/1887273722 wait complete. 2024-03-30T01:52:25.837 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-03-30T01:52:25.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:25.837 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-03-30T01:52:25.931 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2024-03-30T01:52:25.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:25.932 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-30T01:52:25.982 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:52:25.982 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:52:26.038 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:52:26.039 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:52:26.094 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:52:26.094 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:52:26.148 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:52:26.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.354+0000 7f7139200640 1 Processor -- start 2024-03-30T01:52:26.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.354+0000 7f7139200640 1 -- start start 2024-03-30T01:52:26.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.356+0000 7f7139200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f713415cc50 0x7f71340d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:26.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.356+0000 7f7139200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713415d030 con 0x7f71340cfb80 2024-03-30T01:52:26.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.356+0000 7f7139200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71340b5af0 con 0x7f71340d2240 2024-03-30T01:52:26.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.356+0000 7f7139200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71340d1c50 con 0x7f713415cc50 2024-03-30T01:52:26.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.356+0000 7f7132800640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f71340cfb80 0x7f71340b14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58650/0 (socket says 172.21.15.133:58650) 2024-03-30T01:52:26.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.356+0000 7f7132800640 1 -- 172.21.15.133:0/1871874851 learned_addr learned my addr 172.21.15.133:0/1871874851 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:26.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.357+0000 7f7130a00640 1 -- 172.21.15.133:0/1871874851 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416858537 0 0) 0x7f713415d030 con 0x7f71340cfb80 2024-03-30T01:52:26.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.357+0000 7f7130a00640 1 -- 172.21.15.133:0/1871874851 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7114003520 con 0x7f71340cfb80 2024-03-30T01:52:26.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.357+0000 7f7131e00640 1 --2- 172.21.15.133:0/1871874851 >> v2:172.21.15.137:3300/0 conn(0x7f713415cc50 0x7f71340d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:26.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.357+0000 7f7130a00640 1 -- 172.21.15.133:0/1871874851 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2955060562 0 0) 0x7f7114003520 con 0x7f71340cfb80 2024-03-30T01:52:26.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.357+0000 7f7130a00640 1 -- 172.21.15.133:0/1871874851 >> v2:172.21.15.137:3300/0 conn(0x7f713415cc50 msgr2=0x7f71340d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:26.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.357+0000 7f7130a00640 1 --2- 172.21.15.133:0/1871874851 >> v2:172.21.15.137:3300/0 conn(0x7f713415cc50 0x7f71340d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:26.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.357+0000 7f7130a00640 1 -- 172.21.15.133:0/1871874851 >> v1:172.21.15.137:6789/0 conn(0x7f71340d2240 legacy=0x7f71340cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:26.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.357+0000 7f7130a00640 1 -- 172.21.15.133:0/1871874851 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71340d10d0 con 0x7f71340cfb80 2024-03-30T01:52:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.357+0000 7f7130a00640 1 -- 172.21.15.133:0/1871874851 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f712c001690 con 0x7f71340cfb80 2024-03-30T01:52:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.357+0000 7f7130a00640 1 -- 172.21.15.133:0/1871874851 >> v1:172.21.15.133:6789/0 conn(0x7f71340cfb80 legacy=0x7f71340b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.357+0000 7f7130a00640 1 --2- 172.21.15.133:0/1871874851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003970 0x7f7114003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.357+0000 7f7130a00640 1 --2- 172.21.15.133:0/1871874851 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71140047c0 0x7f7114004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.357+0000 7f7130a00640 1 --2- 172.21.15.133:0/1871874851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7114005180 0x7f711400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.357+0000 7f7130a00640 1 -- 172.21.15.133:0/1871874851 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71340d1c50 con 0x7f7114003970 2024-03-30T01:52:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.357+0000 7f7130a00640 1 -- 172.21.15.133:0/1871874851 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711400c0d0 con 0x7f7114005180 2024-03-30T01:52:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.357+0000 7f7130a00640 1 -- 172.21.15.133:0/1871874851 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711400c290 con 0x7f71140047c0 2024-03-30T01:52:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.357+0000 7f7131e00640 1 --2- 172.21.15.133:0/1871874851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003970 0x7f7114003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.358+0000 7f7131e00640 1 -- 172.21.15.133:0/1871874851 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71140047c0 msgr2=0x7f7114004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.358+0000 7f7131e00640 1 --2- 172.21.15.133:0/1871874851 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71140047c0 0x7f7114004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.358+0000 7f7131e00640 1 -- 172.21.15.133:0/1871874851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7114005180 msgr2=0x7f711400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.358+0000 7f7131e00640 1 --2- 172.21.15.133:0/1871874851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7114005180 0x7f711400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.358+0000 7f7131e00640 1 -- 172.21.15.133:0/1871874851 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7114003520 con 0x7f7114003970 2024-03-30T01:52:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.358+0000 7f7132800640 1 -- 172.21.15.133:0/1871874851 reap_dead start 2024-03-30T01:52:26.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.359+0000 7f7131e00640 1 --2- 172.21.15.133:0/1871874851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003970 0x7f7114003d90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f712400ba30 tx=0x7f71140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c6477383e26f73 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:26.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.359+0000 7f7130a00640 1 -- 172.21.15.133:0/1871874851 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7124032680 con 0x7f7114003970 2024-03-30T01:52:26.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.359+0000 7f7130a00640 1 -- 172.21.15.133:0/1871874851 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71240327e0 con 0x7f7114003970 2024-03-30T01:52:26.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.359+0000 7f7130a00640 1 -- 172.21.15.133:0/1871874851 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7124032b70 con 0x7f7114003970 2024-03-30T01:52:26.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.360+0000 7f7139200640 1 -- 172.21.15.133:0/1871874851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003970 msgr2=0x7f7114003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:26.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.360+0000 7f7139200640 1 --2- 172.21.15.133:0/1871874851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003970 0x7f7114003d90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f712400ba30 tx=0x7f71140057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:26.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.360+0000 7f7139200640 1 -- 172.21.15.133:0/1871874851 shutdown_connections 2024-03-30T01:52:26.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.360+0000 7f7139200640 1 --2- 172.21.15.133:0/1871874851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003970 0x7f7114003d90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:26.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.360+0000 7f7139200640 1 -- 172.21.15.133:0/1871874851 >> 172.21.15.133:0/1871874851 conn(0x7f7134071a40 msgr2=0x7f713406b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:26.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.360+0000 7f7139200640 1 -- 172.21.15.133:0/1871874851 shutdown_connections 2024-03-30T01:52:26.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.360+0000 7f7139200640 1 -- 172.21.15.133:0/1871874851 wait complete. 2024-03-30T01:52:26.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.362+0000 7f7139200640 1 Processor -- start 2024-03-30T01:52:26.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.362+0000 7f7139200640 1 -- start start 2024-03-30T01:52:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.363+0000 7f7139200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7114003970 0x7f713414d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.363+0000 7f7139200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7134155420 0x7f71341f2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.363+0000 7f7139200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f713415ef50 0x7f713415f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.363+0000 7f7139200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71341f34d0 con 0x7f7134155420 2024-03-30T01:52:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.363+0000 7f7139200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713415f910 con 0x7f7114003970 2024-03-30T01:52:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.363+0000 7f7139200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713415d4c0 con 0x7f713415ef50 2024-03-30T01:52:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.363+0000 7f7131400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7134155420 0x7f71341f2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.363+0000 7f7131400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7134155420 0x7f71341f2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47620/0 (socket says 172.21.15.133:47620) 2024-03-30T01:52:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.363+0000 7f7131400640 1 -- 172.21.15.133:0/1308671308 learned_addr learned my addr 172.21.15.133:0/1308671308 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.363+0000 7f7131e00640 1 --2- 172.21.15.133:0/1308671308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7114003970 0x7f713414d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.363+0000 7f7132800640 1 --2- 172.21.15.133:0/1308671308 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f713415ef50 0x7f713415f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.363+0000 7f7131400640 1 -- 172.21.15.133:0/1308671308 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f713415ef50 msgr2=0x7f713415f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:26.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.363+0000 7f7131400640 1 --2- 172.21.15.133:0/1308671308 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f713415ef50 0x7f713415f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:26.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.364+0000 7f7131400640 1 -- 172.21.15.133:0/1308671308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7114003970 msgr2=0x7f713414d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:26.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.364+0000 7f7131400640 1 --2- 172.21.15.133:0/1308671308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7114003970 0x7f713414d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:26.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.364+0000 7f7131400640 1 -- 172.21.15.133:0/1308671308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713415d710 con 0x7f7134155420 2024-03-30T01:52:26.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.364+0000 7f7131e00640 1 --2- 172.21.15.133:0/1308671308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7114003970 0x7f713414d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:26.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.364+0000 7f7131400640 1 --2- 172.21.15.133:0/1308671308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7134155420 0x7f71341f2f90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f711c00c6c0 tx=0x7f711c00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:26.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.364+0000 7f712a000640 1 -- 172.21.15.133:0/1308671308 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c003b70 con 0x7f7134155420 2024-03-30T01:52:26.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.364+0000 7f712a000640 1 -- 172.21.15.133:0/1308671308 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c003cd0 con 0x7f7134155420 2024-03-30T01:52:26.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.364+0000 7f712a000640 1 -- 172.21.15.133:0/1308671308 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c005310 con 0x7f7134155420 2024-03-30T01:52:26.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.364+0000 7f7139200640 1 -- 172.21.15.133:0/1308671308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713415d9f0 con 0x7f7134155420 2024-03-30T01:52:26.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.364+0000 7f7139200640 1 -- 172.21.15.133:0/1308671308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713415dfb0 con 0x7f7134155420 2024-03-30T01:52:26.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.365+0000 7f7139200640 1 -- 172.21.15.133:0/1308671308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71341600f0 con 0x7f7134155420 2024-03-30T01:52:26.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.366+0000 7f712a000640 1 -- 172.21.15.133:0/1308671308 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f711c005470 con 0x7f7134155420 2024-03-30T01:52:26.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.367+0000 7f712a000640 1 --2- 172.21.15.133:0/1308671308 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f711006ac30 0x7f711006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:26.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.367+0000 7f712a000640 1 -- 172.21.15.133:0/1308671308 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f711c089170 con 0x7f7134155420 2024-03-30T01:52:26.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.367+0000 7f7131e00640 1 --2- 172.21.15.133:0/1308671308 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f711006ac30 0x7f711006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:26.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.368+0000 7f7131e00640 1 --2- 172.21.15.133:0/1308671308 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f711006ac30 0x7f711006d0f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f712400ba00 tx=0x7f712403d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:26.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.371+0000 7f712a000640 1 -- 172.21.15.133:0/1308671308 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f711c0542c0 con 0x7f7134155420 2024-03-30T01:52:26.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.565+0000 7f7139200640 1 -- 172.21.15.133:0/1308671308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7134066d80 con 0x7f7134155420 2024-03-30T01:52:26.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.567+0000 7f712a000640 1 -- 172.21.15.133:0/1308671308 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16335 (secure 0 0 0) 0x7f711c0578e0 con 0x7f7134155420 2024-03-30T01:52:26.574 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:26.574 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:52:15.520675+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:51:31.245378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T01:51:31.774247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:52:26.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.570+0000 7f7139200640 1 -- 172.21.15.133:0/1308671308 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f711006ac30 msgr2=0x7f711006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:26.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.570+0000 7f7139200640 1 --2- 172.21.15.133:0/1308671308 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f711006ac30 0x7f711006d0f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f712400ba00 tx=0x7f712403d040 comp rx=0 tx=0).stop 2024-03-30T01:52:26.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.570+0000 7f7139200640 1 -- 172.21.15.133:0/1308671308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7134155420 msgr2=0x7f71341f2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:26.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.570+0000 7f7139200640 1 --2- 172.21.15.133:0/1308671308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7134155420 0x7f71341f2f90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f711c00c6c0 tx=0x7f711c00cb80 comp rx=0 tx=0).stop 2024-03-30T01:52:26.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.570+0000 7f7139200640 1 -- 172.21.15.133:0/1308671308 shutdown_connections 2024-03-30T01:52:26.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.570+0000 7f7139200640 1 --2- 172.21.15.133:0/1308671308 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f711006ac30 0x7f711006d0f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:26.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.570+0000 7f7139200640 1 --2- 172.21.15.133:0/1308671308 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f713415ef50 0x7f713415f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:26.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.570+0000 7f7139200640 1 --2- 172.21.15.133:0/1308671308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7134155420 0x7f71341f2f90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:26.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.570+0000 7f7139200640 1 --2- 172.21.15.133:0/1308671308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7114003970 0x7f713414d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:26.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.570+0000 7f7139200640 1 -- 172.21.15.133:0/1308671308 >> 172.21.15.133:0/1308671308 conn(0x7f7134071a40 msgr2=0x7f71340732c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:26.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.571+0000 7f7139200640 1 -- 172.21.15.133:0/1308671308 shutdown_connections 2024-03-30T01:52:26.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.571+0000 7f7139200640 1 -- 172.21.15.133:0/1308671308 wait complete. 2024-03-30T01:52:26.594 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T01:51:21.771393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T01:51:31.245378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T01:51:31.774247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T01:52:26.595 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T01:52:26.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.801+0000 7f8531e00640 1 Processor -- start 2024-03-30T01:52:26.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.801+0000 7f8531e00640 1 -- start start 2024-03-30T01:52:26.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.803+0000 7f8531e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f852c145d30 0x7f852c070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:26.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.803+0000 7f8531e00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f852c06c320 con 0x7f852c070a40 2024-03-30T01:52:26.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.803+0000 7f8531e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f852c06c600 con 0x7f852c1457b0 2024-03-30T01:52:26.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.803+0000 7f8531e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f852c070ed0 con 0x7f852c145d30 2024-03-30T01:52:26.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.803+0000 7f8523e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f852c145d30 0x7f852c070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:26.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.803+0000 7f8523e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f852c145d30 0x7f852c070500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47630/0 (socket says 172.21.15.133:47630) 2024-03-30T01:52:26.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.803+0000 7f8523e00640 1 -- 172.21.15.133:0/3766845772 learned_addr learned my addr 172.21.15.133:0/3766845772 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:26.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.804+0000 7f8523e00640 1 -- 172.21.15.133:0/3766845772 >> v1:172.21.15.137:6789/0 conn(0x7f852c1457b0 legacy=0x7f852c0b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:26.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.804+0000 7f8523e00640 1 -- 172.21.15.133:0/3766845772 >> v1:172.21.15.133:6789/0 conn(0x7f852c070a40 legacy=0x7f852c0b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:26.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.804+0000 7f852a000640 1 -- 172.21.15.133:0/3766845772 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195361733 0 0) 0x7f852c06c320 con 0x7f852c070a40 2024-03-30T01:52:26.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.804+0000 7f8523e00640 1 -- 172.21.15.133:0/3766845772 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852c06c8e0 con 0x7f852c145d30 2024-03-30T01:52:26.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.805+0000 7f8523e00640 1 --2- 172.21.15.133:0/3766845772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f852c145d30 0x7f852c070500 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8514009870 tx=0x7f851402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27d067a12781822 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:26.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.805+0000 7f852a000640 1 -- 172.21.15.133:0/3766845772 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851402f840 con 0x7f852c145d30 2024-03-30T01:52:26.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.805+0000 7f852a000640 1 -- 172.21.15.133:0/3766845772 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851402f9a0 con 0x7f852c145d30 2024-03-30T01:52:26.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.805+0000 7f852a000640 1 -- 172.21.15.133:0/3766845772 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851402fd30 con 0x7f852c145d30 2024-03-30T01:52:26.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.806+0000 7f8531e00640 1 -- 172.21.15.133:0/3766845772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f852c145d30 msgr2=0x7f852c070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:26.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.806+0000 7f8531e00640 1 --2- 172.21.15.133:0/3766845772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f852c145d30 0x7f852c070500 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8514009870 tx=0x7f851402ba20 comp rx=0 tx=0).stop 2024-03-30T01:52:26.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.806+0000 7f8531e00640 1 -- 172.21.15.133:0/3766845772 shutdown_connections 2024-03-30T01:52:26.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.806+0000 7f8531e00640 1 --2- 172.21.15.133:0/3766845772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f852c145d30 0x7f852c070500 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:26.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.806+0000 7f8531e00640 1 -- 172.21.15.133:0/3766845772 >> 172.21.15.133:0/3766845772 conn(0x7f852c0b07a0 msgr2=0x7f852c0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:26.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.806+0000 7f8531e00640 1 -- 172.21.15.133:0/3766845772 shutdown_connections 2024-03-30T01:52:26.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.806+0000 7f8531e00640 1 -- 172.21.15.133:0/3766845772 wait complete. 2024-03-30T01:52:26.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.808+0000 7f8531e00640 1 Processor -- start 2024-03-30T01:52:26.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.808+0000 7f8531e00640 1 -- start start 2024-03-30T01:52:26.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.809+0000 7f8531e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f852c070a40 0x7f852c13a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:26.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.809+0000 7f8531e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f852c1457b0 0x7f852c0cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:26.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.809+0000 7f8531e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f852c145d30 0x7f852c13f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:26.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.809+0000 7f8531e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852c13aad0 con 0x7f852c1457b0 2024-03-30T01:52:26.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.809+0000 7f8531e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852c160350 con 0x7f852c070a40 2024-03-30T01:52:26.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.809+0000 7f8531e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852c15fd90 con 0x7f852c145d30 2024-03-30T01:52:26.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.809+0000 7f8523e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f852c1457b0 0x7f852c0cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:26.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.809+0000 7f8523e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f852c1457b0 0x7f852c0cdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47644/0 (socket says 172.21.15.133:47644) 2024-03-30T01:52:26.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.809+0000 7f8523e00640 1 -- 172.21.15.133:0/3650395847 learned_addr learned my addr 172.21.15.133:0/3650395847 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:26.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.809+0000 7f852aa00640 1 --2- 172.21.15.133:0/3650395847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f852c070a40 0x7f852c13a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:26.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.810+0000 7f8523e00640 1 -- 172.21.15.133:0/3650395847 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f852c145d30 msgr2=0x7f852c13f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:26.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.810+0000 7f8523e00640 1 --2- 172.21.15.133:0/3650395847 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f852c145d30 0x7f852c13f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:26.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.810+0000 7f8523e00640 1 -- 172.21.15.133:0/3650395847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f852c070a40 msgr2=0x7f852c13a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:26.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.810+0000 7f8523e00640 1 --2- 172.21.15.133:0/3650395847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f852c070a40 0x7f852c13a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:26.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.810+0000 7f8523e00640 1 -- 172.21.15.133:0/3650395847 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85140094d0 con 0x7f852c1457b0 2024-03-30T01:52:26.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.810+0000 7f8523e00640 1 --2- 172.21.15.133:0/3650395847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f852c1457b0 0x7f852c0cdac0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8514009870 tx=0x7f8514004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:26.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.810+0000 7f8523400640 1 -- 172.21.15.133:0/3650395847 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851402f7f0 con 0x7f852c1457b0 2024-03-30T01:52:26.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.810+0000 7f8523400640 1 -- 172.21.15.133:0/3650395847 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8514041400 con 0x7f852c1457b0 2024-03-30T01:52:26.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.810+0000 7f8523400640 1 -- 172.21.15.133:0/3650395847 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85140417b0 con 0x7f852c1457b0 2024-03-30T01:52:26.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.810+0000 7f8531e00640 1 -- 172.21.15.133:0/3650395847 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f852c160070 con 0x7f852c1457b0 2024-03-30T01:52:26.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.811+0000 7f8531e00640 1 -- 172.21.15.133:0/3650395847 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852c13f010 con 0x7f852c1457b0 2024-03-30T01:52:26.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.812+0000 7f8531e00640 1 -- 172.21.15.133:0/3650395847 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f852c066d80 con 0x7f852c1457b0 2024-03-30T01:52:26.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.812+0000 7f8523400640 1 -- 172.21.15.133:0/3650395847 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f8514041910 con 0x7f852c1457b0 2024-03-30T01:52:26.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.813+0000 7f8523400640 1 --2- 172.21.15.133:0/3650395847 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f850806ac00 0x7f850806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:26.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.813+0000 7f8523400640 1 -- 172.21.15.133:0/3650395847 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f851403c070 con 0x7f852c1457b0 2024-03-30T01:52:26.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.814+0000 7f852aa00640 1 --2- 172.21.15.133:0/3650395847 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f850806ac00 0x7f850806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:26.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.814+0000 7f852aa00640 1 --2- 172.21.15.133:0/3650395847 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f850806ac00 0x7f850806d0c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f851c000f60 tx=0x7f851c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:26.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:26.818+0000 7f8523400640 1 -- 172.21.15.133:0/3650395847 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f8514077500 con 0x7f852c1457b0 2024-03-30T01:52:27.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.009+0000 7f8531e00640 1 -- 172.21.15.133:0/3650395847 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f852c0cae30 con 0x7f852c1457b0 2024-03-30T01:52:27.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.010+0000 7f8523400640 1 -- 172.21.15.133:0/3650395847 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f851407ab20 con 0x7f852c1457b0 2024-03-30T01:52:27.016 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-03-30T01:52:27.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.012+0000 7f8531e00640 1 -- 172.21.15.133:0/3650395847 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f850806ac00 msgr2=0x7f850806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:27.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.012+0000 7f8531e00640 1 --2- 172.21.15.133:0/3650395847 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f850806ac00 0x7f850806d0c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f851c000f60 tx=0x7f851c009040 comp rx=0 tx=0).stop 2024-03-30T01:52:27.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.012+0000 7f8531e00640 1 -- 172.21.15.133:0/3650395847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f852c1457b0 msgr2=0x7f852c0cdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:27.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.012+0000 7f8531e00640 1 --2- 172.21.15.133:0/3650395847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f852c1457b0 0x7f852c0cdac0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8514009870 tx=0x7f8514004730 comp rx=0 tx=0).stop 2024-03-30T01:52:27.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.012+0000 7f8531e00640 1 -- 172.21.15.133:0/3650395847 shutdown_connections 2024-03-30T01:52:27.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.012+0000 7f8531e00640 1 --2- 172.21.15.133:0/3650395847 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f850806ac00 0x7f850806d0c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.012+0000 7f8531e00640 1 --2- 172.21.15.133:0/3650395847 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f852c145d30 0x7f852c13f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.012+0000 7f8531e00640 1 --2- 172.21.15.133:0/3650395847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f852c1457b0 0x7f852c0cdac0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.012+0000 7f8531e00640 1 --2- 172.21.15.133:0/3650395847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f852c070a40 0x7f852c13a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.012+0000 7f8531e00640 1 -- 172.21.15.133:0/3650395847 >> 172.21.15.133:0/3650395847 conn(0x7f852c0b07a0 msgr2=0x7f852c0b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:27.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.013+0000 7f8531e00640 1 -- 172.21.15.133:0/3650395847 shutdown_connections 2024-03-30T01:52:27.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.013+0000 7f8531e00640 1 -- 172.21.15.133:0/3650395847 wait complete. 2024-03-30T01:52:27.037 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T01:52:27.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.238+0000 7fc705200640 1 Processor -- start 2024-03-30T01:52:27.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.238+0000 7fc705200640 1 -- start start 2024-03-30T01:52:27.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.240+0000 7fc705200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc700070c10 0x7fc700164740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:27.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.240+0000 7fc705200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7000ce400 con 0x7fc70006e2e0 2024-03-30T01:52:27.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.240+0000 7fc705200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc70006d0e0 con 0x7fc700143220 2024-03-30T01:52:27.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.240+0000 7fc705200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7000cc5c0 con 0x7fc700070c10 2024-03-30T01:52:27.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.240+0000 7fc6fd400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc70006e2e0 0x7fc700070500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58666/0 (socket says 172.21.15.133:58666) 2024-03-30T01:52:27.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.240+0000 7fc6fd400640 1 -- 172.21.15.133:0/3201130086 learned_addr learned my addr 172.21.15.133:0/3201130086 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:27.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.240+0000 7fc6fca00640 1 -- 172.21.15.133:0/3201130086 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2333434883 0 0) 0x7fc7000ce400 con 0x7fc70006e2e0 2024-03-30T01:52:27.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.240+0000 7fc6fca00640 1 -- 172.21.15.133:0/3201130086 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6e4003520 con 0x7fc70006e2e0 2024-03-30T01:52:27.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.240+0000 7fc6fe800640 1 --2- 172.21.15.133:0/3201130086 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc700070c10 0x7fc700164740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:27.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.241+0000 7fc6fca00640 1 -- 172.21.15.133:0/3201130086 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2815074861 0 0) 0x7fc6e4003520 con 0x7fc70006e2e0 2024-03-30T01:52:27.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.241+0000 7fc6fca00640 1 -- 172.21.15.133:0/3201130086 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc700070c10 msgr2=0x7fc700164740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:27.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.241+0000 7fc6fca00640 1 --2- 172.21.15.133:0/3201130086 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc700070c10 0x7fc700164740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.241+0000 7fc6fca00640 1 -- 172.21.15.133:0/3201130086 >> v1:172.21.15.137:6789/0 conn(0x7fc700143220 legacy=0x7fc7000cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:27.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.241+0000 7fc6fca00640 1 -- 172.21.15.133:0/3201130086 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70006d3c0 con 0x7fc70006e2e0 2024-03-30T01:52:27.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.241+0000 7fc6fca00640 1 -- 172.21.15.133:0/3201130086 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fc6e8001690 con 0x7fc70006e2e0 2024-03-30T01:52:27.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.241+0000 7fc6fca00640 1 -- 172.21.15.133:0/3201130086 >> v1:172.21.15.133:6789/0 conn(0x7fc70006e2e0 legacy=0x7fc700070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:27.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.241+0000 7fc6fca00640 1 --2- 172.21.15.133:0/3201130086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e40039a0 0x7fc6e4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:27.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.241+0000 7fc6fca00640 1 --2- 172.21.15.133:0/3201130086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6e40047c0 0x7fc6e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:27.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.241+0000 7fc6fca00640 1 --2- 172.21.15.133:0/3201130086 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc700070c10 0x7fc6e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:27.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.241+0000 7fc6fca00640 1 -- 172.21.15.133:0/3201130086 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e400bab0 con 0x7fc6e40039a0 2024-03-30T01:52:27.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.241+0000 7fc6fca00640 1 -- 172.21.15.133:0/3201130086 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e400bc20 con 0x7fc6e40047c0 2024-03-30T01:52:27.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.241+0000 7fc6fca00640 1 -- 172.21.15.133:0/3201130086 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e400bde0 con 0x7fc700070c10 2024-03-30T01:52:27.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.241+0000 7fc6fde00640 1 --2- 172.21.15.133:0/3201130086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e40039a0 0x7fc6e4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:27.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.242+0000 7fc6fd400640 1 --2- 172.21.15.133:0/3201130086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6e40047c0 0x7fc6e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:27.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.242+0000 7fc6fe800640 1 --2- 172.21.15.133:0/3201130086 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc700070c10 0x7fc6e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:27.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.242+0000 7fc6fde00640 1 -- 172.21.15.133:0/3201130086 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc700070c10 msgr2=0x7fc6e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:27.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.242+0000 7fc6fde00640 1 --2- 172.21.15.133:0/3201130086 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc700070c10 0x7fc6e40051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.242+0000 7fc6fde00640 1 -- 172.21.15.133:0/3201130086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6e40047c0 msgr2=0x7fc6e4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:27.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.242+0000 7fc6fde00640 1 --2- 172.21.15.133:0/3201130086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6e40047c0 0x7fc6e4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.242+0000 7fc6fde00640 1 -- 172.21.15.133:0/3201130086 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e4003520 con 0x7fc6e40039a0 2024-03-30T01:52:27.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.242+0000 7fc6fd400640 1 --2- 172.21.15.133:0/3201130086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6e40047c0 0x7fc6e4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:27.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.243+0000 7fc6fde00640 1 --2- 172.21.15.133:0/3201130086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e40039a0 0x7fc6e4003dc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0001330 tx=0x7fc6e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848820d7f82ca8d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:27.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.243+0000 7fc6fca00640 1 -- 172.21.15.133:0/3201130086 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f00052d0 con 0x7fc6e40039a0 2024-03-30T01:52:27.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.243+0000 7fc6fca00640 1 -- 172.21.15.133:0/3201130086 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f0005430 con 0x7fc6e40039a0 2024-03-30T01:52:27.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.243+0000 7fc6fca00640 1 -- 172.21.15.133:0/3201130086 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0003830 con 0x7fc6e40039a0 2024-03-30T01:52:27.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.244+0000 7fc705200640 1 -- 172.21.15.133:0/3201130086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e40039a0 msgr2=0x7fc6e4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:27.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.244+0000 7fc705200640 1 --2- 172.21.15.133:0/3201130086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e40039a0 0x7fc6e4003dc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0001330 tx=0x7fc6e40057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.244+0000 7fc6fe800640 1 -- 172.21.15.133:0/3201130086 reap_dead start 2024-03-30T01:52:27.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.244+0000 7fc705200640 1 -- 172.21.15.133:0/3201130086 shutdown_connections 2024-03-30T01:52:27.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.244+0000 7fc705200640 1 -- 172.21.15.133:0/3201130086 >> 172.21.15.133:0/3201130086 conn(0x7fc7000b07a0 msgr2=0x7fc7000b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:27.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.244+0000 7fc705200640 1 -- 172.21.15.133:0/3201130086 shutdown_connections 2024-03-30T01:52:27.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.244+0000 7fc705200640 1 -- 172.21.15.133:0/3201130086 wait complete. 2024-03-30T01:52:27.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.246+0000 7fc705200640 1 Processor -- start 2024-03-30T01:52:27.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.246+0000 7fc705200640 1 -- start start 2024-03-30T01:52:27.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.247+0000 7fc705200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6e40039a0 0x7fc7000c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:27.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.247+0000 7fc705200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc700159130 0x7fc7000cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:27.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.247+0000 7fc705200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7000cbaf0 0x7fc7000c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:27.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.247+0000 7fc705200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7000cbf50 con 0x7fc7000cbaf0 2024-03-30T01:52:27.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.247+0000 7fc705200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7000c7c40 con 0x7fc6e40039a0 2024-03-30T01:52:27.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.247+0000 7fc705200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7000c8aa0 con 0x7fc700159130 2024-03-30T01:52:27.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.247+0000 7fc6fe800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7000cbaf0 0x7fc7000c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:27.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.247+0000 7fc6fe800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7000cbaf0 0x7fc7000c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47670/0 (socket says 172.21.15.133:47670) 2024-03-30T01:52:27.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.247+0000 7fc6fe800640 1 -- 172.21.15.133:0/3621010895 learned_addr learned my addr 172.21.15.133:0/3621010895 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:27.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.247+0000 7fc6fde00640 1 --2- 172.21.15.133:0/3621010895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6e40039a0 0x7fc7000c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:27.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.247+0000 7fc6fe800640 1 -- 172.21.15.133:0/3621010895 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc700159130 msgr2=0x7fc7000cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:27.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.247+0000 7fc6fe800640 1 --2- 172.21.15.133:0/3621010895 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc700159130 0x7fc7000cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.247+0000 7fc6fe800640 1 -- 172.21.15.133:0/3621010895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6e40039a0 msgr2=0x7fc7000c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:27.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.247+0000 7fc6fe800640 1 --2- 172.21.15.133:0/3621010895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6e40039a0 0x7fc7000c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.247+0000 7fc6fe800640 1 -- 172.21.15.133:0/3621010895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7000c7e90 con 0x7fc7000cbaf0 2024-03-30T01:52:27.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.247+0000 7fc6fde00640 1 --2- 172.21.15.133:0/3621010895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6e40039a0 0x7fc7000c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:27.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.248+0000 7fc6fe800640 1 --2- 172.21.15.133:0/3621010895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7000cbaf0 0x7fc7000c9740 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc7000b1970 tx=0x7fc6f8009d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:27.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.248+0000 7fc6f6000640 1 -- 172.21.15.133:0/3621010895 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8007d20 con 0x7fc7000cbaf0 2024-03-30T01:52:27.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.248+0000 7fc6f6000640 1 -- 172.21.15.133:0/3621010895 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f8014400 con 0x7fc7000cbaf0 2024-03-30T01:52:27.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.248+0000 7fc6f6000640 1 -- 172.21.15.133:0/3621010895 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8007ea0 con 0x7fc7000cbaf0 2024-03-30T01:52:27.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.248+0000 7fc705200640 1 -- 172.21.15.133:0/3621010895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7000c8170 con 0x7fc7000cbaf0 2024-03-30T01:52:27.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.248+0000 7fc705200640 1 -- 172.21.15.133:0/3621010895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7000c8730 con 0x7fc7000cbaf0 2024-03-30T01:52:27.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.249+0000 7fc705200640 1 -- 172.21.15.133:0/3621010895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc700066d80 con 0x7fc7000cbaf0 2024-03-30T01:52:27.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.250+0000 7fc6f6000640 1 -- 172.21.15.133:0/3621010895 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fc6f801d3b0 con 0x7fc7000cbaf0 2024-03-30T01:52:27.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.251+0000 7fc6f6000640 1 --2- 172.21.15.133:0/3621010895 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc6dc06ac00 0x7fc6dc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:27.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.251+0000 7fc6f6000640 1 -- 172.21.15.133:0/3621010895 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc6f8088fc0 con 0x7fc7000cbaf0 2024-03-30T01:52:27.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.251+0000 7fc6fde00640 1 --2- 172.21.15.133:0/3621010895 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc6dc06ac00 0x7fc6dc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:27.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.252+0000 7fc6fde00640 1 --2- 172.21.15.133:0/3621010895 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc6dc06ac00 0x7fc6dc06d0c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0036000 tx=0x7fc6f0009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:27.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.255+0000 7fc6f6000640 1 -- 172.21.15.133:0/3621010895 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fc6f8054120 con 0x7fc7000cbaf0 2024-03-30T01:52:27.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.451+0000 7fc705200640 1 -- 172.21.15.133:0/3621010895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc7001429d0 con 0x7fc7000cbaf0 2024-03-30T01:52:27.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.452+0000 7fc6f6000640 1 -- 172.21.15.133:0/3621010895 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc6f8057740 con 0x7fc7000cbaf0 2024-03-30T01:52:27.458 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-03-30T01:52:27.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.455+0000 7fc705200640 1 -- 172.21.15.133:0/3621010895 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc6dc06ac00 msgr2=0x7fc6dc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:27.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.455+0000 7fc705200640 1 --2- 172.21.15.133:0/3621010895 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc6dc06ac00 0x7fc6dc06d0c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0036000 tx=0x7fc6f0009030 comp rx=0 tx=0).stop 2024-03-30T01:52:27.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.455+0000 7fc705200640 1 -- 172.21.15.133:0/3621010895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7000cbaf0 msgr2=0x7fc7000c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:27.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.455+0000 7fc705200640 1 --2- 172.21.15.133:0/3621010895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7000cbaf0 0x7fc7000c9740 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc7000b1970 tx=0x7fc6f8009d50 comp rx=0 tx=0).stop 2024-03-30T01:52:27.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.455+0000 7fc705200640 1 -- 172.21.15.133:0/3621010895 shutdown_connections 2024-03-30T01:52:27.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.455+0000 7fc705200640 1 --2- 172.21.15.133:0/3621010895 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc6dc06ac00 0x7fc6dc06d0c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.455+0000 7fc705200640 1 --2- 172.21.15.133:0/3621010895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7000cbaf0 0x7fc7000c9740 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.455+0000 7fc705200640 1 --2- 172.21.15.133:0/3621010895 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc700159130 0x7fc7000cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.455+0000 7fc705200640 1 --2- 172.21.15.133:0/3621010895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6e40039a0 0x7fc7000c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.455+0000 7fc705200640 1 -- 172.21.15.133:0/3621010895 >> 172.21.15.133:0/3621010895 conn(0x7fc7000b07a0 msgr2=0x7fc7000b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:27.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.455+0000 7fc705200640 1 -- 172.21.15.133:0/3621010895 shutdown_connections 2024-03-30T01:52:27.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.455+0000 7fc705200640 1 -- 172.21.15.133:0/3621010895 wait complete. 2024-03-30T01:52:27.480 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T01:52:27.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.678+0000 7f71a7c00640 1 Processor -- start 2024-03-30T01:52:27.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.678+0000 7f71a7c00640 1 -- start start 2024-03-30T01:52:27.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.680+0000 7f71a7c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f71a0143790 0x7f71a00cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:27.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.680+0000 7f71a7c00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a00a76a0 con 0x7f71a0070500 2024-03-30T01:52:27.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.680+0000 7f71a7c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a00b38e0 con 0x7f71a00ccc40 2024-03-30T01:52:27.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.680+0000 7f71a7c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a00cd180 con 0x7f71a0143790 2024-03-30T01:52:27.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.680+0000 7f719fe00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f71a0070500 0x7f71a00cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58674/0 (socket says 172.21.15.133:58674) 2024-03-30T01:52:27.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.681+0000 7f719fe00640 1 -- 172.21.15.133:0/3101535627 learned_addr learned my addr 172.21.15.133:0/3101535627 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:27.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.681+0000 7f719f400640 1 -- 172.21.15.133:0/3101535627 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54481172 0 0) 0x7f71a00a76a0 con 0x7f71a0070500 2024-03-30T01:52:27.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.681+0000 7f719f400640 1 -- 172.21.15.133:0/3101535627 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7188003520 con 0x7f71a0070500 2024-03-30T01:52:27.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.681+0000 7f71a5200640 1 --2- 172.21.15.133:0/3101535627 >> v2:172.21.15.137:3300/0 conn(0x7f71a0143790 0x7f71a00cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:27.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.681+0000 7f719f400640 1 -- 172.21.15.133:0/3101535627 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3596281252 0 0) 0x7f7188003520 con 0x7f71a0070500 2024-03-30T01:52:27.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.681+0000 7f719f400640 1 -- 172.21.15.133:0/3101535627 >> v2:172.21.15.137:3300/0 conn(0x7f71a0143790 msgr2=0x7f71a00cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:27.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.681+0000 7f719f400640 1 --2- 172.21.15.133:0/3101535627 >> v2:172.21.15.137:3300/0 conn(0x7f71a0143790 0x7f71a00cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.681+0000 7f719f400640 1 -- 172.21.15.133:0/3101535627 >> v1:172.21.15.137:6789/0 conn(0x7f71a00ccc40 legacy=0x7f71a015ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:27.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.681+0000 7f719f400640 1 -- 172.21.15.133:0/3101535627 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a00cd460 con 0x7f71a0070500 2024-03-30T01:52:27.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.681+0000 7f719f400640 1 -- 172.21.15.133:0/3101535627 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f718c001670 con 0x7f71a0070500 2024-03-30T01:52:27.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.681+0000 7f719f400640 1 -- 172.21.15.133:0/3101535627 >> v1:172.21.15.133:6789/0 conn(0x7f71a0070500 legacy=0x7f71a00cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:27.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.681+0000 7f719f400640 1 --2- 172.21.15.133:0/3101535627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71880039c0 0x7f7188003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:27.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.681+0000 7f719f400640 1 --2- 172.21.15.133:0/3101535627 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71880047c0 0x7f7188004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:27.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.681+0000 7f719f400640 1 --2- 172.21.15.133:0/3101535627 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71880051d0 0x7f718800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:27.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.681+0000 7f719f400640 1 -- 172.21.15.133:0/3101535627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a00cd180 con 0x7f71880039c0 2024-03-30T01:52:27.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.682+0000 7f719f400640 1 -- 172.21.15.133:0/3101535627 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718800c110 con 0x7f71880047c0 2024-03-30T01:52:27.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.682+0000 7f719f400640 1 -- 172.21.15.133:0/3101535627 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718800c2d0 con 0x7f71880051d0 2024-03-30T01:52:27.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.682+0000 7f71a5200640 1 --2- 172.21.15.133:0/3101535627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71880039c0 0x7f7188003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:27.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.682+0000 7f71a5200640 1 -- 172.21.15.133:0/3101535627 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71880051d0 msgr2=0x7f718800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:27.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.682+0000 7f71a5200640 1 --2- 172.21.15.133:0/3101535627 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71880051d0 0x7f718800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.682+0000 7f71a5200640 1 -- 172.21.15.133:0/3101535627 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71880047c0 msgr2=0x7f7188004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:27.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.682+0000 7f71a5200640 1 --2- 172.21.15.133:0/3101535627 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71880047c0 0x7f7188004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.682+0000 7f71a5200640 1 -- 172.21.15.133:0/3101535627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7188003520 con 0x7f71880039c0 2024-03-30T01:52:27.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.682+0000 7f71a5c00640 1 -- 172.21.15.133:0/3101535627 reap_dead start 2024-03-30T01:52:27.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.683+0000 7f71a5200640 1 --2- 172.21.15.133:0/3101535627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71880039c0 0x7f7188003de0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f719400ba30 tx=0x7f71880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4867476847662ced server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:27.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.683+0000 7f719f400640 1 -- 172.21.15.133:0/3101535627 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194032680 con 0x7f71880039c0 2024-03-30T01:52:27.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.683+0000 7f719f400640 1 -- 172.21.15.133:0/3101535627 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71940327e0 con 0x7f71880039c0 2024-03-30T01:52:27.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.683+0000 7f719f400640 1 -- 172.21.15.133:0/3101535627 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194032b70 con 0x7f71880039c0 2024-03-30T01:52:27.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.684+0000 7f71a7c00640 1 -- 172.21.15.133:0/3101535627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71880039c0 msgr2=0x7f7188003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:27.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.684+0000 7f71a7c00640 1 --2- 172.21.15.133:0/3101535627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71880039c0 0x7f7188003de0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f719400ba30 tx=0x7f71880057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.684+0000 7f71a7c00640 1 -- 172.21.15.133:0/3101535627 shutdown_connections 2024-03-30T01:52:27.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.684+0000 7f71a7c00640 1 --2- 172.21.15.133:0/3101535627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71880039c0 0x7f7188003de0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.684+0000 7f71a7c00640 1 -- 172.21.15.133:0/3101535627 >> 172.21.15.133:0/3101535627 conn(0x7f71a00b07a0 msgr2=0x7f71a00b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:27.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.684+0000 7f71a7c00640 1 -- 172.21.15.133:0/3101535627 shutdown_connections 2024-03-30T01:52:27.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.684+0000 7f71a7c00640 1 -- 172.21.15.133:0/3101535627 wait complete. 2024-03-30T01:52:27.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.686+0000 7f71a7c00640 1 Processor -- start 2024-03-30T01:52:27.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.686+0000 7f71a7c00640 1 -- start start 2024-03-30T01:52:27.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.687+0000 7f71a7c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71880039c0 0x7f71a013c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:27.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.687+0000 7f71a7c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71a013ed70 0x7f71a013f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:27.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.687+0000 7f71a7c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71a013d970 0x7f71a013ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:27.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.687+0000 7f71a7c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a013f730 con 0x7f71a013ed70 2024-03-30T01:52:27.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.687+0000 7f71a7c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a01f22a0 con 0x7f71880039c0 2024-03-30T01:52:27.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.687+0000 7f71a7c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a013c780 con 0x7f71a013d970 2024-03-30T01:52:27.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.687+0000 7f719fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71a013ed70 0x7f71a013f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:27.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.687+0000 7f719fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71a013ed70 0x7f71a013f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47694/0 (socket says 172.21.15.133:47694) 2024-03-30T01:52:27.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.687+0000 7f719fe00640 1 -- 172.21.15.133:0/2594019211 learned_addr learned my addr 172.21.15.133:0/2594019211 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:27.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.688+0000 7f71a5200640 1 --2- 172.21.15.133:0/2594019211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71880039c0 0x7f71a013c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:27.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.688+0000 7f719fe00640 1 -- 172.21.15.133:0/2594019211 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71a013d970 msgr2=0x7f71a013ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:27.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.688+0000 7f719fe00640 1 --2- 172.21.15.133:0/2594019211 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71a013d970 0x7f71a013ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.688+0000 7f719fe00640 1 -- 172.21.15.133:0/2594019211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71880039c0 msgr2=0x7f71a013c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:27.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.688+0000 7f719fe00640 1 --2- 172.21.15.133:0/2594019211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71880039c0 0x7f71a013c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.688+0000 7f719fe00640 1 -- 172.21.15.133:0/2594019211 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a015acd0 con 0x7f71a013ed70 2024-03-30T01:52:27.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.688+0000 7f71a5200640 1 --2- 172.21.15.133:0/2594019211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71880039c0 0x7f71a013c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:27.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.688+0000 7f719fe00640 1 --2- 172.21.15.133:0/2594019211 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71a013ed70 0x7f71a013f1f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f718c00c730 tx=0x7f718c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:27.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.688+0000 7f719cc00640 1 -- 172.21.15.133:0/2594019211 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c0072d0 con 0x7f71a013ed70 2024-03-30T01:52:27.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.688+0000 7f719cc00640 1 -- 172.21.15.133:0/2594019211 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c007450 con 0x7f71a013ed70 2024-03-30T01:52:27.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.688+0000 7f719cc00640 1 -- 172.21.15.133:0/2594019211 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c004a20 con 0x7f71a013ed70 2024-03-30T01:52:27.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.688+0000 7f71a7c00640 1 -- 172.21.15.133:0/2594019211 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a015afb0 con 0x7f71a013ed70 2024-03-30T01:52:27.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.688+0000 7f71a7c00640 1 -- 172.21.15.133:0/2594019211 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a015b570 con 0x7f71a013ed70 2024-03-30T01:52:27.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.690+0000 7f71a7c00640 1 -- 172.21.15.133:0/2594019211 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a0066d80 con 0x7f71a013ed70 2024-03-30T01:52:27.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.691+0000 7f719cc00640 1 -- 172.21.15.133:0/2594019211 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f718c00a5e0 con 0x7f71a013ed70 2024-03-30T01:52:27.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.691+0000 7f719cc00640 1 --2- 172.21.15.133:0/2594019211 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f718006ac00 0x7f718006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:27.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.692+0000 7f719cc00640 1 -- 172.21.15.133:0/2594019211 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f718c088a90 con 0x7f71a013ed70 2024-03-30T01:52:27.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.692+0000 7f71a5200640 1 --2- 172.21.15.133:0/2594019211 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f718006ac00 0x7f718006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:27.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.692+0000 7f71a5200640 1 --2- 172.21.15.133:0/2594019211 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f718006ac00 0x7f718006d0c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f719400ba00 tx=0x7f719403d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:27.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.696+0000 7f719cc00640 1 -- 172.21.15.133:0/2594019211 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f718c053b50 con 0x7f71a013ed70 2024-03-30T01:52:27.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.884+0000 7f71a7c00640 1 -- 172.21.15.133:0/2594019211 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f71a00ae5d0 con 0x7f71a013ed70 2024-03-30T01:52:27.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.885+0000 7f719cc00640 1 -- 172.21.15.133:0/2594019211 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f718c018020 con 0x7f71a013ed70 2024-03-30T01:52:27.891 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-03-30T01:52:27.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.887+0000 7f71a7c00640 1 -- 172.21.15.133:0/2594019211 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f718006ac00 msgr2=0x7f718006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:27.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.887+0000 7f71a7c00640 1 --2- 172.21.15.133:0/2594019211 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f718006ac00 0x7f718006d0c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f719400ba00 tx=0x7f719403d040 comp rx=0 tx=0).stop 2024-03-30T01:52:27.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.887+0000 7f71a7c00640 1 -- 172.21.15.133:0/2594019211 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71a013ed70 msgr2=0x7f71a013f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:27.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.887+0000 7f71a7c00640 1 --2- 172.21.15.133:0/2594019211 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71a013ed70 0x7f71a013f1f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f718c00c730 tx=0x7f718c00cbf0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.887+0000 7f71a7c00640 1 -- 172.21.15.133:0/2594019211 shutdown_connections 2024-03-30T01:52:27.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.887+0000 7f71a7c00640 1 --2- 172.21.15.133:0/2594019211 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f718006ac00 0x7f718006d0c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.887+0000 7f71a7c00640 1 --2- 172.21.15.133:0/2594019211 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71a013d970 0x7f71a013ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.887+0000 7f71a7c00640 1 --2- 172.21.15.133:0/2594019211 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71a013ed70 0x7f71a013f1f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.887+0000 7f71a7c00640 1 --2- 172.21.15.133:0/2594019211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71880039c0 0x7f71a013c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:27.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.887+0000 7f71a7c00640 1 -- 172.21.15.133:0/2594019211 >> 172.21.15.133:0/2594019211 conn(0x7f71a00b07a0 msgr2=0x7f71a00aedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:27.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.888+0000 7f71a7c00640 1 -- 172.21.15.133:0/2594019211 shutdown_connections 2024-03-30T01:52:27.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:27.888+0000 7f71a7c00640 1 -- 172.21.15.133:0/2594019211 wait complete. 2024-03-30T01:52:27.911 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T01:52:28.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.111+0000 7f180d600640 1 Processor -- start 2024-03-30T01:52:28.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.112+0000 7f180d600640 1 -- start start 2024-03-30T01:52:28.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.113+0000 7f180d600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f180815cc50 0x7f18080d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:28.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.113+0000 7f180d600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18080cfb80 0x7f18080b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:28.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.113+0000 7f180d600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180815d030 con 0x7f18080d2240 2024-03-30T01:52:28.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.113+0000 7f180d600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18080d1c50 con 0x7f18080cfb80 2024-03-30T01:52:28.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.113+0000 7f180d600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18080b5af0 con 0x7f180815cc50 2024-03-30T01:52:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.114+0000 7f1807400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18080cfb80 0x7f18080b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.114+0000 7f1807400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18080cfb80 0x7f18080b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47708/0 (socket says 172.21.15.133:47708) 2024-03-30T01:52:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.114+0000 7f1807400640 1 -- 172.21.15.133:0/3784971350 learned_addr learned my addr 172.21.15.133:0/3784971350 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.114+0000 7f1806a00640 1 --2- 172.21.15.133:0/3784971350 >> v2:172.21.15.137:3300/0 conn(0x7f180815cc50 0x7f18080d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.114+0000 7f1807400640 1 -- 172.21.15.133:0/3784971350 >> v2:172.21.15.137:3300/0 conn(0x7f180815cc50 msgr2=0x7f18080d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.114+0000 7f1807400640 1 --2- 172.21.15.133:0/3784971350 >> v2:172.21.15.137:3300/0 conn(0x7f180815cc50 0x7f18080d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.114+0000 7f1807400640 1 -- 172.21.15.133:0/3784971350 >> v1:172.21.15.137:6789/0 conn(0x7f18080d2240 legacy=0x7f18080cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.114+0000 7f1807400640 1 -- 172.21.15.133:0/3784971350 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18080d10d0 con 0x7f18080cfb80 2024-03-30T01:52:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.114+0000 7f1806a00640 1 --2- 172.21.15.133:0/3784971350 >> v2:172.21.15.137:3300/0 conn(0x7f180815cc50 0x7f18080d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:52:28.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.115+0000 7f1807400640 1 --2- 172.21.15.133:0/3784971350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18080cfb80 0x7f18080b14f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f18080b5620 tx=0x7f180002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dcfb70b28b68e87 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:28.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.116+0000 7f1805600640 1 -- 172.21.15.133:0/3784971350 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800030860 con 0x7f18080cfb80 2024-03-30T01:52:28.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.116+0000 7f1805600640 1 -- 172.21.15.133:0/3784971350 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18000309c0 con 0x7f18080cfb80 2024-03-30T01:52:28.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.116+0000 7f1805600640 1 -- 172.21.15.133:0/3784971350 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800030d50 con 0x7f18080cfb80 2024-03-30T01:52:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.116+0000 7f180d600640 1 -- 172.21.15.133:0/3784971350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18080cfb80 msgr2=0x7f18080b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.116+0000 7f180d600640 1 --2- 172.21.15.133:0/3784971350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18080cfb80 0x7f18080b14f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f18080b5620 tx=0x7f180002b9a0 comp rx=0 tx=0).stop 2024-03-30T01:52:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.116+0000 7f180d600640 1 -- 172.21.15.133:0/3784971350 shutdown_connections 2024-03-30T01:52:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.116+0000 7f180d600640 1 --2- 172.21.15.133:0/3784971350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18080cfb80 0x7f18080b14f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.116+0000 7f180d600640 1 --2- 172.21.15.133:0/3784971350 >> v2:172.21.15.137:3300/0 conn(0x7f180815cc50 0x7f18080d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.116+0000 7f180d600640 1 -- 172.21.15.133:0/3784971350 >> 172.21.15.133:0/3784971350 conn(0x7f1808071a40 msgr2=0x7f180806b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.117+0000 7f180d600640 1 -- 172.21.15.133:0/3784971350 shutdown_connections 2024-03-30T01:52:28.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.117+0000 7f180d600640 1 -- 172.21.15.133:0/3784971350 wait complete. 2024-03-30T01:52:28.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.119+0000 7f180d600640 1 Processor -- start 2024-03-30T01:52:28.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.119+0000 7f180d600640 1 -- start start 2024-03-30T01:52:28.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.120+0000 7f180d600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18080cfb80 0x7f18080cb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:28.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.120+0000 7f180d600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18080d2240 0x7f18080cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:28.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.120+0000 7f180d600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f180815cc50 0x7f1808156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:28.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.120+0000 7f180d600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18080cbfb0 con 0x7f180815cc50 2024-03-30T01:52:28.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.120+0000 7f180d600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18080cbda0 con 0x7f18080cfb80 2024-03-30T01:52:28.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.120+0000 7f180d600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1808158100 con 0x7f18080d2240 2024-03-30T01:52:28.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.120+0000 7f1807400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f180815cc50 0x7f1808156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:28.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.121+0000 7f1807400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f180815cc50 0x7f1808156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47710/0 (socket says 172.21.15.133:47710) 2024-03-30T01:52:28.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.121+0000 7f1807400640 1 -- 172.21.15.133:0/1787136065 learned_addr learned my addr 172.21.15.133:0/1787136065 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:28.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.121+0000 7f1806a00640 1 --2- 172.21.15.133:0/1787136065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18080cfb80 0x7f18080cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:28.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.121+0000 7f1806000640 1 --2- 172.21.15.133:0/1787136065 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18080d2240 0x7f18080cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:28.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.121+0000 7f1807400640 1 -- 172.21.15.133:0/1787136065 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18080d2240 msgr2=0x7f18080cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:28.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.121+0000 7f1807400640 1 --2- 172.21.15.133:0/1787136065 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18080d2240 0x7f18080cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:28.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.121+0000 7f1807400640 1 -- 172.21.15.133:0/1787136065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18080cfb80 msgr2=0x7f18080cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:28.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.121+0000 7f1807400640 1 --2- 172.21.15.133:0/1787136065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18080cfb80 0x7f18080cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:28.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.121+0000 7f1807400640 1 -- 172.21.15.133:0/1787136065 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18000094d0 con 0x7f180815cc50 2024-03-30T01:52:28.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.121+0000 7f1806000640 1 --2- 172.21.15.133:0/1787136065 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18080d2240 0x7f18080cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:28.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.121+0000 7f1807400640 1 --2- 172.21.15.133:0/1787136065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f180815cc50 0x7f1808156160 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f18000090b0 tx=0x7f1800004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:28.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.121+0000 7f17fea00640 1 -- 172.21.15.133:0/1787136065 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800039c90 con 0x7f180815cc50 2024-03-30T01:52:28.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.122+0000 7f17fea00640 1 -- 172.21.15.133:0/1787136065 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1800039df0 con 0x7f180815cc50 2024-03-30T01:52:28.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.122+0000 7f17fea00640 1 -- 172.21.15.133:0/1787136065 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800043640 con 0x7f180815cc50 2024-03-30T01:52:28.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.122+0000 7f180d600640 1 -- 172.21.15.133:0/1787136065 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18081583a0 con 0x7f180815cc50 2024-03-30T01:52:28.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.122+0000 7f180d600640 1 -- 172.21.15.133:0/1787136065 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1808158960 con 0x7f180815cc50 2024-03-30T01:52:28.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.123+0000 7f180d600640 1 -- 172.21.15.133:0/1787136065 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1808066d80 con 0x7f180815cc50 2024-03-30T01:52:28.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.124+0000 7f17fea00640 1 -- 172.21.15.133:0/1787136065 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f18000437a0 con 0x7f180815cc50 2024-03-30T01:52:28.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.125+0000 7f17fea00640 1 --2- 172.21.15.133:0/1787136065 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f17e806ac00 0x7f17e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:28.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.125+0000 7f17fea00640 1 -- 172.21.15.133:0/1787136065 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f180003e070 con 0x7f180815cc50 2024-03-30T01:52:28.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.125+0000 7f1806a00640 1 --2- 172.21.15.133:0/1787136065 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f17e806ac00 0x7f17e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:28.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.126+0000 7f1806a00640 1 --2- 172.21.15.133:0/1787136065 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f17e806ac00 0x7f17e806d0c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f17f8003fd0 tx=0x7f17f8003ce0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:28.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.130+0000 7f17fea00640 1 -- 172.21.15.133:0/1787136065 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f18000776b0 con 0x7f180815cc50 2024-03-30T01:52:28.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.339+0000 7f180d600640 1 -- 172.21.15.133:0/1787136065 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f180815fa60 con 0x7f180815cc50 2024-03-30T01:52:28.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.339+0000 7f17fea00640 1 -- 172.21.15.133:0/1787136065 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f180007acd0 con 0x7f180815cc50 2024-03-30T01:52:28.346 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2024-03-30T01:52:28.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.342+0000 7f180d600640 1 -- 172.21.15.133:0/1787136065 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f17e806ac00 msgr2=0x7f17e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:28.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.342+0000 7f180d600640 1 --2- 172.21.15.133:0/1787136065 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f17e806ac00 0x7f17e806d0c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f17f8003fd0 tx=0x7f17f8003ce0 comp rx=0 tx=0).stop 2024-03-30T01:52:28.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.342+0000 7f180d600640 1 -- 172.21.15.133:0/1787136065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f180815cc50 msgr2=0x7f1808156160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:28.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.342+0000 7f180d600640 1 --2- 172.21.15.133:0/1787136065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f180815cc50 0x7f1808156160 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f18000090b0 tx=0x7f1800004730 comp rx=0 tx=0).stop 2024-03-30T01:52:28.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.342+0000 7f180d600640 1 -- 172.21.15.133:0/1787136065 shutdown_connections 2024-03-30T01:52:28.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.342+0000 7f180d600640 1 --2- 172.21.15.133:0/1787136065 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f17e806ac00 0x7f17e806d0c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:28.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.342+0000 7f180d600640 1 --2- 172.21.15.133:0/1787136065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f180815cc50 0x7f1808156160 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:28.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.342+0000 7f180d600640 1 --2- 172.21.15.133:0/1787136065 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18080d2240 0x7f18080cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:28.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.342+0000 7f180d600640 1 --2- 172.21.15.133:0/1787136065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18080cfb80 0x7f18080cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:28.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.342+0000 7f180d600640 1 -- 172.21.15.133:0/1787136065 >> 172.21.15.133:0/1787136065 conn(0x7f1808071a40 msgr2=0x7f180806b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:28.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.342+0000 7f180d600640 1 -- 172.21.15.133:0/1787136065 shutdown_connections 2024-03-30T01:52:28.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.342+0000 7f180d600640 1 -- 172.21.15.133:0/1787136065 wait complete. 2024-03-30T01:52:28.368 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-03-30T01:52:28.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:28.368 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-03-30T01:52:28.474 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-03-30T01:52:28.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:28.474 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-30T01:52:28.525 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-03-30T01:52:28.526 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T01:52:28.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.731+0000 7f5289a00640 1 Processor -- start 2024-03-30T01:52:28.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.731+0000 7f5289a00640 1 -- start start 2024-03-30T01:52:28.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.732+0000 7f5289a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f528406e2e0 0x7f5284070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:28.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.732+0000 7f5289a00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5284070e50 con 0x7f5284070a40 2024-03-30T01:52:28.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.733+0000 7f5289a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52840ce400 con 0x7f5284143220 2024-03-30T01:52:28.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.733+0000 7f5289a00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52840cc5c0 con 0x7f528406e2e0 2024-03-30T01:52:28.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.733+0000 7f527a000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f528406e2e0 0x7f5284070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:28.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.733+0000 7f527a000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f528406e2e0 0x7f5284070500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47726/0 (socket says 172.21.15.133:47726) 2024-03-30T01:52:28.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.733+0000 7f5283400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5284070a40 0x7f528415d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58682/0 (socket says 172.21.15.133:58682) 2024-03-30T01:52:28.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.733+0000 7f527a000640 1 -- 172.21.15.133:0/1788514008 learned_addr learned my addr 172.21.15.133:0/1788514008 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:28.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.733+0000 7f527a000640 1 -- 172.21.15.133:0/1788514008 >> v1:172.21.15.137:6789/0 conn(0x7f5284143220 legacy=0x7f52840cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:28.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.733+0000 7f527a000640 1 -- 172.21.15.133:0/1788514008 >> v1:172.21.15.133:6789/0 conn(0x7f5284070a40 legacy=0x7f528415d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:28.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.733+0000 7f527a000640 1 -- 172.21.15.133:0/1788514008 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528406d0e0 con 0x7f528406e2e0 2024-03-30T01:52:28.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.733+0000 7f5282000640 1 -- 172.21.15.133:0/1788514008 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3612852101 0 0) 0x7f5284070e50 con 0x7f5284070a40 2024-03-30T01:52:28.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.734+0000 7f527a000640 1 --2- 172.21.15.133:0/1788514008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f528406e2e0 0x7f5284070500 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f526c009870 tx=0x7f526c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123b8130b84fbf85 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:28.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.735+0000 7f5282000640 1 -- 172.21.15.133:0/1788514008 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c030860 con 0x7f528406e2e0 2024-03-30T01:52:28.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.735+0000 7f5282000640 1 -- 172.21.15.133:0/1788514008 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c0309c0 con 0x7f528406e2e0 2024-03-30T01:52:28.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.735+0000 7f5282000640 1 -- 172.21.15.133:0/1788514008 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c030d50 con 0x7f528406e2e0 2024-03-30T01:52:28.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.735+0000 7f5289a00640 1 -- 172.21.15.133:0/1788514008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f528406e2e0 msgr2=0x7f5284070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:28.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.735+0000 7f5289a00640 1 --2- 172.21.15.133:0/1788514008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f528406e2e0 0x7f5284070500 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f526c009870 tx=0x7f526c02b9a0 comp rx=0 tx=0).stop 2024-03-30T01:52:28.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.735+0000 7f5289a00640 1 -- 172.21.15.133:0/1788514008 shutdown_connections 2024-03-30T01:52:28.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.735+0000 7f5289a00640 1 --2- 172.21.15.133:0/1788514008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f528406e2e0 0x7f5284070500 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:28.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.735+0000 7f5289a00640 1 -- 172.21.15.133:0/1788514008 >> 172.21.15.133:0/1788514008 conn(0x7f52840b07a0 msgr2=0x7f52840b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:28.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.735+0000 7f5289a00640 1 -- 172.21.15.133:0/1788514008 shutdown_connections 2024-03-30T01:52:28.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.735+0000 7f5289a00640 1 -- 172.21.15.133:0/1788514008 wait complete. 2024-03-30T01:52:28.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.737+0000 7f5289a00640 1 Processor -- start 2024-03-30T01:52:28.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.737+0000 7f5289a00640 1 -- start start 2024-03-30T01:52:28.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.738+0000 7f5289a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f528406e2e0 0x7f5284140810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:28.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.738+0000 7f5289a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5284070a40 0x7f52841e66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:28.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.738+0000 7f5289a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5284143220 0x7f5284156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:28.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.738+0000 7f5289a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5284141900 con 0x7f528406e2e0 2024-03-30T01:52:28.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.738+0000 7f5289a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5284141060 con 0x7f5284070a40 2024-03-30T01:52:28.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.738+0000 7f5289a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5284141340 con 0x7f5284143220 2024-03-30T01:52:28.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.738+0000 7f5282a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f528406e2e0 0x7f5284140810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:28.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.738+0000 7f5282a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f528406e2e0 0x7f5284140810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47740/0 (socket says 172.21.15.133:47740) 2024-03-30T01:52:28.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.738+0000 7f5282a00640 1 -- 172.21.15.133:0/1570966542 learned_addr learned my addr 172.21.15.133:0/1570966542 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:28.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.739+0000 7f5282a00640 1 -- 172.21.15.133:0/1570966542 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5284143220 msgr2=0x7f5284156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:28.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.739+0000 7f5282a00640 1 --2- 172.21.15.133:0/1570966542 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5284143220 0x7f5284156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:28.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.739+0000 7f5282a00640 1 -- 172.21.15.133:0/1570966542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5284070a40 msgr2=0x7f52841e66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:28.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.739+0000 7f5282a00640 1 --2- 172.21.15.133:0/1570966542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5284070a40 0x7f52841e66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:28.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.739+0000 7f5282a00640 1 -- 172.21.15.133:0/1570966542 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526c0094d0 con 0x7f528406e2e0 2024-03-30T01:52:28.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.739+0000 7f5282a00640 1 --2- 172.21.15.133:0/1570966542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f528406e2e0 0x7f5284140810 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f527400b3f0 tx=0x7f527400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:28.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.739+0000 7f527b400640 1 -- 172.21.15.133:0/1570966542 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5274011830 con 0x7f528406e2e0 2024-03-30T01:52:28.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.739+0000 7f527b400640 1 -- 172.21.15.133:0/1570966542 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5274011990 con 0x7f528406e2e0 2024-03-30T01:52:28.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.739+0000 7f5289a00640 1 -- 172.21.15.133:0/1570966542 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5284141620 con 0x7f528406e2e0 2024-03-30T01:52:28.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.739+0000 7f527b400640 1 -- 172.21.15.133:0/1570966542 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5274011d40 con 0x7f528406e2e0 2024-03-30T01:52:28.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.739+0000 7f5289a00640 1 -- 172.21.15.133:0/1570966542 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5284140d50 con 0x7f528406e2e0 2024-03-30T01:52:28.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.741+0000 7f5289a00640 1 -- 172.21.15.133:0/1570966542 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52841f2900 con 0x7f528406e2e0 2024-03-30T01:52:28.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.741+0000 7f527b400640 1 -- 172.21.15.133:0/1570966542 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f527401a400 con 0x7f528406e2e0 2024-03-30T01:52:28.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.743+0000 7f527b400640 1 --2- 172.21.15.133:0/1570966542 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f526006ac00 0x7f526006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:28.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.743+0000 7f527b400640 1 -- 172.21.15.133:0/1570966542 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5274089590 con 0x7f528406e2e0 2024-03-30T01:52:28.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.743+0000 7f527a000640 1 --2- 172.21.15.133:0/1570966542 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f526006ac00 0x7f526006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:28.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.744+0000 7f527a000640 1 --2- 172.21.15.133:0/1570966542 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f526006ac00 0x7f526006d0c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f526c036000 tx=0x7f526c03b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:28.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.748+0000 7f527b400640 1 -- 172.21.15.133:0/1570966542 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f52841f2900 con 0x7f528406e2e0 2024-03-30T01:52:28.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.986+0000 7f5289a00640 1 -- 172.21.15.133:0/1570966542 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52841f2900 con 0x7f528406e2e0 2024-03-30T01:52:28.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.987+0000 7f527b400640 1 -- 172.21.15.133:0/1570966542 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4737 (secure 0 0 0) 0x7f52841f2900 con 0x7f528406e2e0 2024-03-30T01:52:28.993 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:28.993 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2218506023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2218506023},{"type":"v1","addr":"172.21.15.137:6835","nonce":2218506023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2935514153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2935514153},{"type":"v1","addr":"172.21.15.133:6836","nonce":2935514153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2942187095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2942187095},{"type":"v1","addr":"172.21.15.133:6837","nonce":2942187095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T01:51:32.776583+0000","modified":"2024-03-30T01:51:35.787820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/225370013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":225370013},{"type":"v1","addr":"172.21.15.137:6834","nonce":225370013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-30T01:52:28.993 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 7 2024-03-30T01:52:28.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.989+0000 7f5289a00640 1 -- 172.21.15.133:0/1570966542 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f526006ac00 msgr2=0x7f526006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:28.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.989+0000 7f5289a00640 1 --2- 172.21.15.133:0/1570966542 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f526006ac00 0x7f526006d0c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f526c036000 tx=0x7f526c03b040 comp rx=0 tx=0).stop 2024-03-30T01:52:28.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.989+0000 7f5289a00640 1 -- 172.21.15.133:0/1570966542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f528406e2e0 msgr2=0x7f5284140810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:28.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.989+0000 7f5289a00640 1 --2- 172.21.15.133:0/1570966542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f528406e2e0 0x7f5284140810 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f527400b3f0 tx=0x7f527400b8b0 comp rx=0 tx=0).stop 2024-03-30T01:52:28.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.989+0000 7f5289a00640 1 -- 172.21.15.133:0/1570966542 shutdown_connections 2024-03-30T01:52:28.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.989+0000 7f5289a00640 1 --2- 172.21.15.133:0/1570966542 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f526006ac00 0x7f526006d0c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:28.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.989+0000 7f5289a00640 1 --2- 172.21.15.133:0/1570966542 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5284143220 0x7f5284156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:28.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.989+0000 7f5289a00640 1 --2- 172.21.15.133:0/1570966542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5284070a40 0x7f52841e66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:28.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.989+0000 7f5289a00640 1 --2- 172.21.15.133:0/1570966542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f528406e2e0 0x7f5284140810 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:28.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.990+0000 7f5289a00640 1 -- 172.21.15.133:0/1570966542 >> 172.21.15.133:0/1570966542 conn(0x7f52840b07a0 msgr2=0x7f528415be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:28.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.990+0000 7f5289a00640 1 -- 172.21.15.133:0/1570966542 shutdown_connections 2024-03-30T01:52:28.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:28.990+0000 7f5289a00640 1 -- 172.21.15.133:0/1570966542 wait complete. 2024-03-30T01:52:29.017 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:52:29.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.211+0000 7efcc7200640 1 Processor -- start 2024-03-30T01:52:29.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.212+0000 7efcc7200640 1 -- start start 2024-03-30T01:52:29.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.213+0000 7efcc7200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efcc00b42c0 0x7efcc00cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:29.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.213+0000 7efcc7200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc013dba0 con 0x7efcc015b9c0 2024-03-30T01:52:29.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.213+0000 7efcc7200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc01408b0 con 0x7efcc00ccb30 2024-03-30T01:52:29.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.213+0000 7efcc7200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc015bda0 con 0x7efcc00b42c0 2024-03-30T01:52:29.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.213+0000 7efcc5400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efcc00b42c0 0x7efcc00cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:29.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.214+0000 7efcc5400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efcc00b42c0 0x7efcc00cc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47746/0 (socket says 172.21.15.133:47746) 2024-03-30T01:52:29.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.214+0000 7efcc5400640 1 -- 172.21.15.133:0/3182041029 learned_addr learned my addr 172.21.15.133:0/3182041029 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:29.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.214+0000 7efcc5e00640 1 --1- 172.21.15.133:0/3182041029 >> v1:172.21.15.133:6789/0 conn(0x7efcc015b9c0 0x7efcc00b3bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58688/0 (socket says 172.21.15.133:58688) 2024-03-30T01:52:29.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.214+0000 7efcc5400640 1 -- 172.21.15.133:0/3182041029 >> v1:172.21.15.137:6789/0 conn(0x7efcc00ccb30 legacy=0x7efcc015e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:29.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.214+0000 7efcc5400640 1 -- 172.21.15.133:0/3182041029 >> v1:172.21.15.133:6789/0 conn(0x7efcc015b9c0 legacy=0x7efcc00b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:29.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.214+0000 7efcc5400640 1 -- 172.21.15.133:0/3182041029 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc015ad40 con 0x7efcc00b42c0 2024-03-30T01:52:29.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.215+0000 7efcc5400640 1 --2- 172.21.15.133:0/3182041029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc00b42c0 0x7efcc00cc5f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009870 tx=0x7efcb002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f5a60ec4fcb5f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:29.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.215+0000 7efcc4a00640 1 -- 172.21.15.133:0/3182041029 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb0030860 con 0x7efcc00b42c0 2024-03-30T01:52:29.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.215+0000 7efcc4a00640 1 -- 172.21.15.133:0/3182041029 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb00309c0 con 0x7efcc00b42c0 2024-03-30T01:52:29.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.215+0000 7efcc4a00640 1 -- 172.21.15.133:0/3182041029 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb0030d50 con 0x7efcc00b42c0 2024-03-30T01:52:29.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.216+0000 7efcc7200640 1 -- 172.21.15.133:0/3182041029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc00b42c0 msgr2=0x7efcc00cc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:29.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.216+0000 7efcc7200640 1 --2- 172.21.15.133:0/3182041029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc00b42c0 0x7efcc00cc5f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009870 tx=0x7efcb002b9a0 comp rx=0 tx=0).stop 2024-03-30T01:52:29.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.216+0000 7efcc7200640 1 -- 172.21.15.133:0/3182041029 shutdown_connections 2024-03-30T01:52:29.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.216+0000 7efcc7200640 1 --2- 172.21.15.133:0/3182041029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc00b42c0 0x7efcc00cc5f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:29.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.216+0000 7efcc7200640 1 -- 172.21.15.133:0/3182041029 >> 172.21.15.133:0/3182041029 conn(0x7efcc00b05a0 msgr2=0x7efcc00b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:29.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.216+0000 7efcc7200640 1 -- 172.21.15.133:0/3182041029 shutdown_connections 2024-03-30T01:52:29.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.216+0000 7efcc7200640 1 -- 172.21.15.133:0/3182041029 wait complete. 2024-03-30T01:52:29.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.218+0000 7efcc7200640 1 Processor -- start 2024-03-30T01:52:29.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.218+0000 7efcc7200640 1 -- start start 2024-03-30T01:52:29.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.219+0000 7efcc7200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcc00b42c0 0x7efcc00b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:29.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.219+0000 7efcc7200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcc00ccb30 0x7efcc00a7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:29.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.219+0000 7efcc7200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc015b9c0 0x7efcc013ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:29.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.219+0000 7efcc7200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc01546b0 con 0x7efcc015b9c0 2024-03-30T01:52:29.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.219+0000 7efcc7200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc0153e10 con 0x7efcc00ccb30 2024-03-30T01:52:29.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.219+0000 7efcc7200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc01540f0 con 0x7efcc00b42c0 2024-03-30T01:52:29.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.219+0000 7efcc6800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc015b9c0 0x7efcc013ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:29.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.219+0000 7efcc6800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc015b9c0 0x7efcc013ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47748/0 (socket says 172.21.15.133:47748) 2024-03-30T01:52:29.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.219+0000 7efcc6800640 1 -- 172.21.15.133:0/809355579 learned_addr learned my addr 172.21.15.133:0/809355579 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:29.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.219+0000 7efcc5400640 1 --2- 172.21.15.133:0/809355579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcc00ccb30 0x7efcc00a7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:29.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.219+0000 7efcc5e00640 1 --2- 172.21.15.133:0/809355579 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcc00b42c0 0x7efcc00b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:29.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.220+0000 7efcc6800640 1 -- 172.21.15.133:0/809355579 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcc00b42c0 msgr2=0x7efcc00b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:29.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.220+0000 7efcc6800640 1 --2- 172.21.15.133:0/809355579 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcc00b42c0 0x7efcc00b3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:29.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.220+0000 7efcc6800640 1 -- 172.21.15.133:0/809355579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcc00ccb30 msgr2=0x7efcc00a7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:29.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.220+0000 7efcc6800640 1 --2- 172.21.15.133:0/809355579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcc00ccb30 0x7efcc00a7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:29.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.220+0000 7efcc6800640 1 -- 172.21.15.133:0/809355579 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb00094d0 con 0x7efcc015b9c0 2024-03-30T01:52:29.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.220+0000 7efcc5400640 1 --2- 172.21.15.133:0/809355579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcc00ccb30 0x7efcc00a7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:29.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.220+0000 7efcc6800640 1 --2- 172.21.15.133:0/809355579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc015b9c0 0x7efcc013ccb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00c390 tx=0x7efcbc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:29.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.220+0000 7efcb6000640 1 -- 172.21.15.133:0/809355579 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc0035f0 con 0x7efcc015b9c0 2024-03-30T01:52:29.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.220+0000 7efcb6000640 1 -- 172.21.15.133:0/809355579 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcbc003750 con 0x7efcc015b9c0 2024-03-30T01:52:29.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.220+0000 7efcc7200640 1 -- 172.21.15.133:0/809355579 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc01543d0 con 0x7efcc015b9c0 2024-03-30T01:52:29.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.220+0000 7efcb6000640 1 -- 172.21.15.133:0/809355579 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc003b00 con 0x7efcc015b9c0 2024-03-30T01:52:29.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.220+0000 7efcc7200640 1 -- 172.21.15.133:0/809355579 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc00b3a70 con 0x7efcc015b9c0 2024-03-30T01:52:29.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.221+0000 7efcc7200640 1 -- 172.21.15.133:0/809355579 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc01f2990 con 0x7efcc015b9c0 2024-03-30T01:52:29.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.222+0000 7efcb6000640 1 -- 172.21.15.133:0/809355579 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7efcbc003c60 con 0x7efcc015b9c0 2024-03-30T01:52:29.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.224+0000 7efcb6000640 1 --2- 172.21.15.133:0/809355579 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efca406ac00 0x7efca406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:29.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.224+0000 7efcb6000640 1 -- 172.21.15.133:0/809355579 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7efcbc0889b0 con 0x7efcc015b9c0 2024-03-30T01:52:29.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.224+0000 7efcc5e00640 1 --2- 172.21.15.133:0/809355579 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efca406ac00 0x7efca406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:29.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.224+0000 7efcc5e00640 1 --2- 172.21.15.133:0/809355579 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efca406ac00 0x7efca406d0c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efcb80012e0 tx=0x7efcb8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:29.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.228+0000 7efcb6000640 1 -- 172.21.15.133:0/809355579 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7efcc01f2990 con 0x7efcc015b9c0 2024-03-30T01:52:29.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.426+0000 7efcc7200640 1 -- 172.21.15.133:0/809355579 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcc01f2990 con 0x7efcc015b9c0 2024-03-30T01:52:29.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.429+0000 7efcb6000640 1 -- 172.21.15.133:0/809355579 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16335 (secure 0 0 0) 0x7efcc01f2990 con 0x7efcc015b9c0 2024-03-30T01:52:29.435 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:29.435 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:52:15.520675+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:51:31.245378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T01:51:31.774247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:52:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.432+0000 7efcc7200640 1 -- 172.21.15.133:0/809355579 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efca406ac00 msgr2=0x7efca406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.432+0000 7efcc7200640 1 --2- 172.21.15.133:0/809355579 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efca406ac00 0x7efca406d0c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efcb80012e0 tx=0x7efcb8009040 comp rx=0 tx=0).stop 2024-03-30T01:52:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.432+0000 7efcc7200640 1 -- 172.21.15.133:0/809355579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc015b9c0 msgr2=0x7efcc013ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.432+0000 7efcc7200640 1 --2- 172.21.15.133:0/809355579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc015b9c0 0x7efcc013ccb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00c390 tx=0x7efcbc00c850 comp rx=0 tx=0).stop 2024-03-30T01:52:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.432+0000 7efcc7200640 1 -- 172.21.15.133:0/809355579 shutdown_connections 2024-03-30T01:52:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.432+0000 7efcc7200640 1 --2- 172.21.15.133:0/809355579 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efca406ac00 0x7efca406d0c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.432+0000 7efcc7200640 1 --2- 172.21.15.133:0/809355579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc015b9c0 0x7efcc013ccb0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.432+0000 7efcc7200640 1 --2- 172.21.15.133:0/809355579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcc00ccb30 0x7efcc00a7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:29.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.432+0000 7efcc7200640 1 --2- 172.21.15.133:0/809355579 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcc00b42c0 0x7efcc00b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:29.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.432+0000 7efcc7200640 1 -- 172.21.15.133:0/809355579 >> 172.21.15.133:0/809355579 conn(0x7efcc00b05a0 msgr2=0x7efcc00af7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:29.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.433+0000 7efcc7200640 1 -- 172.21.15.133:0/809355579 shutdown_connections 2024-03-30T01:52:29.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.433+0000 7efcc7200640 1 -- 172.21.15.133:0/809355579 wait complete. 2024-03-30T01:52:29.457 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T01:51:21.771393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T01:51:31.245378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T01:51:31.774247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T01:52:29.457 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T01:52:29.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.656+0000 7fbd5dc00640 1 Processor -- start 2024-03-30T01:52:29.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.657+0000 7fbd5dc00640 1 -- start start 2024-03-30T01:52:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.658+0000 7fbd5dc00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbd5815cc50 0x7fbd580d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.658+0000 7fbd5dc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd580d2240 0x7fbd580cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.658+0000 7fbd5dc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd5815d030 con 0x7fbd580cf9b0 2024-03-30T01:52:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.658+0000 7fbd5dc00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd580d1c50 con 0x7fbd5815cc50 2024-03-30T01:52:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.658+0000 7fbd5dc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd580cfe40 con 0x7fbd580d2240 2024-03-30T01:52:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.658+0000 7fbd56a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbd5815cc50 0x7fbd580d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.658+0000 7fbd56a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbd5815cc50 0x7fbd580d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47752/0 (socket says 172.21.15.133:47752) 2024-03-30T01:52:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.658+0000 7fbd56a00640 1 -- 172.21.15.133:0/33289110 learned_addr learned my addr 172.21.15.133:0/33289110 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.659+0000 7fbd56a00640 1 -- 172.21.15.133:0/33289110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd580d2240 msgr2=0x7fbd580cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.659+0000 7fbd56a00640 1 --2- 172.21.15.133:0/33289110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd580d2240 0x7fbd580cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:29.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.659+0000 7fbd56a00640 1 -- 172.21.15.133:0/33289110 >> v1:172.21.15.137:6789/0 conn(0x7fbd580cf9b0 legacy=0x7fbd580b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:29.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.659+0000 7fbd56a00640 1 -- 172.21.15.133:0/33289110 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd580b5af0 con 0x7fbd5815cc50 2024-03-30T01:52:29.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.660+0000 7fbd56a00640 1 --2- 172.21.15.133:0/33289110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd5815cc50 0x7fbd580d0af0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009870 tx=0x7fbd4002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8e5fc008274a64 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.660+0000 7fbd55600640 1 -- 172.21.15.133:0/33289110 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd40031640 con 0x7fbd5815cc50 2024-03-30T01:52:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.660+0000 7fbd55600640 1 -- 172.21.15.133:0/33289110 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd400317a0 con 0x7fbd5815cc50 2024-03-30T01:52:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.660+0000 7fbd55600640 1 -- 172.21.15.133:0/33289110 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd40031b30 con 0x7fbd5815cc50 2024-03-30T01:52:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.661+0000 7fbd5dc00640 1 -- 172.21.15.133:0/33289110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd5815cc50 msgr2=0x7fbd580d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.661+0000 7fbd5dc00640 1 --2- 172.21.15.133:0/33289110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd5815cc50 0x7fbd580d0af0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009870 tx=0x7fbd4002b8f0 comp rx=0 tx=0).stop 2024-03-30T01:52:29.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.661+0000 7fbd5dc00640 1 -- 172.21.15.133:0/33289110 shutdown_connections 2024-03-30T01:52:29.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.661+0000 7fbd5dc00640 1 --2- 172.21.15.133:0/33289110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd580d2240 0x7fbd580cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:29.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.661+0000 7fbd5dc00640 1 --2- 172.21.15.133:0/33289110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd5815cc50 0x7fbd580d0af0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:29.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.661+0000 7fbd5dc00640 1 -- 172.21.15.133:0/33289110 >> 172.21.15.133:0/33289110 conn(0x7fbd58071a40 msgr2=0x7fbd5806b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:29.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.661+0000 7fbd5dc00640 1 -- 172.21.15.133:0/33289110 shutdown_connections 2024-03-30T01:52:29.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.661+0000 7fbd5dc00640 1 -- 172.21.15.133:0/33289110 wait complete. 2024-03-30T01:52:29.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.663+0000 7fbd5dc00640 1 Processor -- start 2024-03-30T01:52:29.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.663+0000 7fbd5dc00640 1 -- start start 2024-03-30T01:52:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.664+0000 7fbd5dc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd580cf9b0 0x7fbd581482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.664+0000 7fbd5dc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd580d2240 0x7fbd580c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.664+0000 7fbd5dc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd5815cc50 0x7fbd581f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.664+0000 7fbd5dc00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd580c8510 con 0x7fbd580cf9b0 2024-03-30T01:52:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.664+0000 7fbd5dc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd58145a80 con 0x7fbd580d2240 2024-03-30T01:52:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.664+0000 7fbd5dc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd580c8740 con 0x7fbd5815cc50 2024-03-30T01:52:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.664+0000 7fbd56a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd580cf9b0 0x7fbd581482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.664+0000 7fbd56a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd580cf9b0 0x7fbd581482b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47754/0 (socket says 172.21.15.133:47754) 2024-03-30T01:52:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.664+0000 7fbd56a00640 1 -- 172.21.15.133:0/329647265 learned_addr learned my addr 172.21.15.133:0/329647265 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.665+0000 7fbd57400640 1 --2- 172.21.15.133:0/329647265 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd5815cc50 0x7fbd581f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.665+0000 7fbd56000640 1 --2- 172.21.15.133:0/329647265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd580d2240 0x7fbd580c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.665+0000 7fbd56a00640 1 -- 172.21.15.133:0/329647265 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd5815cc50 msgr2=0x7fbd581f1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.665+0000 7fbd56a00640 1 --2- 172.21.15.133:0/329647265 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd5815cc50 0x7fbd581f1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:29.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.665+0000 7fbd56a00640 1 -- 172.21.15.133:0/329647265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd580d2240 msgr2=0x7fbd580c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:29.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.665+0000 7fbd56a00640 1 --2- 172.21.15.133:0/329647265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd580d2240 0x7fbd580c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:29.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.665+0000 7fbd56a00640 1 -- 172.21.15.133:0/329647265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd400094d0 con 0x7fbd580cf9b0 2024-03-30T01:52:29.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.665+0000 7fbd56000640 1 --2- 172.21.15.133:0/329647265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd580d2240 0x7fbd580c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.665+0000 7fbd56a00640 1 --2- 172.21.15.133:0/329647265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd580cf9b0 0x7fbd581482b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009870 tx=0x7fbd400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.665+0000 7fbd4ea00640 1 -- 172.21.15.133:0/329647265 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4003ac60 con 0x7fbd580cf9b0 2024-03-30T01:52:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.665+0000 7fbd4ea00640 1 -- 172.21.15.133:0/329647265 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4003adc0 con 0x7fbd580cf9b0 2024-03-30T01:52:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.665+0000 7fbd4ea00640 1 -- 172.21.15.133:0/329647265 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd40044630 con 0x7fbd580cf9b0 2024-03-30T01:52:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.665+0000 7fbd5dc00640 1 -- 172.21.15.133:0/329647265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd580c8a20 con 0x7fbd580cf9b0 2024-03-30T01:52:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.666+0000 7fbd5dc00640 1 -- 172.21.15.133:0/329647265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd581f2020 con 0x7fbd580cf9b0 2024-03-30T01:52:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.667+0000 7fbd5dc00640 1 -- 172.21.15.133:0/329647265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd58066d80 con 0x7fbd580cf9b0 2024-03-30T01:52:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.667+0000 7fbd4ea00640 1 -- 172.21.15.133:0/329647265 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fbd4002f050 con 0x7fbd580cf9b0 2024-03-30T01:52:29.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.668+0000 7fbd4ea00640 1 --2- 172.21.15.133:0/329647265 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbd3406ac00 0x7fbd3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:29.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.668+0000 7fbd4ea00640 1 -- 172.21.15.133:0/329647265 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fbd400ab4d0 con 0x7fbd580cf9b0 2024-03-30T01:52:29.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.669+0000 7fbd56000640 1 --2- 172.21.15.133:0/329647265 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbd3406ac00 0x7fbd3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:29.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.669+0000 7fbd56000640 1 --2- 172.21.15.133:0/329647265 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbd3406ac00 0x7fbd3406d0c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbd581f56f0 tx=0x7fbd480073c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:29.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.673+0000 7fbd4ea00640 1 -- 172.21.15.133:0/329647265 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fbd40076500 con 0x7fbd580cf9b0 2024-03-30T01:52:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.868+0000 7fbd5dc00640 1 -- 172.21.15.133:0/329647265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd580c8f40 con 0x7fbd580cf9b0 2024-03-30T01:52:29.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.869+0000 7fbd4ea00640 1 -- 172.21.15.133:0/329647265 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbd40079b20 con 0x7fbd580cf9b0 2024-03-30T01:52:29.876 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-03-30T01:52:29.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.872+0000 7fbd5dc00640 1 -- 172.21.15.133:0/329647265 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbd3406ac00 msgr2=0x7fbd3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.872+0000 7fbd5dc00640 1 --2- 172.21.15.133:0/329647265 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbd3406ac00 0x7fbd3406d0c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbd581f56f0 tx=0x7fbd480073c0 comp rx=0 tx=0).stop 2024-03-30T01:52:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.872+0000 7fbd5dc00640 1 -- 172.21.15.133:0/329647265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd580cf9b0 msgr2=0x7fbd581482b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.872+0000 7fbd5dc00640 1 --2- 172.21.15.133:0/329647265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd580cf9b0 0x7fbd581482b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009870 tx=0x7fbd400046c0 comp rx=0 tx=0).stop 2024-03-30T01:52:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.872+0000 7fbd5dc00640 1 -- 172.21.15.133:0/329647265 shutdown_connections 2024-03-30T01:52:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.872+0000 7fbd5dc00640 1 --2- 172.21.15.133:0/329647265 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbd3406ac00 0x7fbd3406d0c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.872+0000 7fbd5dc00640 1 --2- 172.21.15.133:0/329647265 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd5815cc50 0x7fbd581f1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.872+0000 7fbd5dc00640 1 --2- 172.21.15.133:0/329647265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd580d2240 0x7fbd580c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.872+0000 7fbd5dc00640 1 --2- 172.21.15.133:0/329647265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd580cf9b0 0x7fbd581482b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.872+0000 7fbd5dc00640 1 -- 172.21.15.133:0/329647265 >> 172.21.15.133:0/329647265 conn(0x7fbd58071a40 msgr2=0x7fbd58072ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.872+0000 7fbd5dc00640 1 -- 172.21.15.133:0/329647265 shutdown_connections 2024-03-30T01:52:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:29.873+0000 7fbd5dc00640 1 -- 172.21.15.133:0/329647265 wait complete. 2024-03-30T01:52:29.896 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T01:52:30.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.098+0000 7fa354e00640 1 Processor -- start 2024-03-30T01:52:30.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.098+0000 7fa354e00640 1 -- start start 2024-03-30T01:52:30.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.099+0000 7fa354e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa350143790 0x7fa3500cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:30.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.099+0000 7fa354e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa3500ccc40 0x7fa350070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:30.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.099+0000 7fa354e00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3500a76a0 con 0x7fa350070500 2024-03-30T01:52:30.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.099+0000 7fa354e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3500b38e0 con 0x7fa3500ccc40 2024-03-30T01:52:30.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.099+0000 7fa354e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3500cd180 con 0x7fa350143790 2024-03-30T01:52:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.100+0000 7fa347e00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa350070500 0x7fa3500cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58692/0 (socket says 172.21.15.133:58692) 2024-03-30T01:52:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.100+0000 7fa347e00640 1 -- 172.21.15.133:0/1745335933 learned_addr learned my addr 172.21.15.133:0/1745335933 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.100+0000 7fa34de00640 1 --2- 172.21.15.133:0/1745335933 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa350143790 0x7fa3500cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.100+0000 7fa34e800640 1 --2- 172.21.15.133:0/1745335933 >> v2:172.21.15.137:3300/0 conn(0x7fa3500ccc40 0x7fa350070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.100+0000 7fa34d400640 1 -- 172.21.15.133:0/1745335933 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2061320464 0 0) 0x7fa3500a76a0 con 0x7fa350070500 2024-03-30T01:52:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.100+0000 7fa34d400640 1 -- 172.21.15.133:0/1745335933 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa334003520 con 0x7fa350070500 2024-03-30T01:52:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.101+0000 7fa34d400640 1 -- 172.21.15.133:0/1745335933 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2250394778 0 0) 0x7fa334003520 con 0x7fa350070500 2024-03-30T01:52:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.101+0000 7fa34d400640 1 -- 172.21.15.133:0/1745335933 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa350143790 msgr2=0x7fa3500cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.101+0000 7fa34d400640 1 --2- 172.21.15.133:0/1745335933 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa350143790 0x7fa3500cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.101+0000 7fa34d400640 1 -- 172.21.15.133:0/1745335933 >> v2:172.21.15.137:3300/0 conn(0x7fa3500ccc40 msgr2=0x7fa350070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.101+0000 7fa34d400640 1 --2- 172.21.15.133:0/1745335933 >> v2:172.21.15.137:3300/0 conn(0x7fa3500ccc40 0x7fa350070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:30.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.101+0000 7fa34d400640 1 -- 172.21.15.133:0/1745335933 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa350070ea0 con 0x7fa350070500 2024-03-30T01:52:30.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.101+0000 7fa34d400640 1 -- 172.21.15.133:0/1745335933 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fa338001670 con 0x7fa350070500 2024-03-30T01:52:30.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.101+0000 7fa34d400640 1 -- 172.21.15.133:0/1745335933 >> v1:172.21.15.133:6789/0 conn(0x7fa350070500 legacy=0x7fa3500cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:30.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.101+0000 7fa34d400640 1 --2- 172.21.15.133:0/1745335933 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa350143790 0x7fa334003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:30.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.101+0000 7fa34d400640 1 --2- 172.21.15.133:0/1745335933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa334003f40 0x7fa3340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:30.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.101+0000 7fa34d400640 1 --2- 172.21.15.133:0/1745335933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa334004d00 0x7fa334005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:30.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.101+0000 7fa34d400640 1 -- 172.21.15.133:0/1745335933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3500b38e0 con 0x7fa334004d00 2024-03-30T01:52:30.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.101+0000 7fa34d400640 1 -- 172.21.15.133:0/1745335933 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3500cd180 con 0x7fa334003f40 2024-03-30T01:52:30.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.101+0000 7fa34d400640 1 -- 172.21.15.133:0/1745335933 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33400ba00 con 0x7fa350143790 2024-03-30T01:52:30.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.101+0000 7fa34e800640 1 --2- 172.21.15.133:0/1745335933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa334004d00 0x7fa334005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:30.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.101+0000 7fa34de00640 1 --2- 172.21.15.133:0/1745335933 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa350143790 0x7fa334003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:30.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.101+0000 7fa34e800640 1 -- 172.21.15.133:0/1745335933 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa350143790 msgr2=0x7fa334003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:30.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.101+0000 7fa34e800640 1 --2- 172.21.15.133:0/1745335933 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa350143790 0x7fa334003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:30.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.101+0000 7fa347e00640 1 --2- 172.21.15.133:0/1745335933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa334003f40 0x7fa3340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:30.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.101+0000 7fa34e800640 1 -- 172.21.15.133:0/1745335933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa334003f40 msgr2=0x7fa3340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:30.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.101+0000 7fa34e800640 1 --2- 172.21.15.133:0/1745335933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa334003f40 0x7fa3340047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:30.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.101+0000 7fa34e800640 1 -- 172.21.15.133:0/1745335933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa334003520 con 0x7fa334004d00 2024-03-30T01:52:30.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.102+0000 7fa34e800640 1 --2- 172.21.15.133:0/1745335933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa334004d00 0x7fa334005180 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa348009f90 tx=0x7fa3340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49de6bedab870d85 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.103+0000 7fa34d400640 1 -- 172.21.15.133:0/1745335933 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34802cc20 con 0x7fa334004d00 2024-03-30T01:52:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.103+0000 7fa34d400640 1 -- 172.21.15.133:0/1745335933 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34800f040 con 0x7fa334004d00 2024-03-30T01:52:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.103+0000 7fa34d400640 1 -- 172.21.15.133:0/1745335933 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348034440 con 0x7fa334004d00 2024-03-30T01:52:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.103+0000 7fa354e00640 1 -- 172.21.15.133:0/1745335933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa334004d00 msgr2=0x7fa334005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.103+0000 7fa354e00640 1 --2- 172.21.15.133:0/1745335933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa334004d00 0x7fa334005180 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa348009f90 tx=0x7fa3340057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.103+0000 7fa34e800640 1 -- 172.21.15.133:0/1745335933 reap_dead start 2024-03-30T01:52:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.103+0000 7fa354e00640 1 -- 172.21.15.133:0/1745335933 shutdown_connections 2024-03-30T01:52:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.103+0000 7fa354e00640 1 -- 172.21.15.133:0/1745335933 >> 172.21.15.133:0/1745335933 conn(0x7fa3500b07a0 msgr2=0x7fa3500b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.103+0000 7fa354e00640 1 -- 172.21.15.133:0/1745335933 shutdown_connections 2024-03-30T01:52:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.103+0000 7fa354e00640 1 -- 172.21.15.133:0/1745335933 wait complete. 2024-03-30T01:52:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.105+0000 7fa354e00640 1 Processor -- start 2024-03-30T01:52:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.105+0000 7fa354e00640 1 -- start start 2024-03-30T01:52:30.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.106+0000 7fa354e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa334004d00 0x7fa35015a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:30.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.106+0000 7fa354e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3501e4b30 0x7fa3501e4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:30.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.106+0000 7fa354e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3501e0760 0x7fa3501e0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:30.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.106+0000 7fa354e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3501f39e0 con 0x7fa3501e0760 2024-03-30T01:52:30.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.106+0000 7fa354e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3501e2180 con 0x7fa3501e4b30 2024-03-30T01:52:30.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.106+0000 7fa354e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35015a940 con 0x7fa334004d00 2024-03-30T01:52:30.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.106+0000 7fa34e800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3501e0760 0x7fa3501e0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:30.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.107+0000 7fa34e800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3501e0760 0x7fa3501e0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47770/0 (socket says 172.21.15.133:47770) 2024-03-30T01:52:30.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.107+0000 7fa34e800640 1 -- 172.21.15.133:0/1979678315 learned_addr learned my addr 172.21.15.133:0/1979678315 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:30.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.107+0000 7fa34de00640 1 --2- 172.21.15.133:0/1979678315 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa334004d00 0x7fa35015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:30.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.107+0000 7fa347e00640 1 --2- 172.21.15.133:0/1979678315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3501e4b30 0x7fa3501e4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:30.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.107+0000 7fa34e800640 1 -- 172.21.15.133:0/1979678315 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa334004d00 msgr2=0x7fa35015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:30.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.107+0000 7fa34e800640 1 --2- 172.21.15.133:0/1979678315 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa334004d00 0x7fa35015a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:30.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.107+0000 7fa34e800640 1 -- 172.21.15.133:0/1979678315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3501e4b30 msgr2=0x7fa3501e4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:30.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.107+0000 7fa34e800640 1 --2- 172.21.15.133:0/1979678315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3501e4b30 0x7fa3501e4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:30.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.107+0000 7fa34e800640 1 -- 172.21.15.133:0/1979678315 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3501f4240 con 0x7fa3501e0760 2024-03-30T01:52:30.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.107+0000 7fa347e00640 1 --2- 172.21.15.133:0/1979678315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3501e4b30 0x7fa3501e4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:30.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.107+0000 7fa34e800640 1 --2- 172.21.15.133:0/1979678315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3501e0760 0x7fa3501e0be0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa348037040 tx=0x7fa348009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:30.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.107+0000 7fa346000640 1 -- 172.21.15.133:0/1979678315 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348043070 con 0x7fa3501e0760 2024-03-30T01:52:30.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.108+0000 7fa346000640 1 -- 172.21.15.133:0/1979678315 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa348034b50 con 0x7fa3501e0760 2024-03-30T01:52:30.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.108+0000 7fa346000640 1 -- 172.21.15.133:0/1979678315 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348003990 con 0x7fa3501e0760 2024-03-30T01:52:30.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.108+0000 7fa354e00640 1 -- 172.21.15.133:0/1979678315 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3501e54d0 con 0x7fa3501e0760 2024-03-30T01:52:30.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.108+0000 7fa354e00640 1 -- 172.21.15.133:0/1979678315 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3501f3bf0 con 0x7fa3501e0760 2024-03-30T01:52:30.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.109+0000 7fa354e00640 1 -- 172.21.15.133:0/1979678315 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3501f43d0 con 0x7fa3501e0760 2024-03-30T01:52:30.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.110+0000 7fa346000640 1 -- 172.21.15.133:0/1979678315 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fa34803e440 con 0x7fa3501e0760 2024-03-30T01:52:30.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.110+0000 7fa346000640 1 --2- 172.21.15.133:0/1979678315 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa32c06ac30 0x7fa32c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:30.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.110+0000 7fa346000640 1 -- 172.21.15.133:0/1979678315 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa3480ab1d0 con 0x7fa3501e0760 2024-03-30T01:52:30.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.111+0000 7fa34de00640 1 --2- 172.21.15.133:0/1979678315 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa32c06ac30 0x7fa32c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:30.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.111+0000 7fa34de00640 1 --2- 172.21.15.133:0/1979678315 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa32c06ac30 0x7fa32c06d0f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa340009a10 tx=0x7fa340008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:30.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.115+0000 7fa346000640 1 -- 172.21.15.133:0/1979678315 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fa3480763b0 con 0x7fa3501e0760 2024-03-30T01:52:30.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.306+0000 7fa354e00640 1 -- 172.21.15.133:0/1979678315 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa350066d80 con 0x7fa3501e0760 2024-03-30T01:52:30.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.307+0000 7fa346000640 1 -- 172.21.15.133:0/1979678315 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa3480799d0 con 0x7fa3501e0760 2024-03-30T01:52:30.313 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-03-30T01:52:30.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.309+0000 7fa354e00640 1 -- 172.21.15.133:0/1979678315 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa32c06ac30 msgr2=0x7fa32c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:30.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.309+0000 7fa354e00640 1 --2- 172.21.15.133:0/1979678315 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa32c06ac30 0x7fa32c06d0f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa340009a10 tx=0x7fa340008040 comp rx=0 tx=0).stop 2024-03-30T01:52:30.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.309+0000 7fa354e00640 1 -- 172.21.15.133:0/1979678315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3501e0760 msgr2=0x7fa3501e0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:30.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.309+0000 7fa354e00640 1 --2- 172.21.15.133:0/1979678315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3501e0760 0x7fa3501e0be0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa348037040 tx=0x7fa348009750 comp rx=0 tx=0).stop 2024-03-30T01:52:30.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.309+0000 7fa354e00640 1 -- 172.21.15.133:0/1979678315 shutdown_connections 2024-03-30T01:52:30.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.309+0000 7fa354e00640 1 --2- 172.21.15.133:0/1979678315 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa32c06ac30 0x7fa32c06d0f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:30.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.309+0000 7fa354e00640 1 --2- 172.21.15.133:0/1979678315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3501e0760 0x7fa3501e0be0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:30.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.309+0000 7fa354e00640 1 --2- 172.21.15.133:0/1979678315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3501e4b30 0x7fa3501e4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:30.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.309+0000 7fa354e00640 1 --2- 172.21.15.133:0/1979678315 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa334004d00 0x7fa35015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:30.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.309+0000 7fa354e00640 1 -- 172.21.15.133:0/1979678315 >> 172.21.15.133:0/1979678315 conn(0x7fa3500b07a0 msgr2=0x7fa35006c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:30.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.310+0000 7fa354e00640 1 -- 172.21.15.133:0/1979678315 shutdown_connections 2024-03-30T01:52:30.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.310+0000 7fa354e00640 1 -- 172.21.15.133:0/1979678315 wait complete. 2024-03-30T01:52:30.334 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T01:52:30.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.541+0000 7f6a62400640 1 Processor -- start 2024-03-30T01:52:30.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.541+0000 7f6a62400640 1 -- start start 2024-03-30T01:52:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.543+0000 7f6a62400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6a5c0cfb80 0x7f6a5c0b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.543+0000 7f6a62400640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5c15d030 con 0x7f6a5c0d0af0 2024-03-30T01:52:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.543+0000 7f6a62400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5c0b5af0 con 0x7f6a5c15cc50 2024-03-30T01:52:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.543+0000 7f6a62400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5c0d1c50 con 0x7f6a5c0cfb80 2024-03-30T01:52:30.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.543+0000 7f6a52a00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6a5c0d0af0 0x7f6a5c0cf470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58698/0 (socket says 172.21.15.133:58698) 2024-03-30T01:52:30.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.543+0000 7f6a52a00640 1 -- 172.21.15.133:0/122753617 learned_addr learned my addr 172.21.15.133:0/122753617 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:30.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.543+0000 7f6a5be00640 1 --2- 172.21.15.133:0/122753617 >> v2:172.21.15.133:3300/0 conn(0x7f6a5c0cfb80 0x7f6a5c0b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.544+0000 7f6a5aa00640 1 -- 172.21.15.133:0/122753617 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290781793 0 0) 0x7f6a5c15d030 con 0x7f6a5c0d0af0 2024-03-30T01:52:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.544+0000 7f6a5aa00640 1 -- 172.21.15.133:0/122753617 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a40003520 con 0x7f6a5c0d0af0 2024-03-30T01:52:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.544+0000 7f6a5be00640 1 -- 172.21.15.133:0/122753617 >> v1:172.21.15.137:6789/0 conn(0x7f6a5c15cc50 legacy=0x7f6a5c0d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.544+0000 7f6a5be00640 1 -- 172.21.15.133:0/122753617 >> v1:172.21.15.133:6789/0 conn(0x7f6a5c0d0af0 legacy=0x7f6a5c0cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.544+0000 7f6a5aa00640 1 -- 172.21.15.133:0/122753617 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651483154 0 0) 0x7f6a5c0b5af0 con 0x7f6a5c15cc50 2024-03-30T01:52:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.544+0000 7f6a5be00640 1 -- 172.21.15.133:0/122753617 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c0d10d0 con 0x7f6a5c0cfb80 2024-03-30T01:52:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.545+0000 7f6a5be00640 1 --2- 172.21.15.133:0/122753617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a5c0cfb80 0x7f6a5c0b14f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6a54009d90 tx=0x7f6a5402bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be88a85f01aea9a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.545+0000 7f6a5aa00640 1 -- 172.21.15.133:0/122753617 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5402ccf0 con 0x7f6a5c0cfb80 2024-03-30T01:52:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.545+0000 7f6a5aa00640 1 -- 172.21.15.133:0/122753617 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5402ce50 con 0x7f6a5c0cfb80 2024-03-30T01:52:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.545+0000 7f6a5aa00640 1 -- 172.21.15.133:0/122753617 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a54034660 con 0x7f6a5c0cfb80 2024-03-30T01:52:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.546+0000 7f6a62400640 1 -- 172.21.15.133:0/122753617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a5c0cfb80 msgr2=0x7f6a5c0b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.546+0000 7f6a62400640 1 --2- 172.21.15.133:0/122753617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a5c0cfb80 0x7f6a5c0b14f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6a54009d90 tx=0x7f6a5402bf40 comp rx=0 tx=0).stop 2024-03-30T01:52:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.546+0000 7f6a62400640 1 -- 172.21.15.133:0/122753617 shutdown_connections 2024-03-30T01:52:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.546+0000 7f6a62400640 1 --2- 172.21.15.133:0/122753617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a5c0cfb80 0x7f6a5c0b14f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.546+0000 7f6a62400640 1 -- 172.21.15.133:0/122753617 >> 172.21.15.133:0/122753617 conn(0x7f6a5c071a40 msgr2=0x7f6a5c06b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.546+0000 7f6a62400640 1 -- 172.21.15.133:0/122753617 shutdown_connections 2024-03-30T01:52:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.546+0000 7f6a62400640 1 -- 172.21.15.133:0/122753617 wait complete. 2024-03-30T01:52:30.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.548+0000 7f6a62400640 1 Processor -- start 2024-03-30T01:52:30.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.548+0000 7f6a62400640 1 -- start start 2024-03-30T01:52:30.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.549+0000 7f6a62400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a5c0cfb80 0x7f6a5c0acd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:30.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.549+0000 7f6a62400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a5c0d0af0 0x7f6a5c0c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:30.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.549+0000 7f6a62400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a5c15cc50 0x7f6a5c0c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:30.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.549+0000 7f6a62400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c0ac7d0 con 0x7f6a5c0cfb80 2024-03-30T01:52:30.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.549+0000 7f6a62400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c0ab730 con 0x7f6a5c0d0af0 2024-03-30T01:52:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.549+0000 7f6a62400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c0aba10 con 0x7f6a5c15cc50 2024-03-30T01:52:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.549+0000 7f6a5b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a5c0cfb80 0x7f6a5c0acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.549+0000 7f6a5b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a5c0cfb80 0x7f6a5c0acd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47788/0 (socket says 172.21.15.133:47788) 2024-03-30T01:52:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.549+0000 7f6a5b400640 1 -- 172.21.15.133:0/3892700809 learned_addr learned my addr 172.21.15.133:0/3892700809 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.549+0000 7f6a52a00640 1 --2- 172.21.15.133:0/3892700809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a5c0d0af0 0x7f6a5c0c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.549+0000 7f6a5b400640 1 -- 172.21.15.133:0/3892700809 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a5c15cc50 msgr2=0x7f6a5c0c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.549+0000 7f6a5b400640 1 --2- 172.21.15.133:0/3892700809 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a5c15cc50 0x7f6a5c0c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.549+0000 7f6a5b400640 1 -- 172.21.15.133:0/3892700809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a5c0d0af0 msgr2=0x7f6a5c0c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.549+0000 7f6a5b400640 1 --2- 172.21.15.133:0/3892700809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a5c0d0af0 0x7f6a5c0c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.549+0000 7f6a5b400640 1 -- 172.21.15.133:0/3892700809 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a54009a70 con 0x7f6a5c0cfb80 2024-03-30T01:52:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.550+0000 7f6a5b400640 1 --2- 172.21.15.133:0/3892700809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a5c0cfb80 0x7f6a5c0acd00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00c410 tx=0x7f6a4c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.550+0000 7f6a53e00640 1 -- 172.21.15.133:0/3892700809 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c0035f0 con 0x7f6a5c0cfb80 2024-03-30T01:52:30.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.550+0000 7f6a53e00640 1 -- 172.21.15.133:0/3892700809 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4c003770 con 0x7f6a5c0cfb80 2024-03-30T01:52:30.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.550+0000 7f6a62400640 1 -- 172.21.15.133:0/3892700809 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5c0abcf0 con 0x7f6a5c0cfb80 2024-03-30T01:52:30.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.550+0000 7f6a53e00640 1 -- 172.21.15.133:0/3892700809 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c003b20 con 0x7f6a5c0cfb80 2024-03-30T01:52:30.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.550+0000 7f6a62400640 1 -- 172.21.15.133:0/3892700809 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5c0ac2b0 con 0x7f6a5c0cfb80 2024-03-30T01:52:30.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.551+0000 7f6a62400640 1 -- 172.21.15.133:0/3892700809 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5c0ac4d0 con 0x7f6a5c0cfb80 2024-03-30T01:52:30.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.552+0000 7f6a53e00640 1 -- 172.21.15.133:0/3892700809 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f6a4c003c80 con 0x7f6a5c0cfb80 2024-03-30T01:52:30.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.553+0000 7f6a53e00640 1 --2- 172.21.15.133:0/3892700809 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6a3806ac00 0x7f6a3806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:30.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.553+0000 7f6a53e00640 1 -- 172.21.15.133:0/3892700809 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6a4c0889b0 con 0x7f6a5c0cfb80 2024-03-30T01:52:30.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.553+0000 7f6a52a00640 1 --2- 172.21.15.133:0/3892700809 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6a3806ac00 0x7f6a3806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.554+0000 7f6a52a00640 1 --2- 172.21.15.133:0/3892700809 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6a3806ac00 0x7f6a3806d0c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c14ed10 tx=0x7f6a44009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:30.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.557+0000 7f6a53e00640 1 -- 172.21.15.133:0/3892700809 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f6a4c053ba0 con 0x7f6a5c0cfb80 2024-03-30T01:52:30.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.756+0000 7f6a62400640 1 -- 172.21.15.133:0/3892700809 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6a5c066d80 con 0x7f6a5c0cfb80 2024-03-30T01:52:30.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.757+0000 7f6a53e00640 1 -- 172.21.15.133:0/3892700809 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6a4c017020 con 0x7f6a5c0cfb80 2024-03-30T01:52:30.763 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-03-30T01:52:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.760+0000 7f6a62400640 1 -- 172.21.15.133:0/3892700809 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6a3806ac00 msgr2=0x7f6a3806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.760+0000 7f6a62400640 1 --2- 172.21.15.133:0/3892700809 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6a3806ac00 0x7f6a3806d0c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c14ed10 tx=0x7f6a44009040 comp rx=0 tx=0).stop 2024-03-30T01:52:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.760+0000 7f6a62400640 1 -- 172.21.15.133:0/3892700809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a5c0cfb80 msgr2=0x7f6a5c0acd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:30.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.760+0000 7f6a62400640 1 --2- 172.21.15.133:0/3892700809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a5c0cfb80 0x7f6a5c0acd00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00c410 tx=0x7f6a4c00c8d0 comp rx=0 tx=0).stop 2024-03-30T01:52:30.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.760+0000 7f6a62400640 1 -- 172.21.15.133:0/3892700809 shutdown_connections 2024-03-30T01:52:30.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.760+0000 7f6a62400640 1 --2- 172.21.15.133:0/3892700809 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6a3806ac00 0x7f6a3806d0c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:30.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.760+0000 7f6a62400640 1 --2- 172.21.15.133:0/3892700809 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a5c15cc50 0x7f6a5c0c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:30.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.760+0000 7f6a62400640 1 --2- 172.21.15.133:0/3892700809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a5c0d0af0 0x7f6a5c0c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:30.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.760+0000 7f6a62400640 1 --2- 172.21.15.133:0/3892700809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a5c0cfb80 0x7f6a5c0acd00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:30.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.760+0000 7f6a62400640 1 -- 172.21.15.133:0/3892700809 >> 172.21.15.133:0/3892700809 conn(0x7f6a5c071a40 msgr2=0x7f6a5c0b7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:30.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.760+0000 7f6a62400640 1 -- 172.21.15.133:0/3892700809 shutdown_connections 2024-03-30T01:52:30.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.760+0000 7f6a62400640 1 -- 172.21.15.133:0/3892700809 wait complete. 2024-03-30T01:52:30.785 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T01:52:30.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.990+0000 7f70fe000640 1 Processor -- start 2024-03-30T01:52:30.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.990+0000 7f70fe000640 1 -- start start 2024-03-30T01:52:30.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.991+0000 7f70fe000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f70f806e2e0 0x7f70f8070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:30.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.991+0000 7f70fe000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70f8070a40 0x7f70f815d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:30.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.991+0000 7f70fe000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f8070e90 con 0x7f70f8143220 2024-03-30T01:52:30.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.991+0000 7f70fe000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f80cc5c0 con 0x7f70f806e2e0 2024-03-30T01:52:30.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.991+0000 7f70fe000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f80ce400 con 0x7f70f8070a40 2024-03-30T01:52:30.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.992+0000 7f70f7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70f8070a40 0x7f70f815d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:30.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.992+0000 7f70f7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70f8070a40 0x7f70f815d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.133:46094/0 (socket says 172.21.15.133:46094) 2024-03-30T01:52:30.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.992+0000 7f70f7e00640 1 -- 172.21.15.133:0/591431124 learned_addr learned my addr 172.21.15.133:0/591431124 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:30.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.992+0000 7f70eea00640 1 --2- 172.21.15.133:0/591431124 >> v2:172.21.15.137:3300/0 conn(0x7f70f806e2e0 0x7f70f8070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:30.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.992+0000 7f70f7e00640 1 -- 172.21.15.133:0/591431124 >> v2:172.21.15.137:3300/0 conn(0x7f70f806e2e0 msgr2=0x7f70f8070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:30.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.992+0000 7f70f7e00640 1 --2- 172.21.15.133:0/591431124 >> v2:172.21.15.137:3300/0 conn(0x7f70f806e2e0 0x7f70f8070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:30.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.992+0000 7f70f7e00640 1 -- 172.21.15.133:0/591431124 >> v1:172.21.15.137:6789/0 conn(0x7f70f8143220 legacy=0x7f70f80cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:30.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.993+0000 7f70f7e00640 1 -- 172.21.15.133:0/591431124 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f806d0e0 con 0x7f70f8070a40 2024-03-30T01:52:30.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.993+0000 7f70eea00640 1 --2- 172.21.15.133:0/591431124 >> v2:172.21.15.137:3300/0 conn(0x7f70f806e2e0 0x7f70f8070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:31.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.994+0000 7f70f7e00640 1 --2- 172.21.15.133:0/591431124 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70f8070a40 0x7f70f815d3b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009e50 tx=0x7f70f002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39d4d3531fa98f42 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:31.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.994+0000 7f70f6a00640 1 -- 172.21.15.133:0/591431124 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f002cb00 con 0x7f70f8070a40 2024-03-30T01:52:31.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.994+0000 7f70f6a00640 1 -- 172.21.15.133:0/591431124 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f002cc60 con 0x7f70f8070a40 2024-03-30T01:52:31.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.994+0000 7f70f6a00640 1 -- 172.21.15.133:0/591431124 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f00343f0 con 0x7f70f8070a40 2024-03-30T01:52:31.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.995+0000 7f70fe000640 1 -- 172.21.15.133:0/591431124 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70f8070a40 msgr2=0x7f70f815d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:31.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.995+0000 7f70fe000640 1 --2- 172.21.15.133:0/591431124 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70f8070a40 0x7f70f815d3b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009e50 tx=0x7f70f002bf60 comp rx=0 tx=0).stop 2024-03-30T01:52:31.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.995+0000 7f70fe000640 1 -- 172.21.15.133:0/591431124 shutdown_connections 2024-03-30T01:52:31.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.995+0000 7f70fe000640 1 --2- 172.21.15.133:0/591431124 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70f8070a40 0x7f70f815d3b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:31.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.995+0000 7f70fe000640 1 --2- 172.21.15.133:0/591431124 >> v2:172.21.15.137:3300/0 conn(0x7f70f806e2e0 0x7f70f8070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:31.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.995+0000 7f70fe000640 1 -- 172.21.15.133:0/591431124 >> 172.21.15.133:0/591431124 conn(0x7f70f80b07a0 msgr2=0x7f70f80b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:31.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.995+0000 7f70fe000640 1 -- 172.21.15.133:0/591431124 shutdown_connections 2024-03-30T01:52:31.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.995+0000 7f70fe000640 1 -- 172.21.15.133:0/591431124 wait complete. 2024-03-30T01:52:31.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.996+0000 7f70fe000640 1 Processor -- start 2024-03-30T01:52:31.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.997+0000 7f70fe000640 1 -- start start 2024-03-30T01:52:31.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.998+0000 7f70fe000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70f806e2e0 0x7f70f813c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:31.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.998+0000 7f70fe000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70f8070a40 0x7f70f813ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:31.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.998+0000 7f70fe000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70f8143220 0x7f70f8138c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:31.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.998+0000 7f70fe000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f80c4240 con 0x7f70f806e2e0 2024-03-30T01:52:31.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.998+0000 7f70fe000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f813c110 con 0x7f70f8070a40 2024-03-30T01:52:31.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.998+0000 7f70fe000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f813b590 con 0x7f70f8143220 2024-03-30T01:52:31.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.998+0000 7f70f7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70f806e2e0 0x7f70f813c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:31.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.998+0000 7f70f7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70f806e2e0 0x7f70f813c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47798/0 (socket says 172.21.15.133:47798) 2024-03-30T01:52:31.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.998+0000 7f70f7400640 1 -- 172.21.15.133:0/918513418 learned_addr learned my addr 172.21.15.133:0/918513418 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:31.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.998+0000 7f70f7e00640 1 --2- 172.21.15.133:0/918513418 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70f8143220 0x7f70f8138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:31.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.998+0000 7f70eea00640 1 --2- 172.21.15.133:0/918513418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70f8070a40 0x7f70f813ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:31.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.998+0000 7f70f7400640 1 -- 172.21.15.133:0/918513418 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70f8143220 msgr2=0x7f70f8138c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:31.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.998+0000 7f70f7400640 1 --2- 172.21.15.133:0/918513418 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70f8143220 0x7f70f8138c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:31.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.998+0000 7f70f7400640 1 -- 172.21.15.133:0/918513418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70f8070a40 msgr2=0x7f70f813ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:31.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.998+0000 7f70f7400640 1 --2- 172.21.15.133:0/918513418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70f8070a40 0x7f70f813ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:31.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.998+0000 7f70f7400640 1 -- 172.21.15.133:0/918513418 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f0009b30 con 0x7f70f806e2e0 2024-03-30T01:52:31.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.999+0000 7f70f7400640 1 --2- 172.21.15.133:0/918513418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70f806e2e0 0x7f70f813c8f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f70e800c400 tx=0x7f70e800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:31.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.999+0000 7f70efe00640 1 -- 172.21.15.133:0/918513418 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e80052d0 con 0x7f70f806e2e0 2024-03-30T01:52:31.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.999+0000 7f70efe00640 1 -- 172.21.15.133:0/918513418 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e8005430 con 0x7f70f806e2e0 2024-03-30T01:52:31.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.999+0000 7f70efe00640 1 -- 172.21.15.133:0/918513418 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e8003830 con 0x7f70f806e2e0 2024-03-30T01:52:31.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.999+0000 7f70fe000640 1 -- 172.21.15.133:0/918513418 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f813b870 con 0x7f70f806e2e0 2024-03-30T01:52:31.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:30.999+0000 7f70fe000640 1 -- 172.21.15.133:0/918513418 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f813be30 con 0x7f70f806e2e0 2024-03-30T01:52:31.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.000+0000 7f70fe000640 1 -- 172.21.15.133:0/918513418 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f8066d80 con 0x7f70f806e2e0 2024-03-30T01:52:31.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.001+0000 7f70efe00640 1 -- 172.21.15.133:0/918513418 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f70e8003990 con 0x7f70f806e2e0 2024-03-30T01:52:31.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.002+0000 7f70efe00640 1 --2- 172.21.15.133:0/918513418 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f70d406ac00 0x7f70d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:31.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.002+0000 7f70efe00640 1 -- 172.21.15.133:0/918513418 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f70e80887e0 con 0x7f70f806e2e0 2024-03-30T01:52:31.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.002+0000 7f70eea00640 1 --2- 172.21.15.133:0/918513418 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f70d406ac00 0x7f70d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:31.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.003+0000 7f70eea00640 1 --2- 172.21.15.133:0/918513418 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f70d406ac00 0x7f70d406d0c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f70f81f6730 tx=0x7f70e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:31.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.007+0000 7f70efe00640 1 -- 172.21.15.133:0/918513418 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f70e8053930 con 0x7f70f806e2e0 2024-03-30T01:52:31.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.237+0000 7f70fe000640 1 -- 172.21.15.133:0/918513418 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70f8070e90 con 0x7f70f806e2e0 2024-03-30T01:52:31.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.239+0000 7f70efe00640 1 -- 172.21.15.133:0/918513418 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4737 (secure 0 0 0) 0x7f70f8070e90 con 0x7f70f806e2e0 2024-03-30T01:52:31.245 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:31.245 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2218506023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2218506023},{"type":"v1","addr":"172.21.15.137:6835","nonce":2218506023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2935514153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2935514153},{"type":"v1","addr":"172.21.15.133:6836","nonce":2935514153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2942187095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2942187095},{"type":"v1","addr":"172.21.15.133:6837","nonce":2942187095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T01:51:32.776583+0000","modified":"2024-03-30T01:51:35.787820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/225370013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":225370013},{"type":"v1","addr":"172.21.15.137:6834","nonce":225370013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-30T01:52:31.245 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 7 2024-03-30T01:52:31.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.242+0000 7f70fe000640 1 -- 172.21.15.133:0/918513418 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f70d406ac00 msgr2=0x7f70d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:31.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.242+0000 7f70fe000640 1 --2- 172.21.15.133:0/918513418 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f70d406ac00 0x7f70d406d0c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f70f81f6730 tx=0x7f70e0008040 comp rx=0 tx=0).stop 2024-03-30T01:52:31.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.242+0000 7f70fe000640 1 -- 172.21.15.133:0/918513418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70f806e2e0 msgr2=0x7f70f813c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:31.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.242+0000 7f70fe000640 1 --2- 172.21.15.133:0/918513418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70f806e2e0 0x7f70f813c8f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f70e800c400 tx=0x7f70e800c8c0 comp rx=0 tx=0).stop 2024-03-30T01:52:31.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.242+0000 7f70fe000640 1 -- 172.21.15.133:0/918513418 shutdown_connections 2024-03-30T01:52:31.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.242+0000 7f70fe000640 1 --2- 172.21.15.133:0/918513418 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f70d406ac00 0x7f70d406d0c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:31.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.242+0000 7f70fe000640 1 --2- 172.21.15.133:0/918513418 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70f8143220 0x7f70f8138c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:31.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.242+0000 7f70fe000640 1 --2- 172.21.15.133:0/918513418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70f8070a40 0x7f70f813ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:31.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.242+0000 7f70fe000640 1 --2- 172.21.15.133:0/918513418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70f806e2e0 0x7f70f813c8f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:31.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.242+0000 7f70fe000640 1 -- 172.21.15.133:0/918513418 >> 172.21.15.133:0/918513418 conn(0x7f70f80b07a0 msgr2=0x7f70f8141640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:31.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.242+0000 7f70fe000640 1 -- 172.21.15.133:0/918513418 shutdown_connections 2024-03-30T01:52:31.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.242+0000 7f70fe000640 1 -- 172.21.15.133:0/918513418 wait complete. 2024-03-30T01:52:31.266 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:52:31.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.467+0000 7f736d600640 1 Processor -- start 2024-03-30T01:52:31.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.467+0000 7f736d600640 1 -- start start 2024-03-30T01:52:31.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.469+0000 7f736d600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f73680b61d0 0x7f73680d1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:31.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.469+0000 7f736d600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73680d1c90 con 0x7f73680cdc50 2024-03-30T01:52:31.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.469+0000 7f736d600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f736815cfb0 con 0x7f736815cbd0 2024-03-30T01:52:31.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.469+0000 7f736d600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73680d1ef0 con 0x7f73680b61d0 2024-03-30T01:52:31.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.469+0000 7f7367400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f73680b61d0 0x7f73680d1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:31.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.469+0000 7f7367400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f73680b61d0 0x7f73680d1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47802/0 (socket says 172.21.15.133:47802) 2024-03-30T01:52:31.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.469+0000 7f7367400640 1 -- 172.21.15.133:0/866696072 learned_addr learned my addr 172.21.15.133:0/866696072 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:31.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.469+0000 7f7367400640 1 -- 172.21.15.133:0/866696072 >> v1:172.21.15.137:6789/0 conn(0x7f736815cbd0 legacy=0x7f73680d2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:31.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.469+0000 7f7367400640 1 -- 172.21.15.133:0/866696072 >> v1:172.21.15.133:6789/0 conn(0x7f73680cdc50 legacy=0x7f73680b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:31.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.470+0000 7f7367400640 1 -- 172.21.15.133:0/866696072 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73680d21d0 con 0x7f73680b61d0 2024-03-30T01:52:31.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.469+0000 7f7365600640 1 -- 172.21.15.133:0/866696072 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058049966 0 0) 0x7f73680d1c90 con 0x7f73680cdc50 2024-03-30T01:52:31.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.471+0000 7f7367400640 1 --2- 172.21.15.133:0/866696072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73680b61d0 0x7f73680d1750 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7360009870 tx=0x7f736002bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=795bc40d09db593 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:31.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.471+0000 7f7365600640 1 -- 172.21.15.133:0/866696072 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736002d870 con 0x7f73680b61d0 2024-03-30T01:52:31.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.471+0000 7f7365600640 1 -- 172.21.15.133:0/866696072 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736002d9d0 con 0x7f73680b61d0 2024-03-30T01:52:31.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.471+0000 7f7365600640 1 -- 172.21.15.133:0/866696072 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736002dd60 con 0x7f73680b61d0 2024-03-30T01:52:31.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.471+0000 7f736d600640 1 -- 172.21.15.133:0/866696072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73680b61d0 msgr2=0x7f73680d1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:31.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.471+0000 7f736d600640 1 --2- 172.21.15.133:0/866696072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73680b61d0 0x7f73680d1750 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7360009870 tx=0x7f736002bab0 comp rx=0 tx=0).stop 2024-03-30T01:52:31.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.471+0000 7f736d600640 1 -- 172.21.15.133:0/866696072 shutdown_connections 2024-03-30T01:52:31.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.472+0000 7f736d600640 1 --2- 172.21.15.133:0/866696072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73680b61d0 0x7f73680d1750 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:31.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.472+0000 7f736d600640 1 -- 172.21.15.133:0/866696072 >> 172.21.15.133:0/866696072 conn(0x7f7368071830 msgr2=0x7f7368071c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:31.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.472+0000 7f736d600640 1 -- 172.21.15.133:0/866696072 shutdown_connections 2024-03-30T01:52:31.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.472+0000 7f736d600640 1 -- 172.21.15.133:0/866696072 wait complete. 2024-03-30T01:52:31.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.473+0000 7f736d600640 1 Processor -- start 2024-03-30T01:52:31.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.474+0000 7f736d600640 1 -- start start 2024-03-30T01:52:31.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.474+0000 7f736d600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73680cdc50 0x7f73680b8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:31.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.474+0000 7f736d600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f736815cbd0 0x7f73681f1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:31.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.474+0000 7f736d600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73680cc620 0x7f73681f2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:31.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.475+0000 7f736d600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736815f3d0 con 0x7f73680cdc50 2024-03-30T01:52:31.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.475+0000 7f736d600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736815f600 con 0x7f73680cc620 2024-03-30T01:52:31.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.475+0000 7f736d600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736815f8e0 con 0x7f736815cbd0 2024-03-30T01:52:31.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.475+0000 7f7366a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73680cdc50 0x7f73680b8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:31.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.475+0000 7f7366a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73680cdc50 0x7f73680b8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47814/0 (socket says 172.21.15.133:47814) 2024-03-30T01:52:31.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.475+0000 7f7366a00640 1 -- 172.21.15.133:0/2994987827 learned_addr learned my addr 172.21.15.133:0/2994987827 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:31.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.475+0000 7f7366000640 1 --2- 172.21.15.133:0/2994987827 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f736815cbd0 0x7f73681f1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:31.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.475+0000 7f7367400640 1 --2- 172.21.15.133:0/2994987827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73680cc620 0x7f73681f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:31.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.475+0000 7f7366a00640 1 -- 172.21.15.133:0/2994987827 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f736815cbd0 msgr2=0x7f73681f1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:31.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.475+0000 7f7366a00640 1 --2- 172.21.15.133:0/2994987827 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f736815cbd0 0x7f73681f1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:31.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.475+0000 7f7366a00640 1 -- 172.21.15.133:0/2994987827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73680cc620 msgr2=0x7f73681f2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:31.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.475+0000 7f7366a00640 1 --2- 172.21.15.133:0/2994987827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73680cc620 0x7f73681f2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:31.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.475+0000 7f7366a00640 1 -- 172.21.15.133:0/2994987827 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73600094d0 con 0x7f73680cdc50 2024-03-30T01:52:31.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.475+0000 7f7366000640 1 --2- 172.21.15.133:0/2994987827 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f736815cbd0 0x7f73681f1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:31.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.476+0000 7f7366a00640 1 --2- 172.21.15.133:0/2994987827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73680cdc50 0x7f73680b8320 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f735800c730 tx=0x7f735800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:31.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.476+0000 7f735ea00640 1 -- 172.21.15.133:0/2994987827 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7358003b70 con 0x7f73680cdc50 2024-03-30T01:52:31.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.476+0000 7f735ea00640 1 -- 172.21.15.133:0/2994987827 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7358003cf0 con 0x7f73680cdc50 2024-03-30T01:52:31.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.476+0000 7f735ea00640 1 -- 172.21.15.133:0/2994987827 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7358003ea0 con 0x7f73680cdc50 2024-03-30T01:52:31.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.476+0000 7f736d600640 1 -- 172.21.15.133:0/2994987827 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f736815fbc0 con 0x7f73680cdc50 2024-03-30T01:52:31.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.476+0000 7f736d600640 1 -- 172.21.15.133:0/2994987827 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73680b8860 con 0x7f73680cdc50 2024-03-30T01:52:31.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.477+0000 7f736d600640 1 -- 172.21.15.133:0/2994987827 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7368066d80 con 0x7f73680cdc50 2024-03-30T01:52:31.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.478+0000 7f735ea00640 1 -- 172.21.15.133:0/2994987827 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f735800aa90 con 0x7f73680cdc50 2024-03-30T01:52:31.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.479+0000 7f735ea00640 1 --2- 172.21.15.133:0/2994987827 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f734406ac00 0x7f734406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:31.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.479+0000 7f735ea00640 1 -- 172.21.15.133:0/2994987827 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f73580891f0 con 0x7f73680cdc50 2024-03-30T01:52:31.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.479+0000 7f7366000640 1 --2- 172.21.15.133:0/2994987827 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f734406ac00 0x7f734406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:31.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.480+0000 7f7366000640 1 --2- 172.21.15.133:0/2994987827 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f734406ac00 0x7f734406d0c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f73680b3f90 tx=0x7f7350009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:31.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.483+0000 7f735ea00640 1 -- 172.21.15.133:0/2994987827 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f7358054340 con 0x7f73680cdc50 2024-03-30T01:52:31.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.678+0000 7f736d600640 1 -- 172.21.15.133:0/2994987827 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73680c93b0 con 0x7f73680cdc50 2024-03-30T01:52:31.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.681+0000 7f735ea00640 1 -- 172.21.15.133:0/2994987827 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16335 (secure 0 0 0) 0x7f7358057960 con 0x7f73680cdc50 2024-03-30T01:52:31.688 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:31.688 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:52:15.520675+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:51:31.245378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T01:51:31.774247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:52:31.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.684+0000 7f736d600640 1 -- 172.21.15.133:0/2994987827 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f734406ac00 msgr2=0x7f734406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:31.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.684+0000 7f736d600640 1 --2- 172.21.15.133:0/2994987827 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f734406ac00 0x7f734406d0c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f73680b3f90 tx=0x7f7350009040 comp rx=0 tx=0).stop 2024-03-30T01:52:31.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.684+0000 7f736d600640 1 -- 172.21.15.133:0/2994987827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73680cdc50 msgr2=0x7f73680b8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:31.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.684+0000 7f736d600640 1 --2- 172.21.15.133:0/2994987827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73680cdc50 0x7f73680b8320 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f735800c730 tx=0x7f735800cbf0 comp rx=0 tx=0).stop 2024-03-30T01:52:31.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.684+0000 7f736d600640 1 -- 172.21.15.133:0/2994987827 shutdown_connections 2024-03-30T01:52:31.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.684+0000 7f736d600640 1 --2- 172.21.15.133:0/2994987827 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f734406ac00 0x7f734406d0c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:31.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.684+0000 7f736d600640 1 --2- 172.21.15.133:0/2994987827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73680cc620 0x7f73681f2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:31.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.684+0000 7f736d600640 1 --2- 172.21.15.133:0/2994987827 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f736815cbd0 0x7f73681f1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:31.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.684+0000 7f736d600640 1 --2- 172.21.15.133:0/2994987827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73680cdc50 0x7f73680b8320 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:31.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.684+0000 7f736d600640 1 -- 172.21.15.133:0/2994987827 >> 172.21.15.133:0/2994987827 conn(0x7f7368071830 msgr2=0x7f736815be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:31.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.684+0000 7f736d600640 1 -- 172.21.15.133:0/2994987827 shutdown_connections 2024-03-30T01:52:31.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.684+0000 7f736d600640 1 -- 172.21.15.133:0/2994987827 wait complete. 2024-03-30T01:52:31.710 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-30T01:52:31.710 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T01:52:31.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.911+0000 7fb7f5000640 1 Processor -- start 2024-03-30T01:52:31.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.911+0000 7fb7f5000640 1 -- start start 2024-03-30T01:52:31.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.912+0000 7fb7f5000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb7f0143790 0x7fb7f00cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:31.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.912+0000 7fb7f5000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb7f00ccc40 0x7fb7f0070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:31.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.912+0000 7fb7f5000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f00a76a0 con 0x7fb7f0070500 2024-03-30T01:52:31.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.912+0000 7fb7f5000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f0070ed0 con 0x7fb7f00ccc40 2024-03-30T01:52:31.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.912+0000 7fb7f5000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f00b38e0 con 0x7fb7f0143790 2024-03-30T01:52:31.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.913+0000 7fb7ee800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb7f00ccc40 0x7fb7f0070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:31.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.913+0000 7fb7e7e00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb7f0070500 0x7fb7f00cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58714/0 (socket says 172.21.15.133:58714) 2024-03-30T01:52:31.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.913+0000 7fb7e7e00640 1 -- 172.21.15.133:0/3690021060 learned_addr learned my addr 172.21.15.133:0/3690021060 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:31.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.913+0000 7fb7ede00640 1 --2- 172.21.15.133:0/3690021060 >> v2:172.21.15.137:3300/0 conn(0x7fb7f0143790 0x7fb7f00cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:31.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.913+0000 7fb7ed400640 1 -- 172.21.15.133:0/3690021060 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080167329 0 0) 0x7fb7f00a76a0 con 0x7fb7f0070500 2024-03-30T01:52:31.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.913+0000 7fb7ed400640 1 -- 172.21.15.133:0/3690021060 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7d4003520 con 0x7fb7f0070500 2024-03-30T01:52:31.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.914+0000 7fb7ee800640 1 -- 172.21.15.133:0/3690021060 >> v2:172.21.15.137:3300/0 conn(0x7fb7f0143790 msgr2=0x7fb7f00cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:31.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.914+0000 7fb7ee800640 1 --2- 172.21.15.133:0/3690021060 >> v2:172.21.15.137:3300/0 conn(0x7fb7f0143790 0x7fb7f00cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:31.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.914+0000 7fb7ee800640 1 -- 172.21.15.133:0/3690021060 >> v1:172.21.15.133:6789/0 conn(0x7fb7f0070500 legacy=0x7fb7f00cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:31.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.914+0000 7fb7ee800640 1 -- 172.21.15.133:0/3690021060 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f00cd180 con 0x7fb7f00ccc40 2024-03-30T01:52:31.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.915+0000 7fb7ee800640 1 --2- 172.21.15.133:0/3690021060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7f00ccc40 0x7fb7f0070990 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb7f006ea10 tx=0x7fb7e802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee96ad901262a27e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:31.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.915+0000 7fb7ed400640 1 -- 172.21.15.133:0/3690021060 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e802cd00 con 0x7fb7f00ccc40 2024-03-30T01:52:31.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.915+0000 7fb7ed400640 1 -- 172.21.15.133:0/3690021060 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e802ce60 con 0x7fb7f00ccc40 2024-03-30T01:52:31.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.915+0000 7fb7ed400640 1 -- 172.21.15.133:0/3690021060 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8034660 con 0x7fb7f00ccc40 2024-03-30T01:52:31.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.916+0000 7fb7f5000640 1 -- 172.21.15.133:0/3690021060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7f00ccc40 msgr2=0x7fb7f0070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:31.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.916+0000 7fb7f5000640 1 --2- 172.21.15.133:0/3690021060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7f00ccc40 0x7fb7f0070990 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb7f006ea10 tx=0x7fb7e802bf50 comp rx=0 tx=0).stop 2024-03-30T01:52:31.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.916+0000 7fb7f5000640 1 -- 172.21.15.133:0/3690021060 shutdown_connections 2024-03-30T01:52:31.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.916+0000 7fb7f5000640 1 --2- 172.21.15.133:0/3690021060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7f00ccc40 0x7fb7f0070990 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:31.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.916+0000 7fb7f5000640 1 --2- 172.21.15.133:0/3690021060 >> v2:172.21.15.137:3300/0 conn(0x7fb7f0143790 0x7fb7f00cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:31.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.916+0000 7fb7f5000640 1 -- 172.21.15.133:0/3690021060 >> 172.21.15.133:0/3690021060 conn(0x7fb7f00b07a0 msgr2=0x7fb7f00b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:31.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.916+0000 7fb7f5000640 1 -- 172.21.15.133:0/3690021060 shutdown_connections 2024-03-30T01:52:31.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.916+0000 7fb7f5000640 1 -- 172.21.15.133:0/3690021060 wait complete. 2024-03-30T01:52:31.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.918+0000 7fb7f5000640 1 Processor -- start 2024-03-30T01:52:31.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.918+0000 7fb7f5000640 1 -- start start 2024-03-30T01:52:31.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.919+0000 7fb7f5000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7f0070500 0x7fb7f015a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:31.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.919+0000 7fb7f5000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7f00ccc40 0x7fb7f013e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:31.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.919+0000 7fb7f5000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb7f0143790 0x7fb7f013ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:31.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.919+0000 7fb7f5000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f006cf30 con 0x7fb7f00ccc40 2024-03-30T01:52:31.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.919+0000 7fb7f5000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f006c320 con 0x7fb7f0070500 2024-03-30T01:52:31.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.919+0000 7fb7f5000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f006c600 con 0x7fb7f0143790 2024-03-30T01:52:31.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.919+0000 7fb7e7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7f00ccc40 0x7fb7f013e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:31.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.919+0000 7fb7e7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7f00ccc40 0x7fb7f013e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47820/0 (socket says 172.21.15.133:47820) 2024-03-30T01:52:31.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.919+0000 7fb7e7e00640 1 -- 172.21.15.133:0/1366013262 learned_addr learned my addr 172.21.15.133:0/1366013262 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:31.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.919+0000 7fb7ede00640 1 --2- 172.21.15.133:0/1366013262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7f0070500 0x7fb7f015a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:31.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.919+0000 7fb7e7e00640 1 -- 172.21.15.133:0/1366013262 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb7f0143790 msgr2=0x7fb7f013ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:31.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.919+0000 7fb7ee800640 1 --2- 172.21.15.133:0/1366013262 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb7f0143790 0x7fb7f013ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:31.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.919+0000 7fb7e7e00640 1 --2- 172.21.15.133:0/1366013262 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb7f0143790 0x7fb7f013ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:31.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.919+0000 7fb7e7e00640 1 -- 172.21.15.133:0/1366013262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7f0070500 msgr2=0x7fb7f015a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:31.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.919+0000 7fb7e7e00640 1 --2- 172.21.15.133:0/1366013262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7f0070500 0x7fb7f015a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:31.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.919+0000 7fb7e7e00640 1 -- 172.21.15.133:0/1366013262 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e8009a70 con 0x7fb7f00ccc40 2024-03-30T01:52:31.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.920+0000 7fb7e7e00640 1 --2- 172.21.15.133:0/1366013262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7f00ccc40 0x7fb7f013e6d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800c500 tx=0x7fb7d800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:31.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.920+0000 7fb7e6000640 1 -- 172.21.15.133:0/1366013262 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8005ce0 con 0x7fb7f00ccc40 2024-03-30T01:52:31.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.920+0000 7fb7e6000640 1 -- 172.21.15.133:0/1366013262 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d8005e40 con 0x7fb7f00ccc40 2024-03-30T01:52:31.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.920+0000 7fb7e6000640 1 -- 172.21.15.133:0/1366013262 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8007330 con 0x7fb7f00ccc40 2024-03-30T01:52:31.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.920+0000 7fb7f5000640 1 -- 172.21.15.133:0/1366013262 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f006c8e0 con 0x7fb7f00ccc40 2024-03-30T01:52:31.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.920+0000 7fb7f5000640 1 -- 172.21.15.133:0/1366013262 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f015abe0 con 0x7fb7f00ccc40 2024-03-30T01:52:31.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.921+0000 7fb7f5000640 1 -- 172.21.15.133:0/1366013262 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f006d0e0 con 0x7fb7f00ccc40 2024-03-30T01:52:31.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.922+0000 7fb7e6000640 1 -- 172.21.15.133:0/1366013262 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb7d8007490 con 0x7fb7f00ccc40 2024-03-30T01:52:31.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.923+0000 7fb7e6000640 1 --2- 172.21.15.133:0/1366013262 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb7cc06ac30 0x7fb7cc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:31.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.923+0000 7fb7e6000640 1 -- 172.21.15.133:0/1366013262 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb7d8088a30 con 0x7fb7f00ccc40 2024-03-30T01:52:31.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.924+0000 7fb7ede00640 1 --2- 172.21.15.133:0/1366013262 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb7cc06ac30 0x7fb7cc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:31.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.924+0000 7fb7ede00640 1 --2- 172.21.15.133:0/1366013262 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb7cc06ac30 0x7fb7cc06d0f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0006fd0 tx=0x7fb7e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:31.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:31.928+0000 7fb7e6000640 1 -- 172.21.15.133:0/1366013262 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fb7f006d0e0 con 0x7fb7f00ccc40 2024-03-30T01:52:32.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.159+0000 7fb7f5000640 1 -- 172.21.15.133:0/1366013262 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7f0066d80 con 0x7fb7f00ccc40 2024-03-30T01:52:32.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.160+0000 7fb7e6000640 1 -- 172.21.15.133:0/1366013262 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4737 (secure 0 0 0) 0x7fb7d8017020 con 0x7fb7f00ccc40 2024-03-30T01:52:32.166 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:32.166 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2218506023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2218506023},{"type":"v1","addr":"172.21.15.137:6835","nonce":2218506023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2935514153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2935514153},{"type":"v1","addr":"172.21.15.133:6836","nonce":2935514153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2942187095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2942187095},{"type":"v1","addr":"172.21.15.133:6837","nonce":2942187095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T01:51:32.776583+0000","modified":"2024-03-30T01:51:35.787820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/225370013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":225370013},{"type":"v1","addr":"172.21.15.137:6834","nonce":225370013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-30T01:52:32.167 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 7 2024-03-30T01:52:32.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.163+0000 7fb7f5000640 1 -- 172.21.15.133:0/1366013262 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb7cc06ac30 msgr2=0x7fb7cc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:32.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.163+0000 7fb7f5000640 1 --2- 172.21.15.133:0/1366013262 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb7cc06ac30 0x7fb7cc06d0f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0006fd0 tx=0x7fb7e0008040 comp rx=0 tx=0).stop 2024-03-30T01:52:32.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.163+0000 7fb7f5000640 1 -- 172.21.15.133:0/1366013262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7f00ccc40 msgr2=0x7fb7f013e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:32.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.163+0000 7fb7f5000640 1 --2- 172.21.15.133:0/1366013262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7f00ccc40 0x7fb7f013e6d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800c500 tx=0x7fb7d800c9c0 comp rx=0 tx=0).stop 2024-03-30T01:52:32.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.163+0000 7fb7f5000640 1 -- 172.21.15.133:0/1366013262 shutdown_connections 2024-03-30T01:52:32.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.163+0000 7fb7f5000640 1 --2- 172.21.15.133:0/1366013262 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb7cc06ac30 0x7fb7cc06d0f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:32.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.163+0000 7fb7f5000640 1 --2- 172.21.15.133:0/1366013262 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb7f0143790 0x7fb7f013ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:32.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.163+0000 7fb7f5000640 1 --2- 172.21.15.133:0/1366013262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7f00ccc40 0x7fb7f013e6d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:32.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.163+0000 7fb7f5000640 1 --2- 172.21.15.133:0/1366013262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7f0070500 0x7fb7f015a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:32.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.163+0000 7fb7f5000640 1 -- 172.21.15.133:0/1366013262 >> 172.21.15.133:0/1366013262 conn(0x7fb7f00b07a0 msgr2=0x7fb7f00ae5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:32.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.163+0000 7fb7f5000640 1 -- 172.21.15.133:0/1366013262 shutdown_connections 2024-03-30T01:52:32.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.163+0000 7fb7f5000640 1 -- 172.21.15.133:0/1366013262 wait complete. 2024-03-30T01:52:32.189 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T01:52:32.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.383+0000 7feca9e00640 1 Processor -- start 2024-03-30T01:52:32.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.383+0000 7feca9e00640 1 -- start start 2024-03-30T01:52:32.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.385+0000 7feca9e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feca40ccc40 0x7feca4070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:32.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.385+0000 7feca9e00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca40a76a0 con 0x7feca4070500 2024-03-30T01:52:32.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.385+0000 7feca9e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca40b38e0 con 0x7feca4143790 2024-03-30T01:52:32.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.385+0000 7feca9e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca4070ed0 con 0x7feca40ccc40 2024-03-30T01:52:32.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.385+0000 7fec9a000640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7feca4070500 0x7feca40cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58728/0 (socket says 172.21.15.133:58728) 2024-03-30T01:52:32.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.385+0000 7fec9a000640 1 -- 172.21.15.133:0/2033463189 learned_addr learned my addr 172.21.15.133:0/2033463189 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:32.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.385+0000 7feca3400640 1 --2- 172.21.15.133:0/2033463189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feca40ccc40 0x7feca4070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:32.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.385+0000 7feca2000640 1 -- 172.21.15.133:0/2033463189 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604711858 0 0) 0x7feca40a76a0 con 0x7feca4070500 2024-03-30T01:52:32.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.385+0000 7feca2000640 1 -- 172.21.15.133:0/2033463189 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec84003520 con 0x7feca4070500 2024-03-30T01:52:32.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.386+0000 7feca2000640 1 -- 172.21.15.133:0/2033463189 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 405067193 0 0) 0x7fec84003520 con 0x7feca4070500 2024-03-30T01:52:32.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.386+0000 7feca2000640 1 -- 172.21.15.133:0/2033463189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feca40ccc40 msgr2=0x7feca4070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:32.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.386+0000 7feca2000640 1 --2- 172.21.15.133:0/2033463189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feca40ccc40 0x7feca4070990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:32.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.386+0000 7feca2000640 1 -- 172.21.15.133:0/2033463189 >> v1:172.21.15.137:6789/0 conn(0x7feca4143790 legacy=0x7feca40cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:32.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.386+0000 7feca2000640 1 -- 172.21.15.133:0/2033463189 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca40cd180 con 0x7feca4070500 2024-03-30T01:52:32.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.386+0000 7feca2000640 1 -- 172.21.15.133:0/2033463189 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fec8c001670 con 0x7feca4070500 2024-03-30T01:52:32.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.386+0000 7feca2000640 1 -- 172.21.15.133:0/2033463189 >> v1:172.21.15.133:6789/0 conn(0x7feca4070500 legacy=0x7feca40cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:32.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.386+0000 7feca2000640 1 --2- 172.21.15.133:0/2033463189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec840039a0 0x7fec84003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:32.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.386+0000 7feca2000640 1 --2- 172.21.15.133:0/2033463189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feca40ccc40 0x7fec840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:32.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.386+0000 7feca2000640 1 --2- 172.21.15.133:0/2033463189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec84004d00 0x7fec84005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:32.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.386+0000 7feca2000640 1 -- 172.21.15.133:0/2033463189 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca4070ed0 con 0x7fec84004d00 2024-03-30T01:52:32.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.386+0000 7feca2000640 1 -- 172.21.15.133:0/2033463189 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8400bba0 con 0x7fec840039a0 2024-03-30T01:52:32.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.386+0000 7feca2000640 1 -- 172.21.15.133:0/2033463189 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8400bd30 con 0x7feca40ccc40 2024-03-30T01:52:32.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.386+0000 7feca3400640 1 --2- 172.21.15.133:0/2033463189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec84004d00 0x7fec84005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:32.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.386+0000 7feca2a00640 1 --2- 172.21.15.133:0/2033463189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec840039a0 0x7fec84003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:32.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.387+0000 7fec9a000640 1 --2- 172.21.15.133:0/2033463189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feca40ccc40 0x7fec840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:32.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.387+0000 7feca3400640 1 -- 172.21.15.133:0/2033463189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feca40ccc40 msgr2=0x7fec840047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:32.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.387+0000 7feca3400640 1 --2- 172.21.15.133:0/2033463189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feca40ccc40 0x7fec840047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:32.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.387+0000 7feca3400640 1 -- 172.21.15.133:0/2033463189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec840039a0 msgr2=0x7fec84003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:32.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.387+0000 7feca3400640 1 --2- 172.21.15.133:0/2033463189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec840039a0 0x7fec84003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:32.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.387+0000 7feca3400640 1 -- 172.21.15.133:0/2033463189 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec84003520 con 0x7fec84004d00 2024-03-30T01:52:32.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.387+0000 7fec9a000640 1 --2- 172.21.15.133:0/2033463189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feca40ccc40 0x7fec840047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:32.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.388+0000 7feca3400640 1 --2- 172.21.15.133:0/2033463189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec84004d00 0x7fec84005180 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fec9c007360 tx=0x7fec840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa20bee5ef651aa server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:32.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.388+0000 7feca2000640 1 -- 172.21.15.133:0/2033463189 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c02cc80 con 0x7fec84004d00 2024-03-30T01:52:32.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.388+0000 7feca2000640 1 -- 172.21.15.133:0/2033463189 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c02cde0 con 0x7fec84004d00 2024-03-30T01:52:32.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.388+0000 7feca2000640 1 -- 172.21.15.133:0/2033463189 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c034660 con 0x7fec84004d00 2024-03-30T01:52:32.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.388+0000 7feca9e00640 1 -- 172.21.15.133:0/2033463189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec84004d00 msgr2=0x7fec84005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:32.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.388+0000 7feca9e00640 1 --2- 172.21.15.133:0/2033463189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec84004d00 0x7fec84005180 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fec9c007360 tx=0x7fec840057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:32.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.388+0000 7feca3400640 1 -- 172.21.15.133:0/2033463189 reap_dead start 2024-03-30T01:52:32.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.389+0000 7feca9e00640 1 -- 172.21.15.133:0/2033463189 shutdown_connections 2024-03-30T01:52:32.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.389+0000 7feca9e00640 1 -- 172.21.15.133:0/2033463189 >> 172.21.15.133:0/2033463189 conn(0x7feca40b07a0 msgr2=0x7feca40b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:32.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.389+0000 7feca9e00640 1 -- 172.21.15.133:0/2033463189 shutdown_connections 2024-03-30T01:52:32.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.389+0000 7feca9e00640 1 -- 172.21.15.133:0/2033463189 wait complete. 2024-03-30T01:52:32.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.390+0000 7feca9e00640 1 Processor -- start 2024-03-30T01:52:32.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.390+0000 7feca9e00640 1 -- start start 2024-03-30T01:52:32.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.391+0000 7feca9e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec84004d00 0x7feca41ef8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:32.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.391+0000 7feca9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feca415bd20 0x7feca40aa190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:32.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.391+0000 7feca9e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feca415c1a0 0x7feca40aa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:32.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.391+0000 7feca9e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca415c770 con 0x7feca415bd20 2024-03-30T01:52:32.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.391+0000 7feca9e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca415ca50 con 0x7feca415c1a0 2024-03-30T01:52:32.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.391+0000 7feca9e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca415cd30 con 0x7fec84004d00 2024-03-30T01:52:32.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.392+0000 7fec9a000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feca415bd20 0x7feca40aa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:32.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.392+0000 7fec9a000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feca415bd20 0x7feca40aa190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47850/0 (socket says 172.21.15.133:47850) 2024-03-30T01:52:32.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.392+0000 7fec9a000640 1 -- 172.21.15.133:0/2695515807 learned_addr learned my addr 172.21.15.133:0/2695515807 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:32.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.392+0000 7feca3400640 1 --2- 172.21.15.133:0/2695515807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feca415c1a0 0x7feca40aa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:32.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.392+0000 7fec9a000640 1 -- 172.21.15.133:0/2695515807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec84004d00 msgr2=0x7feca41ef8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:32.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.392+0000 7fec9a000640 1 --2- 172.21.15.133:0/2695515807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec84004d00 0x7feca41ef8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:32.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.392+0000 7fec9a000640 1 -- 172.21.15.133:0/2695515807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feca415c1a0 msgr2=0x7feca40aa6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:32.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.392+0000 7fec9a000640 1 --2- 172.21.15.133:0/2695515807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feca415c1a0 0x7feca40aa6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:32.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.392+0000 7fec9a000640 1 -- 172.21.15.133:0/2695515807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca415d010 con 0x7feca415bd20 2024-03-30T01:52:32.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.392+0000 7feca3400640 1 --2- 172.21.15.133:0/2695515807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feca415c1a0 0x7feca40aa6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:32.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.392+0000 7fec9a000640 1 --2- 172.21.15.133:0/2695515807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feca415bd20 0x7feca40aa190 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00d8b0 tx=0x7fec8c00dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:32.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.392+0000 7fec9be00640 1 -- 172.21.15.133:0/2695515807 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c0074e0 con 0x7feca415bd20 2024-03-30T01:52:32.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.392+0000 7fec9be00640 1 -- 172.21.15.133:0/2695515807 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8c007640 con 0x7feca415bd20 2024-03-30T01:52:32.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.392+0000 7fec9be00640 1 -- 172.21.15.133:0/2695515807 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c0049e0 con 0x7feca415bd20 2024-03-30T01:52:32.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.392+0000 7feca9e00640 1 -- 172.21.15.133:0/2695515807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca415d2f0 con 0x7feca415bd20 2024-03-30T01:52:32.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.393+0000 7feca9e00640 1 -- 172.21.15.133:0/2695515807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca41efde0 con 0x7feca415bd20 2024-03-30T01:52:32.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.394+0000 7feca9e00640 1 -- 172.21.15.133:0/2695515807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca4066d80 con 0x7feca415bd20 2024-03-30T01:52:32.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.394+0000 7fec9be00640 1 -- 172.21.15.133:0/2695515807 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fec8c004b40 con 0x7feca415bd20 2024-03-30T01:52:32.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.395+0000 7fec9be00640 1 --2- 172.21.15.133:0/2695515807 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fec8006ac00 0x7fec8006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:32.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.395+0000 7fec9be00640 1 -- 172.21.15.133:0/2695515807 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fec8c088e90 con 0x7feca415bd20 2024-03-30T01:52:32.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.396+0000 7feca2a00640 1 --2- 172.21.15.133:0/2695515807 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fec8006ac00 0x7fec8006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:32.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.396+0000 7feca2a00640 1 --2- 172.21.15.133:0/2695515807 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fec8006ac00 0x7fec8006d0c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fec94007fd0 tx=0x7fec94009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:32.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.399+0000 7fec9be00640 1 -- 172.21.15.133:0/2695515807 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fec8c057b40 con 0x7feca415bd20 2024-03-30T01:52:32.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.613+0000 7feca9e00640 1 -- 172.21.15.133:0/2695515807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feca40ae940 con 0x7feca415bd20 2024-03-30T01:52:32.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.614+0000 7fec9be00640 1 -- 172.21.15.133:0/2695515807 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4737 (secure 0 0 0) 0x7fec8c019020 con 0x7feca415bd20 2024-03-30T01:52:32.621 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:32.621 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2218506023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2218506023},{"type":"v1","addr":"172.21.15.137:6835","nonce":2218506023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2935514153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2935514153},{"type":"v1","addr":"172.21.15.133:6836","nonce":2935514153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2942187095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2942187095},{"type":"v1","addr":"172.21.15.133:6837","nonce":2942187095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T01:51:32.776583+0000","modified":"2024-03-30T01:51:35.787820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/225370013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":225370013},{"type":"v1","addr":"172.21.15.137:6834","nonce":225370013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-30T01:52:32.622 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 7 2024-03-30T01:52:32.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.617+0000 7feca9e00640 1 -- 172.21.15.133:0/2695515807 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fec8006ac00 msgr2=0x7fec8006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:32.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.617+0000 7feca9e00640 1 --2- 172.21.15.133:0/2695515807 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fec8006ac00 0x7fec8006d0c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fec94007fd0 tx=0x7fec94009040 comp rx=0 tx=0).stop 2024-03-30T01:52:32.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.617+0000 7feca9e00640 1 -- 172.21.15.133:0/2695515807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feca415bd20 msgr2=0x7feca40aa190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:32.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.617+0000 7feca9e00640 1 --2- 172.21.15.133:0/2695515807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feca415bd20 0x7feca40aa190 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00d8b0 tx=0x7fec8c00dd70 comp rx=0 tx=0).stop 2024-03-30T01:52:32.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.617+0000 7feca9e00640 1 -- 172.21.15.133:0/2695515807 shutdown_connections 2024-03-30T01:52:32.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.617+0000 7feca9e00640 1 --2- 172.21.15.133:0/2695515807 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fec8006ac00 0x7fec8006d0c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:32.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.617+0000 7feca9e00640 1 --2- 172.21.15.133:0/2695515807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feca415c1a0 0x7feca40aa6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:32.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.617+0000 7feca9e00640 1 --2- 172.21.15.133:0/2695515807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feca415bd20 0x7feca40aa190 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:32.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.617+0000 7feca9e00640 1 --2- 172.21.15.133:0/2695515807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec84004d00 0x7feca41ef8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:32.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.617+0000 7feca9e00640 1 -- 172.21.15.133:0/2695515807 >> 172.21.15.133:0/2695515807 conn(0x7feca40b07a0 msgr2=0x7feca40afdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:32.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.617+0000 7feca9e00640 1 -- 172.21.15.133:0/2695515807 shutdown_connections 2024-03-30T01:52:32.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.617+0000 7feca9e00640 1 -- 172.21.15.133:0/2695515807 wait complete. 2024-03-30T01:52:32.641 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:52:32.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.837+0000 7f6e72600640 1 Processor -- start 2024-03-30T01:52:32.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.837+0000 7f6e72600640 1 -- start start 2024-03-30T01:52:32.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.839+0000 7f6e72600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6e6c143790 0x7f6e6c0cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:32.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.839+0000 7f6e72600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e6c070500 0x7f6e6c070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:32.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.839+0000 7f6e72600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e6c0a76a0 con 0x7f6e6c0cc530 2024-03-30T01:52:32.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.839+0000 7f6e72600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e6c0b38e0 con 0x7f6e6c143790 2024-03-30T01:52:32.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.839+0000 7f6e72600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c0cd180 con 0x7f6e6c070500 2024-03-30T01:52:32.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.839+0000 7f6e6b400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6e6c143790 0x7f6e6c0cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:32.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.839+0000 7f6e6be00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6e6c0cc530 0x7f6e6c0cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58732/0 (socket says 172.21.15.133:58732) 2024-03-30T01:52:32.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.839+0000 7f6e6be00640 1 -- 172.21.15.133:0/772714443 learned_addr learned my addr 172.21.15.133:0/772714443 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:32.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.839+0000 7f6e6b400640 1 --2- 172.21.15.133:0/772714443 >> v2:172.21.15.133:3300/0 conn(0x7f6e6c143790 0x7f6e6c0cbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47864/0 (socket says 172.21.15.133:47864) 2024-03-30T01:52:32.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.839+0000 7f6e6aa00640 1 --2- 172.21.15.133:0/772714443 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e6c070500 0x7f6e6c070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:32.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.839+0000 7f6e6b400640 1 -- 172.21.15.133:0/772714443 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e6c070500 msgr2=0x7f6e6c070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:32.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.839+0000 7f6e6b400640 1 --2- 172.21.15.133:0/772714443 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e6c070500 0x7f6e6c070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:32.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.840+0000 7f6e6b400640 1 -- 172.21.15.133:0/772714443 >> v1:172.21.15.133:6789/0 conn(0x7f6e6c0cc530 legacy=0x7f6e6c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:32.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.840+0000 7f6e6b400640 1 -- 172.21.15.133:0/772714443 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6c070ea0 con 0x7f6e6c143790 2024-03-30T01:52:32.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.840+0000 7f6e6a000640 1 -- 172.21.15.133:0/772714443 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835143896 0 0) 0x7f6e6c0a76a0 con 0x7f6e6c0cc530 2024-03-30T01:52:32.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.841+0000 7f6e6b400640 1 --2- 172.21.15.133:0/772714443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6c143790 0x7f6e6c0cbb10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c0097a0 tx=0x7f6e5c02b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7e7d900ad19e34 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:32.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.841+0000 7f6e6a000640 1 -- 172.21.15.133:0/772714443 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c030800 con 0x7f6e6c143790 2024-03-30T01:52:32.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.841+0000 7f6e6a000640 1 -- 172.21.15.133:0/772714443 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5c030960 con 0x7f6e6c143790 2024-03-30T01:52:32.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.841+0000 7f6e6a000640 1 -- 172.21.15.133:0/772714443 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c030cf0 con 0x7f6e6c143790 2024-03-30T01:52:32.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.841+0000 7f6e72600640 1 -- 172.21.15.133:0/772714443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6c143790 msgr2=0x7f6e6c0cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:32.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.841+0000 7f6e72600640 1 --2- 172.21.15.133:0/772714443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6c143790 0x7f6e6c0cbb10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c0097a0 tx=0x7f6e5c02b940 comp rx=0 tx=0).stop 2024-03-30T01:52:32.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.842+0000 7f6e72600640 1 -- 172.21.15.133:0/772714443 shutdown_connections 2024-03-30T01:52:32.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.842+0000 7f6e72600640 1 --2- 172.21.15.133:0/772714443 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e6c070500 0x7f6e6c070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:32.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.842+0000 7f6e72600640 1 --2- 172.21.15.133:0/772714443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6c143790 0x7f6e6c0cbb10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:32.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.842+0000 7f6e72600640 1 -- 172.21.15.133:0/772714443 >> 172.21.15.133:0/772714443 conn(0x7f6e6c0b07a0 msgr2=0x7f6e6c0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:32.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.842+0000 7f6e72600640 1 -- 172.21.15.133:0/772714443 shutdown_connections 2024-03-30T01:52:32.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.842+0000 7f6e72600640 1 -- 172.21.15.133:0/772714443 wait complete. 2024-03-30T01:52:32.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.843+0000 7f6e72600640 1 Processor -- start 2024-03-30T01:52:32.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.843+0000 7f6e72600640 1 -- start start 2024-03-30T01:52:32.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.844+0000 7f6e72600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e6c070500 0x7f6e6c06d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:32.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.844+0000 7f6e72600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e6c0cc530 0x7f6e6c15a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:32.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.844+0000 7f6e72600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6c143790 0x7f6e6c0c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:32.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.844+0000 7f6e72600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c15ac70 con 0x7f6e6c143790 2024-03-30T01:52:32.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.844+0000 7f6e72600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c13d290 con 0x7f6e6c0cc530 2024-03-30T01:52:32.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.844+0000 7f6e72600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c06d480 con 0x7f6e6c070500 2024-03-30T01:52:32.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.845+0000 7f6e6be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6c143790 0x7f6e6c0c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:32.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.845+0000 7f6e6be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6c143790 0x7f6e6c0c38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47874/0 (socket says 172.21.15.133:47874) 2024-03-30T01:52:32.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.845+0000 7f6e6be00640 1 -- 172.21.15.133:0/812894251 learned_addr learned my addr 172.21.15.133:0/812894251 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:32.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.845+0000 7f6e6b400640 1 --2- 172.21.15.133:0/812894251 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e6c070500 0x7f6e6c06d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:32.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.845+0000 7f6e6aa00640 1 --2- 172.21.15.133:0/812894251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e6c0cc530 0x7f6e6c15a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:32.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.845+0000 7f6e6be00640 1 -- 172.21.15.133:0/812894251 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e6c070500 msgr2=0x7f6e6c06d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:32.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.845+0000 7f6e6be00640 1 --2- 172.21.15.133:0/812894251 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e6c070500 0x7f6e6c06d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:32.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.845+0000 7f6e6be00640 1 -- 172.21.15.133:0/812894251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e6c0cc530 msgr2=0x7f6e6c15a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:32.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.845+0000 7f6e6be00640 1 --2- 172.21.15.133:0/812894251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e6c0cc530 0x7f6e6c15a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:32.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.845+0000 7f6e6be00640 1 -- 172.21.15.133:0/812894251 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c009400 con 0x7f6e6c143790 2024-03-30T01:52:32.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.845+0000 7f6e6be00640 1 --2- 172.21.15.133:0/812894251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6c143790 0x7f6e6c0c38a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6e6400c7d0 tx=0x7f6e6400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:32.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.845+0000 7f6e63400640 1 -- 172.21.15.133:0/812894251 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6400a640 con 0x7f6e6c143790 2024-03-30T01:52:32.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.846+0000 7f6e63400640 1 -- 172.21.15.133:0/812894251 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6400a7a0 con 0x7f6e6c143790 2024-03-30T01:52:32.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.846+0000 7f6e63400640 1 -- 172.21.15.133:0/812894251 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6400ab90 con 0x7f6e6c143790 2024-03-30T01:52:32.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.846+0000 7f6e72600640 1 -- 172.21.15.133:0/812894251 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6c13cfb0 con 0x7f6e6c143790 2024-03-30T01:52:32.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.846+0000 7f6e72600640 1 -- 172.21.15.133:0/812894251 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e6c06d110 con 0x7f6e6c143790 2024-03-30T01:52:32.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.847+0000 7f6e72600640 1 -- 172.21.15.133:0/812894251 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e6c06cc60 con 0x7f6e6c143790 2024-03-30T01:52:32.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.848+0000 7f6e63400640 1 -- 172.21.15.133:0/812894251 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f6e6400acf0 con 0x7f6e6c143790 2024-03-30T01:52:32.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.848+0000 7f6e63400640 1 --2- 172.21.15.133:0/812894251 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6e4c06ac00 0x7f6e4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:32.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.849+0000 7f6e63400640 1 -- 172.21.15.133:0/812894251 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6e64088970 con 0x7f6e6c143790 2024-03-30T01:52:32.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.849+0000 7f6e6b400640 1 --2- 172.21.15.133:0/812894251 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6e4c06ac00 0x7f6e4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:32.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.849+0000 7f6e6b400640 1 --2- 172.21.15.133:0/812894251 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6e4c06ac00 0x7f6e4c06d0c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c036000 tx=0x7f6e5c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:32.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:32.853+0000 7f6e63400640 1 -- 172.21.15.133:0/812894251 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f6e64053ac0 con 0x7f6e6c143790 2024-03-30T01:52:33.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.045+0000 7f6e72600640 1 -- 172.21.15.133:0/812894251 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e6c066d80 con 0x7f6e6c143790 2024-03-30T01:52:33.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.048+0000 7f6e63400640 1 -- 172.21.15.133:0/812894251 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16335 (secure 0 0 0) 0x7f6e64018070 con 0x7f6e6c143790 2024-03-30T01:52:33.055 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:33.055 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:52:15.520675+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:51:31.245378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T01:51:31.774247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:52:33.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.051+0000 7f6e72600640 1 -- 172.21.15.133:0/812894251 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6e4c06ac00 msgr2=0x7f6e4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:33.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.051+0000 7f6e72600640 1 --2- 172.21.15.133:0/812894251 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6e4c06ac00 0x7f6e4c06d0c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c036000 tx=0x7f6e5c008030 comp rx=0 tx=0).stop 2024-03-30T01:52:33.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.051+0000 7f6e72600640 1 -- 172.21.15.133:0/812894251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6c143790 msgr2=0x7f6e6c0c38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:33.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.051+0000 7f6e72600640 1 --2- 172.21.15.133:0/812894251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6c143790 0x7f6e6c0c38a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6e6400c7d0 tx=0x7f6e6400cc90 comp rx=0 tx=0).stop 2024-03-30T01:52:33.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.051+0000 7f6e72600640 1 -- 172.21.15.133:0/812894251 shutdown_connections 2024-03-30T01:52:33.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.051+0000 7f6e72600640 1 --2- 172.21.15.133:0/812894251 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6e4c06ac00 0x7f6e4c06d0c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.051+0000 7f6e72600640 1 --2- 172.21.15.133:0/812894251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6c143790 0x7f6e6c0c38a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.051+0000 7f6e72600640 1 --2- 172.21.15.133:0/812894251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e6c0cc530 0x7f6e6c15a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.051+0000 7f6e72600640 1 --2- 172.21.15.133:0/812894251 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e6c070500 0x7f6e6c06d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.051+0000 7f6e72600640 1 -- 172.21.15.133:0/812894251 >> 172.21.15.133:0/812894251 conn(0x7f6e6c0b07a0 msgr2=0x7f6e6c072ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:33.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.052+0000 7f6e72600640 1 -- 172.21.15.133:0/812894251 shutdown_connections 2024-03-30T01:52:33.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.052+0000 7f6e72600640 1 -- 172.21.15.133:0/812894251 wait complete. 2024-03-30T01:52:33.077 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-30T01:52:33.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.276+0000 7f01d4c00640 1 Processor -- start 2024-03-30T01:52:33.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.276+0000 7f01d4c00640 1 -- start start 2024-03-30T01:52:33.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.277+0000 7f01d4c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f01d015b9c0 0x7f01d00b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:33.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.277+0000 7f01d4c00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d013dba0 con 0x7f01d00b40f0 2024-03-30T01:52:33.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.277+0000 7f01d4c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d01408b0 con 0x7f01d00ccd00 2024-03-30T01:52:33.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.277+0000 7f01d4c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d015bda0 con 0x7f01d015b9c0 2024-03-30T01:52:33.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.278+0000 7f01c6a00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f01d00b40f0 0x7f01d00cc5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58736/0 (socket says 172.21.15.133:58736) 2024-03-30T01:52:33.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.278+0000 7f01c6a00640 1 -- 172.21.15.133:0/355667663 learned_addr learned my addr 172.21.15.133:0/355667663 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:33.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.278+0000 7f01cea00640 1 -- 172.21.15.133:0/355667663 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113653339 0 0) 0x7f01d013dba0 con 0x7f01d00b40f0 2024-03-30T01:52:33.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.278+0000 7f01cea00640 1 -- 172.21.15.133:0/355667663 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01b4003520 con 0x7f01d00b40f0 2024-03-30T01:52:33.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.278+0000 7f01cf400640 1 --2- 172.21.15.133:0/355667663 >> v2:172.21.15.137:3300/0 conn(0x7f01d015b9c0 0x7f01d00b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:33.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.279+0000 7f01cea00640 1 -- 172.21.15.133:0/355667663 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1369226454 0 0) 0x7f01b4003520 con 0x7f01d00b40f0 2024-03-30T01:52:33.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.279+0000 7f01cea00640 1 -- 172.21.15.133:0/355667663 >> v2:172.21.15.137:3300/0 conn(0x7f01d015b9c0 msgr2=0x7f01d00b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:33.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.279+0000 7f01cea00640 1 --2- 172.21.15.133:0/355667663 >> v2:172.21.15.137:3300/0 conn(0x7f01d015b9c0 0x7f01d00b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.279+0000 7f01cea00640 1 -- 172.21.15.133:0/355667663 >> v1:172.21.15.137:6789/0 conn(0x7f01d00ccd00 legacy=0x7f01d015e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:33.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.279+0000 7f01cea00640 1 -- 172.21.15.133:0/355667663 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d015ad40 con 0x7f01d00b40f0 2024-03-30T01:52:33.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.279+0000 7f01cea00640 1 -- 172.21.15.133:0/355667663 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f01b8001670 con 0x7f01d00b40f0 2024-03-30T01:52:33.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.279+0000 7f01cea00640 1 -- 172.21.15.133:0/355667663 >> v1:172.21.15.133:6789/0 conn(0x7f01d00b40f0 legacy=0x7f01d00cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:33.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.279+0000 7f01cea00640 1 --2- 172.21.15.133:0/355667663 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f01b40039c0 0x7f01b4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:33.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.279+0000 7f01cea00640 1 --2- 172.21.15.133:0/355667663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01b40047c0 0x7f01b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:33.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.279+0000 7f01cea00640 1 --2- 172.21.15.133:0/355667663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01b40051d0 0x7f01b400fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:33.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.279+0000 7f01cea00640 1 -- 172.21.15.133:0/355667663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d015bda0 con 0x7f01b40047c0 2024-03-30T01:52:33.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.279+0000 7f01cea00640 1 -- 172.21.15.133:0/355667663 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b4010530 con 0x7f01b40051d0 2024-03-30T01:52:33.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.279+0000 7f01cea00640 1 -- 172.21.15.133:0/355667663 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b40106f0 con 0x7f01b40039c0 2024-03-30T01:52:33.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.279+0000 7f01c6a00640 1 --2- 172.21.15.133:0/355667663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01b40047c0 0x7f01b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:33.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.279+0000 7f01cfe00640 1 --2- 172.21.15.133:0/355667663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01b40051d0 0x7f01b400fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:33.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.279+0000 7f01cf400640 1 --2- 172.21.15.133:0/355667663 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f01b40039c0 0x7f01b4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:33.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.279+0000 7f01c6a00640 1 -- 172.21.15.133:0/355667663 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f01b40039c0 msgr2=0x7f01b4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:33.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.279+0000 7f01c6a00640 1 --2- 172.21.15.133:0/355667663 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f01b40039c0 0x7f01b4003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.279+0000 7f01c6a00640 1 -- 172.21.15.133:0/355667663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01b40051d0 msgr2=0x7f01b400fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:33.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.279+0000 7f01c6a00640 1 --2- 172.21.15.133:0/355667663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01b40051d0 0x7f01b400fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.279+0000 7f01c6a00640 1 -- 172.21.15.133:0/355667663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b4003520 con 0x7f01b40047c0 2024-03-30T01:52:33.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.279+0000 7f01cfe00640 1 -- 172.21.15.133:0/355667663 reap_dead start 2024-03-30T01:52:33.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.280+0000 7f01c6a00640 1 --2- 172.21.15.133:0/355667663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01b40047c0 0x7f01b4004c40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f01b800c0e0 tx=0x7f01b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668f237b6489e3ff server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:33.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.281+0000 7f01cea00640 1 -- 172.21.15.133:0/355667663 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b8005ad0 con 0x7f01b40047c0 2024-03-30T01:52:33.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.281+0000 7f01cea00640 1 -- 172.21.15.133:0/355667663 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b8005c30 con 0x7f01b40047c0 2024-03-30T01:52:33.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.281+0000 7f01cea00640 1 -- 172.21.15.133:0/355667663 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b802ca50 con 0x7f01b40047c0 2024-03-30T01:52:33.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.281+0000 7f01d4c00640 1 -- 172.21.15.133:0/355667663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01b40047c0 msgr2=0x7f01b4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:33.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.281+0000 7f01d4c00640 1 --2- 172.21.15.133:0/355667663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01b40047c0 0x7f01b4004c40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f01b800c0e0 tx=0x7f01b40057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.281+0000 7f01d4c00640 1 -- 172.21.15.133:0/355667663 shutdown_connections 2024-03-30T01:52:33.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.281+0000 7f01d4c00640 1 --2- 172.21.15.133:0/355667663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01b40047c0 0x7f01b4004c40 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.281+0000 7f01d4c00640 1 -- 172.21.15.133:0/355667663 >> 172.21.15.133:0/355667663 conn(0x7f01d00b05a0 msgr2=0x7f01d00b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:33.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.281+0000 7f01d4c00640 1 -- 172.21.15.133:0/355667663 shutdown_connections 2024-03-30T01:52:33.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.281+0000 7f01d4c00640 1 -- 172.21.15.133:0/355667663 wait complete. 2024-03-30T01:52:33.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.283+0000 7f01d4c00640 1 Processor -- start 2024-03-30T01:52:33.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.283+0000 7f01d4c00640 1 -- start start 2024-03-30T01:52:33.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.284+0000 7f01d4c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01b40047c0 0x7f01d0138e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.284+0000 7f01d4c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f01d01536a0 0x7f01d0138650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.284+0000 7f01d4c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d015d060 0x7f01d015d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.284+0000 7f01d4c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d015da30 con 0x7f01d015d060 2024-03-30T01:52:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.284+0000 7f01d4c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d0153b20 con 0x7f01b40047c0 2024-03-30T01:52:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.284+0000 7f01d4c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d0153210 con 0x7f01d01536a0 2024-03-30T01:52:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.285+0000 7f01cfe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d015d060 0x7f01d015d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.285+0000 7f01cfe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d015d060 0x7f01d015d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47888/0 (socket says 172.21.15.133:47888) 2024-03-30T01:52:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.285+0000 7f01cfe00640 1 -- 172.21.15.133:0/585404720 learned_addr learned my addr 172.21.15.133:0/585404720 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.285+0000 7f01c6a00640 1 --2- 172.21.15.133:0/585404720 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f01d01536a0 0x7f01d0138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.285+0000 7f01cf400640 1 --2- 172.21.15.133:0/585404720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01b40047c0 0x7f01d0138e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.285+0000 7f01cfe00640 1 -- 172.21.15.133:0/585404720 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f01d01536a0 msgr2=0x7f01d0138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.285+0000 7f01cfe00640 1 --2- 172.21.15.133:0/585404720 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f01d01536a0 0x7f01d0138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.285+0000 7f01cfe00640 1 -- 172.21.15.133:0/585404720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01b40047c0 msgr2=0x7f01d0138e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.285+0000 7f01cfe00640 1 --2- 172.21.15.133:0/585404720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01b40047c0 0x7f01d0138e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.285+0000 7f01cfe00640 1 -- 172.21.15.133:0/585404720 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d013aff0 con 0x7f01d015d060 2024-03-30T01:52:33.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.285+0000 7f01cf400640 1 --2- 172.21.15.133:0/585404720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01b40047c0 0x7f01d0138e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:33.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.285+0000 7f01cfe00640 1 --2- 172.21.15.133:0/585404720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d015d060 0x7f01d015d4f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f01d00b48c0 tx=0x7f01c800e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:33.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.286+0000 7f01c7e00640 1 -- 172.21.15.133:0/585404720 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8005110 con 0x7f01d015d060 2024-03-30T01:52:33.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.286+0000 7f01c7e00640 1 -- 172.21.15.133:0/585404720 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c8005270 con 0x7f01d015d060 2024-03-30T01:52:33.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.286+0000 7f01d4c00640 1 -- 172.21.15.133:0/585404720 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d01528e0 con 0x7f01d015d060 2024-03-30T01:52:33.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.286+0000 7f01c7e00640 1 -- 172.21.15.133:0/585404720 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8007030 con 0x7f01d015d060 2024-03-30T01:52:33.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.286+0000 7f01d4c00640 1 -- 172.21.15.133:0/585404720 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d0152ea0 con 0x7f01d015d060 2024-03-30T01:52:33.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.287+0000 7f01d4c00640 1 -- 172.21.15.133:0/585404720 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d01533c0 con 0x7f01d015d060 2024-03-30T01:52:33.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.288+0000 7f01c7e00640 1 -- 172.21.15.133:0/585404720 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f01c8007190 con 0x7f01d015d060 2024-03-30T01:52:33.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.289+0000 7f01c7e00640 1 --2- 172.21.15.133:0/585404720 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f01ac06ac00 0x7f01ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:33.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.289+0000 7f01c7e00640 1 -- 172.21.15.133:0/585404720 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f01c8088680 con 0x7f01d015d060 2024-03-30T01:52:33.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.289+0000 7f01cf400640 1 --2- 172.21.15.133:0/585404720 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f01ac06ac00 0x7f01ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:33.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.290+0000 7f01cf400640 1 --2- 172.21.15.133:0/585404720 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f01ac06ac00 0x7f01ac06d0c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f01d013f5c0 tx=0x7f01c000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:33.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.294+0000 7f01c7e00640 1 -- 172.21.15.133:0/585404720 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f01d01533c0 con 0x7f01d015d060 2024-03-30T01:52:33.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.527+0000 7f01d4c00640 1 -- 172.21.15.133:0/585404720 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f01d0153380 con 0x7f01d015d060 2024-03-30T01:52:33.535 INFO:tasks.ceph.mon.a.smithi133.stderr:2024-03-30T01:52:33.529+0000 7fa124c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-30T01:52:33.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.543+0000 7f01c7e00640 1 -- 172.21.15.133:0/585404720 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f01c8053870 con 0x7f01d015d060 2024-03-30T01:52:33.549 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-30T01:52:33.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.546+0000 7f01d4c00640 1 -- 172.21.15.133:0/585404720 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f01ac06ac00 msgr2=0x7f01ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:33.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.546+0000 7f01d4c00640 1 --2- 172.21.15.133:0/585404720 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f01ac06ac00 0x7f01ac06d0c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f01d013f5c0 tx=0x7f01c000b040 comp rx=0 tx=0).stop 2024-03-30T01:52:33.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.546+0000 7f01d4c00640 1 -- 172.21.15.133:0/585404720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d015d060 msgr2=0x7f01d015d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:33.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.546+0000 7f01d4c00640 1 --2- 172.21.15.133:0/585404720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d015d060 0x7f01d015d4f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f01d00b48c0 tx=0x7f01c800e8a0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.546+0000 7f01d4c00640 1 -- 172.21.15.133:0/585404720 shutdown_connections 2024-03-30T01:52:33.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.546+0000 7f01d4c00640 1 --2- 172.21.15.133:0/585404720 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f01ac06ac00 0x7f01ac06d0c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.546+0000 7f01d4c00640 1 --2- 172.21.15.133:0/585404720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d015d060 0x7f01d015d4f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.546+0000 7f01d4c00640 1 --2- 172.21.15.133:0/585404720 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f01d01536a0 0x7f01d0138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.546+0000 7f01d4c00640 1 --2- 172.21.15.133:0/585404720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01b40047c0 0x7f01d0138e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.546+0000 7f01d4c00640 1 -- 172.21.15.133:0/585404720 >> 172.21.15.133:0/585404720 conn(0x7f01d00b05a0 msgr2=0x7f01d00af810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:33.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.546+0000 7f01d4c00640 1 -- 172.21.15.133:0/585404720 shutdown_connections 2024-03-30T01:52:33.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.546+0000 7f01d4c00640 1 -- 172.21.15.133:0/585404720 wait complete. 2024-03-30T01:52:33.570 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-30T01:52:33.587 INFO:tasks.ceph.mds.d.smithi137.stderr: -7634> 2024-03-30T01:51:34.268+0000 7f7306e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-30T01:52:33.678 INFO:tasks.ceph.mds.d.smithi137.stdout:starting mds.d at 2024-03-30T01:52:33.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.773+0000 7f1e0b400640 1 Processor -- start 2024-03-30T01:52:33.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.773+0000 7f1e0b400640 1 -- start start 2024-03-30T01:52:33.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.774+0000 7f1e0b400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1e041457b0 0x7f1e040b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:33.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.774+0000 7f1e0b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e04145d30 0x7f1e04070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:33.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.774+0000 7f1e0b400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1e04070a40 0x7f1e04160620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:33.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.774+0000 7f1e0b400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e04070ed0 con 0x7f1e04070a40 2024-03-30T01:52:33.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.774+0000 7f1e0b400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e04145b90 con 0x7f1e041457b0 2024-03-30T01:52:33.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.774+0000 7f1e0b400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0406c320 con 0x7f1e04145d30 2024-03-30T01:52:33.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.775+0000 7f1e09400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1e04070a40 0x7f1e04160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:33.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.775+0000 7f1e09400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1e04070a40 0x7f1e04160620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47892/0 (socket says 172.21.15.133:47892) 2024-03-30T01:52:33.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.775+0000 7f1e09400640 1 -- 172.21.15.133:0/632114565 learned_addr learned my addr 172.21.15.133:0/632114565 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:33.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.775+0000 7f1e08a00640 1 --2- 172.21.15.133:0/632114565 >> v2:172.21.15.137:3300/0 conn(0x7f1e041457b0 0x7f1e040b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:33.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.775+0000 7f1dfbe00640 1 --2- 172.21.15.133:0/632114565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e04145d30 0x7f1e04070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:33.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.775+0000 7f1e09400640 1 -- 172.21.15.133:0/632114565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e04145d30 msgr2=0x7f1e04070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:33.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.775+0000 7f1e09400640 1 --2- 172.21.15.133:0/632114565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e04145d30 0x7f1e04070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.775+0000 7f1e09400640 1 -- 172.21.15.133:0/632114565 >> v2:172.21.15.137:3300/0 conn(0x7f1e041457b0 msgr2=0x7f1e040b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:33.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.775+0000 7f1e09400640 1 --2- 172.21.15.133:0/632114565 >> v2:172.21.15.137:3300/0 conn(0x7f1e041457b0 0x7f1e040b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.775+0000 7f1e09400640 1 -- 172.21.15.133:0/632114565 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0406c600 con 0x7f1e04070a40 2024-03-30T01:52:33.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.775+0000 7f1e08a00640 1 --2- 172.21.15.133:0/632114565 >> v2:172.21.15.137:3300/0 conn(0x7f1e041457b0 0x7f1e040b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:52:33.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.776+0000 7f1e09400640 1 --2- 172.21.15.133:0/632114565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e04070a40 0x7f1e04160620 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1e04071240 tx=0x7f1dfc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538555f45f885272 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:33.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.777+0000 7f1e03e00640 1 -- 172.21.15.133:0/632114565 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc02ca70 con 0x7f1e04070a40 2024-03-30T01:52:33.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.777+0000 7f1e03e00640 1 -- 172.21.15.133:0/632114565 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dfc02cbd0 con 0x7f1e04070a40 2024-03-30T01:52:33.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.777+0000 7f1e03e00640 1 -- 172.21.15.133:0/632114565 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc0343f0 con 0x7f1e04070a40 2024-03-30T01:52:33.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.777+0000 7f1e0b400640 1 -- 172.21.15.133:0/632114565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e04070a40 msgr2=0x7f1e04160620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:33.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.777+0000 7f1e0b400640 1 --2- 172.21.15.133:0/632114565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e04070a40 0x7f1e04160620 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1e04071240 tx=0x7f1dfc02bed0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.777+0000 7f1e0b400640 1 -- 172.21.15.133:0/632114565 shutdown_connections 2024-03-30T01:52:33.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.777+0000 7f1e0b400640 1 --2- 172.21.15.133:0/632114565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e04070a40 0x7f1e04160620 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.777+0000 7f1e0b400640 1 --2- 172.21.15.133:0/632114565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e04145d30 0x7f1e04070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.777+0000 7f1e0b400640 1 --2- 172.21.15.133:0/632114565 >> v2:172.21.15.137:3300/0 conn(0x7f1e041457b0 0x7f1e040b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.777+0000 7f1e0b400640 1 -- 172.21.15.133:0/632114565 >> 172.21.15.133:0/632114565 conn(0x7f1e040b07a0 msgr2=0x7f1e040b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:33.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.777+0000 7f1e0b400640 1 -- 172.21.15.133:0/632114565 shutdown_connections 2024-03-30T01:52:33.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.778+0000 7f1e0b400640 1 -- 172.21.15.133:0/632114565 wait complete. 2024-03-30T01:52:33.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.779+0000 7f1e0b400640 1 Processor -- start 2024-03-30T01:52:33.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.779+0000 7f1e0b400640 1 -- start start 2024-03-30T01:52:33.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.780+0000 7f1e0b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e04070a40 0x7f1e040ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:33.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.780+0000 7f1e0b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e041457b0 0x7f1e0413fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:33.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.780+0000 7f1e0b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e04145d30 0x7f1e041f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:33.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.780+0000 7f1e0b400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0415fbc0 con 0x7f1e041457b0 2024-03-30T01:52:33.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.780+0000 7f1e0b400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e041441b0 con 0x7f1e04145d30 2024-03-30T01:52:33.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.780+0000 7f1e0b400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e04140200 con 0x7f1e04070a40 2024-03-30T01:52:33.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.780+0000 7f1dfbe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e041457b0 0x7f1e0413fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:33.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.781+0000 7f1dfbe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e041457b0 0x7f1e0413fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47902/0 (socket says 172.21.15.133:47902) 2024-03-30T01:52:33.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.781+0000 7f1dfbe00640 1 -- 172.21.15.133:0/3711152263 learned_addr learned my addr 172.21.15.133:0/3711152263 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:33.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.781+0000 7f1e09400640 1 --2- 172.21.15.133:0/3711152263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e04145d30 0x7f1e041f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:33.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.781+0000 7f1e08a00640 1 --2- 172.21.15.133:0/3711152263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e04070a40 0x7f1e040ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:33.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.781+0000 7f1dfbe00640 1 -- 172.21.15.133:0/3711152263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e04070a40 msgr2=0x7f1e040ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:33.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.781+0000 7f1dfbe00640 1 --2- 172.21.15.133:0/3711152263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e04070a40 0x7f1e040ca3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.781+0000 7f1dfbe00640 1 -- 172.21.15.133:0/3711152263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e04145d30 msgr2=0x7f1e041f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:33.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.781+0000 7f1dfbe00640 1 --2- 172.21.15.133:0/3711152263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e04145d30 0x7f1e041f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:33.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.781+0000 7f1dfbe00640 1 -- 172.21.15.133:0/3711152263 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc009b30 con 0x7f1e041457b0 2024-03-30T01:52:33.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.781+0000 7f1e09400640 1 --2- 172.21.15.133:0/3711152263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e04145d30 0x7f1e041f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:33.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.781+0000 7f1dfbe00640 1 --2- 172.21.15.133:0/3711152263 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e041457b0 0x7f1e0413fcc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1df400d800 tx=0x7f1df400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:33.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.782+0000 7f1e01600640 1 -- 172.21.15.133:0/3711152263 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df400b6c0 con 0x7f1e041457b0 2024-03-30T01:52:33.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.782+0000 7f1e01600640 1 -- 172.21.15.133:0/3711152263 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df400b820 con 0x7f1e041457b0 2024-03-30T01:52:33.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.782+0000 7f1e01600640 1 -- 172.21.15.133:0/3711152263 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df400bbb0 con 0x7f1e041457b0 2024-03-30T01:52:33.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.782+0000 7f1e0b400640 1 -- 172.21.15.133:0/3711152263 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e041f6330 con 0x7f1e041457b0 2024-03-30T01:52:33.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.782+0000 7f1e0b400640 1 -- 172.21.15.133:0/3711152263 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e04141a70 con 0x7f1e041457b0 2024-03-30T01:52:33.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.783+0000 7f1e0b400640 1 -- 172.21.15.133:0/3711152263 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e041418d0 con 0x7f1e041457b0 2024-03-30T01:52:33.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.784+0000 7f1e01600640 1 -- 172.21.15.133:0/3711152263 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1df400bd10 con 0x7f1e041457b0 2024-03-30T01:52:33.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.785+0000 7f1e01600640 1 --2- 172.21.15.133:0/3711152263 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f1de006ac00 0x7f1de006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:33.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.785+0000 7f1e01600640 1 -- 172.21.15.133:0/3711152263 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f1df4089980 con 0x7f1e041457b0 2024-03-30T01:52:33.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.786+0000 7f1e08a00640 1 --2- 172.21.15.133:0/3711152263 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f1de006ac00 0x7f1de006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:33.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.786+0000 7f1e08a00640 1 --2- 172.21.15.133:0/3711152263 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f1de006ac00 0x7f1de006d0c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1dec006fd0 tx=0x7f1dec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:33.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:33.790+0000 7f1e01600640 1 -- 172.21.15.133:0/3711152263 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f1e041418d0 con 0x7f1e041457b0 2024-03-30T01:52:34.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.024+0000 7f1e0b400640 1 -- 172.21.15.133:0/3711152263 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1e041418d0 con 0x7f1e041457b0 2024-03-30T01:52:34.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.660+0000 7f1e01600640 1 -- 172.21.15.133:0/3711152263 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1e041418d0 con 0x7f1e041457b0 2024-03-30T01:52:34.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.663+0000 7f1e0b400640 1 -- 172.21.15.133:0/3711152263 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f1de006ac00 msgr2=0x7f1de006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:34.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.663+0000 7f1e0b400640 1 --2- 172.21.15.133:0/3711152263 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f1de006ac00 0x7f1de006d0c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1dec006fd0 tx=0x7f1dec008040 comp rx=0 tx=0).stop 2024-03-30T01:52:34.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.663+0000 7f1e0b400640 1 -- 172.21.15.133:0/3711152263 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e041457b0 msgr2=0x7f1e0413fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:34.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.663+0000 7f1e0b400640 1 --2- 172.21.15.133:0/3711152263 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e041457b0 0x7f1e0413fcc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1df400d800 tx=0x7f1df400dcc0 comp rx=0 tx=0).stop 2024-03-30T01:52:34.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.663+0000 7f1e0b400640 1 -- 172.21.15.133:0/3711152263 shutdown_connections 2024-03-30T01:52:34.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.663+0000 7f1e0b400640 1 --2- 172.21.15.133:0/3711152263 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f1de006ac00 0x7f1de006d0c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:34.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.663+0000 7f1e0b400640 1 --2- 172.21.15.133:0/3711152263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e04145d30 0x7f1e041f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:34.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.663+0000 7f1e0b400640 1 --2- 172.21.15.133:0/3711152263 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e041457b0 0x7f1e0413fcc0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:34.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.663+0000 7f1e0b400640 1 --2- 172.21.15.133:0/3711152263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e04070a40 0x7f1e040ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:34.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.663+0000 7f1e0b400640 1 -- 172.21.15.133:0/3711152263 >> 172.21.15.133:0/3711152263 conn(0x7f1e040b07a0 msgr2=0x7f1e040cdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:34.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.664+0000 7f1e0b400640 1 -- 172.21.15.133:0/3711152263 shutdown_connections 2024-03-30T01:52:34.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.664+0000 7f1e0b400640 1 -- 172.21.15.133:0/3711152263 wait complete. 2024-03-30T01:52:34.692 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-30T01:52:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.900+0000 7f7c65400640 1 Processor -- start 2024-03-30T01:52:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.900+0000 7f7c65400640 1 -- start start 2024-03-30T01:52:34.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.901+0000 7f7c65400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7c60144450 0x7f7c600cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:34.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.901+0000 7f7c65400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7c600b2340 0x7f7c600705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:34.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.901+0000 7f7c65400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c600cd700 con 0x7f7c60070af0 2024-03-30T01:52:34.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.901+0000 7f7c65400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6015ae10 con 0x7f7c600b2340 2024-03-30T01:52:34.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.901+0000 7f7c65400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c60070ed0 con 0x7f7c60144450 2024-03-30T01:52:34.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.902+0000 7f7c55e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7c600b2340 0x7f7c600705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:34.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.902+0000 7f7c55e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7c600b2340 0x7f7c600705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47914/0 (socket says 172.21.15.133:47914) 2024-03-30T01:52:34.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.902+0000 7f7c55e00640 1 -- 172.21.15.133:0/1296692364 learned_addr learned my addr 172.21.15.133:0/1296692364 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:34.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.902+0000 7f7c55e00640 1 -- 172.21.15.133:0/1296692364 >> v2:172.21.15.137:3300/0 conn(0x7f7c60144450 msgr2=0x7f7c600cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:34.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.902+0000 7f7c55e00640 1 --2- 172.21.15.133:0/1296692364 >> v2:172.21.15.137:3300/0 conn(0x7f7c60144450 0x7f7c600cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:34.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.902+0000 7f7c55e00640 1 -- 172.21.15.133:0/1296692364 >> v1:172.21.15.137:6789/0 conn(0x7f7c60070af0 legacy=0x7f7c600cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.902+0000 7f7c55e00640 1 -- 172.21.15.133:0/1296692364 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c600ccb80 con 0x7f7c600b2340 2024-03-30T01:52:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.904+0000 7f7c55e00640 1 --2- 172.21.15.133:0/1296692364 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c600b2340 0x7f7c600705b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7c600b1610 tx=0x7f7c4802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c3b4e7a4277ab1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.904+0000 7f7c5de00640 1 -- 172.21.15.133:0/1296692364 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48031870 con 0x7f7c600b2340 2024-03-30T01:52:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.904+0000 7f7c5de00640 1 -- 172.21.15.133:0/1296692364 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c480319d0 con 0x7f7c600b2340 2024-03-30T01:52:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.904+0000 7f7c5de00640 1 -- 172.21.15.133:0/1296692364 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48031d60 con 0x7f7c600b2340 2024-03-30T01:52:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.905+0000 7f7c65400640 1 -- 172.21.15.133:0/1296692364 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c600b2340 msgr2=0x7f7c600705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.905+0000 7f7c65400640 1 --2- 172.21.15.133:0/1296692364 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c600b2340 0x7f7c600705b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7c600b1610 tx=0x7f7c4802b910 comp rx=0 tx=0).stop 2024-03-30T01:52:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.905+0000 7f7c65400640 1 -- 172.21.15.133:0/1296692364 shutdown_connections 2024-03-30T01:52:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.905+0000 7f7c65400640 1 --2- 172.21.15.133:0/1296692364 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c600b2340 0x7f7c600705b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.905+0000 7f7c65400640 1 --2- 172.21.15.133:0/1296692364 >> v2:172.21.15.137:3300/0 conn(0x7f7c60144450 0x7f7c600cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.905+0000 7f7c65400640 1 -- 172.21.15.133:0/1296692364 >> 172.21.15.133:0/1296692364 conn(0x7f7c600b0810 msgr2=0x7f7c600b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.905+0000 7f7c65400640 1 -- 172.21.15.133:0/1296692364 shutdown_connections 2024-03-30T01:52:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.905+0000 7f7c65400640 1 -- 172.21.15.133:0/1296692364 wait complete. 2024-03-30T01:52:34.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.907+0000 7f7c65400640 1 Processor -- start 2024-03-30T01:52:34.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.907+0000 7f7c65400640 1 -- start start 2024-03-30T01:52:34.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.908+0000 7f7c65400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c60070af0 0x7f7c6013d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:34.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.908+0000 7f7c65400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c600b2340 0x7f7c600ad770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:34.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.908+0000 7f7c65400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c60144450 0x7f7c601f1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:34.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.908+0000 7f7c65400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6013d810 con 0x7f7c600b2340 2024-03-30T01:52:34.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.908+0000 7f7c65400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6006c950 con 0x7f7c60070af0 2024-03-30T01:52:34.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.908+0000 7f7c65400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6006cc30 con 0x7f7c60144450 2024-03-30T01:52:34.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.908+0000 7f7c55e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c600b2340 0x7f7c600ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:34.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.908+0000 7f7c55e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c600b2340 0x7f7c600ad770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47916/0 (socket says 172.21.15.133:47916) 2024-03-30T01:52:34.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.908+0000 7f7c55e00640 1 -- 172.21.15.133:0/4197100823 learned_addr learned my addr 172.21.15.133:0/4197100823 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:34.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.908+0000 7f7c5e800640 1 --2- 172.21.15.133:0/4197100823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c60070af0 0x7f7c6013d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:34.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.908+0000 7f7c5f200640 1 --2- 172.21.15.133:0/4197100823 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c60144450 0x7f7c601f1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:34.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.908+0000 7f7c55e00640 1 -- 172.21.15.133:0/4197100823 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c60144450 msgr2=0x7f7c601f1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:34.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.908+0000 7f7c55e00640 1 --2- 172.21.15.133:0/4197100823 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c60144450 0x7f7c601f1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:34.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.908+0000 7f7c55e00640 1 -- 172.21.15.133:0/4197100823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c60070af0 msgr2=0x7f7c6013d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:34.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.908+0000 7f7c55e00640 1 --2- 172.21.15.133:0/4197100823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c60070af0 0x7f7c6013d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:34.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.908+0000 7f7c55e00640 1 -- 172.21.15.133:0/4197100823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c480094d0 con 0x7f7c600b2340 2024-03-30T01:52:34.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.909+0000 7f7c5f200640 1 --2- 172.21.15.133:0/4197100823 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c60144450 0x7f7c601f1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:34.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.909+0000 7f7c55e00640 1 --2- 172.21.15.133:0/4197100823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c600b2340 0x7f7c600ad770 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7c48000c00 tx=0x7f7c480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:34.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.909+0000 7f7c57400640 1 -- 172.21.15.133:0/4197100823 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4803ad10 con 0x7f7c600b2340 2024-03-30T01:52:34.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.909+0000 7f7c57400640 1 -- 172.21.15.133:0/4197100823 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4803ae70 con 0x7f7c600b2340 2024-03-30T01:52:34.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.909+0000 7f7c65400640 1 -- 172.21.15.133:0/4197100823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6006cf10 con 0x7f7c600b2340 2024-03-30T01:52:34.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.909+0000 7f7c57400640 1 -- 172.21.15.133:0/4197100823 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48044610 con 0x7f7c600b2340 2024-03-30T01:52:34.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.909+0000 7f7c65400640 1 -- 172.21.15.133:0/4197100823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6006d4d0 con 0x7f7c600b2340 2024-03-30T01:52:34.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.910+0000 7f7c65400640 1 -- 172.21.15.133:0/4197100823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6006d6c0 con 0x7f7c600b2340 2024-03-30T01:52:34.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.911+0000 7f7c57400640 1 -- 172.21.15.133:0/4197100823 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f7c4804d450 con 0x7f7c600b2340 2024-03-30T01:52:34.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.912+0000 7f7c57400640 1 --2- 172.21.15.133:0/4197100823 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7c3c06ac00 0x7f7c3c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:34.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.912+0000 7f7c57400640 1 -- 172.21.15.133:0/4197100823 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f7c4802d040 con 0x7f7c600b2340 2024-03-30T01:52:34.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.913+0000 7f7c5e800640 1 --2- 172.21.15.133:0/4197100823 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7c3c06ac00 0x7f7c3c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:34.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.913+0000 7f7c5e800640 1 --2- 172.21.15.133:0/4197100823 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7c3c06ac00 0x7f7c3c06d0c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000b810 tx=0x7f7c50008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:34.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:34.919+0000 7f7c57400640 1 -- 172.21.15.133:0/4197100823 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f7c48076ae0 con 0x7f7c600b2340 2024-03-30T01:52:35.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.114+0000 7f7c65400640 1 -- 172.21.15.133:0/4197100823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7c600cd700 con 0x7f7c600b2340 2024-03-30T01:52:35.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.675+0000 7f7c57400640 1 -- 172.21.15.133:0/4197100823 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7c600cd700 con 0x7f7c600b2340 2024-03-30T01:52:35.682 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2024-03-30T01:52:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.680+0000 7f7c65400640 1 -- 172.21.15.133:0/4197100823 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7c3c06ac00 msgr2=0x7f7c3c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.680+0000 7f7c65400640 1 --2- 172.21.15.133:0/4197100823 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7c3c06ac00 0x7f7c3c06d0c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000b810 tx=0x7f7c50008040 comp rx=0 tx=0).stop 2024-03-30T01:52:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.680+0000 7f7c65400640 1 -- 172.21.15.133:0/4197100823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c600b2340 msgr2=0x7f7c600ad770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.680+0000 7f7c65400640 1 --2- 172.21.15.133:0/4197100823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c600b2340 0x7f7c600ad770 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7c48000c00 tx=0x7f7c480046c0 comp rx=0 tx=0).stop 2024-03-30T01:52:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.680+0000 7f7c65400640 1 -- 172.21.15.133:0/4197100823 shutdown_connections 2024-03-30T01:52:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.680+0000 7f7c65400640 1 --2- 172.21.15.133:0/4197100823 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f7c3c06ac00 0x7f7c3c06d0c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.680+0000 7f7c65400640 1 --2- 172.21.15.133:0/4197100823 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c60144450 0x7f7c601f1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.680+0000 7f7c65400640 1 --2- 172.21.15.133:0/4197100823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c600b2340 0x7f7c600ad770 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.680+0000 7f7c65400640 1 --2- 172.21.15.133:0/4197100823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c60070af0 0x7f7c6013d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.680+0000 7f7c65400640 1 -- 172.21.15.133:0/4197100823 >> 172.21.15.133:0/4197100823 conn(0x7f7c600b0810 msgr2=0x7f7c600b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:35.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.680+0000 7f7c65400640 1 -- 172.21.15.133:0/4197100823 shutdown_connections 2024-03-30T01:52:35.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.680+0000 7f7c65400640 1 -- 172.21.15.133:0/4197100823 wait complete. 2024-03-30T01:52:35.708 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-30T01:52:35.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.918+0000 7f914e000640 1 Processor -- start 2024-03-30T01:52:35.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.918+0000 7f914e000640 1 -- start start 2024-03-30T01:52:35.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.920+0000 7f914e000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9148143340 0x7f91480cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:35.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.920+0000 7f914e000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91480b2b40 0x7f91480b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:35.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.920+0000 7f914e000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91480b34d0 con 0x7f914806e3e0 2024-03-30T01:52:35.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.920+0000 7f914e000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9148143720 con 0x7f9148143340 2024-03-30T01:52:35.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.920+0000 7f914e000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91480cbf50 con 0x7f91480b2b40 2024-03-30T01:52:35.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.920+0000 7f913ea00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f914806e3e0 0x7f914806d600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58186/0 (socket says 172.21.15.133:58186) 2024-03-30T01:52:35.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.920+0000 7f913ea00640 1 -- 172.21.15.133:0/648637886 learned_addr learned my addr 172.21.15.133:0/648637886 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:35.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.921+0000 7f9147400640 1 --2- 172.21.15.133:0/648637886 >> v2:172.21.15.137:3300/0 conn(0x7f9148143340 0x7f91480cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:35.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.921+0000 7f9147e00640 1 --2- 172.21.15.133:0/648637886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91480b2b40 0x7f91480b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:35.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.921+0000 7f9146a00640 1 -- 172.21.15.133:0/648637886 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1360681668 0 0) 0x7f9130001110 con 0x7f914806e3e0 2024-03-30T01:52:35.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.921+0000 7f9146a00640 1 -- 172.21.15.133:0/648637886 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f912c005730 con 0x7f914806e3e0 2024-03-30T01:52:35.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.921+0000 7f9146a00640 1 -- 172.21.15.133:0/648637886 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1351907203 0 0) 0x7f912c005730 con 0x7f914806e3e0 2024-03-30T01:52:35.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.921+0000 7f9146a00640 1 -- 172.21.15.133:0/648637886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91480b2b40 msgr2=0x7f91480b2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:35.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.921+0000 7f9146a00640 1 --2- 172.21.15.133:0/648637886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91480b2b40 0x7f91480b2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:35.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.921+0000 7f9146a00640 1 -- 172.21.15.133:0/648637886 >> v2:172.21.15.137:3300/0 conn(0x7f9148143340 msgr2=0x7f91480cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:35.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.921+0000 7f9146a00640 1 --2- 172.21.15.133:0/648637886 >> v2:172.21.15.137:3300/0 conn(0x7f9148143340 0x7f91480cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:35.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.921+0000 7f9146a00640 1 -- 172.21.15.133:0/648637886 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91480cc230 con 0x7f914806e3e0 2024-03-30T01:52:35.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.921+0000 7f9146a00640 1 -- 172.21.15.133:0/648637886 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f9130001800 con 0x7f914806e3e0 2024-03-30T01:52:35.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.921+0000 7f9146a00640 1 -- 172.21.15.133:0/648637886 >> v1:172.21.15.133:6789/0 conn(0x7f914806e3e0 legacy=0x7f914806d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:35.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.921+0000 7f9146a00640 1 --2- 172.21.15.133:0/648637886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f912c005b80 0x7f912c005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:35.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.921+0000 7f9146a00640 1 --2- 172.21.15.133:0/648637886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f912c0069d0 0x7f912c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:35.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.921+0000 7f9146a00640 1 --2- 172.21.15.133:0/648637886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91480b2b40 0x7f912c007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:35.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.921+0000 7f9146a00640 1 -- 172.21.15.133:0/648637886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9148143720 con 0x7f912c0069d0 2024-03-30T01:52:35.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.921+0000 7f9146a00640 1 -- 172.21.15.133:0/648637886 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91480cbf50 con 0x7f912c005b80 2024-03-30T01:52:35.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.921+0000 7f9146a00640 1 -- 172.21.15.133:0/648637886 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912c00db90 con 0x7f91480b2b40 2024-03-30T01:52:35.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.922+0000 7f913ea00640 1 --2- 172.21.15.133:0/648637886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f912c0069d0 0x7f912c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:35.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.922+0000 7f9147e00640 1 --2- 172.21.15.133:0/648637886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91480b2b40 0x7f912c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:35.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.922+0000 7f9147400640 1 --2- 172.21.15.133:0/648637886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f912c005b80 0x7f912c005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:35.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.922+0000 7f913ea00640 1 -- 172.21.15.133:0/648637886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91480b2b40 msgr2=0x7f912c007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:35.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.922+0000 7f913ea00640 1 --2- 172.21.15.133:0/648637886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91480b2b40 0x7f912c007390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:35.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.922+0000 7f913ea00640 1 -- 172.21.15.133:0/648637886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f912c005b80 msgr2=0x7f912c005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:35.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.922+0000 7f913ea00640 1 --2- 172.21.15.133:0/648637886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f912c005b80 0x7f912c005fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:35.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.922+0000 7f913ea00640 1 -- 172.21.15.133:0/648637886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c005730 con 0x7f912c0069d0 2024-03-30T01:52:35.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.923+0000 7f913ea00640 1 --2- 172.21.15.133:0/648637886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f912c0069d0 0x7f912c006e50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f913000c110 tx=0x7f912c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9295b3a4fa6eef server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:35.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.923+0000 7f9146a00640 1 -- 172.21.15.133:0/648637886 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9130005ad0 con 0x7f912c0069d0 2024-03-30T01:52:35.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.923+0000 7f9146a00640 1 -- 172.21.15.133:0/648637886 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9130005c50 con 0x7f912c0069d0 2024-03-30T01:52:35.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.923+0000 7f9146a00640 1 -- 172.21.15.133:0/648637886 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913002c810 con 0x7f912c0069d0 2024-03-30T01:52:35.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.924+0000 7f914e000640 1 -- 172.21.15.133:0/648637886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f912c0069d0 msgr2=0x7f912c006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:35.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.924+0000 7f914e000640 1 --2- 172.21.15.133:0/648637886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f912c0069d0 0x7f912c006e50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f913000c110 tx=0x7f912c007a00 comp rx=0 tx=0).stop 2024-03-30T01:52:35.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.924+0000 7f9147e00640 1 -- 172.21.15.133:0/648637886 reap_dead start 2024-03-30T01:52:35.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.924+0000 7f914e000640 1 -- 172.21.15.133:0/648637886 shutdown_connections 2024-03-30T01:52:35.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.924+0000 7f914e000640 1 -- 172.21.15.133:0/648637886 >> 172.21.15.133:0/648637886 conn(0x7f91480b0810 msgr2=0x7f91480b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:35.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.924+0000 7f914e000640 1 -- 172.21.15.133:0/648637886 shutdown_connections 2024-03-30T01:52:35.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.924+0000 7f914e000640 1 -- 172.21.15.133:0/648637886 wait complete. 2024-03-30T01:52:35.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.926+0000 7f914e000640 1 Processor -- start 2024-03-30T01:52:35.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.926+0000 7f914e000640 1 -- start start 2024-03-30T01:52:35.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.927+0000 7f914e000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f912c0069d0 0x7f91481f3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:35.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.927+0000 7f914e000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91481efa30 0x7f91480ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:35.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.927+0000 7f914e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91480ae970 0x7f91480ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:35.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.927+0000 7f914e000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91480c38a0 con 0x7f91481efa30 2024-03-30T01:52:35.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.927+0000 7f914e000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91480aedf0 con 0x7f91480ae970 2024-03-30T01:52:35.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.927+0000 7f914e000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9148159be0 con 0x7f912c0069d0 2024-03-30T01:52:35.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.927+0000 7f913ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91481efa30 0x7f91480ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:35.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.927+0000 7f913ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91481efa30 0x7f91480ae430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56502/0 (socket says 172.21.15.133:56502) 2024-03-30T01:52:35.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.927+0000 7f913ea00640 1 -- 172.21.15.133:0/82650919 learned_addr learned my addr 172.21.15.133:0/82650919 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:35.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.928+0000 7f9147400640 1 --2- 172.21.15.133:0/82650919 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f912c0069d0 0x7f91481f3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:35.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.928+0000 7f9147e00640 1 --2- 172.21.15.133:0/82650919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91480ae970 0x7f91480ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:35.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.928+0000 7f913ea00640 1 -- 172.21.15.133:0/82650919 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f912c0069d0 msgr2=0x7f91481f3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:35.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.928+0000 7f913ea00640 1 --2- 172.21.15.133:0/82650919 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f912c0069d0 0x7f91481f3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:35.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.928+0000 7f913ea00640 1 -- 172.21.15.133:0/82650919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91480ae970 msgr2=0x7f91480ac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:35.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.928+0000 7f913ea00640 1 --2- 172.21.15.133:0/82650919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91480ae970 0x7f91480ac3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:35.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.928+0000 7f913ea00640 1 -- 172.21.15.133:0/82650919 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91481efeb0 con 0x7f91481efa30 2024-03-30T01:52:35.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.928+0000 7f9147e00640 1 --2- 172.21.15.133:0/82650919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91480ae970 0x7f91480ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:35.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.928+0000 7f913ea00640 1 --2- 172.21.15.133:0/82650919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91481efa30 0x7f91480ae430 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f913000c110 tx=0x7f914806ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:35.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.928+0000 7f913fe00640 1 -- 172.21.15.133:0/82650919 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9130039070 con 0x7f91481efa30 2024-03-30T01:52:35.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.929+0000 7f913fe00640 1 -- 172.21.15.133:0/82650919 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913002cc20 con 0x7f91481efa30 2024-03-30T01:52:35.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.929+0000 7f914e000640 1 -- 172.21.15.133:0/82650919 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91480c3ab0 con 0x7f91481efa30 2024-03-30T01:52:35.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.929+0000 7f913fe00640 1 -- 172.21.15.133:0/82650919 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913003c040 con 0x7f91481efa30 2024-03-30T01:52:35.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.929+0000 7f914e000640 1 -- 172.21.15.133:0/82650919 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91480c4070 con 0x7f91481efa30 2024-03-30T01:52:35.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.930+0000 7f914e000640 1 -- 172.21.15.133:0/82650919 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9148066d80 con 0x7f91481efa30 2024-03-30T01:52:35.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.931+0000 7f913fe00640 1 -- 172.21.15.133:0/82650919 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9130032070 con 0x7f91481efa30 2024-03-30T01:52:35.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.932+0000 7f913fe00640 1 --2- 172.21.15.133:0/82650919 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f912406ac30 0x7f912406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:35.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.932+0000 7f913fe00640 1 -- 172.21.15.133:0/82650919 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f91300aa470 con 0x7f91481efa30 2024-03-30T01:52:35.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.932+0000 7f9147400640 1 --2- 172.21.15.133:0/82650919 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f912406ac30 0x7f912406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:35.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.932+0000 7f9147400640 1 --2- 172.21.15.133:0/82650919 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f912406ac30 0x7f912406d0f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f91480ad7f0 tx=0x7f9138008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:35.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:35.936+0000 7f913fe00640 1 -- 172.21.15.133:0/82650919 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f9130075690 con 0x7f91481efa30 2024-03-30T01:52:36.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.129+0000 7f914e000640 1 -- 172.21.15.133:0/82650919 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f91480b34d0 con 0x7f91481efa30 2024-03-30T01:52:36.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.689+0000 7f913fe00640 1 -- 172.21.15.133:0/82650919 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f91480b34d0 con 0x7f91481efa30 2024-03-30T01:52:36.695 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2024-03-30T01:52:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.693+0000 7f914e000640 1 -- 172.21.15.133:0/82650919 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f912406ac30 msgr2=0x7f912406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.693+0000 7f914e000640 1 --2- 172.21.15.133:0/82650919 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f912406ac30 0x7f912406d0f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f91480ad7f0 tx=0x7f9138008040 comp rx=0 tx=0).stop 2024-03-30T01:52:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.693+0000 7f914e000640 1 -- 172.21.15.133:0/82650919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91481efa30 msgr2=0x7f91480ae430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.693+0000 7f914e000640 1 --2- 172.21.15.133:0/82650919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91481efa30 0x7f91480ae430 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f913000c110 tx=0x7f914806ccf0 comp rx=0 tx=0).stop 2024-03-30T01:52:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.694+0000 7f914e000640 1 -- 172.21.15.133:0/82650919 shutdown_connections 2024-03-30T01:52:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.694+0000 7f914e000640 1 --2- 172.21.15.133:0/82650919 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f912406ac30 0x7f912406d0f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.694+0000 7f914e000640 1 --2- 172.21.15.133:0/82650919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91480ae970 0x7f91480ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.694+0000 7f914e000640 1 --2- 172.21.15.133:0/82650919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91481efa30 0x7f91480ae430 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.694+0000 7f914e000640 1 --2- 172.21.15.133:0/82650919 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f912c0069d0 0x7f91481f3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.694+0000 7f914e000640 1 -- 172.21.15.133:0/82650919 >> 172.21.15.133:0/82650919 conn(0x7f91480b0810 msgr2=0x7f91480afe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.694+0000 7f914e000640 1 -- 172.21.15.133:0/82650919 shutdown_connections 2024-03-30T01:52:36.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.695+0000 7f914e000640 1 -- 172.21.15.133:0/82650919 wait complete. 2024-03-30T01:52:36.722 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-30T01:52:36.722 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-30T01:52:36.723 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-30T01:52:36.723 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T01:52:36.723 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-30T01:52:36.723 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-30T01:52:36.723 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-30T01:52:36.723 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T01:52:36.724 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-30T01:52:36.724 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-30T01:52:36.724 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-30T01:52:36.724 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T01:52:36.724 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-30T01:52:36.724 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-30T01:52:36.724 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-30T01:52:36.724 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T01:52:36.744 INFO:tasks.ceph.mds.c:Stopped 2024-03-30T01:52:36.744 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-30T01:52:36.745 INFO:tasks.ceph.mds.b:Stopped 2024-03-30T01:52:36.745 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-30T01:52:36.746 INFO:tasks.ceph.mds.d:Stopped 2024-03-30T01:52:36.746 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-30T01:52:36.747 INFO:tasks.ceph.mds.a:Stopped 2024-03-30T01:52:36.747 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-30T01:52:36.793 INFO:tasks.ceph.mds.b:Started 2024-03-30T01:52:36.793 DEBUG:teuthology.parallel:result is None 2024-03-30T01:52:36.795 INFO:tasks.ceph.mds.c:Started 2024-03-30T01:52:36.795 DEBUG:teuthology.parallel:result is None 2024-03-30T01:52:36.798 INFO:tasks.ceph.mds.d:Started 2024-03-30T01:52:36.798 DEBUG:teuthology.parallel:result is None 2024-03-30T01:52:36.801 INFO:tasks.ceph.mds.a:Started 2024-03-30T01:52:36.801 DEBUG:teuthology.parallel:result is None 2024-03-30T01:52:36.801 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-30T01:52:36.954 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2024-03-30T01:52:37.008 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2024-03-30T01:52:37.009 INFO:tasks.ceph.mds.c.smithi133.stderr:2024-03-30T01:52:36.950+0000 7f365ce00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-03-30T01:52:37.012 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2024-03-30T01:52:37.012 INFO:tasks.ceph.mds.d.smithi137.stdout:starting mds.d at 2024-03-30T01:52:37.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.987+0000 7ff38ee00640 1 Processor -- start 2024-03-30T01:52:37.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.987+0000 7ff38ee00640 1 -- start start 2024-03-30T01:52:37.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.989+0000 7ff38ee00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff388071ae0 0x7ff3880b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:37.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.989+0000 7ff38ee00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff388160800 con 0x7ff38815cc20 2024-03-30T01:52:37.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.989+0000 7ff38ee00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3880b2680 con 0x7ff38806b200 2024-03-30T01:52:37.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.989+0000 7ff38ee00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38815d000 con 0x7ff388071ae0 2024-03-30T01:52:37.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.989+0000 7ff387e00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff38815cc20 0x7ff3880ace80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58206/0 (socket says 172.21.15.133:58206) 2024-03-30T01:52:37.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.989+0000 7ff387e00640 1 -- 172.21.15.133:0/1838434585 learned_addr learned my addr 172.21.15.133:0/1838434585 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:37.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.989+0000 7ff38ce00640 1 --2- 172.21.15.133:0/1838434585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff388071ae0 0x7ff3880b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:37.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.989+0000 7ff38ce00640 1 -- 172.21.15.133:0/1838434585 >> v1:172.21.15.137:6789/0 conn(0x7ff38806b200 legacy=0x7ff3880713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:37.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.989+0000 7ff38ce00640 1 -- 172.21.15.133:0/1838434585 >> v1:172.21.15.133:6789/0 conn(0x7ff38815cc20 legacy=0x7ff3880ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:37.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.989+0000 7ff38ce00640 1 -- 172.21.15.133:0/1838434585 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3880b2960 con 0x7ff388071ae0 2024-03-30T01:52:37.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.991+0000 7ff38ce00640 1 --2- 172.21.15.133:0/1838434585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff388071ae0 0x7ff3880b20a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff380009dc0 tx=0x7ff38002bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1854038e065334b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:37.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.992+0000 7ff386a00640 1 -- 172.21.15.133:0/1838434585 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38002ccd0 con 0x7ff388071ae0 2024-03-30T01:52:37.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.992+0000 7ff386a00640 1 -- 172.21.15.133:0/1838434585 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38002ce30 con 0x7ff388071ae0 2024-03-30T01:52:37.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.992+0000 7ff386a00640 1 -- 172.21.15.133:0/1838434585 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff380034660 con 0x7ff388071ae0 2024-03-30T01:52:37.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.992+0000 7ff38ee00640 1 -- 172.21.15.133:0/1838434585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff388071ae0 msgr2=0x7ff3880b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:37.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.993+0000 7ff38ee00640 1 --2- 172.21.15.133:0/1838434585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff388071ae0 0x7ff3880b20a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff380009dc0 tx=0x7ff38002bf20 comp rx=0 tx=0).stop 2024-03-30T01:52:37.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.993+0000 7ff38ee00640 1 -- 172.21.15.133:0/1838434585 shutdown_connections 2024-03-30T01:52:37.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.993+0000 7ff38ee00640 1 --2- 172.21.15.133:0/1838434585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff388071ae0 0x7ff3880b20a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:37.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.993+0000 7ff38ee00640 1 -- 172.21.15.133:0/1838434585 >> 172.21.15.133:0/1838434585 conn(0x7ff38806da20 msgr2=0x7ff388070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:37.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.993+0000 7ff38ee00640 1 -- 172.21.15.133:0/1838434585 shutdown_connections 2024-03-30T01:52:37.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.993+0000 7ff38ee00640 1 -- 172.21.15.133:0/1838434585 wait complete. 2024-03-30T01:52:37.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.994+0000 7ff38ee00640 1 Processor -- start 2024-03-30T01:52:37.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.995+0000 7ff38ee00640 1 -- start start 2024-03-30T01:52:37.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.995+0000 7ff38ee00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff38806b200 0x7ff3881f3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:37.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.995+0000 7ff38ee00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff388071ae0 0x7ff38814e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:37.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.996+0000 7ff38ee00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff38815cc20 0x7ff38815d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:37.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.996+0000 7ff38ee00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38814ee80 con 0x7ff38815cc20 2024-03-30T01:52:37.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.996+0000 7ff38ee00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38815d690 con 0x7ff388071ae0 2024-03-30T01:52:37.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.996+0000 7ff38ee00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38815d930 con 0x7ff38806b200 2024-03-30T01:52:37.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.996+0000 7ff38ce00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff38815cc20 0x7ff38815d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:37.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.996+0000 7ff38ce00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff38815cc20 0x7ff38815d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56548/0 (socket says 172.21.15.133:56548) 2024-03-30T01:52:37.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.996+0000 7ff38ce00640 1 -- 172.21.15.133:0/1287067209 learned_addr learned my addr 172.21.15.133:0/1287067209 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:37.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.996+0000 7ff387400640 1 --2- 172.21.15.133:0/1287067209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff388071ae0 0x7ff38814e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:37.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.996+0000 7ff387e00640 1 --2- 172.21.15.133:0/1287067209 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff38806b200 0x7ff3881f3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:37.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.996+0000 7ff38ce00640 1 -- 172.21.15.133:0/1287067209 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff38806b200 msgr2=0x7ff3881f3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:37.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.996+0000 7ff38ce00640 1 --2- 172.21.15.133:0/1287067209 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff38806b200 0x7ff3881f3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:37.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.996+0000 7ff38ce00640 1 -- 172.21.15.133:0/1287067209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff388071ae0 msgr2=0x7ff38814e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:37.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.996+0000 7ff38ce00640 1 --2- 172.21.15.133:0/1287067209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff388071ae0 0x7ff38814e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:37.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.996+0000 7ff38ce00640 1 -- 172.21.15.133:0/1287067209 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff380009a70 con 0x7ff38815cc20 2024-03-30T01:52:37.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.996+0000 7ff387400640 1 --2- 172.21.15.133:0/1287067209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff388071ae0 0x7ff38814e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T01:52:37.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.997+0000 7ff38ce00640 1 --2- 172.21.15.133:0/1287067209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff38815cc20 0x7ff38815d150 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff38002dfd0 tx=0x7ff380004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:37.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.997+0000 7ff37fe00640 1 -- 172.21.15.133:0/1287067209 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38003d600 con 0x7ff38815cc20 2024-03-30T01:52:37.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.997+0000 7ff37fe00640 1 -- 172.21.15.133:0/1287067209 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38003d760 con 0x7ff38815cc20 2024-03-30T01:52:37.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.997+0000 7ff37fe00640 1 -- 172.21.15.133:0/1287067209 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38003db10 con 0x7ff38815cc20 2024-03-30T01:52:37.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.997+0000 7ff38ee00640 1 -- 172.21.15.133:0/1287067209 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38815dc10 con 0x7ff38815cc20 2024-03-30T01:52:37.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.997+0000 7ff38ee00640 1 -- 172.21.15.133:0/1287067209 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38815e1d0 con 0x7ff38815cc20 2024-03-30T01:52:37.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.998+0000 7ff38ee00640 1 -- 172.21.15.133:0/1287067209 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff388066d80 con 0x7ff38815cc20 2024-03-30T01:52:37.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:36.999+0000 7ff37fe00640 1 -- 172.21.15.133:0/1287067209 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ff38003b040 con 0x7ff38815cc20 2024-03-30T01:52:37.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:37.000+0000 7ff37fe00640 1 --2- 172.21.15.133:0/1287067209 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff36806ac00 0x7ff36806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:37.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:37.000+0000 7ff37fe00640 1 -- 172.21.15.133:0/1287067209 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff3800ab6e0 con 0x7ff38815cc20 2024-03-30T01:52:37.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:37.000+0000 7ff387e00640 1 --2- 172.21.15.133:0/1287067209 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff36806ac00 0x7ff36806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:37.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:37.001+0000 7ff387e00640 1 --2- 172.21.15.133:0/1287067209 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff36806ac00 0x7ff36806d0c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff378005880 tx=0x7ff378009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:37.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:37.004+0000 7ff37fe00640 1 -- 172.21.15.133:0/1287067209 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7ff380076bd0 con 0x7ff38815cc20 2024-03-30T01:52:37.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:37.213+0000 7ff38ee00640 1 -- 172.21.15.133:0/1287067209 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff3880cb860 con 0x7ff38815cc20 2024-03-30T01:52:38.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:37.997+0000 7ff37fe00640 1 -- 172.21.15.133:0/1287067209 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff38007a1f0 con 0x7ff38815cc20 2024-03-30T01:52:38.003 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blocklist entries 2024-03-30T01:52:38.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.001+0000 7ff38ee00640 1 -- 172.21.15.133:0/1287067209 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff36806ac00 msgr2=0x7ff36806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:38.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.001+0000 7ff38ee00640 1 --2- 172.21.15.133:0/1287067209 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff36806ac00 0x7ff36806d0c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff378005880 tx=0x7ff378009040 comp rx=0 tx=0).stop 2024-03-30T01:52:38.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.001+0000 7ff38ee00640 1 -- 172.21.15.133:0/1287067209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff38815cc20 msgr2=0x7ff38815d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:38.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.001+0000 7ff38ee00640 1 --2- 172.21.15.133:0/1287067209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff38815cc20 0x7ff38815d150 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff38002dfd0 tx=0x7ff380004a40 comp rx=0 tx=0).stop 2024-03-30T01:52:38.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.001+0000 7ff38ee00640 1 -- 172.21.15.133:0/1287067209 shutdown_connections 2024-03-30T01:52:38.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.001+0000 7ff38ee00640 1 --2- 172.21.15.133:0/1287067209 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff36806ac00 0x7ff36806d0c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:38.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.001+0000 7ff38ee00640 1 --2- 172.21.15.133:0/1287067209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff38815cc20 0x7ff38815d150 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:38.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.001+0000 7ff38ee00640 1 --2- 172.21.15.133:0/1287067209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff388071ae0 0x7ff38814e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:38.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.001+0000 7ff38ee00640 1 --2- 172.21.15.133:0/1287067209 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff38806b200 0x7ff3881f3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:38.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.001+0000 7ff38ee00640 1 -- 172.21.15.133:0/1287067209 >> 172.21.15.133:0/1287067209 conn(0x7ff38806da20 msgr2=0x7ff3880aebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:38.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.001+0000 7ff38ee00640 1 -- 172.21.15.133:0/1287067209 shutdown_connections 2024-03-30T01:52:38.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.001+0000 7ff38ee00640 1 -- 172.21.15.133:0/1287067209 wait complete. 2024-03-30T01:52:38.030 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-30T01:52:38.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.232+0000 7fae78600640 1 Processor -- start 2024-03-30T01:52:38.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.232+0000 7fae78600640 1 -- start start 2024-03-30T01:52:38.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.234+0000 7fae78600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fae70143820 0x7fae70070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:38.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.234+0000 7fae78600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fae7006d4c0 0x7fae7015b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:38.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.234+0000 7fae78600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae700cdb90 con 0x7fae700ce020 2024-03-30T01:52:38.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.234+0000 7fae78600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae70071420 con 0x7fae70143820 2024-03-30T01:52:38.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.234+0000 7fae78600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae700ccca0 con 0x7fae7006d4c0 2024-03-30T01:52:38.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.234+0000 7fae75c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fae70143820 0x7fae70070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:38.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.234+0000 7fae75200640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fae700ce020 0x7fae7006cdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58220/0 (socket says 172.21.15.133:58220) 2024-03-30T01:52:38.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.234+0000 7fae75200640 1 -- 172.21.15.133:0/2216969243 learned_addr learned my addr 172.21.15.133:0/2216969243 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:38.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.234+0000 7fae76600640 1 --2- 172.21.15.133:0/2216969243 >> v2:172.21.15.137:3300/0 conn(0x7fae7006d4c0 0x7fae7015b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:38.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.235+0000 7fae75c00640 1 -- 172.21.15.133:0/2216969243 >> v2:172.21.15.137:3300/0 conn(0x7fae7006d4c0 msgr2=0x7fae7015b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:38.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.235+0000 7fae75c00640 1 --2- 172.21.15.133:0/2216969243 >> v2:172.21.15.137:3300/0 conn(0x7fae7006d4c0 0x7fae7015b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:38.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.235+0000 7fae75c00640 1 -- 172.21.15.133:0/2216969243 >> v1:172.21.15.133:6789/0 conn(0x7fae700ce020 legacy=0x7fae7006cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:38.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.235+0000 7fae6fe00640 1 -- 172.21.15.133:0/2216969243 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436509716 0 0) 0x7fae700cdb90 con 0x7fae700ce020 2024-03-30T01:52:38.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.235+0000 7fae75c00640 1 -- 172.21.15.133:0/2216969243 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae700ccf80 con 0x7fae70143820 2024-03-30T01:52:38.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.236+0000 7fae75c00640 1 --2- 172.21.15.133:0/2216969243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae70143820 0x7fae70070ee0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fae70071950 tx=0x7fae6402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feca5eb8b4fbe3f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:38.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.237+0000 7fae6fe00640 1 -- 172.21.15.133:0/2216969243 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae64031830 con 0x7fae70143820 2024-03-30T01:52:38.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.237+0000 7fae6fe00640 1 -- 172.21.15.133:0/2216969243 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae64031990 con 0x7fae70143820 2024-03-30T01:52:38.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.237+0000 7fae6fe00640 1 -- 172.21.15.133:0/2216969243 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae64031d20 con 0x7fae70143820 2024-03-30T01:52:38.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.237+0000 7fae78600640 1 -- 172.21.15.133:0/2216969243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae70143820 msgr2=0x7fae70070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:38.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.237+0000 7fae78600640 1 --2- 172.21.15.133:0/2216969243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae70143820 0x7fae70070ee0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fae70071950 tx=0x7fae6402b8d0 comp rx=0 tx=0).stop 2024-03-30T01:52:38.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.237+0000 7fae78600640 1 -- 172.21.15.133:0/2216969243 shutdown_connections 2024-03-30T01:52:38.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.237+0000 7fae78600640 1 --2- 172.21.15.133:0/2216969243 >> v2:172.21.15.137:3300/0 conn(0x7fae7006d4c0 0x7fae7015b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:38.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.237+0000 7fae78600640 1 --2- 172.21.15.133:0/2216969243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae70143820 0x7fae70070ee0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:38.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.237+0000 7fae78600640 1 -- 172.21.15.133:0/2216969243 >> 172.21.15.133:0/2216969243 conn(0x7fae700b05c0 msgr2=0x7fae700b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:38.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.238+0000 7fae78600640 1 -- 172.21.15.133:0/2216969243 shutdown_connections 2024-03-30T01:52:38.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.238+0000 7fae78600640 1 -- 172.21.15.133:0/2216969243 wait complete. 2024-03-30T01:52:38.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.239+0000 7fae78600640 1 Processor -- start 2024-03-30T01:52:38.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.239+0000 7fae78600640 1 -- start start 2024-03-30T01:52:38.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.240+0000 7fae78600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae7006d4c0 0x7fae7013cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:38.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.240+0000 7fae78600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae700ce020 0x7fae7012f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:38.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.240+0000 7fae78600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae70143820 0x7fae700abd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:38.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.240+0000 7fae78600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7013d1e0 con 0x7fae70143820 2024-03-30T01:52:38.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.240+0000 7fae78600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae701300e0 con 0x7fae700ce020 2024-03-30T01:52:38.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.240+0000 7fae78600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae701303c0 con 0x7fae7006d4c0 2024-03-30T01:52:38.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.241+0000 7fae76600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae70143820 0x7fae700abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:38.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.241+0000 7fae76600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae70143820 0x7fae700abd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56566/0 (socket says 172.21.15.133:56566) 2024-03-30T01:52:38.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.241+0000 7fae76600640 1 -- 172.21.15.133:0/3430477774 learned_addr learned my addr 172.21.15.133:0/3430477774 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:38.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.241+0000 7fae75c00640 1 --2- 172.21.15.133:0/3430477774 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae7006d4c0 0x7fae7013cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:38.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.241+0000 7fae75200640 1 --2- 172.21.15.133:0/3430477774 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae700ce020 0x7fae7012f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:38.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.241+0000 7fae76600640 1 -- 172.21.15.133:0/3430477774 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae7006d4c0 msgr2=0x7fae7013cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:38.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.241+0000 7fae76600640 1 --2- 172.21.15.133:0/3430477774 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae7006d4c0 0x7fae7013cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:38.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.241+0000 7fae76600640 1 -- 172.21.15.133:0/3430477774 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae700ce020 msgr2=0x7fae7012f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:38.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.241+0000 7fae76600640 1 --2- 172.21.15.133:0/3430477774 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae700ce020 0x7fae7012f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:38.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.241+0000 7fae76600640 1 -- 172.21.15.133:0/3430477774 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae64009400 con 0x7fae70143820 2024-03-30T01:52:38.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.241+0000 7fae76600640 1 --2- 172.21.15.133:0/3430477774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae70143820 0x7fae700abd60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fae68007e30 tx=0x7fae6800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:38.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.242+0000 7fae6d600640 1 -- 172.21.15.133:0/3430477774 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae68014620 con 0x7fae70143820 2024-03-30T01:52:38.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.242+0000 7fae6d600640 1 -- 172.21.15.133:0/3430477774 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6800ee90 con 0x7fae70143820 2024-03-30T01:52:38.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.242+0000 7fae78600640 1 -- 172.21.15.133:0/3430477774 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae701306a0 con 0x7fae70143820 2024-03-30T01:52:38.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.242+0000 7fae6d600640 1 -- 172.21.15.133:0/3430477774 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae680149c0 con 0x7fae70143820 2024-03-30T01:52:38.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.242+0000 7fae78600640 1 -- 172.21.15.133:0/3430477774 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7012fd20 con 0x7fae70143820 2024-03-30T01:52:38.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.243+0000 7fae78600640 1 -- 172.21.15.133:0/3430477774 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae70073750 con 0x7fae70143820 2024-03-30T01:52:38.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.244+0000 7fae6d600640 1 -- 172.21.15.133:0/3430477774 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fae68014b20 con 0x7fae70143820 2024-03-30T01:52:38.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.245+0000 7fae6d600640 1 --2- 172.21.15.133:0/3430477774 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fae5006ac00 0x7fae5006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:38.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.246+0000 7fae6d600640 1 -- 172.21.15.133:0/3430477774 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fae68089900 con 0x7fae70143820 2024-03-30T01:52:38.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.246+0000 7fae75c00640 1 --2- 172.21.15.133:0/3430477774 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fae5006ac00 0x7fae5006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:38.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.246+0000 7fae75c00640 1 --2- 172.21.15.133:0/3430477774 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fae5006ac00 0x7fae5006d0c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fae64036000 tx=0x7fae6403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:38.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.250+0000 7fae6d600640 1 -- 172.21.15.133:0/3430477774 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fae68054ec0 con 0x7fae70143820 2024-03-30T01:52:38.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.515+0000 7fae78600640 1 -- 172.21.15.133:0/3430477774 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fae7012feb0 con 0x7fae70143820 2024-03-30T01:52:38.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.515+0000 7fae6d600640 1 -- 172.21.15.133:0/3430477774 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fae680584e0 con 0x7fae70143820 2024-03-30T01:52:38.522 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:38.522 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-03-30T01:52:38.522 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2024-03-30T01:52:38.522 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.522 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2024-03-30T01:52:38.522 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDebwdmkr7ADhAAu0uXAIk2g0kgg2MP39R30Q==", 2024-03-30T01:52:38.522 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.522 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-03-30T01:52:38.522 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-03-30T01:52:38.522 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-03-30T01:52:38.523 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-03-30T01:52:38.523 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.523 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.523 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.523 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2024-03-30T01:52:38.523 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDebwdmcGjULRAAZQgxNwjrIIgCij4d0I7HZQ==", 2024-03-30T01:52:38.523 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.523 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-03-30T01:52:38.523 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-03-30T01:52:38.523 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-03-30T01:52:38.523 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-03-30T01:52:38.523 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.523 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.523 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.523 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2024-03-30T01:52:38.523 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDebwdmI9nWHhAAP1ONl6CfaVy2ONKW3grPrA==", 2024-03-30T01:52:38.524 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.524 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-03-30T01:52:38.524 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-03-30T01:52:38.524 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-03-30T01:52:38.524 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-03-30T01:52:38.524 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.524 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.524 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.524 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.d", 2024-03-30T01:52:38.524 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDfbwdmWc/TAhAABf+PMlPYzuYGMeUGA2fDPg==", 2024-03-30T01:52:38.524 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.524 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-03-30T01:52:38.524 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-03-30T01:52:38.524 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-03-30T01:52:38.525 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-03-30T01:52:38.525 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.525 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.525 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2024-03-30T01:52:38.525 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDjbwdm5HpcKxAAqnQUfq7TU4AdOFpM9FmFuw==", 2024-03-30T01:52:38.525 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.525 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-03-30T01:52:38.525 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-03-30T01:52:38.525 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-03-30T01:52:38.525 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.525 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.525 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2024-03-30T01:52:38.525 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDnbwdmUTwlCBAApfKESGLGMopFNFoTSxGkbw==", 2024-03-30T01:52:38.525 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.526 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-03-30T01:52:38.526 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-03-30T01:52:38.526 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-03-30T01:52:38.526 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.526 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2024-03-30T01:52:38.526 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDqbwdmnvhCEhAAA79NXAhmqRkjb9w3tzSl1g==", 2024-03-30T01:52:38.526 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.526 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-03-30T01:52:38.526 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-03-30T01:52:38.526 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-03-30T01:52:38.526 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.527 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2024-03-30T01:52:38.527 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDtbwdm0DOXKRAA9xrH6BPDmMPloR0pgI+TkA==", 2024-03-30T01:52:38.527 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.527 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-03-30T01:52:38.527 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-03-30T01:52:38.527 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-03-30T01:52:38.527 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.527 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2024-03-30T01:52:38.527 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQD0bwdmOHPaLRAAZ8+uVX5TMx7ykq2W7N9dDg==", 2024-03-30T01:52:38.527 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.527 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-03-30T01:52:38.527 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-03-30T01:52:38.528 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-03-30T01:52:38.528 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.528 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2024-03-30T01:52:38.528 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQD3bwdmN/3JOBAAMTS2oLC2JpdaNlrrfRDafw==", 2024-03-30T01:52:38.528 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.528 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-03-30T01:52:38.528 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-03-30T01:52:38.528 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-03-30T01:52:38.528 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.529 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2024-03-30T01:52:38.529 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQD7bwdmzTqvFRAAYEgyn6vfgzK5diDQSP38nA==", 2024-03-30T01:52:38.529 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.529 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-03-30T01:52:38.529 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-03-30T01:52:38.529 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-03-30T01:52:38.529 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.529 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2024-03-30T01:52:38.529 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQD+bwdmQZ2fHhAA/ZFaICZn5fGIe8rZeDn3Fg==", 2024-03-30T01:52:38.529 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.529 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-03-30T01:52:38.529 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-03-30T01:52:38.529 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-03-30T01:52:38.529 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.530 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.530 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.530 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2024-03-30T01:52:38.530 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDfbwdmkcCwEBAALBXqz3Ig6wLpBxm0qvzHHA==", 2024-03-30T01:52:38.530 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.530 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-03-30T01:52:38.530 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-03-30T01:52:38.530 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-03-30T01:52:38.530 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-03-30T01:52:38.530 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.530 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.530 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.530 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2024-03-30T01:52:38.530 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDfbwdm5A32JRAAUfU1vpjO00nIx+mAsxzCng==", 2024-03-30T01:52:38.530 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.530 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-03-30T01:52:38.531 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-03-30T01:52:38.531 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-03-30T01:52:38.531 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-03-30T01:52:38.531 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.531 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.531 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.531 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.2", 2024-03-30T01:52:38.531 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDfbwdmSawSGxAA6SdbVP0UoK0NoZdvIuxblQ==", 2024-03-30T01:52:38.531 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.531 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-03-30T01:52:38.531 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-03-30T01:52:38.531 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-03-30T01:52:38.531 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-03-30T01:52:38.531 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.531 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.531 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.532 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.3", 2024-03-30T01:52:38.532 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDfbwdmoSG0MBAAQD5nPtEEOolsbC2CoUfbPQ==", 2024-03-30T01:52:38.532 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.532 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-03-30T01:52:38.532 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-03-30T01:52:38.532 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-03-30T01:52:38.532 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-03-30T01:52:38.532 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.532 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2024-03-30T01:52:38.532 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDdbwdmCEX2AhAAkq66rsZul7VlDIUphjkxZg==", 2024-03-30T01:52:38.532 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.532 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-03-30T01:52:38.533 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-03-30T01:52:38.533 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-03-30T01:52:38.533 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-03-30T01:52:38.533 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.533 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.533 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-mds", 2024-03-30T01:52:38.533 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAMcAdmqqWUJhAAQUAYqSyfEdXBQL/pLotq4w==", 2024-03-30T01:52:38.533 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.533 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-mds" 2024-03-30T01:52:38.533 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.533 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.533 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-mgr", 2024-03-30T01:52:38.533 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAMcAdmn8iUJhAAq+bNZbgyFSn2VRNIwg4Cmw==", 2024-03-30T01:52:38.533 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.533 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-mgr" 2024-03-30T01:52:38.534 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.534 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-osd", 2024-03-30T01:52:38.534 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAMcAdmdOKUJhAAzNQuSy2EJsE6bhJp7HLI9Q==", 2024-03-30T01:52:38.534 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.534 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-osd" 2024-03-30T01:52:38.534 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.534 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-rbd", 2024-03-30T01:52:38.534 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAMcAdmA/uUJhAACUYhlD30HOZ+PMr9GlBfYQ==", 2024-03-30T01:52:38.534 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.534 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-rbd" 2024-03-30T01:52:38.534 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.535 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-03-30T01:52:38.535 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAMcAdmgRSVJhAArTzcikrx3MxQVsPDsGCPxw==", 2024-03-30T01:52:38.535 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.535 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-03-30T01:52:38.535 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.535 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-rgw", 2024-03-30T01:52:38.535 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAMcAdmPy6VJhAAJm2NnRF3ZvHfkJ29xSwAWw==", 2024-03-30T01:52:38.535 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.535 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-rgw" 2024-03-30T01:52:38.535 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.535 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2024-03-30T01:52:38.535 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDebwdmKZMrAxAA1/8WSPvB1uNyVWcmoPgBUQ==", 2024-03-30T01:52:38.536 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.536 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-03-30T01:52:38.536 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-03-30T01:52:38.536 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-03-30T01:52:38.536 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-03-30T01:52:38.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:38.536 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2024-03-30T01:52:38.536 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDdbwdmw45WMxAALzfXrivcnGUnQc0D1sakMw==", 2024-03-30T01:52:38.536 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-03-30T01:52:38.536 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-03-30T01:52:38.536 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-03-30T01:52:38.536 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-03-30T01:52:38.536 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.536 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:38.536 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-03-30T01:52:38.536 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-03-30T01:52:38.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.518+0000 7fae78600640 1 -- 172.21.15.133:0/3430477774 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fae5006ac00 msgr2=0x7fae5006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:38.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.518+0000 7fae78600640 1 --2- 172.21.15.133:0/3430477774 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fae5006ac00 0x7fae5006d0c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fae64036000 tx=0x7fae6403c040 comp rx=0 tx=0).stop 2024-03-30T01:52:38.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.518+0000 7fae78600640 1 -- 172.21.15.133:0/3430477774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae70143820 msgr2=0x7fae700abd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:38.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.518+0000 7fae78600640 1 --2- 172.21.15.133:0/3430477774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae70143820 0x7fae700abd60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fae68007e30 tx=0x7fae6800e4b0 comp rx=0 tx=0).stop 2024-03-30T01:52:38.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.518+0000 7fae78600640 1 -- 172.21.15.133:0/3430477774 shutdown_connections 2024-03-30T01:52:38.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.518+0000 7fae78600640 1 --2- 172.21.15.133:0/3430477774 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fae5006ac00 0x7fae5006d0c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:38.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.518+0000 7fae78600640 1 --2- 172.21.15.133:0/3430477774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae70143820 0x7fae700abd60 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:38.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.518+0000 7fae78600640 1 --2- 172.21.15.133:0/3430477774 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae700ce020 0x7fae7012f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:38.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.518+0000 7fae78600640 1 --2- 172.21.15.133:0/3430477774 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae7006d4c0 0x7fae7013cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:38.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.519+0000 7fae78600640 1 -- 172.21.15.133:0/3430477774 >> 172.21.15.133:0/3430477774 conn(0x7fae700b05c0 msgr2=0x7fae700b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:38.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.519+0000 7fae78600640 1 -- 172.21.15.133:0/3430477774 shutdown_connections 2024-03-30T01:52:38.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.519+0000 7fae78600640 1 -- 172.21.15.133:0/3430477774 wait complete. 2024-03-30T01:52:38.542 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-03-30T01:52:38.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.745+0000 7f0ec7e00640 1 Processor -- start 2024-03-30T01:52:38.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.745+0000 7f0ec7e00640 1 -- start start 2024-03-30T01:52:38.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.746+0000 7f0ec7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ec0143790 0x7f0ec00cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:38.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.746+0000 7f0ec7e00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec00a76a0 con 0x7f0ec0070500 2024-03-30T01:52:38.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.747+0000 7f0ec7e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec00b38e0 con 0x7f0ec00ccc40 2024-03-30T01:52:38.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.747+0000 7f0ec7e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00cd180 con 0x7f0ec0143790 2024-03-30T01:52:38.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.747+0000 7f0ec4a00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0ec0070500 0x7f0ec00cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58230/0 (socket says 172.21.15.133:58230) 2024-03-30T01:52:38.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.747+0000 7f0ec4a00640 1 -- 172.21.15.133:0/3833653173 learned_addr learned my addr 172.21.15.133:0/3833653173 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:38.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.747+0000 7f0ec5400640 1 --2- 172.21.15.133:0/3833653173 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ec0143790 0x7f0ec00cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:38.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.747+0000 7f0ebfe00640 1 -- 172.21.15.133:0/3833653173 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265917327 0 0) 0x7f0ec00a76a0 con 0x7f0ec0070500 2024-03-30T01:52:38.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.747+0000 7f0ebfe00640 1 -- 172.21.15.133:0/3833653173 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ea8003520 con 0x7f0ec0070500 2024-03-30T01:52:38.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.748+0000 7f0ebfe00640 1 -- 172.21.15.133:0/3833653173 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 596694661 0 0) 0x7f0ea8003520 con 0x7f0ec0070500 2024-03-30T01:52:38.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.748+0000 7f0ebfe00640 1 -- 172.21.15.133:0/3833653173 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ec0143790 msgr2=0x7f0ec00cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:38.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.748+0000 7f0ebfe00640 1 --2- 172.21.15.133:0/3833653173 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ec0143790 0x7f0ec00cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:38.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.748+0000 7f0ebfe00640 1 -- 172.21.15.133:0/3833653173 >> v1:172.21.15.137:6789/0 conn(0x7f0ec00ccc40 legacy=0x7f0ec015ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:38.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.748+0000 7f0ebfe00640 1 -- 172.21.15.133:0/3833653173 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec00cd460 con 0x7f0ec0070500 2024-03-30T01:52:38.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.748+0000 7f0ebfe00640 1 -- 172.21.15.133:0/3833653173 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f0eac001670 con 0x7f0ec0070500 2024-03-30T01:52:38.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.748+0000 7f0ebfe00640 1 -- 172.21.15.133:0/3833653173 >> v1:172.21.15.133:6789/0 conn(0x7f0ec0070500 legacy=0x7f0ec00cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:38.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.748+0000 7f0ebfe00640 1 --2- 172.21.15.133:0/3833653173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ea80039a0 0x7f0ea8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:38.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.748+0000 7f0ebfe00640 1 --2- 172.21.15.133:0/3833653173 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ec0143790 0x7f0ea80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:38.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.748+0000 7f0ebfe00640 1 --2- 172.21.15.133:0/3833653173 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ea8004d00 0x7f0ea8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:38.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.748+0000 7f0ebfe00640 1 -- 172.21.15.133:0/3833653173 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00cd180 con 0x7f0ea80039a0 2024-03-30T01:52:38.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.748+0000 7f0ebfe00640 1 -- 172.21.15.133:0/3833653173 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea800baf0 con 0x7f0ea8004d00 2024-03-30T01:52:38.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.748+0000 7f0ebfe00640 1 -- 172.21.15.133:0/3833653173 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea800bcb0 con 0x7f0ec0143790 2024-03-30T01:52:38.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.748+0000 7f0ec5400640 1 --2- 172.21.15.133:0/3833653173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ea80039a0 0x7f0ea8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:38.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.748+0000 7f0ec5400640 1 -- 172.21.15.133:0/3833653173 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ec0143790 msgr2=0x7f0ea80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:38.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.748+0000 7f0ec5400640 1 --2- 172.21.15.133:0/3833653173 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ec0143790 0x7f0ea80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:38.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.748+0000 7f0ec5400640 1 -- 172.21.15.133:0/3833653173 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ea8004d00 msgr2=0x7f0ea8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:38.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.748+0000 7f0ec5400640 1 --2- 172.21.15.133:0/3833653173 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ea8004d00 0x7f0ea8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:38.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.748+0000 7f0ec5400640 1 -- 172.21.15.133:0/3833653173 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea8003520 con 0x7f0ea80039a0 2024-03-30T01:52:38.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.749+0000 7f0ec5400640 1 --2- 172.21.15.133:0/3833653173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ea80039a0 0x7f0ea8003dc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009f90 tx=0x7f0ea80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8956c0bd17e29ff server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:38.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.750+0000 7f0ebfe00640 1 -- 172.21.15.133:0/3833653173 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb402cc20 con 0x7f0ea80039a0 2024-03-30T01:52:38.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.750+0000 7f0ebfe00640 1 -- 172.21.15.133:0/3833653173 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb400f040 con 0x7f0ea80039a0 2024-03-30T01:52:38.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.750+0000 7f0ebfe00640 1 -- 172.21.15.133:0/3833653173 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4034440 con 0x7f0ea80039a0 2024-03-30T01:52:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.750+0000 7f0ec7e00640 1 -- 172.21.15.133:0/3833653173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ea80039a0 msgr2=0x7f0ea8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.750+0000 7f0ec7e00640 1 --2- 172.21.15.133:0/3833653173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ea80039a0 0x7f0ea8003dc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009f90 tx=0x7f0ea80057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.750+0000 7f0ec5e00640 1 -- 172.21.15.133:0/3833653173 reap_dead start 2024-03-30T01:52:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.750+0000 7f0ec7e00640 1 -- 172.21.15.133:0/3833653173 shutdown_connections 2024-03-30T01:52:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.750+0000 7f0ec7e00640 1 -- 172.21.15.133:0/3833653173 >> 172.21.15.133:0/3833653173 conn(0x7f0ec00b07a0 msgr2=0x7f0ec00b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.751+0000 7f0ec7e00640 1 -- 172.21.15.133:0/3833653173 shutdown_connections 2024-03-30T01:52:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.751+0000 7f0ec7e00640 1 -- 172.21.15.133:0/3833653173 wait complete. 2024-03-30T01:52:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.752+0000 7f0ec7e00640 1 Processor -- start 2024-03-30T01:52:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.752+0000 7f0ec7e00640 1 -- start start 2024-03-30T01:52:38.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.753+0000 7f0ec7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ea80039a0 0x7f0ec00ac600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:38.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.753+0000 7f0ec7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ec00acb40 0x7f0ec012f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:38.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.753+0000 7f0ec7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ec012fba0 0x7f0ec0130050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:38.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.753+0000 7f0ec7e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00a7590 con 0x7f0ec012fba0 2024-03-30T01:52:38.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.753+0000 7f0ec7e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00a7b50 con 0x7f0ec00acb40 2024-03-30T01:52:38.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.753+0000 7f0ec7e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00acfa0 con 0x7f0ea80039a0 2024-03-30T01:52:38.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.754+0000 7f0ec5e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ec012fba0 0x7f0ec0130050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:38.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.754+0000 7f0ec5e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ec012fba0 0x7f0ec0130050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56578/0 (socket says 172.21.15.133:56578) 2024-03-30T01:52:38.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.754+0000 7f0ec5e00640 1 -- 172.21.15.133:0/1362785882 learned_addr learned my addr 172.21.15.133:0/1362785882 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:38.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.754+0000 7f0ec4a00640 1 --2- 172.21.15.133:0/1362785882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ec00acb40 0x7f0ec012f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:38.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.754+0000 7f0ec5400640 1 --2- 172.21.15.133:0/1362785882 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ea80039a0 0x7f0ec00ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:38.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.754+0000 7f0ec5e00640 1 -- 172.21.15.133:0/1362785882 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ea80039a0 msgr2=0x7f0ec00ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:38.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.754+0000 7f0ec5e00640 1 --2- 172.21.15.133:0/1362785882 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ea80039a0 0x7f0ec00ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:38.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.754+0000 7f0ec5e00640 1 -- 172.21.15.133:0/1362785882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ec00acb40 msgr2=0x7f0ec012f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:38.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.754+0000 7f0ec5e00640 1 --2- 172.21.15.133:0/1362785882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ec00acb40 0x7f0ec012f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:38.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.754+0000 7f0ec5e00640 1 -- 172.21.15.133:0/1362785882 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec012db50 con 0x7f0ec012fba0 2024-03-30T01:52:38.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.754+0000 7f0ec5e00640 1 --2- 172.21.15.133:0/1362785882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ec012fba0 0x7f0ec0130050 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00cd0b0 tx=0x7f0eb800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:38.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.755+0000 7f0ebd600640 1 -- 172.21.15.133:0/1362785882 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8007340 con 0x7f0ec012fba0 2024-03-30T01:52:38.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.755+0000 7f0ebd600640 1 -- 172.21.15.133:0/1362785882 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb80074a0 con 0x7f0ec012fba0 2024-03-30T01:52:38.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.755+0000 7f0ec7e00640 1 -- 172.21.15.133:0/1362785882 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec0130680 con 0x7f0ec012fba0 2024-03-30T01:52:38.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.755+0000 7f0ebd600640 1 -- 172.21.15.133:0/1362785882 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8004260 con 0x7f0ec012fba0 2024-03-30T01:52:38.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.755+0000 7f0ec7e00640 1 -- 172.21.15.133:0/1362785882 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec00a77e0 con 0x7f0ec012fba0 2024-03-30T01:52:38.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.756+0000 7f0ec7e00640 1 -- 172.21.15.133:0/1362785882 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec0130ba0 con 0x7f0ec012fba0 2024-03-30T01:52:38.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.757+0000 7f0ebd600640 1 -- 172.21.15.133:0/1362785882 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0eb80057c0 con 0x7f0ec012fba0 2024-03-30T01:52:38.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.758+0000 7f0ebd600640 1 --2- 172.21.15.133:0/1362785882 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0ea006ac00 0x7f0ea006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:38.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.758+0000 7f0ebd600640 1 -- 172.21.15.133:0/1362785882 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0eb8088370 con 0x7f0ec012fba0 2024-03-30T01:52:38.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.758+0000 7f0ec5400640 1 --2- 172.21.15.133:0/1362785882 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0ea006ac00 0x7f0ea006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:38.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.759+0000 7f0ec5400640 1 --2- 172.21.15.133:0/1362785882 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0ea006ac00 0x7f0ea006d0c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4036000 tx=0x7f0eb402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:38.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:38.763+0000 7f0ebd600640 1 -- 172.21.15.133:0/1362785882 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f0eb8053800 con 0x7f0ec012fba0 2024-03-30T01:52:39.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.016+0000 7f0ec7e00640 1 -- 172.21.15.133:0/1362785882 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f0ec00a7ce0 con 0x7f0ec012fba0 2024-03-30T01:52:39.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.022+0000 7f0ebd600640 1 -- 172.21.15.133:0/1362785882 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0eb8056e20 con 0x7f0ec012fba0 2024-03-30T01:52:39.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.025+0000 7f0ec7e00640 1 -- 172.21.15.133:0/1362785882 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0ea006ac00 msgr2=0x7f0ea006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:39.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.025+0000 7f0ec7e00640 1 --2- 172.21.15.133:0/1362785882 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0ea006ac00 0x7f0ea006d0c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4036000 tx=0x7f0eb402e000 comp rx=0 tx=0).stop 2024-03-30T01:52:39.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.025+0000 7f0ec7e00640 1 -- 172.21.15.133:0/1362785882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ec012fba0 msgr2=0x7f0ec0130050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:39.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.025+0000 7f0ec7e00640 1 --2- 172.21.15.133:0/1362785882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ec012fba0 0x7f0ec0130050 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00cd0b0 tx=0x7f0eb800c820 comp rx=0 tx=0).stop 2024-03-30T01:52:39.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.025+0000 7f0ec7e00640 1 -- 172.21.15.133:0/1362785882 shutdown_connections 2024-03-30T01:52:39.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.025+0000 7f0ec7e00640 1 --2- 172.21.15.133:0/1362785882 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0ea006ac00 0x7f0ea006d0c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:39.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.025+0000 7f0ec7e00640 1 --2- 172.21.15.133:0/1362785882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ec012fba0 0x7f0ec0130050 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:39.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.025+0000 7f0ec7e00640 1 --2- 172.21.15.133:0/1362785882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ec00acb40 0x7f0ec012f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:39.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.025+0000 7f0ec7e00640 1 --2- 172.21.15.133:0/1362785882 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ea80039a0 0x7f0ec00ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:39.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.025+0000 7f0ec7e00640 1 -- 172.21.15.133:0/1362785882 >> 172.21.15.133:0/1362785882 conn(0x7f0ec00b07a0 msgr2=0x7f0ec00b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:39.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.025+0000 7f0ec7e00640 1 -- 172.21.15.133:0/1362785882 shutdown_connections 2024-03-30T01:52:39.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.025+0000 7f0ec7e00640 1 -- 172.21.15.133:0/1362785882 wait complete. 2024-03-30T01:52:39.049 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-03-30T01:52:39.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.240+0000 7faa3c600640 1 Processor -- start 2024-03-30T01:52:39.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.240+0000 7faa3c600640 1 -- start start 2024-03-30T01:52:39.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.242+0000 7faa3c600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa34143790 0x7faa340cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:39.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.242+0000 7faa3c600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faa34070500 0x7faa34070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:39.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.242+0000 7faa3c600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa340a76a0 con 0x7faa340cc530 2024-03-30T01:52:39.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.242+0000 7faa3c600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa340b38e0 con 0x7faa34070500 2024-03-30T01:52:39.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.242+0000 7faa3c600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa340cd180 con 0x7faa34143790 2024-03-30T01:52:39.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.242+0000 7faa3a600640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7faa340cc530 0x7faa340cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58232/0 (socket says 172.21.15.133:58232) 2024-03-30T01:52:39.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.242+0000 7faa3a600640 1 -- 172.21.15.133:0/541843453 learned_addr learned my addr 172.21.15.133:0/541843453 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:39.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.243+0000 7faa39200640 1 --2- 172.21.15.133:0/541843453 >> v2:172.21.15.137:3300/0 conn(0x7faa34070500 0x7faa34070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:39.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.243+0000 7faa33e00640 1 -- 172.21.15.133:0/541843453 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146800759 0 0) 0x7faa340a76a0 con 0x7faa340cc530 2024-03-30T01:52:39.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.243+0000 7faa33e00640 1 -- 172.21.15.133:0/541843453 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa1c003520 con 0x7faa340cc530 2024-03-30T01:52:39.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.243+0000 7faa39c00640 1 --2- 172.21.15.133:0/541843453 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa34143790 0x7faa340cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:39.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.243+0000 7faa33e00640 1 -- 172.21.15.133:0/541843453 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3597473418 0 0) 0x7faa1c003520 con 0x7faa340cc530 2024-03-30T01:52:39.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.243+0000 7faa33e00640 1 -- 172.21.15.133:0/541843453 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa34143790 msgr2=0x7faa340cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:39.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.243+0000 7faa33e00640 1 --2- 172.21.15.133:0/541843453 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa34143790 0x7faa340cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:39.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.243+0000 7faa33e00640 1 -- 172.21.15.133:0/541843453 >> v2:172.21.15.137:3300/0 conn(0x7faa34070500 msgr2=0x7faa34070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:39.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.243+0000 7faa33e00640 1 --2- 172.21.15.133:0/541843453 >> v2:172.21.15.137:3300/0 conn(0x7faa34070500 0x7faa34070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:39.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.243+0000 7faa33e00640 1 -- 172.21.15.133:0/541843453 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa34070ea0 con 0x7faa340cc530 2024-03-30T01:52:39.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.243+0000 7faa33e00640 1 -- 172.21.15.133:0/541843453 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7faa2c0019f0 con 0x7faa340cc530 2024-03-30T01:52:39.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.243+0000 7faa33e00640 1 -- 172.21.15.133:0/541843453 >> v1:172.21.15.133:6789/0 conn(0x7faa340cc530 legacy=0x7faa340cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:39.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.243+0000 7faa33e00640 1 --2- 172.21.15.133:0/541843453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa1c003970 0x7faa1c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:39.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.243+0000 7faa33e00640 1 --2- 172.21.15.133:0/541843453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa1c0047c0 0x7faa1c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:39.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.243+0000 7faa33e00640 1 --2- 172.21.15.133:0/541843453 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa34143790 0x7faa1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:39.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.243+0000 7faa33e00640 1 -- 172.21.15.133:0/541843453 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa340b38e0 con 0x7faa1c003970 2024-03-30T01:52:39.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.243+0000 7faa33e00640 1 -- 172.21.15.133:0/541843453 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa340cd180 con 0x7faa1c0047c0 2024-03-30T01:52:39.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.243+0000 7faa33e00640 1 -- 172.21.15.133:0/541843453 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c00fed0 con 0x7faa34143790 2024-03-30T01:52:39.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.243+0000 7faa39c00640 1 --2- 172.21.15.133:0/541843453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa1c003970 0x7faa1c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:39.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.244+0000 7faa39200640 1 --2- 172.21.15.133:0/541843453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa1c0047c0 0x7faa1c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:39.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.244+0000 7faa3a600640 1 --2- 172.21.15.133:0/541843453 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa34143790 0x7faa1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:39.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.244+0000 7faa39c00640 1 -- 172.21.15.133:0/541843453 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa34143790 msgr2=0x7faa1c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:39.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.244+0000 7faa39c00640 1 --2- 172.21.15.133:0/541843453 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa34143790 0x7faa1c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:39.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.244+0000 7faa39c00640 1 -- 172.21.15.133:0/541843453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa1c0047c0 msgr2=0x7faa1c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:39.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.244+0000 7faa39c00640 1 --2- 172.21.15.133:0/541843453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa1c0047c0 0x7faa1c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:39.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.244+0000 7faa39c00640 1 -- 172.21.15.133:0/541843453 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1c003520 con 0x7faa1c003970 2024-03-30T01:52:39.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.244+0000 7faa3a600640 1 --2- 172.21.15.133:0/541843453 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa34143790 0x7faa1c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:39.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.244+0000 7faa39200640 1 --2- 172.21.15.133:0/541843453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa1c0047c0 0x7faa1c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:39.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.245+0000 7faa39c00640 1 --2- 172.21.15.133:0/541843453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa1c003970 0x7faa1c003d90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7faa2800ba00 tx=0x7faa1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62829c2d4fae1b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:39.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.246+0000 7faa33e00640 1 -- 172.21.15.133:0/541843453 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa280325f0 con 0x7faa1c003970 2024-03-30T01:52:39.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.246+0000 7faa33e00640 1 -- 172.21.15.133:0/541843453 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa28032750 con 0x7faa1c003970 2024-03-30T01:52:39.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.246+0000 7faa33e00640 1 -- 172.21.15.133:0/541843453 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa28032ae0 con 0x7faa1c003970 2024-03-30T01:52:39.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.246+0000 7faa3c600640 1 -- 172.21.15.133:0/541843453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa1c003970 msgr2=0x7faa1c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:39.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.246+0000 7faa3c600640 1 --2- 172.21.15.133:0/541843453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa1c003970 0x7faa1c003d90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7faa2800ba00 tx=0x7faa1c0057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:39.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.246+0000 7faa3a600640 1 -- 172.21.15.133:0/541843453 reap_dead start 2024-03-30T01:52:39.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.246+0000 7faa3c600640 1 -- 172.21.15.133:0/541843453 shutdown_connections 2024-03-30T01:52:39.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.246+0000 7faa3c600640 1 -- 172.21.15.133:0/541843453 >> 172.21.15.133:0/541843453 conn(0x7faa340b07a0 msgr2=0x7faa340b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:39.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.246+0000 7faa3c600640 1 -- 172.21.15.133:0/541843453 shutdown_connections 2024-03-30T01:52:39.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.246+0000 7faa3c600640 1 -- 172.21.15.133:0/541843453 wait complete. 2024-03-30T01:52:39.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.248+0000 7faa3c600640 1 Processor -- start 2024-03-30T01:52:39.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.248+0000 7faa3c600640 1 -- start start 2024-03-30T01:52:39.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.249+0000 7faa3c600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa1c003970 0x7faa3413e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:39.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.249+0000 7faa3c600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa3413dd50 0x7faa3413d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:39.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.249+0000 7faa3c600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa340aa360 0x7faa340ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:39.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.249+0000 7faa3c600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa340a9ed0 con 0x7faa1c003970 2024-03-30T01:52:39.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.249+0000 7faa3c600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa340ac030 con 0x7faa340aa360 2024-03-30T01:52:39.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.249+0000 7faa3c600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa340ac310 con 0x7faa3413dd50 2024-03-30T01:52:39.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.249+0000 7faa39c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa1c003970 0x7faa3413e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:39.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.249+0000 7faa39c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa1c003970 0x7faa3413e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56606/0 (socket says 172.21.15.133:56606) 2024-03-30T01:52:39.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.249+0000 7faa39c00640 1 -- 172.21.15.133:0/750980214 learned_addr learned my addr 172.21.15.133:0/750980214 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:39.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.250+0000 7faa39c00640 1 -- 172.21.15.133:0/750980214 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa3413dd50 msgr2=0x7faa3413d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:39.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.250+0000 7faa39c00640 1 --2- 172.21.15.133:0/750980214 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa3413dd50 0x7faa3413d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:39.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.250+0000 7faa39c00640 1 -- 172.21.15.133:0/750980214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa340aa360 msgr2=0x7faa340ac670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:39.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.250+0000 7faa39c00640 1 --2- 172.21.15.133:0/750980214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa340aa360 0x7faa340ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:39.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.250+0000 7faa39c00640 1 -- 172.21.15.133:0/750980214 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa340a9b60 con 0x7faa1c003970 2024-03-30T01:52:39.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.250+0000 7faa39c00640 1 --2- 172.21.15.133:0/750980214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa1c003970 0x7faa3413e280 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7faa2800bb20 tx=0x7faa28004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:39.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.250+0000 7faa31600640 1 -- 172.21.15.133:0/750980214 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa28004220 con 0x7faa1c003970 2024-03-30T01:52:39.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.250+0000 7faa31600640 1 -- 172.21.15.133:0/750980214 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa28004380 con 0x7faa1c003970 2024-03-30T01:52:39.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.250+0000 7faa31600640 1 -- 172.21.15.133:0/750980214 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa28003810 con 0x7faa1c003970 2024-03-30T01:52:39.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.250+0000 7faa3c600640 1 -- 172.21.15.133:0/750980214 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa340a9850 con 0x7faa1c003970 2024-03-30T01:52:39.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.250+0000 7faa3c600640 1 -- 172.21.15.133:0/750980214 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa340aa7e0 con 0x7faa1c003970 2024-03-30T01:52:39.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.251+0000 7faa3c600640 1 -- 172.21.15.133:0/750980214 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa340a9cf0 con 0x7faa1c003970 2024-03-30T01:52:39.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.252+0000 7faa31600640 1 -- 172.21.15.133:0/750980214 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7faa28044070 con 0x7faa1c003970 2024-03-30T01:52:39.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.253+0000 7faa31600640 1 --2- 172.21.15.133:0/750980214 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7faa1406ac00 0x7faa1406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:39.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.253+0000 7faa31600640 1 -- 172.21.15.133:0/750980214 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faa280aafc0 con 0x7faa1c003970 2024-03-30T01:52:39.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.253+0000 7faa39200640 1 --2- 172.21.15.133:0/750980214 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7faa1406ac00 0x7faa1406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:39.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.254+0000 7faa39200640 1 --2- 172.21.15.133:0/750980214 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7faa1406ac00 0x7faa1406d0c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faa340c3950 tx=0x7faa200092f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:39.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.257+0000 7faa31600640 1 -- 172.21.15.133:0/750980214 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7faa28076570 con 0x7faa1c003970 2024-03-30T01:52:39.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.519+0000 7faa3c600640 1 -- 172.21.15.133:0/750980214 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7faa3406da40 con 0x7faa1c003970 2024-03-30T01:52:39.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.526+0000 7faa31600640 1 -- 172.21.15.133:0/750980214 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7faa28079b90 con 0x7faa1c003970 2024-03-30T01:52:39.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.528+0000 7faa3c600640 1 -- 172.21.15.133:0/750980214 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7faa1406ac00 msgr2=0x7faa1406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:39.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.528+0000 7faa3c600640 1 --2- 172.21.15.133:0/750980214 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7faa1406ac00 0x7faa1406d0c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faa340c3950 tx=0x7faa200092f0 comp rx=0 tx=0).stop 2024-03-30T01:52:39.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.528+0000 7faa3c600640 1 -- 172.21.15.133:0/750980214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa1c003970 msgr2=0x7faa3413e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:39.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.528+0000 7faa3c600640 1 --2- 172.21.15.133:0/750980214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa1c003970 0x7faa3413e280 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7faa2800bb20 tx=0x7faa28004730 comp rx=0 tx=0).stop 2024-03-30T01:52:39.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.528+0000 7faa3c600640 1 -- 172.21.15.133:0/750980214 shutdown_connections 2024-03-30T01:52:39.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.528+0000 7faa3c600640 1 --2- 172.21.15.133:0/750980214 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7faa1406ac00 0x7faa1406d0c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:39.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.528+0000 7faa3c600640 1 --2- 172.21.15.133:0/750980214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa340aa360 0x7faa340ac670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:39.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.528+0000 7faa3c600640 1 --2- 172.21.15.133:0/750980214 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa3413dd50 0x7faa3413d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:39.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.528+0000 7faa3c600640 1 --2- 172.21.15.133:0/750980214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa1c003970 0x7faa3413e280 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:39.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.528+0000 7faa3c600640 1 -- 172.21.15.133:0/750980214 >> 172.21.15.133:0/750980214 conn(0x7faa340b07a0 msgr2=0x7faa3413ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:39.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.529+0000 7faa3c600640 1 -- 172.21.15.133:0/750980214 shutdown_connections 2024-03-30T01:52:39.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.529+0000 7faa3c600640 1 -- 172.21.15.133:0/750980214 wait complete. 2024-03-30T01:52:39.551 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-03-30T01:52:39.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.740+0000 7ffa5e800640 1 Processor -- start 2024-03-30T01:52:39.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.740+0000 7ffa5e800640 1 -- start start 2024-03-30T01:52:39.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.741+0000 7ffa5e800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa5806e2e0 0x7ffa58070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:39.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.741+0000 7ffa5e800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffa58070a40 0x7ffa5815d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:39.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.741+0000 7ffa5e800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa580ce400 con 0x7ffa58143220 2024-03-30T01:52:39.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.741+0000 7ffa5e800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa58070ef0 con 0x7ffa58070a40 2024-03-30T01:52:39.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.741+0000 7ffa5e800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa580cc5c0 con 0x7ffa5806e2e0 2024-03-30T01:52:39.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.742+0000 7ffa57e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffa58070a40 0x7ffa5815d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:39.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.742+0000 7ffa57e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffa58070a40 0x7ffa5815d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56618/0 (socket says 172.21.15.133:56618) 2024-03-30T01:52:39.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.742+0000 7ffa57e00640 1 -- 172.21.15.133:0/764306635 learned_addr learned my addr 172.21.15.133:0/764306635 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:39.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.742+0000 7ffa4ea00640 1 --2- 172.21.15.133:0/764306635 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa5806e2e0 0x7ffa58070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:39.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.742+0000 7ffa57e00640 1 -- 172.21.15.133:0/764306635 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa5806e2e0 msgr2=0x7ffa58070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:39.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.742+0000 7ffa57e00640 1 --2- 172.21.15.133:0/764306635 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa5806e2e0 0x7ffa58070500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:39.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.742+0000 7ffa57e00640 1 -- 172.21.15.133:0/764306635 >> v1:172.21.15.137:6789/0 conn(0x7ffa58143220 legacy=0x7ffa580cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:39.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.742+0000 7ffa57e00640 1 -- 172.21.15.133:0/764306635 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5806d0e0 con 0x7ffa58070a40 2024-03-30T01:52:39.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.743+0000 7ffa57e00640 1 --2- 172.21.15.133:0/764306635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa58070a40 0x7ffa5815d3b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000d150 tx=0x7ffa5002e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d7ab9a81296d55 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:39.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.743+0000 7ffa56a00640 1 -- 172.21.15.133:0/764306635 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5002ea80 con 0x7ffa58070a40 2024-03-30T01:52:39.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.743+0000 7ffa56a00640 1 -- 172.21.15.133:0/764306635 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5002ebe0 con 0x7ffa58070a40 2024-03-30T01:52:39.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.743+0000 7ffa56a00640 1 -- 172.21.15.133:0/764306635 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa50009600 con 0x7ffa58070a40 2024-03-30T01:52:39.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.744+0000 7ffa5e800640 1 -- 172.21.15.133:0/764306635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa58070a40 msgr2=0x7ffa5815d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:39.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.744+0000 7ffa5e800640 1 --2- 172.21.15.133:0/764306635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa58070a40 0x7ffa5815d3b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000d150 tx=0x7ffa5002e0e0 comp rx=0 tx=0).stop 2024-03-30T01:52:39.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.744+0000 7ffa5e800640 1 -- 172.21.15.133:0/764306635 shutdown_connections 2024-03-30T01:52:39.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.744+0000 7ffa5e800640 1 --2- 172.21.15.133:0/764306635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa58070a40 0x7ffa5815d3b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:39.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.744+0000 7ffa5e800640 1 --2- 172.21.15.133:0/764306635 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa5806e2e0 0x7ffa58070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:39.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.744+0000 7ffa5e800640 1 -- 172.21.15.133:0/764306635 >> 172.21.15.133:0/764306635 conn(0x7ffa580b07a0 msgr2=0x7ffa580b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:39.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.744+0000 7ffa5e800640 1 -- 172.21.15.133:0/764306635 shutdown_connections 2024-03-30T01:52:39.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.744+0000 7ffa5e800640 1 -- 172.21.15.133:0/764306635 wait complete. 2024-03-30T01:52:39.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.746+0000 7ffa5e800640 1 Processor -- start 2024-03-30T01:52:39.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.746+0000 7ffa5e800640 1 -- start start 2024-03-30T01:52:39.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.747+0000 7ffa5e800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa5806e2e0 0x7ffa58155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.747+0000 7ffa5e800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa58070a40 0x7ffa580b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.747+0000 7ffa5e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffa58143220 0x7ffa5815b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.747+0000 7ffa5e800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5815ae70 con 0x7ffa58070a40 2024-03-30T01:52:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.747+0000 7ffa5e800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5815a260 con 0x7ffa58143220 2024-03-30T01:52:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.747+0000 7ffa5e800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5815a540 con 0x7ffa5806e2e0 2024-03-30T01:52:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.747+0000 7ffa4ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa58070a40 0x7ffa580b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.747+0000 7ffa4ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa58070a40 0x7ffa580b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56624/0 (socket says 172.21.15.133:56624) 2024-03-30T01:52:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.747+0000 7ffa4ea00640 1 -- 172.21.15.133:0/1372077636 learned_addr learned my addr 172.21.15.133:0/1372077636 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.747+0000 7ffa57400640 1 --2- 172.21.15.133:0/1372077636 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa5806e2e0 0x7ffa58155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.747+0000 7ffa57e00640 1 --2- 172.21.15.133:0/1372077636 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffa58143220 0x7ffa5815b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.747+0000 7ffa4ea00640 1 -- 172.21.15.133:0/1372077636 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa5806e2e0 msgr2=0x7ffa58155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.747+0000 7ffa4ea00640 1 --2- 172.21.15.133:0/1372077636 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa5806e2e0 0x7ffa58155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.747+0000 7ffa4ea00640 1 -- 172.21.15.133:0/1372077636 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffa58143220 msgr2=0x7ffa5815b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.747+0000 7ffa4ea00640 1 --2- 172.21.15.133:0/1372077636 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffa58143220 0x7ffa5815b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:39.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.747+0000 7ffa4ea00640 1 -- 172.21.15.133:0/1372077636 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5000bd40 con 0x7ffa58070a40 2024-03-30T01:52:39.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.747+0000 7ffa57400640 1 --2- 172.21.15.133:0/1372077636 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa5806e2e0 0x7ffa58155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:39.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.748+0000 7ffa4ea00640 1 --2- 172.21.15.133:0/1372077636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa58070a40 0x7ffa580b2be0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000c7f0 tx=0x7ffa4000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:39.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.748+0000 7ffa4fe00640 1 -- 172.21.15.133:0/1372077636 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa40004220 con 0x7ffa58070a40 2024-03-30T01:52:39.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.748+0000 7ffa4fe00640 1 -- 172.21.15.133:0/1372077636 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa40004380 con 0x7ffa58070a40 2024-03-30T01:52:39.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.748+0000 7ffa4fe00640 1 -- 172.21.15.133:0/1372077636 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa40007840 con 0x7ffa58070a40 2024-03-30T01:52:39.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.748+0000 7ffa5e800640 1 -- 172.21.15.133:0/1372077636 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5815a820 con 0x7ffa58070a40 2024-03-30T01:52:39.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.748+0000 7ffa5e800640 1 -- 172.21.15.133:0/1372077636 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa580b3120 con 0x7ffa58070a40 2024-03-30T01:52:39.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.749+0000 7ffa5e800640 1 -- 172.21.15.133:0/1372077636 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa581595a0 con 0x7ffa58070a40 2024-03-30T01:52:39.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.750+0000 7ffa4fe00640 1 -- 172.21.15.133:0/1372077636 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ffa40007bb0 con 0x7ffa58070a40 2024-03-30T01:52:39.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.751+0000 7ffa4fe00640 1 --2- 172.21.15.133:0/1372077636 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ffa3406ac00 0x7ffa3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:39.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.751+0000 7ffa4fe00640 1 -- 172.21.15.133:0/1372077636 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ffa400890c0 con 0x7ffa58070a40 2024-03-30T01:52:39.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.751+0000 7ffa57400640 1 --2- 172.21.15.133:0/1372077636 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ffa3406ac00 0x7ffa3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:39.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.752+0000 7ffa57400640 1 --2- 172.21.15.133:0/1372077636 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ffa3406ac00 0x7ffa3406d0c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800a810 tx=0x7ffa48008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:39.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:39.755+0000 7ffa4fe00640 1 -- 172.21.15.133:0/1372077636 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7ffa40054550 con 0x7ffa58070a40 2024-03-30T01:52:40.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.001+0000 7ffa5e800640 1 -- 172.21.15.133:0/1372077636 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7ffa58066d80 con 0x7ffa58070a40 2024-03-30T01:52:40.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.009+0000 7ffa4fe00640 1 -- 172.21.15.133:0/1372077636 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7ffa40007e60 con 0x7ffa58070a40 2024-03-30T01:52:40.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.012+0000 7ffa5e800640 1 -- 172.21.15.133:0/1372077636 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ffa3406ac00 msgr2=0x7ffa3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:40.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.012+0000 7ffa5e800640 1 --2- 172.21.15.133:0/1372077636 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ffa3406ac00 0x7ffa3406d0c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800a810 tx=0x7ffa48008040 comp rx=0 tx=0).stop 2024-03-30T01:52:40.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.012+0000 7ffa5e800640 1 -- 172.21.15.133:0/1372077636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa58070a40 msgr2=0x7ffa580b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:40.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.012+0000 7ffa5e800640 1 --2- 172.21.15.133:0/1372077636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa58070a40 0x7ffa580b2be0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000c7f0 tx=0x7ffa4000ccb0 comp rx=0 tx=0).stop 2024-03-30T01:52:40.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.012+0000 7ffa5e800640 1 -- 172.21.15.133:0/1372077636 shutdown_connections 2024-03-30T01:52:40.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.012+0000 7ffa5e800640 1 --2- 172.21.15.133:0/1372077636 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ffa3406ac00 0x7ffa3406d0c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:40.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.012+0000 7ffa5e800640 1 --2- 172.21.15.133:0/1372077636 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffa58143220 0x7ffa5815b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:40.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.012+0000 7ffa5e800640 1 --2- 172.21.15.133:0/1372077636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa58070a40 0x7ffa580b2be0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:40.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.012+0000 7ffa5e800640 1 --2- 172.21.15.133:0/1372077636 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa5806e2e0 0x7ffa58155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:40.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.012+0000 7ffa5e800640 1 -- 172.21.15.133:0/1372077636 >> 172.21.15.133:0/1372077636 conn(0x7ffa580b07a0 msgr2=0x7ffa58140ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:40.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.012+0000 7ffa5e800640 1 -- 172.21.15.133:0/1372077636 shutdown_connections 2024-03-30T01:52:40.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.012+0000 7ffa5e800640 1 -- 172.21.15.133:0/1372077636 wait complete. 2024-03-30T01:52:40.036 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-03-30T01:52:40.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.235+0000 7ff3b4e00640 1 Processor -- start 2024-03-30T01:52:40.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.235+0000 7ff3b4e00640 1 -- start start 2024-03-30T01:52:40.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.237+0000 7ff3b4e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3b015b9c0 0x7ff3b00b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:40.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.237+0000 7ff3b4e00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b00b4550 con 0x7ff3b00ccd00 2024-03-30T01:52:40.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.237+0000 7ff3b4e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b013dba0 con 0x7ff3b00b40f0 2024-03-30T01:52:40.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.237+0000 7ff3b4e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b015bda0 con 0x7ff3b015b9c0 2024-03-30T01:52:40.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.237+0000 7ff3afe00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff3b00ccd00 0x7ff3b015e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58238/0 (socket says 172.21.15.133:58238) 2024-03-30T01:52:40.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.237+0000 7ff3afe00640 1 -- 172.21.15.133:0/3162514898 learned_addr learned my addr 172.21.15.133:0/3162514898 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:40.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.237+0000 7ff3af400640 1 --2- 172.21.15.133:0/3162514898 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3b015b9c0 0x7ff3b00b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.238+0000 7ff3aea00640 1 -- 172.21.15.133:0/3162514898 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3671219172 0 0) 0x7ff3b00b4550 con 0x7ff3b00ccd00 2024-03-30T01:52:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.238+0000 7ff3aea00640 1 -- 172.21.15.133:0/3162514898 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff394003520 con 0x7ff3b00ccd00 2024-03-30T01:52:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.238+0000 7ff3aea00640 1 -- 172.21.15.133:0/3162514898 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3306168340 0 0) 0x7ff394003520 con 0x7ff3b00ccd00 2024-03-30T01:52:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.238+0000 7ff3aea00640 1 -- 172.21.15.133:0/3162514898 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3b015b9c0 msgr2=0x7ff3b00b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.238+0000 7ff3aea00640 1 --2- 172.21.15.133:0/3162514898 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3b015b9c0 0x7ff3b00b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.238+0000 7ff3aea00640 1 -- 172.21.15.133:0/3162514898 >> v1:172.21.15.137:6789/0 conn(0x7ff3b00b40f0 legacy=0x7ff3b00cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.238+0000 7ff3aea00640 1 -- 172.21.15.133:0/3162514898 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b01408b0 con 0x7ff3b00ccd00 2024-03-30T01:52:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.238+0000 7ff3aea00640 1 -- 172.21.15.133:0/3162514898 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7ff3a80019f0 con 0x7ff3b00ccd00 2024-03-30T01:52:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.238+0000 7ff3aea00640 1 -- 172.21.15.133:0/3162514898 >> v1:172.21.15.133:6789/0 conn(0x7ff3b00ccd00 legacy=0x7ff3b015e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.238+0000 7ff3aea00640 1 --2- 172.21.15.133:0/3162514898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3940039a0 0x7ff394003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.238+0000 7ff3aea00640 1 --2- 172.21.15.133:0/3162514898 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3b015b9c0 0x7ff3940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.238+0000 7ff3aea00640 1 --2- 172.21.15.133:0/3162514898 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff394004d00 0x7ff394005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.238+0000 7ff3aea00640 1 -- 172.21.15.133:0/3162514898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b015bda0 con 0x7ff3940039a0 2024-03-30T01:52:40.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.238+0000 7ff3aea00640 1 -- 172.21.15.133:0/3162514898 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39400ba60 con 0x7ff394004d00 2024-03-30T01:52:40.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.238+0000 7ff3aea00640 1 -- 172.21.15.133:0/3162514898 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39400bc20 con 0x7ff3b015b9c0 2024-03-30T01:52:40.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.238+0000 7ff3af400640 1 --2- 172.21.15.133:0/3162514898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3940039a0 0x7ff394003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:40.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.239+0000 7ff3a7e00640 1 --2- 172.21.15.133:0/3162514898 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3b015b9c0 0x7ff3940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:40.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.239+0000 7ff3af400640 1 -- 172.21.15.133:0/3162514898 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3b015b9c0 msgr2=0x7ff3940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:40.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.239+0000 7ff3afe00640 1 --2- 172.21.15.133:0/3162514898 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff394004d00 0x7ff394005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:40.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.239+0000 7ff3af400640 1 --2- 172.21.15.133:0/3162514898 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3b015b9c0 0x7ff3940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:40.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.239+0000 7ff3af400640 1 -- 172.21.15.133:0/3162514898 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff394004d00 msgr2=0x7ff394005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:40.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.239+0000 7ff3af400640 1 --2- 172.21.15.133:0/3162514898 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff394004d00 0x7ff394005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:40.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.239+0000 7ff3af400640 1 -- 172.21.15.133:0/3162514898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff394003520 con 0x7ff3940039a0 2024-03-30T01:52:40.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.239+0000 7ff3a7e00640 1 --2- 172.21.15.133:0/3162514898 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3b015b9c0 0x7ff3940047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:40.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.240+0000 7ff3af400640 1 --2- 172.21.15.133:0/3162514898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3940039a0 0x7ff394003dc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009a90 tx=0x7ff3940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8413c8204e62d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:40.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.240+0000 7ff3aea00640 1 -- 172.21.15.133:0/3162514898 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a002c680 con 0x7ff3940039a0 2024-03-30T01:52:40.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.240+0000 7ff3aea00640 1 -- 172.21.15.133:0/3162514898 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a002c7e0 con 0x7ff3940039a0 2024-03-30T01:52:40.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.240+0000 7ff3aea00640 1 -- 172.21.15.133:0/3162514898 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a002cb70 con 0x7ff3940039a0 2024-03-30T01:52:40.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.241+0000 7ff3b4e00640 1 -- 172.21.15.133:0/3162514898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3940039a0 msgr2=0x7ff394003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:40.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.241+0000 7ff3b4e00640 1 --2- 172.21.15.133:0/3162514898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3940039a0 0x7ff394003dc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009a90 tx=0x7ff3940057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:40.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.241+0000 7ff3afe00640 1 -- 172.21.15.133:0/3162514898 reap_dead start 2024-03-30T01:52:40.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.241+0000 7ff3b4e00640 1 -- 172.21.15.133:0/3162514898 shutdown_connections 2024-03-30T01:52:40.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.241+0000 7ff3b4e00640 1 -- 172.21.15.133:0/3162514898 >> 172.21.15.133:0/3162514898 conn(0x7ff3b00b05a0 msgr2=0x7ff3b00b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:40.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.241+0000 7ff3b4e00640 1 -- 172.21.15.133:0/3162514898 shutdown_connections 2024-03-30T01:52:40.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.241+0000 7ff3b4e00640 1 -- 172.21.15.133:0/3162514898 wait complete. 2024-03-30T01:52:40.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.243+0000 7ff3b4e00640 1 Processor -- start 2024-03-30T01:52:40.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.243+0000 7ff3b4e00640 1 -- start start 2024-03-30T01:52:40.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.244+0000 7ff3b4e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3940039a0 0x7ff3b01f4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:40.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.244+0000 7ff3b4e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b01f4fa0 0x7ff3b01f58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:40.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.244+0000 7ff3b4e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3b01f5e00 0x7ff3b00b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:40.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.244+0000 7ff3b4e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b01566a0 con 0x7ff3b01f4fa0 2024-03-30T01:52:40.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.244+0000 7ff3b4e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b01f5420 con 0x7ff3b01f5e00 2024-03-30T01:52:40.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.244+0000 7ff3b4e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b013d130 con 0x7ff3940039a0 2024-03-30T01:52:40.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.244+0000 7ff3a7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b01f4fa0 0x7ff3b01f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:40.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.244+0000 7ff3a7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b01f4fa0 0x7ff3b01f58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56630/0 (socket says 172.21.15.133:56630) 2024-03-30T01:52:40.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.244+0000 7ff3a7e00640 1 -- 172.21.15.133:0/2620252666 learned_addr learned my addr 172.21.15.133:0/2620252666 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:40.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.244+0000 7ff3afe00640 1 --2- 172.21.15.133:0/2620252666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3b01f5e00 0x7ff3b00b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:40.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.245+0000 7ff3af400640 1 --2- 172.21.15.133:0/2620252666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3940039a0 0x7ff3b01f4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:40.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.245+0000 7ff3a7e00640 1 -- 172.21.15.133:0/2620252666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3940039a0 msgr2=0x7ff3b01f4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:40.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.245+0000 7ff3a7e00640 1 --2- 172.21.15.133:0/2620252666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3940039a0 0x7ff3b01f4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:40.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.245+0000 7ff3a7e00640 1 -- 172.21.15.133:0/2620252666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3b01f5e00 msgr2=0x7ff3b00b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:40.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.245+0000 7ff3a7e00640 1 --2- 172.21.15.133:0/2620252666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3b01f5e00 0x7ff3b00b19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:40.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.245+0000 7ff3a7e00640 1 -- 172.21.15.133:0/2620252666 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b00b2f00 con 0x7ff3b01f4fa0 2024-03-30T01:52:40.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.245+0000 7ff3a7e00640 1 --2- 172.21.15.133:0/2620252666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b01f4fa0 0x7ff3b01f58c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff398000f60 tx=0x7ff39800d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:40.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.245+0000 7ff3a7400640 1 -- 172.21.15.133:0/2620252666 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff398005480 con 0x7ff3b01f4fa0 2024-03-30T01:52:40.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.245+0000 7ff3a7400640 1 -- 172.21.15.133:0/2620252666 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff398003610 con 0x7ff3b01f4fa0 2024-03-30T01:52:40.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.245+0000 7ff3a7400640 1 -- 172.21.15.133:0/2620252666 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3980039c0 con 0x7ff3b01f4fa0 2024-03-30T01:52:40.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.245+0000 7ff3b4e00640 1 -- 172.21.15.133:0/2620252666 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b00b31e0 con 0x7ff3b01f4fa0 2024-03-30T01:52:40.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.245+0000 7ff3b4e00640 1 -- 172.21.15.133:0/2620252666 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b01568f0 con 0x7ff3b01f4fa0 2024-03-30T01:52:40.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.246+0000 7ff3b4e00640 1 -- 172.21.15.133:0/2620252666 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b0156ab0 con 0x7ff3b01f4fa0 2024-03-30T01:52:40.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.247+0000 7ff3a7400640 1 -- 172.21.15.133:0/2620252666 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ff398003b20 con 0x7ff3b01f4fa0 2024-03-30T01:52:40.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.248+0000 7ff3a7400640 1 --2- 172.21.15.133:0/2620252666 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff38c06ac00 0x7ff38c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:40.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.248+0000 7ff3a7400640 1 -- 172.21.15.133:0/2620252666 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff398088f20 con 0x7ff3b01f4fa0 2024-03-30T01:52:40.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.248+0000 7ff3af400640 1 --2- 172.21.15.133:0/2620252666 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff38c06ac00 0x7ff38c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:40.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.249+0000 7ff3af400640 1 --2- 172.21.15.133:0/2620252666 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff38c06ac00 0x7ff38c06d0c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0036000 tx=0x7ff3a0030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:40.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.252+0000 7ff3a7400640 1 -- 172.21.15.133:0/2620252666 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7ff3980544f0 con 0x7ff3b01f4fa0 2024-03-30T01:52:40.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.517+0000 7ff3b4e00640 1 -- 172.21.15.133:0/2620252666 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7ff3b015ad20 con 0x7ff3b01f4fa0 2024-03-30T01:52:40.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.524+0000 7ff3a7400640 1 -- 172.21.15.133:0/2620252666 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff3b015ad20 con 0x7ff3b01f4fa0 2024-03-30T01:52:40.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.526+0000 7ff3b4e00640 1 -- 172.21.15.133:0/2620252666 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff38c06ac00 msgr2=0x7ff38c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:40.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.526+0000 7ff3b4e00640 1 --2- 172.21.15.133:0/2620252666 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff38c06ac00 0x7ff38c06d0c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0036000 tx=0x7ff3a0030000 comp rx=0 tx=0).stop 2024-03-30T01:52:40.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.527+0000 7ff3b4e00640 1 -- 172.21.15.133:0/2620252666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b01f4fa0 msgr2=0x7ff3b01f58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:40.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.527+0000 7ff3b4e00640 1 --2- 172.21.15.133:0/2620252666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b01f4fa0 0x7ff3b01f58c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff398000f60 tx=0x7ff39800d9f0 comp rx=0 tx=0).stop 2024-03-30T01:52:40.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.527+0000 7ff3b4e00640 1 -- 172.21.15.133:0/2620252666 shutdown_connections 2024-03-30T01:52:40.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.527+0000 7ff3b4e00640 1 --2- 172.21.15.133:0/2620252666 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff38c06ac00 0x7ff38c06d0c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:40.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.527+0000 7ff3b4e00640 1 --2- 172.21.15.133:0/2620252666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3b01f5e00 0x7ff3b00b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:40.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.527+0000 7ff3b4e00640 1 --2- 172.21.15.133:0/2620252666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b01f4fa0 0x7ff3b01f58c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:40.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.527+0000 7ff3b4e00640 1 --2- 172.21.15.133:0/2620252666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3940039a0 0x7ff3b01f4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:40.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.527+0000 7ff3b4e00640 1 -- 172.21.15.133:0/2620252666 >> 172.21.15.133:0/2620252666 conn(0x7ff3b00b05a0 msgr2=0x7ff3b00af890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:40.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.527+0000 7ff3b4e00640 1 -- 172.21.15.133:0/2620252666 shutdown_connections 2024-03-30T01:52:40.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.527+0000 7ff3b4e00640 1 -- 172.21.15.133:0/2620252666 wait complete. 2024-03-30T01:52:40.552 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-03-30T01:52:40.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.755+0000 7f3638a00640 1 Processor -- start 2024-03-30T01:52:40.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.755+0000 7f3638a00640 1 -- start start 2024-03-30T01:52:40.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.757+0000 7f3638a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f363415cc50 0x7f36340d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:40.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.757+0000 7f3638a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f36340cfb80 0x7f36340b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:40.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.757+0000 7f3638a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f363415d030 con 0x7f36340d2240 2024-03-30T01:52:40.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.757+0000 7f3638a00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36340d1c50 con 0x7f363415cc50 2024-03-30T01:52:40.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.757+0000 7f3638a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36340b5af0 con 0x7f36340cfb80 2024-03-30T01:52:40.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.757+0000 7f3631e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f363415cc50 0x7f36340d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:40.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.757+0000 7f3631e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f363415cc50 0x7f36340d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56634/0 (socket says 172.21.15.133:56634) 2024-03-30T01:52:40.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.757+0000 7f3631e00640 1 -- 172.21.15.133:0/2082799976 learned_addr learned my addr 172.21.15.133:0/2082799976 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:40.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.758+0000 7f3632800640 1 --2- 172.21.15.133:0/2082799976 >> v2:172.21.15.137:3300/0 conn(0x7f36340cfb80 0x7f36340b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:40.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.758+0000 7f3631e00640 1 -- 172.21.15.133:0/2082799976 >> v2:172.21.15.137:3300/0 conn(0x7f36340cfb80 msgr2=0x7f36340b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:40.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.758+0000 7f3631e00640 1 --2- 172.21.15.133:0/2082799976 >> v2:172.21.15.137:3300/0 conn(0x7f36340cfb80 0x7f36340b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:40.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.758+0000 7f3631e00640 1 -- 172.21.15.133:0/2082799976 >> v1:172.21.15.137:6789/0 conn(0x7f36340d2240 legacy=0x7f36340cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:40.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.758+0000 7f3631e00640 1 -- 172.21.15.133:0/2082799976 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36340d10d0 con 0x7f363415cc50 2024-03-30T01:52:40.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.758+0000 7f3632800640 1 --2- 172.21.15.133:0/2082799976 >> v2:172.21.15.137:3300/0 conn(0x7f36340cfb80 0x7f36340b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:40.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.759+0000 7f3631e00640 1 --2- 172.21.15.133:0/2082799976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f363415cc50 0x7f36340d0af0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f36340b5620 tx=0x7f362402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281982aaa53db137 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:40.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.759+0000 7f3631400640 1 -- 172.21.15.133:0/2082799976 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624031870 con 0x7f363415cc50 2024-03-30T01:52:40.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.759+0000 7f3631400640 1 -- 172.21.15.133:0/2082799976 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36240319d0 con 0x7f363415cc50 2024-03-30T01:52:40.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.759+0000 7f3631400640 1 -- 172.21.15.133:0/2082799976 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624031d60 con 0x7f363415cc50 2024-03-30T01:52:40.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.760+0000 7f3638a00640 1 -- 172.21.15.133:0/2082799976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f363415cc50 msgr2=0x7f36340d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:40.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.760+0000 7f3638a00640 1 --2- 172.21.15.133:0/2082799976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f363415cc50 0x7f36340d0af0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f36340b5620 tx=0x7f362402b910 comp rx=0 tx=0).stop 2024-03-30T01:52:40.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.760+0000 7f3638a00640 1 -- 172.21.15.133:0/2082799976 shutdown_connections 2024-03-30T01:52:40.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.760+0000 7f3638a00640 1 --2- 172.21.15.133:0/2082799976 >> v2:172.21.15.137:3300/0 conn(0x7f36340cfb80 0x7f36340b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:40.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.760+0000 7f3638a00640 1 --2- 172.21.15.133:0/2082799976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f363415cc50 0x7f36340d0af0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:40.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.760+0000 7f3638a00640 1 -- 172.21.15.133:0/2082799976 >> 172.21.15.133:0/2082799976 conn(0x7f3634071a40 msgr2=0x7f363406b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:40.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.760+0000 7f3638a00640 1 -- 172.21.15.133:0/2082799976 shutdown_connections 2024-03-30T01:52:40.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.760+0000 7f3638a00640 1 -- 172.21.15.133:0/2082799976 wait complete. 2024-03-30T01:52:40.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.762+0000 7f3638a00640 1 Processor -- start 2024-03-30T01:52:40.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.762+0000 7f3638a00640 1 -- start start 2024-03-30T01:52:40.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.763+0000 7f3638a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36340cfb80 0x7f3634151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:40.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.763+0000 7f3638a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36340d2240 0x7f3634156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:40.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.763+0000 7f3638a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f363415cc50 0x7f3634158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:40.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.763+0000 7f3638a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3634152c90 con 0x7f363415cc50 2024-03-30T01:52:40.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.763+0000 7f3638a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3634152f70 con 0x7f36340d2240 2024-03-30T01:52:40.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.763+0000 7f3638a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3634153250 con 0x7f36340cfb80 2024-03-30T01:52:40.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.763+0000 7f3632800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f363415cc50 0x7f3634158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:40.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.764+0000 7f3632800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f363415cc50 0x7f3634158790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56638/0 (socket says 172.21.15.133:56638) 2024-03-30T01:52:40.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.764+0000 7f3632800640 1 -- 172.21.15.133:0/1431236663 learned_addr learned my addr 172.21.15.133:0/1431236663 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:40.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.764+0000 7f3631e00640 1 --2- 172.21.15.133:0/1431236663 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36340cfb80 0x7f3634151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:40.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.764+0000 7f3632800640 1 -- 172.21.15.133:0/1431236663 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36340cfb80 msgr2=0x7f3634151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:40.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.764+0000 7f3632800640 1 --2- 172.21.15.133:0/1431236663 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36340cfb80 0x7f3634151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:40.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.764+0000 7f3632800640 1 -- 172.21.15.133:0/1431236663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36340d2240 msgr2=0x7f3634156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:40.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.764+0000 7f3632800640 1 --2- 172.21.15.133:0/1431236663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36340d2240 0x7f3634156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:40.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.764+0000 7f3632800640 1 -- 172.21.15.133:0/1431236663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36240094d0 con 0x7f363415cc50 2024-03-30T01:52:40.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.764+0000 7f3632800640 1 --2- 172.21.15.133:0/1431236663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f363415cc50 0x7f3634158790 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f362c00cef0 tx=0x7f362c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:40.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.764+0000 7f362aa00640 1 -- 172.21.15.133:0/1431236663 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c00d840 con 0x7f363415cc50 2024-03-30T01:52:40.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.765+0000 7f362aa00640 1 -- 172.21.15.133:0/1431236663 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362c00d9c0 con 0x7f363415cc50 2024-03-30T01:52:40.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.765+0000 7f362aa00640 1 -- 172.21.15.133:0/1431236663 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c00dd70 con 0x7f363415cc50 2024-03-30T01:52:40.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.765+0000 7f3638a00640 1 -- 172.21.15.133:0/1431236663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3634153530 con 0x7f363415cc50 2024-03-30T01:52:40.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.765+0000 7f3638a00640 1 -- 172.21.15.133:0/1431236663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36340b7bc0 con 0x7f363415cc50 2024-03-30T01:52:40.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.766+0000 7f3638a00640 1 -- 172.21.15.133:0/1431236663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3634153a50 con 0x7f363415cc50 2024-03-30T01:52:40.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.767+0000 7f362aa00640 1 -- 172.21.15.133:0/1431236663 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f362c01e3b0 con 0x7f363415cc50 2024-03-30T01:52:40.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.768+0000 7f362aa00640 1 --2- 172.21.15.133:0/1431236663 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f361006ac00 0x7f361006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:40.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.768+0000 7f362aa00640 1 -- 172.21.15.133:0/1431236663 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f362c089ac0 con 0x7f363415cc50 2024-03-30T01:52:40.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.768+0000 7f3631e00640 1 --2- 172.21.15.133:0/1431236663 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f361006ac00 0x7f361006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:40.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.769+0000 7f3631e00640 1 --2- 172.21.15.133:0/1431236663 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f361006ac00 0x7f361006d0c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3624036000 tx=0x7f362403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:40.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:40.772+0000 7f362aa00640 1 -- 172.21.15.133:0/1431236663 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f3634153a50 con 0x7f363415cc50 2024-03-30T01:52:41.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.037+0000 7f3638a00640 1 -- 172.21.15.133:0/1431236663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f3634153a50 con 0x7f363415cc50 2024-03-30T01:52:41.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.044+0000 7f362aa00640 1 -- 172.21.15.133:0/1431236663 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3634153a50 con 0x7f363415cc50 2024-03-30T01:52:41.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.047+0000 7f3638a00640 1 -- 172.21.15.133:0/1431236663 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f361006ac00 msgr2=0x7f361006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:41.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.047+0000 7f3638a00640 1 --2- 172.21.15.133:0/1431236663 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f361006ac00 0x7f361006d0c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3624036000 tx=0x7f362403c040 comp rx=0 tx=0).stop 2024-03-30T01:52:41.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.047+0000 7f3638a00640 1 -- 172.21.15.133:0/1431236663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f363415cc50 msgr2=0x7f3634158790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:41.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.047+0000 7f3638a00640 1 --2- 172.21.15.133:0/1431236663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f363415cc50 0x7f3634158790 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f362c00cef0 tx=0x7f362c00a710 comp rx=0 tx=0).stop 2024-03-30T01:52:41.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.047+0000 7f3638a00640 1 -- 172.21.15.133:0/1431236663 shutdown_connections 2024-03-30T01:52:41.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.047+0000 7f3638a00640 1 --2- 172.21.15.133:0/1431236663 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f361006ac00 0x7f361006d0c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.047+0000 7f3638a00640 1 --2- 172.21.15.133:0/1431236663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f363415cc50 0x7f3634158790 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.047+0000 7f3638a00640 1 --2- 172.21.15.133:0/1431236663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36340d2240 0x7f3634156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.047+0000 7f3638a00640 1 --2- 172.21.15.133:0/1431236663 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36340cfb80 0x7f3634151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.047+0000 7f3638a00640 1 -- 172.21.15.133:0/1431236663 >> 172.21.15.133:0/1431236663 conn(0x7f3634071a40 msgr2=0x7f363415e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:41.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.047+0000 7f3638a00640 1 -- 172.21.15.133:0/1431236663 shutdown_connections 2024-03-30T01:52:41.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.048+0000 7f3638a00640 1 -- 172.21.15.133:0/1431236663 wait complete. 2024-03-30T01:52:41.070 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-03-30T01:52:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.273+0000 7f91afe00640 1 Processor -- start 2024-03-30T01:52:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.274+0000 7f91afe00640 1 -- start start 2024-03-30T01:52:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.275+0000 7f91afe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91b00cd6a0 0x7f91b00cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.275+0000 7f91afe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f91b00d1440 0x7f91b00d18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.275+0000 7f91afe00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b00b5b50 con 0x7f91b015cac0 2024-03-30T01:52:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.275+0000 7f91afe00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b00d1020 con 0x7f91b00d1440 2024-03-30T01:52:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.275+0000 7f91afe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b00ce020 con 0x7f91b00cd6a0 2024-03-30T01:52:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.275+0000 7f91aea00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f91b015cac0 0x7f91b0160670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58248/0 (socket says 172.21.15.133:58248) 2024-03-30T01:52:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.275+0000 7f91aea00640 1 -- 172.21.15.133:0/3627065543 learned_addr learned my addr 172.21.15.133:0/3627065543 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.276+0000 7f91af400640 1 --2- 172.21.15.133:0/3627065543 >> v2:172.21.15.137:3300/0 conn(0x7f91b00d1440 0x7f91b00d18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.276+0000 7f91ae000640 1 --2- 172.21.15.133:0/3627065543 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91b00cd6a0 0x7f91b00cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.276+0000 7f91ad600640 1 -- 172.21.15.133:0/3627065543 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670924240 0 0) 0x7f91b00b5b50 con 0x7f91b015cac0 2024-03-30T01:52:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.276+0000 7f91ad600640 1 -- 172.21.15.133:0/3627065543 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9190003520 con 0x7f91b015cac0 2024-03-30T01:52:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.276+0000 7f91ad600640 1 -- 172.21.15.133:0/3627065543 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2650121419 0 0) 0x7f9190003520 con 0x7f91b015cac0 2024-03-30T01:52:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.276+0000 7f91ad600640 1 -- 172.21.15.133:0/3627065543 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91b00cd6a0 msgr2=0x7f91b00cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.276+0000 7f91ad600640 1 --2- 172.21.15.133:0/3627065543 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91b00cd6a0 0x7f91b00cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.276+0000 7f91ad600640 1 -- 172.21.15.133:0/3627065543 >> v2:172.21.15.137:3300/0 conn(0x7f91b00d1440 msgr2=0x7f91b00d18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.276+0000 7f91ad600640 1 --2- 172.21.15.133:0/3627065543 >> v2:172.21.15.137:3300/0 conn(0x7f91b00d1440 0x7f91b00d18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.276+0000 7f91ad600640 1 -- 172.21.15.133:0/3627065543 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b0161100 con 0x7f91b015cac0 2024-03-30T01:52:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.276+0000 7f91ad600640 1 -- 172.21.15.133:0/3627065543 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f91a0001670 con 0x7f91b015cac0 2024-03-30T01:52:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.276+0000 7f91ad600640 1 -- 172.21.15.133:0/3627065543 >> v1:172.21.15.133:6789/0 conn(0x7f91b015cac0 legacy=0x7f91b0160670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.277+0000 7f91ad600640 1 --2- 172.21.15.133:0/3627065543 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91b00cd6a0 0x7f9190003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.277+0000 7f91ad600640 1 --2- 172.21.15.133:0/3627065543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9190003ef0 0x7f91900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:41.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.277+0000 7f91ad600640 1 --2- 172.21.15.133:0/3627065543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9190004d00 0x7f9190005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:41.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.277+0000 7f91ad600640 1 -- 172.21.15.133:0/3627065543 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b00d1020 con 0x7f9190004d00 2024-03-30T01:52:41.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.277+0000 7f91ad600640 1 -- 172.21.15.133:0/3627065543 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b00ce020 con 0x7f9190003ef0 2024-03-30T01:52:41.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.277+0000 7f91ad600640 1 -- 172.21.15.133:0/3627065543 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919000b980 con 0x7f91b00cd6a0 2024-03-30T01:52:41.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.277+0000 7f91af400640 1 --2- 172.21.15.133:0/3627065543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9190004d00 0x7f9190005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:41.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.277+0000 7f91ae000640 1 --2- 172.21.15.133:0/3627065543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9190003ef0 0x7f91900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:41.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.277+0000 7f91aea00640 1 --2- 172.21.15.133:0/3627065543 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91b00cd6a0 0x7f9190003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:41.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.277+0000 7f91af400640 1 -- 172.21.15.133:0/3627065543 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91b00cd6a0 msgr2=0x7f9190003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:41.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.277+0000 7f91af400640 1 --2- 172.21.15.133:0/3627065543 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91b00cd6a0 0x7f9190003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.277+0000 7f91af400640 1 -- 172.21.15.133:0/3627065543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9190003ef0 msgr2=0x7f91900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:41.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.277+0000 7f91af400640 1 --2- 172.21.15.133:0/3627065543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9190003ef0 0x7f91900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.277+0000 7f91af400640 1 -- 172.21.15.133:0/3627065543 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9190003520 con 0x7f9190004d00 2024-03-30T01:52:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.278+0000 7f91af400640 1 --2- 172.21.15.133:0/3627065543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9190004d00 0x7f9190005180 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f91a8009ac0 tx=0x7f91900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911610243aa576c5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.279+0000 7f91ad600640 1 -- 172.21.15.133:0/3627065543 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a802c6d0 con 0x7f9190004d00 2024-03-30T01:52:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.279+0000 7f91ad600640 1 -- 172.21.15.133:0/3627065543 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a802c830 con 0x7f9190004d00 2024-03-30T01:52:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.279+0000 7f91ad600640 1 -- 172.21.15.133:0/3627065543 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a802cbc0 con 0x7f9190004d00 2024-03-30T01:52:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.279+0000 7f91afe00640 1 -- 172.21.15.133:0/3627065543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9190004d00 msgr2=0x7f9190005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.279+0000 7f91afe00640 1 --2- 172.21.15.133:0/3627065543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9190004d00 0x7f9190005180 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f91a8009ac0 tx=0x7f91900057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.279+0000 7f91af400640 1 -- 172.21.15.133:0/3627065543 reap_dead start 2024-03-30T01:52:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.279+0000 7f91afe00640 1 -- 172.21.15.133:0/3627065543 shutdown_connections 2024-03-30T01:52:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.279+0000 7f91afe00640 1 -- 172.21.15.133:0/3627065543 >> 172.21.15.133:0/3627065543 conn(0x7f91b00cf770 msgr2=0x7f91b00cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.279+0000 7f91afe00640 1 -- 172.21.15.133:0/3627065543 shutdown_connections 2024-03-30T01:52:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.279+0000 7f91afe00640 1 -- 172.21.15.133:0/3627065543 wait complete. 2024-03-30T01:52:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.281+0000 7f91afe00640 1 Processor -- start 2024-03-30T01:52:41.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.281+0000 7f91afe00640 1 -- start start 2024-03-30T01:52:41.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.282+0000 7f91afe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9190004d00 0x7f91b014f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:41.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.282+0000 7f91afe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91b00cbc80 0x7f91b01f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:41.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.282+0000 7f91afe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91b01f5e70 0x7f91b00b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:41.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.282+0000 7f91afe00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b01f51c0 con 0x7f9190004d00 2024-03-30T01:52:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.282+0000 7f91afe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b015f1b0 con 0x7f91b01f5e70 2024-03-30T01:52:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.282+0000 7f91afe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b015f490 con 0x7f91b00cbc80 2024-03-30T01:52:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.282+0000 7f91aea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9190004d00 0x7f91b014f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.283+0000 7f91aea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9190004d00 0x7f91b014f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56652/0 (socket says 172.21.15.133:56652) 2024-03-30T01:52:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.283+0000 7f91aea00640 1 -- 172.21.15.133:0/573471048 learned_addr learned my addr 172.21.15.133:0/573471048 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.283+0000 7f91ae000640 1 --2- 172.21.15.133:0/573471048 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91b00cbc80 0x7f91b01f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.283+0000 7f91aea00640 1 -- 172.21.15.133:0/573471048 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91b00cbc80 msgr2=0x7f91b01f5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.283+0000 7f91aea00640 1 --2- 172.21.15.133:0/573471048 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91b00cbc80 0x7f91b01f5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.283+0000 7f91aea00640 1 -- 172.21.15.133:0/573471048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91b01f5e70 msgr2=0x7f91b00b6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.283+0000 7f91aea00640 1 --2- 172.21.15.133:0/573471048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91b01f5e70 0x7f91b00b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.283+0000 7f91aea00640 1 -- 172.21.15.133:0/573471048 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b015f770 con 0x7f9190004d00 2024-03-30T01:52:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.283+0000 7f91aea00640 1 --2- 172.21.15.133:0/573471048 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9190004d00 0x7f91b014f8f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f91a000e840 tx=0x7f91a000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.283+0000 7f91a6a00640 1 -- 172.21.15.133:0/573471048 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a000c850 con 0x7f9190004d00 2024-03-30T01:52:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.284+0000 7f91a6a00640 1 -- 172.21.15.133:0/573471048 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a000c9b0 con 0x7f9190004d00 2024-03-30T01:52:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.284+0000 7f91a6a00640 1 -- 172.21.15.133:0/573471048 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a000cd60 con 0x7f9190004d00 2024-03-30T01:52:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.284+0000 7f91afe00640 1 -- 172.21.15.133:0/573471048 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b01f5410 con 0x7f9190004d00 2024-03-30T01:52:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.284+0000 7f91afe00640 1 -- 172.21.15.133:0/573471048 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b00cc100 con 0x7f9190004d00 2024-03-30T01:52:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.285+0000 7f91afe00640 1 -- 172.21.15.133:0/573471048 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b01f5600 con 0x7f9190004d00 2024-03-30T01:52:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.286+0000 7f91a6a00640 1 -- 172.21.15.133:0/573471048 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f91a001d460 con 0x7f9190004d00 2024-03-30T01:52:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.287+0000 7f91a6a00640 1 --2- 172.21.15.133:0/573471048 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f918c06ac30 0x7f918c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.287+0000 7f91a6a00640 1 -- 172.21.15.133:0/573471048 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f91a0088ff0 con 0x7f9190004d00 2024-03-30T01:52:41.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.288+0000 7f91ae000640 1 --2- 172.21.15.133:0/573471048 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f918c06ac30 0x7f918c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:41.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.288+0000 7f91ae000640 1 --2- 172.21.15.133:0/573471048 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f918c06ac30 0x7f918c06d0f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f91b015e7e0 tx=0x7f919800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.292+0000 7f91a6a00640 1 -- 172.21.15.133:0/573471048 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f91a0054570 con 0x7f9190004d00 2024-03-30T01:52:41.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.534+0000 7f91afe00640 1 -- 172.21.15.133:0/573471048 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f91b00cc380 con 0x7f9190004d00 2024-03-30T01:52:41.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.540+0000 7f91a6a00640 1 -- 172.21.15.133:0/573471048 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f91a0057b90 con 0x7f9190004d00 2024-03-30T01:52:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.543+0000 7f91afe00640 1 -- 172.21.15.133:0/573471048 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f918c06ac30 msgr2=0x7f918c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.543+0000 7f91afe00640 1 --2- 172.21.15.133:0/573471048 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f918c06ac30 0x7f918c06d0f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f91b015e7e0 tx=0x7f919800b040 comp rx=0 tx=0).stop 2024-03-30T01:52:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.543+0000 7f91afe00640 1 -- 172.21.15.133:0/573471048 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9190004d00 msgr2=0x7f91b014f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.543+0000 7f91afe00640 1 --2- 172.21.15.133:0/573471048 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9190004d00 0x7f91b014f8f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f91a000e840 tx=0x7f91a000ed00 comp rx=0 tx=0).stop 2024-03-30T01:52:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.543+0000 7f91afe00640 1 -- 172.21.15.133:0/573471048 shutdown_connections 2024-03-30T01:52:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.543+0000 7f91afe00640 1 --2- 172.21.15.133:0/573471048 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f918c06ac30 0x7f918c06d0f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.543+0000 7f91afe00640 1 --2- 172.21.15.133:0/573471048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91b01f5e70 0x7f91b00b6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.543+0000 7f91afe00640 1 --2- 172.21.15.133:0/573471048 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91b00cbc80 0x7f91b01f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.543+0000 7f91afe00640 1 --2- 172.21.15.133:0/573471048 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9190004d00 0x7f91b014f8f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.543+0000 7f91afe00640 1 -- 172.21.15.133:0/573471048 >> 172.21.15.133:0/573471048 conn(0x7f91b00cf770 msgr2=0x7f91b006b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.543+0000 7f91afe00640 1 -- 172.21.15.133:0/573471048 shutdown_connections 2024-03-30T01:52:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.543+0000 7f91afe00640 1 -- 172.21.15.133:0/573471048 wait complete. 2024-03-30T01:52:41.567 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:52:41.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.762+0000 7f03b1c00640 1 Processor -- start 2024-03-30T01:52:41.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.762+0000 7f03b1c00640 1 -- start start 2024-03-30T01:52:41.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.764+0000 7f03b1c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f03ac0d0af0 0x7f03ac0cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:41.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.764+0000 7f03b1c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03ac0cf9b0 0x7f03ac0b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:41.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.764+0000 7f03b1c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03ac15d030 con 0x7f03ac15cc50 2024-03-30T01:52:41.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.764+0000 7f03b1c00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03ac0d1c50 con 0x7f03ac0d0af0 2024-03-30T01:52:41.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.764+0000 7f03b1c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0cfe40 con 0x7f03ac0cf9b0 2024-03-30T01:52:41.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.764+0000 7f03a2000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f03ac0d0af0 0x7f03ac0cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:41.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.764+0000 7f03a2000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f03ac0d0af0 0x7f03ac0cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56658/0 (socket says 172.21.15.133:56658) 2024-03-30T01:52:41.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.764+0000 7f03a2000640 1 -- 172.21.15.133:0/1740643128 learned_addr learned my addr 172.21.15.133:0/1740643128 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:41.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.765+0000 7f03a2000640 1 -- 172.21.15.133:0/1740643128 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03ac0cf9b0 msgr2=0x7f03ac0b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:41.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.765+0000 7f03ab400640 1 --2- 172.21.15.133:0/1740643128 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03ac0cf9b0 0x7f03ac0b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:41.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.765+0000 7f03a2000640 1 --2- 172.21.15.133:0/1740643128 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03ac0cf9b0 0x7f03ac0b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.765+0000 7f03a2000640 1 -- 172.21.15.133:0/1740643128 >> v1:172.21.15.137:6789/0 conn(0x7f03ac15cc50 legacy=0x7f03ac0d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:41.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.765+0000 7f03a2000640 1 -- 172.21.15.133:0/1740643128 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac0b5af0 con 0x7f03ac0d0af0 2024-03-30T01:52:41.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.766+0000 7f03a2000640 1 --2- 172.21.15.133:0/1740643128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03ac0d0af0 0x7f03ac0cf470 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0394009870 tx=0x7f039402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc4fa38b2fd98be server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:41.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.766+0000 7f03aa000640 1 -- 172.21.15.133:0/1740643128 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0394031640 con 0x7f03ac0d0af0 2024-03-30T01:52:41.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.766+0000 7f03aa000640 1 -- 172.21.15.133:0/1740643128 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03940317a0 con 0x7f03ac0d0af0 2024-03-30T01:52:41.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.766+0000 7f03aa000640 1 -- 172.21.15.133:0/1740643128 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0394031b30 con 0x7f03ac0d0af0 2024-03-30T01:52:41.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.767+0000 7f03b1c00640 1 -- 172.21.15.133:0/1740643128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03ac0d0af0 msgr2=0x7f03ac0cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:41.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.767+0000 7f03b1c00640 1 --2- 172.21.15.133:0/1740643128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03ac0d0af0 0x7f03ac0cf470 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0394009870 tx=0x7f039402b8f0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.767+0000 7f03b1c00640 1 -- 172.21.15.133:0/1740643128 shutdown_connections 2024-03-30T01:52:41.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.767+0000 7f03b1c00640 1 --2- 172.21.15.133:0/1740643128 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03ac0cf9b0 0x7f03ac0b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.767+0000 7f03b1c00640 1 --2- 172.21.15.133:0/1740643128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03ac0d0af0 0x7f03ac0cf470 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.767+0000 7f03b1c00640 1 -- 172.21.15.133:0/1740643128 >> 172.21.15.133:0/1740643128 conn(0x7f03ac071a40 msgr2=0x7f03ac06b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:41.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.767+0000 7f03b1c00640 1 -- 172.21.15.133:0/1740643128 shutdown_connections 2024-03-30T01:52:41.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.767+0000 7f03b1c00640 1 -- 172.21.15.133:0/1740643128 wait complete. 2024-03-30T01:52:41.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.769+0000 7f03b1c00640 1 Processor -- start 2024-03-30T01:52:41.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.769+0000 7f03b1c00640 1 -- start start 2024-03-30T01:52:41.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.770+0000 7f03b1c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03ac0cf9b0 0x7f03ac0c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:41.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.770+0000 7f03b1c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03ac0d0af0 0x7f03ac154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:41.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.770+0000 7f03b1c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03ac15cc50 0x7f03ac1516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:41.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.770+0000 7f03b1c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0ca870 con 0x7f03ac0d0af0 2024-03-30T01:52:41.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.770+0000 7f03b1c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0c9c60 con 0x7f03ac0cf9b0 2024-03-30T01:52:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.770+0000 7f03b1c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0c9f40 con 0x7f03ac15cc50 2024-03-30T01:52:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.770+0000 7f03a2000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03ac0d0af0 0x7f03ac154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.770+0000 7f03a2000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03ac0d0af0 0x7f03ac154df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56662/0 (socket says 172.21.15.133:56662) 2024-03-30T01:52:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.770+0000 7f03a2000640 1 -- 172.21.15.133:0/3872783063 learned_addr learned my addr 172.21.15.133:0/3872783063 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.770+0000 7f03a2000640 1 -- 172.21.15.133:0/3872783063 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03ac15cc50 msgr2=0x7f03ac1516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.770+0000 7f03ab400640 1 --2- 172.21.15.133:0/3872783063 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03ac15cc50 0x7f03ac1516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.770+0000 7f03aaa00640 1 --2- 172.21.15.133:0/3872783063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03ac0cf9b0 0x7f03ac0c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.770+0000 7f03a2000640 1 --2- 172.21.15.133:0/3872783063 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03ac15cc50 0x7f03ac1516e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.770+0000 7f03a2000640 1 -- 172.21.15.133:0/3872783063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03ac0cf9b0 msgr2=0x7f03ac0c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.770+0000 7f03a2000640 1 --2- 172.21.15.133:0/3872783063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03ac0cf9b0 0x7f03ac0c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.770+0000 7f03a2000640 1 -- 172.21.15.133:0/3872783063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03940094d0 con 0x7f03ac0d0af0 2024-03-30T01:52:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.771+0000 7f03a2000640 1 --2- 172.21.15.133:0/3872783063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03ac0d0af0 0x7f03ac154df0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0394000c00 tx=0x7f03940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.771+0000 7f03a3400640 1 -- 172.21.15.133:0/3872783063 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039403ac60 con 0x7f03ac0d0af0 2024-03-30T01:52:41.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.771+0000 7f03a3400640 1 -- 172.21.15.133:0/3872783063 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039403ade0 con 0x7f03ac0d0af0 2024-03-30T01:52:41.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.771+0000 7f03a3400640 1 -- 172.21.15.133:0/3872783063 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0394044630 con 0x7f03ac0d0af0 2024-03-30T01:52:41.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.771+0000 7f03b1c00640 1 -- 172.21.15.133:0/3872783063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ac0ca220 con 0x7f03ac0d0af0 2024-03-30T01:52:41.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.771+0000 7f03b1c00640 1 -- 172.21.15.133:0/3872783063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ac156a50 con 0x7f03ac0d0af0 2024-03-30T01:52:41.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.772+0000 7f03b1c00640 1 -- 172.21.15.133:0/3872783063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ac156c40 con 0x7f03ac0d0af0 2024-03-30T01:52:41.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.773+0000 7f03a3400640 1 -- 172.21.15.133:0/3872783063 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f039402f050 con 0x7f03ac0d0af0 2024-03-30T01:52:41.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.774+0000 7f03a3400640 1 --2- 172.21.15.133:0/3872783063 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f038806ac00 0x7f038806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:41.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.774+0000 7f03a3400640 1 -- 172.21.15.133:0/3872783063 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f03940ab0e0 con 0x7f03ac0d0af0 2024-03-30T01:52:41.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.774+0000 7f03aaa00640 1 --2- 172.21.15.133:0/3872783063 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f038806ac00 0x7f038806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:41.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.775+0000 7f03aaa00640 1 --2- 172.21.15.133:0/3872783063 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f038806ac00 0x7f038806d0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f039c006fd0 tx=0x7f039c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:41.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.779+0000 7f03a3400640 1 -- 172.21.15.133:0/3872783063 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f0394076680 con 0x7f03ac0d0af0 2024-03-30T01:52:41.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.973+0000 7f03b1c00640 1 -- 172.21.15.133:0/3872783063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03ac066d80 con 0x7f03ac0d0af0 2024-03-30T01:52:41.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.974+0000 7f03a3400640 1 -- 172.21.15.133:0/3872783063 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12437 (secure 0 0 0) 0x7f0394079ca0 con 0x7f03ac0d0af0 2024-03-30T01:52:41.981 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:41.981 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":30,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:52:37.989713+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:52:41.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.977+0000 7f03b1c00640 1 -- 172.21.15.133:0/3872783063 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f038806ac00 msgr2=0x7f038806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:41.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.977+0000 7f03b1c00640 1 --2- 172.21.15.133:0/3872783063 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f038806ac00 0x7f038806d0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f039c006fd0 tx=0x7f039c008040 comp rx=0 tx=0).stop 2024-03-30T01:52:41.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.977+0000 7f03b1c00640 1 -- 172.21.15.133:0/3872783063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03ac0d0af0 msgr2=0x7f03ac154df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:41.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.977+0000 7f03b1c00640 1 --2- 172.21.15.133:0/3872783063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03ac0d0af0 0x7f03ac154df0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0394000c00 tx=0x7f03940046c0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.977+0000 7f03b1c00640 1 -- 172.21.15.133:0/3872783063 shutdown_connections 2024-03-30T01:52:41.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.977+0000 7f03b1c00640 1 --2- 172.21.15.133:0/3872783063 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f038806ac00 0x7f038806d0c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.977+0000 7f03b1c00640 1 --2- 172.21.15.133:0/3872783063 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03ac15cc50 0x7f03ac1516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.977+0000 7f03b1c00640 1 --2- 172.21.15.133:0/3872783063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03ac0d0af0 0x7f03ac154df0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.977+0000 7f03b1c00640 1 --2- 172.21.15.133:0/3872783063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03ac0cf9b0 0x7f03ac0c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:41.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.977+0000 7f03b1c00640 1 -- 172.21.15.133:0/3872783063 >> 172.21.15.133:0/3872783063 conn(0x7f03ac071a40 msgr2=0x7f03ac0d2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:41.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.977+0000 7f03b1c00640 1 -- 172.21.15.133:0/3872783063 shutdown_connections 2024-03-30T01:52:41.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:41.977+0000 7f03b1c00640 1 -- 172.21.15.133:0/3872783063 wait complete. 2024-03-30T01:52:42.002 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T01:51:21.771393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T01:52:42.002 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T01:52:42.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.200+0000 7f662a000640 1 Processor -- start 2024-03-30T01:52:42.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.200+0000 7f662a000640 1 -- start start 2024-03-30T01:52:42.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.201+0000 7f662a000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6624160e10 0x7f66240caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:42.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.201+0000 7f662a000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f66240cc710 0x7f66240ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:42.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.202+0000 7f662a000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66241611f0 con 0x7f66240b38c0 2024-03-30T01:52:42.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.202+0000 7f662a000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f662406c260 con 0x7f6624160e10 2024-03-30T01:52:42.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.202+0000 7f662a000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f662406c540 con 0x7f66240cc710 2024-03-30T01:52:42.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.202+0000 7f6628c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6624160e10 0x7f66240caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:42.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.202+0000 7f6628c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6624160e10 0x7f66240caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56672/0 (socket says 172.21.15.133:56672) 2024-03-30T01:52:42.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.202+0000 7f6628c00640 1 -- 172.21.15.133:0/2353229278 learned_addr learned my addr 172.21.15.133:0/2353229278 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:42.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.202+0000 7f6628c00640 1 -- 172.21.15.133:0/2353229278 >> v2:172.21.15.137:3300/0 conn(0x7f66240cc710 msgr2=0x7f66240ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:42.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.202+0000 7f6623e00640 1 --2- 172.21.15.133:0/2353229278 >> v2:172.21.15.137:3300/0 conn(0x7f66240cc710 0x7f66240ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:42.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.202+0000 7f6628c00640 1 --2- 172.21.15.133:0/2353229278 >> v2:172.21.15.137:3300/0 conn(0x7f66240cc710 0x7f66240ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:42.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.202+0000 7f6628c00640 1 -- 172.21.15.133:0/2353229278 >> v1:172.21.15.133:6789/0 conn(0x7f66240b38c0 legacy=0x7f662406d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:42.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.202+0000 7f6623400640 1 -- 172.21.15.133:0/2353229278 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727256441 0 0) 0x7f66241611f0 con 0x7f66240b38c0 2024-03-30T01:52:42.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.202+0000 7f6628c00640 1 -- 172.21.15.133:0/2353229278 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662406c820 con 0x7f6624160e10 2024-03-30T01:52:42.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.202+0000 7f6623e00640 1 --2- 172.21.15.133:0/2353229278 >> v2:172.21.15.137:3300/0 conn(0x7f66240cc710 0x7f66240ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:42.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.204+0000 7f6628c00640 1 --2- 172.21.15.133:0/2353229278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6624160e10 0x7f66240caa90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f66240714b0 tx=0x7f661402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97faf8f05bf16e75 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:42.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.204+0000 7f6623400640 1 -- 172.21.15.133:0/2353229278 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6614030860 con 0x7f6624160e10 2024-03-30T01:52:42.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.204+0000 7f6623400640 1 -- 172.21.15.133:0/2353229278 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66140309c0 con 0x7f6624160e10 2024-03-30T01:52:42.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.204+0000 7f6623400640 1 -- 172.21.15.133:0/2353229278 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6614030d50 con 0x7f6624160e10 2024-03-30T01:52:42.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.204+0000 7f662a000640 1 -- 172.21.15.133:0/2353229278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6624160e10 msgr2=0x7f66240caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:42.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.204+0000 7f662a000640 1 --2- 172.21.15.133:0/2353229278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6624160e10 0x7f66240caa90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f66240714b0 tx=0x7f661402b9a0 comp rx=0 tx=0).stop 2024-03-30T01:52:42.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.205+0000 7f662a000640 1 -- 172.21.15.133:0/2353229278 shutdown_connections 2024-03-30T01:52:42.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.205+0000 7f662a000640 1 --2- 172.21.15.133:0/2353229278 >> v2:172.21.15.137:3300/0 conn(0x7f66240cc710 0x7f66240ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:42.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.205+0000 7f662a000640 1 --2- 172.21.15.133:0/2353229278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6624160e10 0x7f66240caa90 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:42.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.205+0000 7f662a000640 1 -- 172.21.15.133:0/2353229278 >> 172.21.15.133:0/2353229278 conn(0x7f66240b05a0 msgr2=0x7f66240b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:42.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.205+0000 7f662a000640 1 -- 172.21.15.133:0/2353229278 shutdown_connections 2024-03-30T01:52:42.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.205+0000 7f662a000640 1 -- 172.21.15.133:0/2353229278 wait complete. 2024-03-30T01:52:42.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.206+0000 7f662a000640 1 Processor -- start 2024-03-30T01:52:42.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.207+0000 7f662a000640 1 -- start start 2024-03-30T01:52:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.207+0000 7f662a000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66240b38c0 0x7f6624163b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.207+0000 7f662a000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f66240cc710 0x7f66241512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.207+0000 7f662a000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6624160e10 0x7f662414f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.207+0000 7f662a000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66241f6ab0 con 0x7f6624160e10 2024-03-30T01:52:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.207+0000 7f662a000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6624151c90 con 0x7f66240b38c0 2024-03-30T01:52:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.208+0000 7f662a000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66241f6460 con 0x7f66240cc710 2024-03-30T01:52:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.208+0000 7f6629600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6624160e10 0x7f662414f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.208+0000 7f6629600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6624160e10 0x7f662414f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56686/0 (socket says 172.21.15.133:56686) 2024-03-30T01:52:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.208+0000 7f6629600640 1 -- 172.21.15.133:0/1052947471 learned_addr learned my addr 172.21.15.133:0/1052947471 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.208+0000 7f6623e00640 1 --2- 172.21.15.133:0/1052947471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f66240cc710 0x7f66241512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.208+0000 7f6628c00640 1 --2- 172.21.15.133:0/1052947471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66240b38c0 0x7f6624163b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.208+0000 7f6629600640 1 -- 172.21.15.133:0/1052947471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f66240cc710 msgr2=0x7f66241512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.208+0000 7f6629600640 1 --2- 172.21.15.133:0/1052947471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f66240cc710 0x7f66241512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.208+0000 7f6629600640 1 -- 172.21.15.133:0/1052947471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66240b38c0 msgr2=0x7f6624163b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.208+0000 7f6629600640 1 --2- 172.21.15.133:0/1052947471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66240b38c0 0x7f6624163b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.208+0000 7f6629600640 1 -- 172.21.15.133:0/1052947471 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66140094d0 con 0x7f6624160e10 2024-03-30T01:52:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.209+0000 7f6629600640 1 --2- 172.21.15.133:0/1052947471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6624160e10 0x7f662414f3b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f661c001560 tx=0x7f661c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.209+0000 7f6620c00640 1 -- 172.21.15.133:0/1052947471 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c003da0 con 0x7f6624160e10 2024-03-30T01:52:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.209+0000 7f6620c00640 1 -- 172.21.15.133:0/1052947471 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661c005070 con 0x7f6624160e10 2024-03-30T01:52:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.209+0000 7f6620c00640 1 -- 172.21.15.133:0/1052947471 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c005420 con 0x7f6624160e10 2024-03-30T01:52:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.209+0000 7f662a000640 1 -- 172.21.15.133:0/1052947471 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66241f6740 con 0x7f6624160e10 2024-03-30T01:52:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.209+0000 7f662a000640 1 -- 172.21.15.133:0/1052947471 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66241640d0 con 0x7f6624160e10 2024-03-30T01:52:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.210+0000 7f662a000640 1 -- 172.21.15.133:0/1052947471 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66241f6c60 con 0x7f6624160e10 2024-03-30T01:52:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.211+0000 7f6620c00640 1 -- 172.21.15.133:0/1052947471 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f661c005580 con 0x7f6624160e10 2024-03-30T01:52:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.212+0000 7f6620c00640 1 --2- 172.21.15.133:0/1052947471 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f660406ac00 0x7f660406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.212+0000 7f6620c00640 1 -- 172.21.15.133:0/1052947471 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f661c088860 con 0x7f6624160e10 2024-03-30T01:52:42.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.212+0000 7f6628c00640 1 --2- 172.21.15.133:0/1052947471 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f660406ac00 0x7f660406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:42.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.213+0000 7f6628c00640 1 --2- 172.21.15.133:0/1052947471 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f660406ac00 0x7f660406d0c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6614036000 tx=0x7f661403b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:42.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.216+0000 7f6620c00640 1 -- 172.21.15.133:0/1052947471 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f661c053e20 con 0x7f6624160e10 2024-03-30T01:52:42.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.413+0000 7f662a000640 1 -- 172.21.15.133:0/1052947471 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6624073750 con 0x7f6624160e10 2024-03-30T01:52:42.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.414+0000 7f6620c00640 1 -- 172.21.15.133:0/1052947471 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f661c017070 con 0x7f6624160e10 2024-03-30T01:52:42.422 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-03-30T01:52:42.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.416+0000 7f662a000640 1 -- 172.21.15.133:0/1052947471 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f660406ac00 msgr2=0x7f660406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:42.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.416+0000 7f662a000640 1 --2- 172.21.15.133:0/1052947471 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f660406ac00 0x7f660406d0c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6614036000 tx=0x7f661403b040 comp rx=0 tx=0).stop 2024-03-30T01:52:42.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.417+0000 7f662a000640 1 -- 172.21.15.133:0/1052947471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6624160e10 msgr2=0x7f662414f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:42.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.417+0000 7f662a000640 1 --2- 172.21.15.133:0/1052947471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6624160e10 0x7f662414f3b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f661c001560 tx=0x7f661c00cc70 comp rx=0 tx=0).stop 2024-03-30T01:52:42.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.417+0000 7f662a000640 1 -- 172.21.15.133:0/1052947471 shutdown_connections 2024-03-30T01:52:42.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.417+0000 7f662a000640 1 --2- 172.21.15.133:0/1052947471 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f660406ac00 0x7f660406d0c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:42.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.417+0000 7f662a000640 1 --2- 172.21.15.133:0/1052947471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6624160e10 0x7f662414f3b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:42.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.417+0000 7f662a000640 1 --2- 172.21.15.133:0/1052947471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f66240cc710 0x7f66241512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:42.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.417+0000 7f662a000640 1 --2- 172.21.15.133:0/1052947471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66240b38c0 0x7f6624163b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:42.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.417+0000 7f662a000640 1 -- 172.21.15.133:0/1052947471 >> 172.21.15.133:0/1052947471 conn(0x7f66240b05a0 msgr2=0x7f66240cd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:42.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.417+0000 7f662a000640 1 -- 172.21.15.133:0/1052947471 shutdown_connections 2024-03-30T01:52:42.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.417+0000 7f662a000640 1 -- 172.21.15.133:0/1052947471 wait complete. 2024-03-30T01:52:42.443 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-30T01:52:42.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.644+0000 7f28dbc00640 1 Processor -- start 2024-03-30T01:52:42.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.644+0000 7f28dbc00640 1 -- start start 2024-03-30T01:52:42.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.645+0000 7f28dbc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28d4143790 0x7f28d40cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:42.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.646+0000 7f28dbc00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f28d40ccc40 0x7f28d4070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:42.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.646+0000 7f28dbc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d40a76a0 con 0x7f28d4070500 2024-03-30T01:52:42.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.646+0000 7f28dbc00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d40b38e0 con 0x7f28d40ccc40 2024-03-30T01:52:42.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.646+0000 7f28dbc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d40cd180 con 0x7f28d4143790 2024-03-30T01:52:42.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.646+0000 7f28d9c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f28d40ccc40 0x7f28d4070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:42.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.646+0000 7f28d9c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f28d40ccc40 0x7f28d4070960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56696/0 (socket says 172.21.15.133:56696) 2024-03-30T01:52:42.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.646+0000 7f28d9c00640 1 -- 172.21.15.133:0/1043628720 learned_addr learned my addr 172.21.15.133:0/1043628720 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:42.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.646+0000 7f28d9200640 1 --2- 172.21.15.133:0/1043628720 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28d4143790 0x7f28d40cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:42.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.646+0000 7f28d9c00640 1 -- 172.21.15.133:0/1043628720 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28d4143790 msgr2=0x7f28d40cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:42.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.646+0000 7f28d9c00640 1 --2- 172.21.15.133:0/1043628720 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28d4143790 0x7f28d40cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:42.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.647+0000 7f28d9c00640 1 -- 172.21.15.133:0/1043628720 >> v1:172.21.15.137:6789/0 conn(0x7f28d4070500 legacy=0x7f28d40cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:42.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.647+0000 7f28d9c00640 1 -- 172.21.15.133:0/1043628720 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d4070ea0 con 0x7f28d40ccc40 2024-03-30T01:52:42.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.648+0000 7f28d9c00640 1 --2- 172.21.15.133:0/1043628720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d40ccc40 0x7f28d4070960 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f28cc009e50 tx=0x7f28cc02bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d6b9fab73d346ae server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:42.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.648+0000 7f28d3400640 1 -- 172.21.15.133:0/1043628720 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc02cb90 con 0x7f28d40ccc40 2024-03-30T01:52:42.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.648+0000 7f28d3400640 1 -- 172.21.15.133:0/1043628720 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc02ccf0 con 0x7f28d40ccc40 2024-03-30T01:52:42.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.648+0000 7f28d3400640 1 -- 172.21.15.133:0/1043628720 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc034610 con 0x7f28d40ccc40 2024-03-30T01:52:42.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.649+0000 7f28dbc00640 1 -- 172.21.15.133:0/1043628720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d40ccc40 msgr2=0x7f28d4070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:42.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.649+0000 7f28dbc00640 1 --2- 172.21.15.133:0/1043628720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d40ccc40 0x7f28d4070960 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f28cc009e50 tx=0x7f28cc02bff0 comp rx=0 tx=0).stop 2024-03-30T01:52:42.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.649+0000 7f28dbc00640 1 -- 172.21.15.133:0/1043628720 shutdown_connections 2024-03-30T01:52:42.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.649+0000 7f28dbc00640 1 --2- 172.21.15.133:0/1043628720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d40ccc40 0x7f28d4070960 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:42.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.649+0000 7f28dbc00640 1 --2- 172.21.15.133:0/1043628720 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28d4143790 0x7f28d40cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:42.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.649+0000 7f28dbc00640 1 -- 172.21.15.133:0/1043628720 >> 172.21.15.133:0/1043628720 conn(0x7f28d40b07a0 msgr2=0x7f28d40b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:42.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.649+0000 7f28dbc00640 1 -- 172.21.15.133:0/1043628720 shutdown_connections 2024-03-30T01:52:42.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.649+0000 7f28dbc00640 1 -- 172.21.15.133:0/1043628720 wait complete. 2024-03-30T01:52:42.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.650+0000 7f28dbc00640 1 Processor -- start 2024-03-30T01:52:42.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.651+0000 7f28dbc00640 1 -- start start 2024-03-30T01:52:42.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.652+0000 7f28dbc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d4070500 0x7f28d41f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:42.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.652+0000 7f28dbc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28d40ccc40 0x7f28d40b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:42.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.652+0000 7f28dbc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28d4143790 0x7f28d413ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:42.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.652+0000 7f28dbc00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d40abe20 con 0x7f28d4070500 2024-03-30T01:52:42.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.652+0000 7f28dbc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d40abab0 con 0x7f28d4143790 2024-03-30T01:52:42.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.652+0000 7f28dbc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d41f6120 con 0x7f28d40ccc40 2024-03-30T01:52:42.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.652+0000 7f28d9200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d4070500 0x7f28d41f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:42.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.652+0000 7f28d9200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d4070500 0x7f28d41f5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56706/0 (socket says 172.21.15.133:56706) 2024-03-30T01:52:42.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.652+0000 7f28d9200640 1 -- 172.21.15.133:0/3112913940 learned_addr learned my addr 172.21.15.133:0/3112913940 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.652+0000 7f28d3e00640 1 --2- 172.21.15.133:0/3112913940 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28d40ccc40 0x7f28d40b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.652+0000 7f28d9c00640 1 --2- 172.21.15.133:0/3112913940 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28d4143790 0x7f28d413ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.652+0000 7f28d9200640 1 -- 172.21.15.133:0/3112913940 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28d40ccc40 msgr2=0x7f28d40b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.652+0000 7f28d9200640 1 --2- 172.21.15.133:0/3112913940 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28d40ccc40 0x7f28d40b1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.652+0000 7f28d9200640 1 -- 172.21.15.133:0/3112913940 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28d4143790 msgr2=0x7f28d413ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.652+0000 7f28d9200640 1 --2- 172.21.15.133:0/3112913940 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28d4143790 0x7f28d413ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.652+0000 7f28d9200640 1 -- 172.21.15.133:0/3112913940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc009b30 con 0x7f28d4070500 2024-03-30T01:52:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.653+0000 7f28d9200640 1 --2- 172.21.15.133:0/3112913940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d4070500 0x7f28d41f5860 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f28bc00d830 tx=0x7f28bc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.653+0000 7f28d0c00640 1 -- 172.21.15.133:0/3112913940 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc00b6c0 con 0x7f28d4070500 2024-03-30T01:52:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.653+0000 7f28d0c00640 1 -- 172.21.15.133:0/3112913940 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28bc00b840 con 0x7f28d4070500 2024-03-30T01:52:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.653+0000 7f28dbc00640 1 -- 172.21.15.133:0/3112913940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d41f6400 con 0x7f28d4070500 2024-03-30T01:52:42.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.653+0000 7f28d0c00640 1 -- 172.21.15.133:0/3112913940 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc00bbf0 con 0x7f28d4070500 2024-03-30T01:52:42.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.653+0000 7f28dbc00640 1 -- 172.21.15.133:0/3112913940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d41f5da0 con 0x7f28d4070500 2024-03-30T01:52:42.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.654+0000 7f28dbc00640 1 -- 172.21.15.133:0/3112913940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d4066d80 con 0x7f28d4070500 2024-03-30T01:52:42.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.655+0000 7f28d0c00640 1 -- 172.21.15.133:0/3112913940 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f28bc01e460 con 0x7f28d4070500 2024-03-30T01:52:42.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.656+0000 7f28d0c00640 1 --2- 172.21.15.133:0/3112913940 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f28b006ac00 0x7f28b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:42.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.656+0000 7f28d0c00640 1 -- 172.21.15.133:0/3112913940 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f28bc089820 con 0x7f28d4070500 2024-03-30T01:52:42.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.656+0000 7f28d3e00640 1 --2- 172.21.15.133:0/3112913940 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f28b006ac00 0x7f28b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:42.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.657+0000 7f28d3e00640 1 --2- 172.21.15.133:0/3112913940 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f28b006ac00 0x7f28b006d0c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f28d406e220 tx=0x7f28c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:42.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.661+0000 7f28d0c00640 1 -- 172.21.15.133:0/3112913940 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f28bc054d40 con 0x7f28d4070500 2024-03-30T01:52:42.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.857+0000 7f28dbc00640 1 -- 172.21.15.133:0/3112913940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f28d4142e50 con 0x7f28d4070500 2024-03-30T01:52:42.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.858+0000 7f28d0c00640 1 -- 172.21.15.133:0/3112913940 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7f28bc058360 con 0x7f28d4070500 2024-03-30T01:52:42.864 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:42.864 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-03-30T01:52:42.864 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-03-30T01:52:42.864 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2024-03-30T01:52:42.864 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": ".mgr" 2024-03-30T01:52:42.864 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-03-30T01:52:42.865 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-03-30T01:52:42.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.860+0000 7f28dbc00640 1 -- 172.21.15.133:0/3112913940 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f28b006ac00 msgr2=0x7f28b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:42.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.861+0000 7f28dbc00640 1 --2- 172.21.15.133:0/3112913940 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f28b006ac00 0x7f28b006d0c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f28d406e220 tx=0x7f28c4009040 comp rx=0 tx=0).stop 2024-03-30T01:52:42.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.861+0000 7f28dbc00640 1 -- 172.21.15.133:0/3112913940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d4070500 msgr2=0x7f28d41f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:42.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.861+0000 7f28dbc00640 1 --2- 172.21.15.133:0/3112913940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d4070500 0x7f28d41f5860 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f28bc00d830 tx=0x7f28bc00dcf0 comp rx=0 tx=0).stop 2024-03-30T01:52:42.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.861+0000 7f28dbc00640 1 -- 172.21.15.133:0/3112913940 shutdown_connections 2024-03-30T01:52:42.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.861+0000 7f28dbc00640 1 --2- 172.21.15.133:0/3112913940 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f28b006ac00 0x7f28b006d0c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:42.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.861+0000 7f28dbc00640 1 --2- 172.21.15.133:0/3112913940 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28d4143790 0x7f28d413ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:42.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.861+0000 7f28dbc00640 1 --2- 172.21.15.133:0/3112913940 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28d40ccc40 0x7f28d40b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:42.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.861+0000 7f28dbc00640 1 --2- 172.21.15.133:0/3112913940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d4070500 0x7f28d41f5860 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:42.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.861+0000 7f28dbc00640 1 -- 172.21.15.133:0/3112913940 >> 172.21.15.133:0/3112913940 conn(0x7f28d40b07a0 msgr2=0x7f28d40af9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:42.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.861+0000 7f28dbc00640 1 -- 172.21.15.133:0/3112913940 shutdown_connections 2024-03-30T01:52:42.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:42.861+0000 7f28dbc00640 1 -- 172.21.15.133:0/3112913940 wait complete. 2024-03-30T01:52:42.886 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-30T01:52:42.886 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-30T01:52:43.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.093+0000 7f7063a00640 1 Processor -- start 2024-03-30T01:52:43.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.094+0000 7f7063a00640 1 -- start start 2024-03-30T01:52:43.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.095+0000 7f7063a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f705c160290 0x7f705c0b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:43.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.095+0000 7f7063a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f705c1607f0 0x7f705c0d2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:43.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.095+0000 7f7063a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f705c0b6020 con 0x7f705c0d2890 2024-03-30T01:52:43.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.095+0000 7f7063a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f705c160c80 con 0x7f705c1607f0 2024-03-30T01:52:43.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.095+0000 7f7063a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705c160f60 con 0x7f705c160290 2024-03-30T01:52:43.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.096+0000 7f705be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f705c1607f0 0x7f705c0d2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:43.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.096+0000 7f7061000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f705c160290 0x7f705c0b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:43.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.096+0000 7f705be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f705c1607f0 0x7f705c0d2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.133:54598/0 (socket says 172.21.15.133:54598) 2024-03-30T01:52:43.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.096+0000 7f705be00640 1 -- 172.21.15.133:0/53064012 learned_addr learned my addr 172.21.15.133:0/53064012 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:43.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.097+0000 7f7061000640 1 -- 172.21.15.133:0/53064012 >> v2:172.21.15.137:3300/0 conn(0x7f705c1607f0 msgr2=0x7f705c0d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:43.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.097+0000 7f7061000640 1 --2- 172.21.15.133:0/53064012 >> v2:172.21.15.137:3300/0 conn(0x7f705c1607f0 0x7f705c0d2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:43.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.097+0000 7f7061000640 1 -- 172.21.15.133:0/53064012 >> v1:172.21.15.137:6789/0 conn(0x7f705c0d2890 legacy=0x7f705c0b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:43.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.097+0000 7f7061000640 1 -- 172.21.15.133:0/53064012 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c161240 con 0x7f705c160290 2024-03-30T01:52:43.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.098+0000 7f7061000640 1 --2- 172.21.15.133:0/53064012 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f705c160290 0x7f705c0b5ae0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f704c0097d0 tx=0x7f704c02b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bd87b2bb39c3178 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:43.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.099+0000 7f705b400640 1 -- 172.21.15.133:0/53064012 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c031770 con 0x7f705c160290 2024-03-30T01:52:43.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.099+0000 7f705b400640 1 -- 172.21.15.133:0/53064012 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704c0318d0 con 0x7f705c160290 2024-03-30T01:52:43.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.099+0000 7f705b400640 1 -- 172.21.15.133:0/53064012 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c031c60 con 0x7f705c160290 2024-03-30T01:52:43.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.100+0000 7f7063a00640 1 -- 172.21.15.133:0/53064012 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f705c160290 msgr2=0x7f705c0b5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:43.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.100+0000 7f7063a00640 1 --2- 172.21.15.133:0/53064012 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f705c160290 0x7f705c0b5ae0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f704c0097d0 tx=0x7f704c02b810 comp rx=0 tx=0).stop 2024-03-30T01:52:43.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.100+0000 7f7063a00640 1 -- 172.21.15.133:0/53064012 shutdown_connections 2024-03-30T01:52:43.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.100+0000 7f7063a00640 1 --2- 172.21.15.133:0/53064012 >> v2:172.21.15.137:3300/0 conn(0x7f705c1607f0 0x7f705c0d2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:43.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.100+0000 7f7063a00640 1 --2- 172.21.15.133:0/53064012 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f705c160290 0x7f705c0b5ae0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:43.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.100+0000 7f7063a00640 1 -- 172.21.15.133:0/53064012 >> 172.21.15.133:0/53064012 conn(0x7f705c071a70 msgr2=0x7f705c0cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:43.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.100+0000 7f7063a00640 1 -- 172.21.15.133:0/53064012 shutdown_connections 2024-03-30T01:52:43.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.100+0000 7f7063a00640 1 -- 172.21.15.133:0/53064012 wait complete. 2024-03-30T01:52:43.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.101+0000 7f7063a00640 1 Processor -- start 2024-03-30T01:52:43.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.102+0000 7f7063a00640 1 -- start start 2024-03-30T01:52:43.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.103+0000 7f7063a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f705c0d2890 0x7f705c154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:43.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.103+0000 7f7063a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f705c160290 0x7f705c0b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:43.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.103+0000 7f7063a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f705c1e7090 0x7f705c151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:43.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.103+0000 7f7063a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c1e6c70 con 0x7f705c1e7090 2024-03-30T01:52:43.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.103+0000 7f7063a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0b4bc0 con 0x7f705c160290 2024-03-30T01:52:43.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.103+0000 7f7063a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0b48e0 con 0x7f705c0d2890 2024-03-30T01:52:43.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.103+0000 7f7061a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f705c1e7090 0x7f705c151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:43.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.103+0000 7f7061a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f705c1e7090 0x7f705c151f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56712/0 (socket says 172.21.15.133:56712) 2024-03-30T01:52:43.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.103+0000 7f7061a00640 1 -- 172.21.15.133:0/131752260 learned_addr learned my addr 172.21.15.133:0/131752260 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:43.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.103+0000 7f7061000640 1 --2- 172.21.15.133:0/131752260 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f705c0d2890 0x7f705c154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:43.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.103+0000 7f705be00640 1 --2- 172.21.15.133:0/131752260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f705c160290 0x7f705c0b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:43.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.103+0000 7f7061a00640 1 -- 172.21.15.133:0/131752260 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f705c0d2890 msgr2=0x7f705c154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:43.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.103+0000 7f7061a00640 1 --2- 172.21.15.133:0/131752260 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f705c0d2890 0x7f705c154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:43.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.103+0000 7f7061a00640 1 -- 172.21.15.133:0/131752260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f705c160290 msgr2=0x7f705c0b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:43.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.103+0000 7f7061a00640 1 --2- 172.21.15.133:0/131752260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f705c160290 0x7f705c0b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:43.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.103+0000 7f7061a00640 1 -- 172.21.15.133:0/131752260 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704c009400 con 0x7f705c1e7090 2024-03-30T01:52:43.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.104+0000 7f7061a00640 1 --2- 172.21.15.133:0/131752260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f705c1e7090 0x7f705c151f60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f705400c730 tx=0x7f705400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:43.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.104+0000 7f7058c00640 1 -- 172.21.15.133:0/131752260 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054003b70 con 0x7f705c1e7090 2024-03-30T01:52:43.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.104+0000 7f7058c00640 1 -- 172.21.15.133:0/131752260 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7054003cd0 con 0x7f705c1e7090 2024-03-30T01:52:43.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.104+0000 7f7058c00640 1 -- 172.21.15.133:0/131752260 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705400aa90 con 0x7f705c1e7090 2024-03-30T01:52:43.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.104+0000 7f7063a00640 1 -- 172.21.15.133:0/131752260 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f705c1e65b0 con 0x7f705c1e7090 2024-03-30T01:52:43.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.104+0000 7f7063a00640 1 -- 172.21.15.133:0/131752260 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f705c0b45d0 con 0x7f705c1e7090 2024-03-30T01:52:43.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.105+0000 7f7063a00640 1 -- 172.21.15.133:0/131752260 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f705c1e6db0 con 0x7f705c1e7090 2024-03-30T01:52:43.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.106+0000 7f7058c00640 1 -- 172.21.15.133:0/131752260 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f705400abf0 con 0x7f705c1e7090 2024-03-30T01:52:43.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.107+0000 7f7058c00640 1 --2- 172.21.15.133:0/131752260 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f703806ac00 0x7f703806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:43.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.107+0000 7f7058c00640 1 -- 172.21.15.133:0/131752260 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7054088ee0 con 0x7f705c1e7090 2024-03-30T01:52:43.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.107+0000 7f7061000640 1 --2- 172.21.15.133:0/131752260 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f703806ac00 0x7f703806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:43.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.108+0000 7f7061000640 1 --2- 172.21.15.133:0/131752260 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f703806ac00 0x7f703806d0c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f704c036000 tx=0x7f704c03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:43.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.111+0000 7f7058c00640 1 -- 172.21.15.133:0/131752260 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f705c1e6db0 con 0x7f705c1e7090 2024-03-30T01:52:43.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.305+0000 7f7063a00640 1 -- 172.21.15.133:0/131752260 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f705c1e6db0 con 0x7f705c1e7090 2024-03-30T01:52:43.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.730+0000 7f7058c00640 1 -- 172.21.15.133:0/131752260 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f705c1e6db0 con 0x7f705c1e7090 2024-03-30T01:52:43.737 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2024-03-30T01:52:43.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.735+0000 7f7063a00640 1 -- 172.21.15.133:0/131752260 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f703806ac00 msgr2=0x7f703806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:43.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.735+0000 7f7063a00640 1 --2- 172.21.15.133:0/131752260 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f703806ac00 0x7f703806d0c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f704c036000 tx=0x7f704c03d040 comp rx=0 tx=0).stop 2024-03-30T01:52:43.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.736+0000 7f7063a00640 1 -- 172.21.15.133:0/131752260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f705c1e7090 msgr2=0x7f705c151f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:43.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.736+0000 7f7063a00640 1 --2- 172.21.15.133:0/131752260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f705c1e7090 0x7f705c151f60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f705400c730 tx=0x7f705400cbf0 comp rx=0 tx=0).stop 2024-03-30T01:52:43.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.737+0000 7f7063a00640 1 -- 172.21.15.133:0/131752260 shutdown_connections 2024-03-30T01:52:43.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.737+0000 7f7063a00640 1 --2- 172.21.15.133:0/131752260 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f703806ac00 0x7f703806d0c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:43.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.737+0000 7f7063a00640 1 --2- 172.21.15.133:0/131752260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f705c1e7090 0x7f705c151f60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:43.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.737+0000 7f7063a00640 1 --2- 172.21.15.133:0/131752260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f705c160290 0x7f705c0b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:43.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.737+0000 7f7063a00640 1 --2- 172.21.15.133:0/131752260 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f705c0d2890 0x7f705c154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:43.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.737+0000 7f7063a00640 1 -- 172.21.15.133:0/131752260 >> 172.21.15.133:0/131752260 conn(0x7f705c071a70 msgr2=0x7f705c072ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:43.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.737+0000 7f7063a00640 1 -- 172.21.15.133:0/131752260 shutdown_connections 2024-03-30T01:52:43.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.737+0000 7f7063a00640 1 -- 172.21.15.133:0/131752260 wait complete. 2024-03-30T01:52:43.770 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-30T01:52:43.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.959+0000 7fbff7800640 1 Processor -- start 2024-03-30T01:52:43.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.959+0000 7fbff7800640 1 -- start start 2024-03-30T01:52:43.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.961+0000 7fbff7800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbff00cffc0 0x7fbff00cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:43.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.961+0000 7fbff7800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff00cfbd0 con 0x7fbff0160280 2024-03-30T01:52:43.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.961+0000 7fbff7800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff00d1170 con 0x7fbff00d1f30 2024-03-30T01:52:43.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.961+0000 7fbff7800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff00d1450 con 0x7fbff00cffc0 2024-03-30T01:52:43.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.961+0000 7fbff4e00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbff0160280 0x7fbff00b5b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58254/0 (socket says 172.21.15.133:58254) 2024-03-30T01:52:43.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.961+0000 7fbff4e00640 1 -- 172.21.15.133:0/1567087649 learned_addr learned my addr 172.21.15.133:0/1567087649 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:43.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.962+0000 7fbfefe00640 1 --2- 172.21.15.133:0/1567087649 >> v2:172.21.15.137:3300/0 conn(0x7fbff00cffc0 0x7fbff00cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:43.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.962+0000 7fbfef400640 1 -- 172.21.15.133:0/1567087649 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594157984 0 0) 0x7fbff00cfbd0 con 0x7fbff0160280 2024-03-30T01:52:43.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.962+0000 7fbfef400640 1 -- 172.21.15.133:0/1567087649 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfd8003520 con 0x7fbff0160280 2024-03-30T01:52:43.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.962+0000 7fbfef400640 1 -- 172.21.15.133:0/1567087649 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2399482472 0 0) 0x7fbfd8003520 con 0x7fbff0160280 2024-03-30T01:52:43.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.962+0000 7fbfef400640 1 -- 172.21.15.133:0/1567087649 >> v2:172.21.15.137:3300/0 conn(0x7fbff00cffc0 msgr2=0x7fbff00cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:43.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.962+0000 7fbfef400640 1 --2- 172.21.15.133:0/1567087649 >> v2:172.21.15.137:3300/0 conn(0x7fbff00cffc0 0x7fbff00cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:43.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.962+0000 7fbfef400640 1 -- 172.21.15.133:0/1567087649 >> v1:172.21.15.137:6789/0 conn(0x7fbff00d1f30 legacy=0x7fbff00b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:43.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.962+0000 7fbfef400640 1 -- 172.21.15.133:0/1567087649 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff00d1730 con 0x7fbff0160280 2024-03-30T01:52:43.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.962+0000 7fbfef400640 1 -- 172.21.15.133:0/1567087649 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fbfe4001670 con 0x7fbff0160280 2024-03-30T01:52:43.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.962+0000 7fbfef400640 1 -- 172.21.15.133:0/1567087649 >> v1:172.21.15.133:6789/0 conn(0x7fbff0160280 legacy=0x7fbff00b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:43.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.962+0000 7fbfef400640 1 --2- 172.21.15.133:0/1567087649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbfd8003970 0x7fbfd8003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:43.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.962+0000 7fbfef400640 1 --2- 172.21.15.133:0/1567087649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd80047c0 0x7fbfd8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:43.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.962+0000 7fbfef400640 1 --2- 172.21.15.133:0/1567087649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd8005180 0x7fbfd800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:43.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.962+0000 7fbfef400640 1 -- 172.21.15.133:0/1567087649 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff00d1450 con 0x7fbfd8005180 2024-03-30T01:52:43.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.962+0000 7fbfef400640 1 -- 172.21.15.133:0/1567087649 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd800c000 con 0x7fbfd80047c0 2024-03-30T01:52:43.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.962+0000 7fbfef400640 1 -- 172.21.15.133:0/1567087649 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd800c1c0 con 0x7fbfd8003970 2024-03-30T01:52:43.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.963+0000 7fbff5800640 1 --2- 172.21.15.133:0/1567087649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd8005180 0x7fbfd800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:43.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.963+0000 7fbff5800640 1 -- 172.21.15.133:0/1567087649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbfd8003970 msgr2=0x7fbfd8003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:43.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.963+0000 7fbff4e00640 1 --2- 172.21.15.133:0/1567087649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbfd8003970 0x7fbfd8003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:43.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.963+0000 7fbfefe00640 1 --2- 172.21.15.133:0/1567087649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd80047c0 0x7fbfd8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:43.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.963+0000 7fbff5800640 1 --2- 172.21.15.133:0/1567087649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbfd8003970 0x7fbfd8003d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:43.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.963+0000 7fbff5800640 1 -- 172.21.15.133:0/1567087649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd80047c0 msgr2=0x7fbfd8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:43.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.963+0000 7fbff5800640 1 --2- 172.21.15.133:0/1567087649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd80047c0 0x7fbfd8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:43.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.963+0000 7fbff5800640 1 -- 172.21.15.133:0/1567087649 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd8003520 con 0x7fbfd8005180 2024-03-30T01:52:43.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.963+0000 7fbfefe00640 1 --2- 172.21.15.133:0/1567087649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd80047c0 0x7fbfd8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:43.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.964+0000 7fbff5800640 1 -- 172.21.15.133:0/1567087649 reap_dead start 2024-03-30T01:52:43.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.964+0000 7fbff5800640 1 --2- 172.21.15.133:0/1567087649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd8005180 0x7fbfd800b980 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80044b0 tx=0x7fbfd80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa2b44c474de43 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:43.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.964+0000 7fbfef400640 1 -- 172.21.15.133:0/1567087649 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8006d50 con 0x7fbfd8005180 2024-03-30T01:52:43.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.964+0000 7fbfef400640 1 -- 172.21.15.133:0/1567087649 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe8007020 con 0x7fbfd8005180 2024-03-30T01:52:43.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.964+0000 7fbfef400640 1 -- 172.21.15.133:0/1567087649 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe80073d0 con 0x7fbfd8005180 2024-03-30T01:52:43.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.965+0000 7fbff7800640 1 -- 172.21.15.133:0/1567087649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd8005180 msgr2=0x7fbfd800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:43.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.965+0000 7fbff7800640 1 --2- 172.21.15.133:0/1567087649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd8005180 0x7fbfd800b980 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80044b0 tx=0x7fbfd80057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:43.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.965+0000 7fbff7800640 1 -- 172.21.15.133:0/1567087649 shutdown_connections 2024-03-30T01:52:43.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.965+0000 7fbff7800640 1 --2- 172.21.15.133:0/1567087649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd8005180 0x7fbfd800b980 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:43.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.965+0000 7fbff7800640 1 -- 172.21.15.133:0/1567087649 >> 172.21.15.133:0/1567087649 conn(0x7fbff006b7b0 msgr2=0x7fbff006bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:43.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.965+0000 7fbff7800640 1 -- 172.21.15.133:0/1567087649 shutdown_connections 2024-03-30T01:52:43.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.965+0000 7fbff7800640 1 -- 172.21.15.133:0/1567087649 wait complete. 2024-03-30T01:52:43.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.967+0000 7fbff7800640 1 Processor -- start 2024-03-30T01:52:43.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.967+0000 7fbff7800640 1 -- start start 2024-03-30T01:52:43.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.968+0000 7fbff7800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd8005180 0x7fbff0152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:43.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.968+0000 7fbff7800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbff00b6420 0x7fbff00c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:43.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.968+0000 7fbff7800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbff00c8d00 0x7fbff01f22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.968+0000 7fbff7800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff00c68e0 con 0x7fbff00c8d00 2024-03-30T01:52:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.968+0000 7fbff7800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff0152b50 con 0x7fbfd8005180 2024-03-30T01:52:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.968+0000 7fbff7800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff01f3030 con 0x7fbff00b6420 2024-03-30T01:52:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.968+0000 7fbff5800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbff00c8d00 0x7fbff01f22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.968+0000 7fbff5800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbff00c8d00 0x7fbff01f22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56724/0 (socket says 172.21.15.133:56724) 2024-03-30T01:52:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.968+0000 7fbff5800640 1 -- 172.21.15.133:0/1280807164 learned_addr learned my addr 172.21.15.133:0/1280807164 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.968+0000 7fbfefe00640 1 --2- 172.21.15.133:0/1280807164 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbff00b6420 0x7fbff00c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.968+0000 7fbff4e00640 1 --2- 172.21.15.133:0/1280807164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd8005180 0x7fbff0152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.968+0000 7fbff5800640 1 -- 172.21.15.133:0/1280807164 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbff00b6420 msgr2=0x7fbff00c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.968+0000 7fbff5800640 1 --2- 172.21.15.133:0/1280807164 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbff00b6420 0x7fbff00c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.968+0000 7fbff5800640 1 -- 172.21.15.133:0/1280807164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd8005180 msgr2=0x7fbff0152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.968+0000 7fbff5800640 1 --2- 172.21.15.133:0/1280807164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd8005180 0x7fbff0152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.968+0000 7fbff5800640 1 -- 172.21.15.133:0/1280807164 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff01f3310 con 0x7fbff00c8d00 2024-03-30T01:52:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.968+0000 7fbfefe00640 1 --2- 172.21.15.133:0/1280807164 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbff00b6420 0x7fbff00c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:43.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.969+0000 7fbff5800640 1 --2- 172.21.15.133:0/1280807164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbff00c8d00 0x7fbff01f22a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80045d0 tx=0x7fbfe8003a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:43.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.969+0000 7fbfecc00640 1 -- 172.21.15.133:0/1280807164 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe803e070 con 0x7fbff00c8d00 2024-03-30T01:52:43.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.969+0000 7fbfecc00640 1 -- 172.21.15.133:0/1280807164 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe8006e70 con 0x7fbff00c8d00 2024-03-30T01:52:43.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.969+0000 7fbff7800640 1 -- 172.21.15.133:0/1280807164 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff00cac20 con 0x7fbff00c8d00 2024-03-30T01:52:43.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.969+0000 7fbfecc00640 1 -- 172.21.15.133:0/1280807164 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8007870 con 0x7fbff00c8d00 2024-03-30T01:52:43.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.969+0000 7fbff7800640 1 -- 172.21.15.133:0/1280807164 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff00cb1e0 con 0x7fbff00c8d00 2024-03-30T01:52:43.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.970+0000 7fbff7800640 1 -- 172.21.15.133:0/1280807164 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff00cb400 con 0x7fbff00c8d00 2024-03-30T01:52:43.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.971+0000 7fbfecc00640 1 -- 172.21.15.133:0/1280807164 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fbfe8030420 con 0x7fbff00c8d00 2024-03-30T01:52:43.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.972+0000 7fbfecc00640 1 --2- 172.21.15.133:0/1280807164 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbfd006ac30 0x7fbfd006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:43.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.972+0000 7fbfecc00640 1 -- 172.21.15.133:0/1280807164 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fbfe80aa2c0 con 0x7fbff00c8d00 2024-03-30T01:52:43.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.973+0000 7fbff4e00640 1 --2- 172.21.15.133:0/1280807164 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbfd006ac30 0x7fbfd006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:43.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.973+0000 7fbff4e00640 1 --2- 172.21.15.133:0/1280807164 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbfd006ac30 0x7fbfd006d0f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40017a0 tx=0x7fbfe4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:43.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:43.978+0000 7fbfecc00640 1 -- 172.21.15.133:0/1280807164 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fbfe80757b0 con 0x7fbff00c8d00 2024-03-30T01:52:44.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.172+0000 7fbff7800640 1 -- 172.21.15.133:0/1280807164 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbff0066d80 con 0x7fbff00c8d00 2024-03-30T01:52:44.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.737+0000 7fbfecc00640 1 -- 172.21.15.133:0/1280807164 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7fbfe8078dd0 con 0x7fbff00c8d00 2024-03-30T01:52:44.745 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2024-03-30T01:52:44.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.743+0000 7fbff7800640 1 -- 172.21.15.133:0/1280807164 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbfd006ac30 msgr2=0x7fbfd006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:44.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.743+0000 7fbff7800640 1 --2- 172.21.15.133:0/1280807164 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbfd006ac30 0x7fbfd006d0f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40017a0 tx=0x7fbfe4009040 comp rx=0 tx=0).stop 2024-03-30T01:52:44.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.743+0000 7fbff7800640 1 -- 172.21.15.133:0/1280807164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbff00c8d00 msgr2=0x7fbff01f22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:44.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.743+0000 7fbff7800640 1 --2- 172.21.15.133:0/1280807164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbff00c8d00 0x7fbff01f22a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80045d0 tx=0x7fbfe8003a70 comp rx=0 tx=0).stop 2024-03-30T01:52:44.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.745+0000 7fbff7800640 1 -- 172.21.15.133:0/1280807164 shutdown_connections 2024-03-30T01:52:44.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.745+0000 7fbff7800640 1 --2- 172.21.15.133:0/1280807164 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fbfd006ac30 0x7fbfd006d0f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:44.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.745+0000 7fbff7800640 1 --2- 172.21.15.133:0/1280807164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbff00c8d00 0x7fbff01f22a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:44.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.745+0000 7fbff7800640 1 --2- 172.21.15.133:0/1280807164 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbff00b6420 0x7fbff00c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:44.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.745+0000 7fbff7800640 1 --2- 172.21.15.133:0/1280807164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd8005180 0x7fbff0152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:44.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.745+0000 7fbff7800640 1 -- 172.21.15.133:0/1280807164 >> 172.21.15.133:0/1280807164 conn(0x7fbff006b7b0 msgr2=0x7fbff01598f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:44.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.746+0000 7fbff7800640 1 -- 172.21.15.133:0/1280807164 shutdown_connections 2024-03-30T01:52:44.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.746+0000 7fbff7800640 1 -- 172.21.15.133:0/1280807164 wait complete. 2024-03-30T01:52:44.787 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-30T01:52:44.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.962+0000 7fce7d600640 1 Processor -- start 2024-03-30T01:52:44.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.963+0000 7fce7d600640 1 -- start start 2024-03-30T01:52:44.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.964+0000 7fce7d600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce78070c10 0x7fce78164740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:44.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.964+0000 7fce7d600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce780ce400 con 0x7fce78143220 2024-03-30T01:52:44.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.964+0000 7fce7d600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7806d0e0 con 0x7fce7806e2e0 2024-03-30T01:52:44.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.964+0000 7fce7d600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce780cc5c0 con 0x7fce78070c10 2024-03-30T01:52:44.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.964+0000 7fce76a00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fce78143220 0x7fce780cd990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58262/0 (socket says 172.21.15.133:58262) 2024-03-30T01:52:44.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.964+0000 7fce76a00640 1 -- 172.21.15.133:0/210279341 learned_addr learned my addr 172.21.15.133:0/210279341 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:44.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.965+0000 7fce76000640 1 -- 172.21.15.133:0/210279341 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532079402 0 0) 0x7fce780ce400 con 0x7fce78143220 2024-03-30T01:52:44.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.965+0000 7fce76000640 1 -- 172.21.15.133:0/210279341 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce5c005730 con 0x7fce78143220 2024-03-30T01:52:44.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.965+0000 7fce77400640 1 --2- 172.21.15.133:0/210279341 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce78070c10 0x7fce78164740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:44.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.965+0000 7fce76000640 1 -- 172.21.15.133:0/210279341 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2178820573 0 0) 0x7fce5c005730 con 0x7fce78143220 2024-03-30T01:52:44.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.965+0000 7fce76000640 1 -- 172.21.15.133:0/210279341 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce78070c10 msgr2=0x7fce78164740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:44.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.965+0000 7fce76000640 1 --2- 172.21.15.133:0/210279341 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce78070c10 0x7fce78164740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:44.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.965+0000 7fce76000640 1 -- 172.21.15.133:0/210279341 >> v1:172.21.15.137:6789/0 conn(0x7fce7806e2e0 legacy=0x7fce78070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:44.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.965+0000 7fce76000640 1 -- 172.21.15.133:0/210279341 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7806d3c0 con 0x7fce78143220 2024-03-30T01:52:44.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.965+0000 7fce76000640 1 -- 172.21.15.133:0/210279341 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fce68001690 con 0x7fce78143220 2024-03-30T01:52:44.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.965+0000 7fce76000640 1 -- 172.21.15.133:0/210279341 >> v1:172.21.15.133:6789/0 conn(0x7fce78143220 legacy=0x7fce780cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:44.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.965+0000 7fce76000640 1 --2- 172.21.15.133:0/210279341 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce78070c10 0x7fce5c005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:44.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.965+0000 7fce76000640 1 --2- 172.21.15.133:0/210279341 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce5c006210 0x7fce5c0069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:44.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.965+0000 7fce76000640 1 --2- 172.21.15.133:0/210279341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce5c006f10 0x7fce5c007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:44.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.965+0000 7fce76000640 1 -- 172.21.15.133:0/210279341 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c00dd50 con 0x7fce5c006f10 2024-03-30T01:52:44.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.965+0000 7fce76000640 1 -- 172.21.15.133:0/210279341 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c00dec0 con 0x7fce5c006210 2024-03-30T01:52:44.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.965+0000 7fce76000640 1 -- 172.21.15.133:0/210279341 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c00e080 con 0x7fce78070c10 2024-03-30T01:52:44.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.965+0000 7fce77400640 1 --2- 172.21.15.133:0/210279341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce5c006f10 0x7fce5c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:44.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.966+0000 7fce76a00640 1 --2- 172.21.15.133:0/210279341 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce78070c10 0x7fce5c005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:44.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.966+0000 7fce6e000640 1 --2- 172.21.15.133:0/210279341 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce5c006210 0x7fce5c0069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:44.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.966+0000 7fce77400640 1 -- 172.21.15.133:0/210279341 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce78070c10 msgr2=0x7fce5c005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:44.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.966+0000 7fce77400640 1 --2- 172.21.15.133:0/210279341 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce78070c10 0x7fce5c005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:44.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.966+0000 7fce77400640 1 -- 172.21.15.133:0/210279341 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce5c006210 msgr2=0x7fce5c0069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:44.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.966+0000 7fce77400640 1 --2- 172.21.15.133:0/210279341 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce5c006210 0x7fce5c0069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:44.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.966+0000 7fce77400640 1 -- 172.21.15.133:0/210279341 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5c005730 con 0x7fce5c006f10 2024-03-30T01:52:44.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.967+0000 7fce77400640 1 --2- 172.21.15.133:0/210279341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce5c006f10 0x7fce5c007390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fce7000ba00 tx=0x7fce5c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861005caf39ae2bd server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:44.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.967+0000 7fce76000640 1 -- 172.21.15.133:0/210279341 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70032620 con 0x7fce5c006f10 2024-03-30T01:52:44.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.967+0000 7fce76000640 1 -- 172.21.15.133:0/210279341 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce70032780 con 0x7fce5c006f10 2024-03-30T01:52:44.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.967+0000 7fce76000640 1 -- 172.21.15.133:0/210279341 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70032b10 con 0x7fce5c006f10 2024-03-30T01:52:44.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.968+0000 7fce7d600640 1 -- 172.21.15.133:0/210279341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce5c006f10 msgr2=0x7fce5c007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:44.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.968+0000 7fce7d600640 1 --2- 172.21.15.133:0/210279341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce5c006f10 0x7fce5c007390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fce7000ba00 tx=0x7fce5c007a00 comp rx=0 tx=0).stop 2024-03-30T01:52:44.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.968+0000 7fce77400640 1 -- 172.21.15.133:0/210279341 reap_dead start 2024-03-30T01:52:44.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.968+0000 7fce7d600640 1 -- 172.21.15.133:0/210279341 shutdown_connections 2024-03-30T01:52:44.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.968+0000 7fce7d600640 1 -- 172.21.15.133:0/210279341 >> 172.21.15.133:0/210279341 conn(0x7fce780b07a0 msgr2=0x7fce780b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:44.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.968+0000 7fce7d600640 1 -- 172.21.15.133:0/210279341 shutdown_connections 2024-03-30T01:52:44.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.968+0000 7fce7d600640 1 -- 172.21.15.133:0/210279341 wait complete. 2024-03-30T01:52:44.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.970+0000 7fce7d600640 1 Processor -- start 2024-03-30T01:52:44.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.970+0000 7fce7d600640 1 -- start start 2024-03-30T01:52:44.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.971+0000 7fce7d600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce5c006f10 0x7fce7815c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:44.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.971+0000 7fce7d600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce781365b0 0x7fce781edfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:44.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.971+0000 7fce7d600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce78159de0 0x7fce7815ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:44.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.971+0000 7fce7d600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce78136a30 con 0x7fce5c006f10 2024-03-30T01:52:44.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.971+0000 7fce7d600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce78159950 con 0x7fce78159de0 2024-03-30T01:52:44.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.971+0000 7fce7d600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce78159620 con 0x7fce781365b0 2024-03-30T01:52:44.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.971+0000 7fce76a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce5c006f10 0x7fce7815c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:44.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.971+0000 7fce76a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce5c006f10 0x7fce7815c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56748/0 (socket says 172.21.15.133:56748) 2024-03-30T01:52:44.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.971+0000 7fce76a00640 1 -- 172.21.15.133:0/1446614417 learned_addr learned my addr 172.21.15.133:0/1446614417 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:44.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.971+0000 7fce76a00640 1 -- 172.21.15.133:0/1446614417 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce781365b0 msgr2=0x7fce781edfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:44.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.971+0000 7fce76a00640 1 --2- 172.21.15.133:0/1446614417 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce781365b0 0x7fce781edfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:44.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.971+0000 7fce76a00640 1 -- 172.21.15.133:0/1446614417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce78159de0 msgr2=0x7fce7815ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:44.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.971+0000 7fce76a00640 1 --2- 172.21.15.133:0/1446614417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce78159de0 0x7fce7815ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:44.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.971+0000 7fce76a00640 1 -- 172.21.15.133:0/1446614417 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce781ee8a0 con 0x7fce5c006f10 2024-03-30T01:52:44.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.972+0000 7fce76a00640 1 --2- 172.21.15.133:0/1446614417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce5c006f10 0x7fce7815c120 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fce6800e7f0 tx=0x7fce6800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:44.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.972+0000 7fce6f400640 1 -- 172.21.15.133:0/1446614417 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6800c7f0 con 0x7fce5c006f10 2024-03-30T01:52:44.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.972+0000 7fce6f400640 1 -- 172.21.15.133:0/1446614417 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6800c950 con 0x7fce5c006f10 2024-03-30T01:52:44.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.972+0000 7fce7d600640 1 -- 172.21.15.133:0/1446614417 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce781eeb80 con 0x7fce5c006f10 2024-03-30T01:52:44.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.972+0000 7fce6f400640 1 -- 172.21.15.133:0/1446614417 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6800cd00 con 0x7fce5c006f10 2024-03-30T01:52:44.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.972+0000 7fce7d600640 1 -- 172.21.15.133:0/1446614417 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce781ee520 con 0x7fce5c006f10 2024-03-30T01:52:44.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.973+0000 7fce7d600640 1 -- 172.21.15.133:0/1446614417 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce78066d80 con 0x7fce5c006f10 2024-03-30T01:52:44.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.975+0000 7fce6f400640 1 -- 172.21.15.133:0/1446614417 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fce68026430 con 0x7fce5c006f10 2024-03-30T01:52:44.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.975+0000 7fce6f400640 1 --2- 172.21.15.133:0/1446614417 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fce5406ac30 0x7fce5406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:44.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.976+0000 7fce6f400640 1 -- 172.21.15.133:0/1446614417 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fce68089a90 con 0x7fce5c006f10 2024-03-30T01:52:44.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.976+0000 7fce6e000640 1 --2- 172.21.15.133:0/1446614417 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fce5406ac30 0x7fce5406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:44.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.976+0000 7fce6e000640 1 --2- 172.21.15.133:0/1446614417 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fce5406ac30 0x7fce5406d0f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fce60007fd0 tx=0x7fce60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:44.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:44.979+0000 7fce6f400640 1 -- 172.21.15.133:0/1446614417 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fce68054cb0 con 0x7fce5c006f10 2024-03-30T01:52:45.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.208+0000 7fce7d600640 1 -- 172.21.15.133:0/1446614417 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fce78142a40 con 0x7fce5c006f10 2024-03-30T01:52:45.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.219+0000 7fce6f400640 1 -- 172.21.15.133:0/1446614417 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7fce6800ce60 con 0x7fce5c006f10 2024-03-30T01:52:45.226 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 4 and data pool 5 2024-03-30T01:52:45.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.223+0000 7fce7d600640 1 -- 172.21.15.133:0/1446614417 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fce5406ac30 msgr2=0x7fce5406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:45.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.223+0000 7fce7d600640 1 --2- 172.21.15.133:0/1446614417 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fce5406ac30 0x7fce5406d0f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fce60007fd0 tx=0x7fce60009040 comp rx=0 tx=0).stop 2024-03-30T01:52:45.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.223+0000 7fce7d600640 1 -- 172.21.15.133:0/1446614417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce5c006f10 msgr2=0x7fce7815c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:45.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.223+0000 7fce7d600640 1 --2- 172.21.15.133:0/1446614417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce5c006f10 0x7fce7815c120 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fce6800e7f0 tx=0x7fce6800ecb0 comp rx=0 tx=0).stop 2024-03-30T01:52:45.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.225+0000 7fce7d600640 1 -- 172.21.15.133:0/1446614417 shutdown_connections 2024-03-30T01:52:45.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.225+0000 7fce7d600640 1 --2- 172.21.15.133:0/1446614417 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fce5406ac30 0x7fce5406d0f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:45.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.225+0000 7fce7d600640 1 --2- 172.21.15.133:0/1446614417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce78159de0 0x7fce7815ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:45.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.225+0000 7fce7d600640 1 --2- 172.21.15.133:0/1446614417 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce781365b0 0x7fce781edfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:45.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.225+0000 7fce7d600640 1 --2- 172.21.15.133:0/1446614417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce5c006f10 0x7fce7815c120 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:45.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.225+0000 7fce7d600640 1 -- 172.21.15.133:0/1446614417 >> 172.21.15.133:0/1446614417 conn(0x7fce780b07a0 msgr2=0x7fce78157fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:45.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.225+0000 7fce7d600640 1 -- 172.21.15.133:0/1446614417 shutdown_connections 2024-03-30T01:52:45.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.226+0000 7fce7d600640 1 -- 172.21.15.133:0/1446614417 wait complete. 2024-03-30T01:52:45.267 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:52:45.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.429+0000 7fcc38a00640 1 Processor -- start 2024-03-30T01:52:45.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.429+0000 7fcc38a00640 1 -- start start 2024-03-30T01:52:45.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.431+0000 7fcc38a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc34070500 0x7fcc34070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:45.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.431+0000 7fcc38a00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc340a76a0 con 0x7fcc340cc530 2024-03-30T01:52:45.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.431+0000 7fcc38a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc34070ea0 con 0x7fcc34143790 2024-03-30T01:52:45.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.431+0000 7fcc38a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc340b38e0 con 0x7fcc34070500 2024-03-30T01:52:45.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.431+0000 7fcc32800640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcc340cc530 0x7fcc340cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58274/0 (socket says 172.21.15.133:58274) 2024-03-30T01:52:45.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.431+0000 7fcc32800640 1 -- 172.21.15.133:0/2509907882 learned_addr learned my addr 172.21.15.133:0/2509907882 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:45.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.431+0000 7fcc31400640 1 --2- 172.21.15.133:0/2509907882 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc34070500 0x7fcc34070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:45.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.431+0000 7fcc30a00640 1 -- 172.21.15.133:0/2509907882 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2031036558 0 0) 0x7fcc340a76a0 con 0x7fcc340cc530 2024-03-30T01:52:45.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.431+0000 7fcc30a00640 1 -- 172.21.15.133:0/2509907882 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc18003520 con 0x7fcc340cc530 2024-03-30T01:52:45.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.432+0000 7fcc30a00640 1 -- 172.21.15.133:0/2509907882 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1705590162 0 0) 0x7fcc18003520 con 0x7fcc340cc530 2024-03-30T01:52:45.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.432+0000 7fcc30a00640 1 -- 172.21.15.133:0/2509907882 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc34070500 msgr2=0x7fcc34070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:45.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.432+0000 7fcc30a00640 1 --2- 172.21.15.133:0/2509907882 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc34070500 0x7fcc34070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:45.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.432+0000 7fcc30a00640 1 -- 172.21.15.133:0/2509907882 >> v1:172.21.15.137:6789/0 conn(0x7fcc34143790 legacy=0x7fcc340cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:45.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.432+0000 7fcc30a00640 1 -- 172.21.15.133:0/2509907882 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc340cd180 con 0x7fcc340cc530 2024-03-30T01:52:45.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.432+0000 7fcc30a00640 1 -- 172.21.15.133:0/2509907882 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fcc2c001670 con 0x7fcc340cc530 2024-03-30T01:52:45.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.432+0000 7fcc30a00640 1 -- 172.21.15.133:0/2509907882 >> v1:172.21.15.133:6789/0 conn(0x7fcc340cc530 legacy=0x7fcc340cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:45.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.432+0000 7fcc30a00640 1 --2- 172.21.15.133:0/2509907882 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc180039a0 0x7fcc18003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:45.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.432+0000 7fcc30a00640 1 --2- 172.21.15.133:0/2509907882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc180047c0 0x7fcc18004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:45.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.432+0000 7fcc30a00640 1 --2- 172.21.15.133:0/2509907882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc18005180 0x7fcc1800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:45.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.432+0000 7fcc30a00640 1 -- 172.21.15.133:0/2509907882 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc340b38e0 con 0x7fcc18005180 2024-03-30T01:52:45.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.432+0000 7fcc30a00640 1 -- 172.21.15.133:0/2509907882 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1800c060 con 0x7fcc180047c0 2024-03-30T01:52:45.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.432+0000 7fcc30a00640 1 -- 172.21.15.133:0/2509907882 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1800c220 con 0x7fcc180039a0 2024-03-30T01:52:45.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.432+0000 7fcc31400640 1 --2- 172.21.15.133:0/2509907882 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc34070500 0x7fcc34070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:52:45.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.432+0000 7fcc32800640 1 --2- 172.21.15.133:0/2509907882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc18005180 0x7fcc1800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:45.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.432+0000 7fcc31e00640 1 --2- 172.21.15.133:0/2509907882 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc180039a0 0x7fcc18003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:45.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.433+0000 7fcc32800640 1 -- 172.21.15.133:0/2509907882 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc180039a0 msgr2=0x7fcc18003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:45.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.433+0000 7fcc32800640 1 --2- 172.21.15.133:0/2509907882 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc180039a0 0x7fcc18003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:45.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.433+0000 7fcc32800640 1 -- 172.21.15.133:0/2509907882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc180047c0 msgr2=0x7fcc18004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:45.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.433+0000 7fcc32800640 1 --2- 172.21.15.133:0/2509907882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc180047c0 0x7fcc18004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:45.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.433+0000 7fcc32800640 1 -- 172.21.15.133:0/2509907882 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc18003520 con 0x7fcc18005180 2024-03-30T01:52:45.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.433+0000 7fcc31e00640 1 --2- 172.21.15.133:0/2509907882 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc180039a0 0x7fcc18003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:45.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.434+0000 7fcc32800640 1 --2- 172.21.15.133:0/2509907882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc18005180 0x7fcc1800b980 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00c0e0 tx=0x7fcc180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e312590606df88ca server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:45.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.434+0000 7fcc30a00640 1 -- 172.21.15.133:0/2509907882 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c005ad0 con 0x7fcc18005180 2024-03-30T01:52:45.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.434+0000 7fcc30a00640 1 -- 172.21.15.133:0/2509907882 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2c005c30 con 0x7fcc18005180 2024-03-30T01:52:45.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.434+0000 7fcc30a00640 1 -- 172.21.15.133:0/2509907882 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c02ca50 con 0x7fcc18005180 2024-03-30T01:52:45.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.434+0000 7fcc38a00640 1 -- 172.21.15.133:0/2509907882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc18005180 msgr2=0x7fcc1800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:45.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.434+0000 7fcc38a00640 1 --2- 172.21.15.133:0/2509907882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc18005180 0x7fcc1800b980 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00c0e0 tx=0x7fcc180057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:45.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.434+0000 7fcc32800640 1 -- 172.21.15.133:0/2509907882 reap_dead start 2024-03-30T01:52:45.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.434+0000 7fcc38a00640 1 -- 172.21.15.133:0/2509907882 shutdown_connections 2024-03-30T01:52:45.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.434+0000 7fcc38a00640 1 -- 172.21.15.133:0/2509907882 >> 172.21.15.133:0/2509907882 conn(0x7fcc340b07a0 msgr2=0x7fcc340b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:45.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.434+0000 7fcc38a00640 1 -- 172.21.15.133:0/2509907882 shutdown_connections 2024-03-30T01:52:45.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.434+0000 7fcc38a00640 1 -- 172.21.15.133:0/2509907882 wait complete. 2024-03-30T01:52:45.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.436+0000 7fcc38a00640 1 Processor -- start 2024-03-30T01:52:45.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.436+0000 7fcc38a00640 1 -- start start 2024-03-30T01:52:45.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.437+0000 7fcc38a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc18005180 0x7fcc340afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:45.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.437+0000 7fcc38a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc340ab0f0 0x7fcc340adae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:45.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.437+0000 7fcc38a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc340ae020 0x7fcc3412c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:45.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.437+0000 7fcc38a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc340a9e20 con 0x7fcc340ae020 2024-03-30T01:52:45.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.437+0000 7fcc38a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc340ae4a0 con 0x7fcc18005180 2024-03-30T01:52:45.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.437+0000 7fcc38a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc340a8e10 con 0x7fcc340ab0f0 2024-03-30T01:52:45.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.438+0000 7fcc32800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc340ae020 0x7fcc3412c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:45.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.438+0000 7fcc32800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc340ae020 0x7fcc3412c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56766/0 (socket says 172.21.15.133:56766) 2024-03-30T01:52:45.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.438+0000 7fcc32800640 1 -- 172.21.15.133:0/3273588879 learned_addr learned my addr 172.21.15.133:0/3273588879 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:45.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.438+0000 7fcc31400640 1 --2- 172.21.15.133:0/3273588879 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc340ab0f0 0x7fcc340adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:45.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.438+0000 7fcc31e00640 1 --2- 172.21.15.133:0/3273588879 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc18005180 0x7fcc340afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:45.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.438+0000 7fcc32800640 1 -- 172.21.15.133:0/3273588879 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc340ab0f0 msgr2=0x7fcc340adae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:45.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.438+0000 7fcc32800640 1 --2- 172.21.15.133:0/3273588879 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc340ab0f0 0x7fcc340adae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:45.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.438+0000 7fcc32800640 1 -- 172.21.15.133:0/3273588879 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc18005180 msgr2=0x7fcc340afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:45.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.438+0000 7fcc32800640 1 --2- 172.21.15.133:0/3273588879 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc18005180 0x7fcc340afd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:45.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.438+0000 7fcc32800640 1 -- 172.21.15.133:0/3273588879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc340a9060 con 0x7fcc340ae020 2024-03-30T01:52:45.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.438+0000 7fcc31e00640 1 --2- 172.21.15.133:0/3273588879 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc18005180 0x7fcc340afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:45.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.438+0000 7fcc32800640 1 --2- 172.21.15.133:0/3273588879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc340ae020 0x7fcc3412c1a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00c200 tx=0x7fcc2c02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:45.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.438+0000 7fcc2a000640 1 -- 172.21.15.133:0/3273588879 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c03c040 con 0x7fcc340ae020 2024-03-30T01:52:45.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.438+0000 7fcc2a000640 1 -- 172.21.15.133:0/3273588879 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2c02cc40 con 0x7fcc340ae020 2024-03-30T01:52:45.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.438+0000 7fcc38a00640 1 -- 172.21.15.133:0/3273588879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc340a9340 con 0x7fcc340ae020 2024-03-30T01:52:45.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.439+0000 7fcc2a000640 1 -- 172.21.15.133:0/3273588879 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c007070 con 0x7fcc340ae020 2024-03-30T01:52:45.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.439+0000 7fcc38a00640 1 -- 172.21.15.133:0/3273588879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc340a9900 con 0x7fcc340ae020 2024-03-30T01:52:45.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.440+0000 7fcc38a00640 1 -- 172.21.15.133:0/3273588879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc340a9b20 con 0x7fcc340ae020 2024-03-30T01:52:45.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.441+0000 7fcc2a000640 1 -- 172.21.15.133:0/3273588879 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fcc2c032070 con 0x7fcc340ae020 2024-03-30T01:52:45.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.441+0000 7fcc2a000640 1 --2- 172.21.15.133:0/3273588879 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fcc1406ac30 0x7fcc1406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:45.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.442+0000 7fcc2a000640 1 -- 172.21.15.133:0/3273588879 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc2c0aa280 con 0x7fcc340ae020 2024-03-30T01:52:45.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.442+0000 7fcc31e00640 1 --2- 172.21.15.133:0/3273588879 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fcc1406ac30 0x7fcc1406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:45.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.442+0000 7fcc31e00640 1 --2- 172.21.15.133:0/3273588879 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fcc1406ac30 0x7fcc1406d0f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcc240012e0 tx=0x7fcc24009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:45.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.446+0000 7fcc2a000640 1 -- 172.21.15.133:0/3273588879 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fcc2c0753c0 con 0x7fcc340ae020 2024-03-30T01:52:45.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.628+0000 7fcc38a00640 1 -- 172.21.15.133:0/3273588879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc34070c60 con 0x7fcc340ae020 2024-03-30T01:52:45.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.630+0000 7fcc2a000640 1 -- 172.21.15.133:0/3273588879 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16162 (secure 0 0 0) 0x7fcc2c0789e0 con 0x7fcc340ae020 2024-03-30T01:52:45.637 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:45.637 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":33,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:52:45.210563+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:52:43.357481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-30T01:52:44.221573+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:52:45.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.633+0000 7fcc38a00640 1 -- 172.21.15.133:0/3273588879 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fcc1406ac30 msgr2=0x7fcc1406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:45.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.633+0000 7fcc38a00640 1 --2- 172.21.15.133:0/3273588879 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fcc1406ac30 0x7fcc1406d0f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcc240012e0 tx=0x7fcc24009040 comp rx=0 tx=0).stop 2024-03-30T01:52:45.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.633+0000 7fcc38a00640 1 -- 172.21.15.133:0/3273588879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc340ae020 msgr2=0x7fcc3412c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:45.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.633+0000 7fcc38a00640 1 --2- 172.21.15.133:0/3273588879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc340ae020 0x7fcc3412c1a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00c200 tx=0x7fcc2c02e070 comp rx=0 tx=0).stop 2024-03-30T01:52:45.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.633+0000 7fcc38a00640 1 -- 172.21.15.133:0/3273588879 shutdown_connections 2024-03-30T01:52:45.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.633+0000 7fcc38a00640 1 --2- 172.21.15.133:0/3273588879 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fcc1406ac30 0x7fcc1406d0f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:45.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.633+0000 7fcc38a00640 1 --2- 172.21.15.133:0/3273588879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc340ae020 0x7fcc3412c1a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:45.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.633+0000 7fcc38a00640 1 --2- 172.21.15.133:0/3273588879 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc340ab0f0 0x7fcc340adae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:45.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.633+0000 7fcc38a00640 1 --2- 172.21.15.133:0/3273588879 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc18005180 0x7fcc340afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:45.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.633+0000 7fcc38a00640 1 -- 172.21.15.133:0/3273588879 >> 172.21.15.133:0/3273588879 conn(0x7fcc340b07a0 msgr2=0x7fcc34140db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:45.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.633+0000 7fcc38a00640 1 -- 172.21.15.133:0/3273588879 shutdown_connections 2024-03-30T01:52:45.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.633+0000 7fcc38a00640 1 -- 172.21.15.133:0/3273588879 wait complete. 2024-03-30T01:52:45.656 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:52:45.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.848+0000 7f9fb8800640 1 Processor -- start 2024-03-30T01:52:45.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.848+0000 7f9fb8800640 1 -- start start 2024-03-30T01:52:45.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.850+0000 7f9fb8800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9fb015cc50 0x7f9fb00d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:45.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.850+0000 7f9fb8800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9fb00cfb80 0x7f9fb00b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:45.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.850+0000 7f9fb8800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb015d030 con 0x7f9fb00d2240 2024-03-30T01:52:45.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.850+0000 7f9fb8800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb00d1c50 con 0x7f9fb00cfb80 2024-03-30T01:52:45.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.850+0000 7f9fb8800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb00b5af0 con 0x7f9fb015cc50 2024-03-30T01:52:45.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.850+0000 7f9fb5400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9fb00d2240 0x7f9fb00cf470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58282/0 (socket says 172.21.15.133:58282) 2024-03-30T01:52:45.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.850+0000 7f9fb5400640 1 -- 172.21.15.133:0/3087487370 learned_addr learned my addr 172.21.15.133:0/3087487370 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:45.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.850+0000 7f9fb6800640 1 --2- 172.21.15.133:0/3087487370 >> v2:172.21.15.133:3300/0 conn(0x7f9fb00cfb80 0x7f9fb00b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:45.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.851+0000 7f9fb4a00640 1 -- 172.21.15.133:0/3087487370 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2058543143 0 0) 0x7f9fb015d030 con 0x7f9fb00d2240 2024-03-30T01:52:45.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.851+0000 7f9fb4a00640 1 -- 172.21.15.133:0/3087487370 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f98003520 con 0x7f9fb00d2240 2024-03-30T01:52:45.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.851+0000 7f9fb6800640 1 -- 172.21.15.133:0/3087487370 >> v2:172.21.15.137:3300/0 conn(0x7f9fb015cc50 msgr2=0x7f9fb00d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:45.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.851+0000 7f9fb5e00640 1 --2- 172.21.15.133:0/3087487370 >> v2:172.21.15.137:3300/0 conn(0x7f9fb015cc50 0x7f9fb00d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:45.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.851+0000 7f9fb6800640 1 --2- 172.21.15.133:0/3087487370 >> v2:172.21.15.137:3300/0 conn(0x7f9fb015cc50 0x7f9fb00d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:45.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.851+0000 7f9fb6800640 1 -- 172.21.15.133:0/3087487370 >> v1:172.21.15.133:6789/0 conn(0x7f9fb00d2240 legacy=0x7f9fb00cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:45.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.851+0000 7f9fb6800640 1 -- 172.21.15.133:0/3087487370 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb00d10d0 con 0x7f9fb00cfb80 2024-03-30T01:52:45.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.851+0000 7f9fb5e00640 1 --2- 172.21.15.133:0/3087487370 >> v2:172.21.15.137:3300/0 conn(0x7f9fb015cc50 0x7f9fb00d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:45.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.852+0000 7f9fb6800640 1 --2- 172.21.15.133:0/3087487370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fb00cfb80 0x7f9fb00b14f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9fb00b5620 tx=0x7f9fac02bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1affbaf0aafb89 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:45.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.852+0000 7f9fb4a00640 1 -- 172.21.15.133:0/3087487370 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac02cc70 con 0x7f9fb00cfb80 2024-03-30T01:52:45.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.852+0000 7f9fb4a00640 1 -- 172.21.15.133:0/3087487370 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac02cdd0 con 0x7f9fb00cfb80 2024-03-30T01:52:45.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.852+0000 7f9fb4a00640 1 -- 172.21.15.133:0/3087487370 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac034660 con 0x7f9fb00cfb80 2024-03-30T01:52:45.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.853+0000 7f9fb8800640 1 -- 172.21.15.133:0/3087487370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fb00cfb80 msgr2=0x7f9fb00b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:45.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.853+0000 7f9fb8800640 1 --2- 172.21.15.133:0/3087487370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fb00cfb80 0x7f9fb00b14f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9fb00b5620 tx=0x7f9fac02bec0 comp rx=0 tx=0).stop 2024-03-30T01:52:45.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.853+0000 7f9fb8800640 1 -- 172.21.15.133:0/3087487370 shutdown_connections 2024-03-30T01:52:45.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.853+0000 7f9fb8800640 1 --2- 172.21.15.133:0/3087487370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fb00cfb80 0x7f9fb00b14f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:45.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.853+0000 7f9fb8800640 1 --2- 172.21.15.133:0/3087487370 >> v2:172.21.15.137:3300/0 conn(0x7f9fb015cc50 0x7f9fb00d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:45.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.853+0000 7f9fb8800640 1 -- 172.21.15.133:0/3087487370 >> 172.21.15.133:0/3087487370 conn(0x7f9fb0071a40 msgr2=0x7f9fb006b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:45.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.853+0000 7f9fb8800640 1 -- 172.21.15.133:0/3087487370 shutdown_connections 2024-03-30T01:52:45.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.853+0000 7f9fb8800640 1 -- 172.21.15.133:0/3087487370 wait complete. 2024-03-30T01:52:45.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.854+0000 7f9fb8800640 1 Processor -- start 2024-03-30T01:52:45.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.855+0000 7f9fb8800640 1 -- start start 2024-03-30T01:52:45.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.855+0000 7f9fb8800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fb00cfb80 0x7f9fb01551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:45.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.855+0000 7f9fb8800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fb00d2240 0x7f9fb00b6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:45.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.855+0000 7f9fb8800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fb015cc50 0x7f9fb00b7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:45.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.855+0000 7f9fb8800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb01556f0 con 0x7f9fb00cfb80 2024-03-30T01:52:45.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.855+0000 7f9fb8800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb0156be0 con 0x7f9fb015cc50 2024-03-30T01:52:45.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.855+0000 7f9fb8800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb01f23c0 con 0x7f9fb00d2240 2024-03-30T01:52:45.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.856+0000 7f9fb5e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fb00cfb80 0x7f9fb01551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:45.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.856+0000 7f9fb5e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fb00cfb80 0x7f9fb01551b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35360/0 (socket says 172.21.15.133:35360) 2024-03-30T01:52:45.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.856+0000 7f9fb5e00640 1 -- 172.21.15.133:0/4159897423 learned_addr learned my addr 172.21.15.133:0/4159897423 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:45.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.856+0000 7f9fb5e00640 1 -- 172.21.15.133:0/4159897423 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fb00d2240 msgr2=0x7f9fb00b6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:45.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.856+0000 7f9fb5e00640 1 --2- 172.21.15.133:0/4159897423 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fb00d2240 0x7f9fb00b6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:45.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.856+0000 7f9fb5e00640 1 -- 172.21.15.133:0/4159897423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fb015cc50 msgr2=0x7f9fb00b7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:45.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.856+0000 7f9fb5e00640 1 --2- 172.21.15.133:0/4159897423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fb015cc50 0x7f9fb00b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:45.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.856+0000 7f9fb5e00640 1 -- 172.21.15.133:0/4159897423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac009a70 con 0x7f9fb00cfb80 2024-03-30T01:52:45.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.856+0000 7f9fb5e00640 1 --2- 172.21.15.133:0/4159897423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fb00cfb80 0x7f9fb01551b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400c7f0 tx=0x7f9fa400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.857+0000 7f9faa000640 1 -- 172.21.15.133:0/4159897423 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4007820 con 0x7f9fb00cfb80 2024-03-30T01:52:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.857+0000 7f9faa000640 1 -- 172.21.15.133:0/4159897423 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa4007980 con 0x7f9fb00cfb80 2024-03-30T01:52:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.857+0000 7f9fb8800640 1 -- 172.21.15.133:0/4159897423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb01f26a0 con 0x7f9fb00cfb80 2024-03-30T01:52:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.857+0000 7f9faa000640 1 -- 172.21.15.133:0/4159897423 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4007cf0 con 0x7f9fb00cfb80 2024-03-30T01:52:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.857+0000 7f9fb8800640 1 -- 172.21.15.133:0/4159897423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb0156ec0 con 0x7f9fb00cfb80 2024-03-30T01:52:45.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.858+0000 7f9fb8800640 1 -- 172.21.15.133:0/4159897423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb01f21f0 con 0x7f9fb00cfb80 2024-03-30T01:52:45.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.859+0000 7f9faa000640 1 -- 172.21.15.133:0/4159897423 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9fa40113f0 con 0x7f9fb00cfb80 2024-03-30T01:52:45.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.859+0000 7f9faa000640 1 --2- 172.21.15.133:0/4159897423 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9f9406ac50 0x7f9f9406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:45.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.860+0000 7f9faa000640 1 -- 172.21.15.133:0/4159897423 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fa4089690 con 0x7f9fb00cfb80 2024-03-30T01:52:45.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.860+0000 7f9fb5400640 1 --2- 172.21.15.133:0/4159897423 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9f9406ac50 0x7f9f9406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:45.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.860+0000 7f9fb5400640 1 --2- 172.21.15.133:0/4159897423 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9f9406ac50 0x7f9f9406d110 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9fb00b4ae0 tx=0x7f9fa0007930 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:45.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:45.864+0000 7f9faa000640 1 -- 172.21.15.133:0/4159897423 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f9fa4054850 con 0x7f9fb00cfb80 2024-03-30T01:52:46.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.053+0000 7f9fb8800640 1 -- 172.21.15.133:0/4159897423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fb0066d80 con 0x7f9fb00cfb80 2024-03-30T01:52:46.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.055+0000 7f9faa000640 1 -- 172.21.15.133:0/4159897423 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16162 (secure 0 0 0) 0x7f9fa4057e70 con 0x7f9fb00cfb80 2024-03-30T01:52:46.062 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:46.062 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":33,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:52:45.210563+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:52:43.357481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-30T01:52:44.221573+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:52:46.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.058+0000 7f9fb8800640 1 -- 172.21.15.133:0/4159897423 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9f9406ac50 msgr2=0x7f9f9406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:46.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.058+0000 7f9fb8800640 1 --2- 172.21.15.133:0/4159897423 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9f9406ac50 0x7f9f9406d110 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9fb00b4ae0 tx=0x7f9fa0007930 comp rx=0 tx=0).stop 2024-03-30T01:52:46.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.058+0000 7f9fb8800640 1 -- 172.21.15.133:0/4159897423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fb00cfb80 msgr2=0x7f9fb01551b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:46.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.058+0000 7f9fb8800640 1 --2- 172.21.15.133:0/4159897423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fb00cfb80 0x7f9fb01551b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400c7f0 tx=0x7f9fa400ccb0 comp rx=0 tx=0).stop 2024-03-30T01:52:46.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.058+0000 7f9fb8800640 1 -- 172.21.15.133:0/4159897423 shutdown_connections 2024-03-30T01:52:46.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.058+0000 7f9fb8800640 1 --2- 172.21.15.133:0/4159897423 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9f9406ac50 0x7f9f9406d110 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:46.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.058+0000 7f9fb8800640 1 --2- 172.21.15.133:0/4159897423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fb015cc50 0x7f9fb00b7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:46.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.058+0000 7f9fb8800640 1 --2- 172.21.15.133:0/4159897423 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fb00d2240 0x7f9fb00b6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:46.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.058+0000 7f9fb8800640 1 --2- 172.21.15.133:0/4159897423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fb00cfb80 0x7f9fb01551b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:46.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.058+0000 7f9fb8800640 1 -- 172.21.15.133:0/4159897423 >> 172.21.15.133:0/4159897423 conn(0x7f9fb0071a40 msgr2=0x7f9fb006b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:46.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.058+0000 7f9fb8800640 1 -- 172.21.15.133:0/4159897423 shutdown_connections 2024-03-30T01:52:46.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.058+0000 7f9fb8800640 1 -- 172.21.15.133:0/4159897423 wait complete. 2024-03-30T01:52:46.083 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-30T01:52:46.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.282+0000 7fe026200640 1 Processor -- start 2024-03-30T01:52:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.282+0000 7fe026200640 1 -- start start 2024-03-30T01:52:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.284+0000 7fe026200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe020143790 0x7fe0200cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.284+0000 7fe026200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0200a76a0 con 0x7fe020070500 2024-03-30T01:52:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.284+0000 7fe026200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0200b38e0 con 0x7fe0200ccc40 2024-03-30T01:52:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.284+0000 7fe026200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0200cd180 con 0x7fe020143790 2024-03-30T01:52:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.284+0000 7fe016a00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe020070500 0x7fe0200cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47724/0 (socket says 172.21.15.133:47724) 2024-03-30T01:52:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.284+0000 7fe016a00640 1 -- 172.21.15.133:0/693238095 learned_addr learned my addr 172.21.15.133:0/693238095 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:46.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.284+0000 7fe01ea00640 1 -- 172.21.15.133:0/693238095 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2276317375 0 0) 0x7fe0200a76a0 con 0x7fe020070500 2024-03-30T01:52:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.284+0000 7fe01f400640 1 --2- 172.21.15.133:0/693238095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe020143790 0x7fe0200cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.284+0000 7fe01ea00640 1 -- 172.21.15.133:0/693238095 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe004003520 con 0x7fe020070500 2024-03-30T01:52:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.285+0000 7fe01ea00640 1 -- 172.21.15.133:0/693238095 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3295818140 0 0) 0x7fe004003520 con 0x7fe020070500 2024-03-30T01:52:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.285+0000 7fe01ea00640 1 -- 172.21.15.133:0/693238095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe020143790 msgr2=0x7fe0200cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.285+0000 7fe01ea00640 1 --2- 172.21.15.133:0/693238095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe020143790 0x7fe0200cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.285+0000 7fe01ea00640 1 -- 172.21.15.133:0/693238095 >> v1:172.21.15.137:6789/0 conn(0x7fe0200ccc40 legacy=0x7fe02015ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.285+0000 7fe01ea00640 1 -- 172.21.15.133:0/693238095 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0200cd460 con 0x7fe020070500 2024-03-30T01:52:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.285+0000 7fe01ea00640 1 -- 172.21.15.133:0/693238095 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fe008001670 con 0x7fe020070500 2024-03-30T01:52:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.285+0000 7fe01ea00640 1 -- 172.21.15.133:0/693238095 >> v1:172.21.15.133:6789/0 conn(0x7fe020070500 legacy=0x7fe0200cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.285+0000 7fe01ea00640 1 --2- 172.21.15.133:0/693238095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0040039a0 0x7fe004003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.285+0000 7fe01ea00640 1 --2- 172.21.15.133:0/693238095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe020143790 0x7fe0040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.285+0000 7fe01ea00640 1 --2- 172.21.15.133:0/693238095 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe004004d00 0x7fe004005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.285+0000 7fe01ea00640 1 -- 172.21.15.133:0/693238095 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0200cd180 con 0x7fe004004d00 2024-03-30T01:52:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.285+0000 7fe01ea00640 1 -- 172.21.15.133:0/693238095 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00400bbf0 con 0x7fe0040039a0 2024-03-30T01:52:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.285+0000 7fe01ea00640 1 -- 172.21.15.133:0/693238095 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00400bdb0 con 0x7fe020143790 2024-03-30T01:52:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.285+0000 7fe01fe00640 1 --2- 172.21.15.133:0/693238095 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe004004d00 0x7fe004005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.286+0000 7fe01f400640 1 --2- 172.21.15.133:0/693238095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0040039a0 0x7fe004003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.286+0000 7fe01fe00640 1 -- 172.21.15.133:0/693238095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe020143790 msgr2=0x7fe0040047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.286+0000 7fe01fe00640 1 --2- 172.21.15.133:0/693238095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe020143790 0x7fe0040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.286+0000 7fe01fe00640 1 -- 172.21.15.133:0/693238095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0040039a0 msgr2=0x7fe004003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.286+0000 7fe01fe00640 1 --2- 172.21.15.133:0/693238095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0040039a0 0x7fe004003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.286+0000 7fe01fe00640 1 -- 172.21.15.133:0/693238095 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe004003520 con 0x7fe004004d00 2024-03-30T01:52:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.287+0000 7fe01fe00640 1 --2- 172.21.15.133:0/693238095 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe004004d00 0x7fe004005180 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe018001e20 tx=0x7fe0040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3046da1d36189833 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.287+0000 7fe01ea00640 1 -- 172.21.15.133:0/693238095 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe018003b70 con 0x7fe004004d00 2024-03-30T01:52:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.287+0000 7fe01ea00640 1 -- 172.21.15.133:0/693238095 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe018003cd0 con 0x7fe004004d00 2024-03-30T01:52:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.287+0000 7fe01ea00640 1 -- 172.21.15.133:0/693238095 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe018005310 con 0x7fe004004d00 2024-03-30T01:52:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.287+0000 7fe026200640 1 -- 172.21.15.133:0/693238095 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe004004d00 msgr2=0x7fe004005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.287+0000 7fe026200640 1 --2- 172.21.15.133:0/693238095 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe004004d00 0x7fe004005180 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe018001e20 tx=0x7fe0040057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.287+0000 7fe01fe00640 1 -- 172.21.15.133:0/693238095 reap_dead start 2024-03-30T01:52:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.288+0000 7fe026200640 1 -- 172.21.15.133:0/693238095 shutdown_connections 2024-03-30T01:52:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.288+0000 7fe026200640 1 -- 172.21.15.133:0/693238095 >> 172.21.15.133:0/693238095 conn(0x7fe0200b07a0 msgr2=0x7fe0200b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.288+0000 7fe026200640 1 -- 172.21.15.133:0/693238095 shutdown_connections 2024-03-30T01:52:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.288+0000 7fe026200640 1 -- 172.21.15.133:0/693238095 wait complete. 2024-03-30T01:52:46.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.289+0000 7fe026200640 1 Processor -- start 2024-03-30T01:52:46.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.289+0000 7fe026200640 1 -- start start 2024-03-30T01:52:46.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.290+0000 7fe026200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe004004d00 0x7fe0200a7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:46.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.290+0000 7fe026200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe02015a6a0 0x7fe020142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:46.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.290+0000 7fe026200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe020142bb0 0x7fe0200c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:46.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.290+0000 7fe026200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0200a7b70 con 0x7fe02015a6a0 2024-03-30T01:52:46.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.290+0000 7fe026200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe020143030 con 0x7fe004004d00 2024-03-30T01:52:46.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.290+0000 7fe026200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02013cc40 con 0x7fe020142bb0 2024-03-30T01:52:46.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.291+0000 7fe016a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe02015a6a0 0x7fe020142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:46.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.291+0000 7fe016a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe02015a6a0 0x7fe020142670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35378/0 (socket says 172.21.15.133:35378) 2024-03-30T01:52:46.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.291+0000 7fe016a00640 1 -- 172.21.15.133:0/2904083897 learned_addr learned my addr 172.21.15.133:0/2904083897 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:46.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.291+0000 7fe016a00640 1 -- 172.21.15.133:0/2904083897 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe020142bb0 msgr2=0x7fe0200c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:46.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.291+0000 7fe016a00640 1 --2- 172.21.15.133:0/2904083897 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe020142bb0 0x7fe0200c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:46.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.291+0000 7fe016a00640 1 -- 172.21.15.133:0/2904083897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe004004d00 msgr2=0x7fe0200a7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:46.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.291+0000 7fe016a00640 1 --2- 172.21.15.133:0/2904083897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe004004d00 0x7fe0200a7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:46.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.291+0000 7fe016a00640 1 -- 172.21.15.133:0/2904083897 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0200b00f0 con 0x7fe02015a6a0 2024-03-30T01:52:46.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.291+0000 7fe016a00640 1 --2- 172.21.15.133:0/2904083897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe02015a6a0 0x7fe020142670 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe00800c730 tx=0x7fe00800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:46.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.291+0000 7fe017e00640 1 -- 172.21.15.133:0/2904083897 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0080074e0 con 0x7fe02015a6a0 2024-03-30T01:52:46.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.291+0000 7fe017e00640 1 -- 172.21.15.133:0/2904083897 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe008007640 con 0x7fe02015a6a0 2024-03-30T01:52:46.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.291+0000 7fe017e00640 1 -- 172.21.15.133:0/2904083897 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0080049e0 con 0x7fe02015a6a0 2024-03-30T01:52:46.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.291+0000 7fe026200640 1 -- 172.21.15.133:0/2904083897 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0200c8760 con 0x7fe02015a6a0 2024-03-30T01:52:46.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.292+0000 7fe026200640 1 -- 172.21.15.133:0/2904083897 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0200c8d20 con 0x7fe02015a6a0 2024-03-30T01:52:46.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.293+0000 7fe026200640 1 -- 172.21.15.133:0/2904083897 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0200c85a0 con 0x7fe02015a6a0 2024-03-30T01:52:46.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.294+0000 7fe017e00640 1 -- 172.21.15.133:0/2904083897 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe008004b40 con 0x7fe02015a6a0 2024-03-30T01:52:46.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.294+0000 7fe017e00640 1 --2- 172.21.15.133:0/2904083897 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdffc06ac30 0x7fdffc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:46.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.294+0000 7fe017e00640 1 -- 172.21.15.133:0/2904083897 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0080886e0 con 0x7fe02015a6a0 2024-03-30T01:52:46.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.295+0000 7fe01f400640 1 --2- 172.21.15.133:0/2904083897 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdffc06ac30 0x7fdffc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:46.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.295+0000 7fe01f400640 1 --2- 172.21.15.133:0/2904083897 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdffc06ac30 0x7fdffc06d0f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe010006fd0 tx=0x7fe01000b2e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:46.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.299+0000 7fe017e00640 1 -- 172.21.15.133:0/2904083897 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fe0080538c0 con 0x7fe02015a6a0 2024-03-30T01:52:46.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:46.518+0000 7fe026200640 1 -- 172.21.15.133:0/2904083897 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe0200c8f40 con 0x7fe02015a6a0 2024-03-30T01:52:47.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.233+0000 7fe017e00640 1 -- 172.21.15.133:0/2904083897 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe0080180b0 con 0x7fe02015a6a0 2024-03-30T01:52:47.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.236+0000 7fe026200640 1 -- 172.21.15.133:0/2904083897 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdffc06ac30 msgr2=0x7fdffc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:47.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.236+0000 7fe026200640 1 --2- 172.21.15.133:0/2904083897 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdffc06ac30 0x7fdffc06d0f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe010006fd0 tx=0x7fe01000b2e0 comp rx=0 tx=0).stop 2024-03-30T01:52:47.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.236+0000 7fe026200640 1 -- 172.21.15.133:0/2904083897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe02015a6a0 msgr2=0x7fe020142670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:47.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.236+0000 7fe026200640 1 --2- 172.21.15.133:0/2904083897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe02015a6a0 0x7fe020142670 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe00800c730 tx=0x7fe00800cbf0 comp rx=0 tx=0).stop 2024-03-30T01:52:47.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.236+0000 7fe026200640 1 -- 172.21.15.133:0/2904083897 shutdown_connections 2024-03-30T01:52:47.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.236+0000 7fe026200640 1 --2- 172.21.15.133:0/2904083897 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fdffc06ac30 0x7fdffc06d0f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:47.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.236+0000 7fe026200640 1 --2- 172.21.15.133:0/2904083897 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe020142bb0 0x7fe0200c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:47.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.236+0000 7fe026200640 1 --2- 172.21.15.133:0/2904083897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe02015a6a0 0x7fe020142670 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:47.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.236+0000 7fe026200640 1 --2- 172.21.15.133:0/2904083897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe004004d00 0x7fe0200a7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:47.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.236+0000 7fe026200640 1 -- 172.21.15.133:0/2904083897 >> 172.21.15.133:0/2904083897 conn(0x7fe0200b07a0 msgr2=0x7fe02006dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:47.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.236+0000 7fe026200640 1 -- 172.21.15.133:0/2904083897 shutdown_connections 2024-03-30T01:52:47.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.236+0000 7fe026200640 1 -- 172.21.15.133:0/2904083897 wait complete. 2024-03-30T01:52:47.262 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-30T01:52:47.262 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-30T01:52:47.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.466+0000 7f8314a00640 1 Processor -- start 2024-03-30T01:52:47.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.467+0000 7f8314a00640 1 -- start start 2024-03-30T01:52:47.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.468+0000 7f8314a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f83100d0af0 0x7f83100cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:47.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.468+0000 7f8314a00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f831015d030 con 0x7f83100cf9b0 2024-03-30T01:52:47.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.468+0000 7f8314a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83100cfe20 con 0x7f831015cc50 2024-03-30T01:52:47.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.468+0000 7f8314a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83100d1c50 con 0x7f83100d0af0 2024-03-30T01:52:47.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.468+0000 7f830e800640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f83100cf9b0 0x7f83100b14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47738/0 (socket says 172.21.15.133:47738) 2024-03-30T01:52:47.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.468+0000 7f830e800640 1 -- 172.21.15.133:0/922261762 learned_addr learned my addr 172.21.15.133:0/922261762 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:47.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.469+0000 7f830d400640 1 --2- 172.21.15.133:0/922261762 >> v2:172.21.15.137:3300/0 conn(0x7f83100d0af0 0x7f83100cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:47.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.469+0000 7f830ca00640 1 -- 172.21.15.133:0/922261762 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1771357421 0 0) 0x7f831015d030 con 0x7f83100cf9b0 2024-03-30T01:52:47.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.469+0000 7f830ca00640 1 -- 172.21.15.133:0/922261762 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82f4003520 con 0x7f83100cf9b0 2024-03-30T01:52:47.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.469+0000 7f830ca00640 1 -- 172.21.15.133:0/922261762 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3390098657 0 0) 0x7f82f4003520 con 0x7f83100cf9b0 2024-03-30T01:52:47.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.469+0000 7f830ca00640 1 -- 172.21.15.133:0/922261762 >> v2:172.21.15.137:3300/0 conn(0x7f83100d0af0 msgr2=0x7f83100cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:47.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.469+0000 7f830ca00640 1 --2- 172.21.15.133:0/922261762 >> v2:172.21.15.137:3300/0 conn(0x7f83100d0af0 0x7f83100cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:47.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.469+0000 7f830ca00640 1 -- 172.21.15.133:0/922261762 >> v1:172.21.15.137:6789/0 conn(0x7f831015cc50 legacy=0x7f83100d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:47.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.469+0000 7f830ca00640 1 -- 172.21.15.133:0/922261762 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83100b5af0 con 0x7f83100cf9b0 2024-03-30T01:52:47.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.469+0000 7f830ca00640 1 -- 172.21.15.133:0/922261762 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f8308001a10 con 0x7f83100cf9b0 2024-03-30T01:52:47.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.469+0000 7f830ca00640 1 -- 172.21.15.133:0/922261762 >> v1:172.21.15.133:6789/0 conn(0x7f83100cf9b0 legacy=0x7f83100b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:47.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.469+0000 7f830ca00640 1 --2- 172.21.15.133:0/922261762 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82f4003970 0x7f82f4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:47.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.470+0000 7f830ca00640 1 --2- 172.21.15.133:0/922261762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82f40047c0 0x7f82f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:47.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.470+0000 7f830ca00640 1 --2- 172.21.15.133:0/922261762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82f4005180 0x7f82f400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:47.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.470+0000 7f830ca00640 1 -- 172.21.15.133:0/922261762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83100d1c50 con 0x7f82f40047c0 2024-03-30T01:52:47.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.470+0000 7f830ca00640 1 -- 172.21.15.133:0/922261762 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f400c020 con 0x7f82f4005180 2024-03-30T01:52:47.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.470+0000 7f830ca00640 1 -- 172.21.15.133:0/922261762 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f400c1e0 con 0x7f82f4003970 2024-03-30T01:52:47.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.470+0000 7f830d400640 1 --2- 172.21.15.133:0/922261762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82f40047c0 0x7f82f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:47.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.470+0000 7f830de00640 1 --2- 172.21.15.133:0/922261762 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82f4003970 0x7f82f4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:47.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.470+0000 7f830e800640 1 --2- 172.21.15.133:0/922261762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82f4005180 0x7f82f400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:47.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.470+0000 7f830d400640 1 -- 172.21.15.133:0/922261762 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82f4003970 msgr2=0x7f82f4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:47.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.470+0000 7f830d400640 1 --2- 172.21.15.133:0/922261762 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82f4003970 0x7f82f4003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:47.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.470+0000 7f830d400640 1 -- 172.21.15.133:0/922261762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82f4005180 msgr2=0x7f82f400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:47.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.470+0000 7f830d400640 1 --2- 172.21.15.133:0/922261762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82f4005180 0x7f82f400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:47.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.470+0000 7f830e800640 1 -- 172.21.15.133:0/922261762 reap_dead start 2024-03-30T01:52:47.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.470+0000 7f830d400640 1 -- 172.21.15.133:0/922261762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f4003520 con 0x7f82f40047c0 2024-03-30T01:52:47.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.471+0000 7f830d400640 1 --2- 172.21.15.133:0/922261762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82f40047c0 0x7f82f4004c40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f82f8009ac0 tx=0x7f82f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb97b4d8dba10d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:47.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.471+0000 7f830ca00640 1 -- 172.21.15.133:0/922261762 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f802c6b0 con 0x7f82f40047c0 2024-03-30T01:52:47.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.471+0000 7f830ca00640 1 -- 172.21.15.133:0/922261762 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f802c810 con 0x7f82f40047c0 2024-03-30T01:52:47.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.471+0000 7f830ca00640 1 -- 172.21.15.133:0/922261762 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f802cba0 con 0x7f82f40047c0 2024-03-30T01:52:47.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.472+0000 7f8314a00640 1 -- 172.21.15.133:0/922261762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82f40047c0 msgr2=0x7f82f4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:47.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.472+0000 7f8314a00640 1 --2- 172.21.15.133:0/922261762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82f40047c0 0x7f82f4004c40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f82f8009ac0 tx=0x7f82f40057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:47.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.472+0000 7f8314a00640 1 -- 172.21.15.133:0/922261762 shutdown_connections 2024-03-30T01:52:47.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.472+0000 7f8314a00640 1 --2- 172.21.15.133:0/922261762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82f40047c0 0x7f82f4004c40 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:47.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.472+0000 7f8314a00640 1 -- 172.21.15.133:0/922261762 >> 172.21.15.133:0/922261762 conn(0x7f8310071a40 msgr2=0x7f831006b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:47.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.472+0000 7f8314a00640 1 -- 172.21.15.133:0/922261762 shutdown_connections 2024-03-30T01:52:47.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.472+0000 7f8314a00640 1 -- 172.21.15.133:0/922261762 wait complete. 2024-03-30T01:52:47.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.474+0000 7f8314a00640 1 Processor -- start 2024-03-30T01:52:47.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.474+0000 7f8314a00640 1 -- start start 2024-03-30T01:52:47.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.475+0000 7f8314a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82f40047c0 0x7f83101523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:47.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.475+0000 7f8314a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8310157630 0x7f8310148c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:47.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.475+0000 7f8314a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83100c63b0 0x7f831015e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:47.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.475+0000 7f8314a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8310154d20 con 0x7f8310157630 2024-03-30T01:52:47.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.475+0000 7f8314a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8310152200 con 0x7f83100c63b0 2024-03-30T01:52:47.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.475+0000 7f8314a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8310157ab0 con 0x7f82f40047c0 2024-03-30T01:52:47.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.475+0000 7f830d400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8310157630 0x7f8310148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:47.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.475+0000 7f830d400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8310157630 0x7f8310148c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35400/0 (socket says 172.21.15.133:35400) 2024-03-30T01:52:47.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.475+0000 7f830d400640 1 -- 172.21.15.133:0/539404718 learned_addr learned my addr 172.21.15.133:0/539404718 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:47.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.475+0000 7f830de00640 1 --2- 172.21.15.133:0/539404718 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82f40047c0 0x7f83101523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:47.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.476+0000 7f830d400640 1 -- 172.21.15.133:0/539404718 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82f40047c0 msgr2=0x7f83101523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:47.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.476+0000 7f830d400640 1 --2- 172.21.15.133:0/539404718 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82f40047c0 0x7f83101523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:47.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.476+0000 7f830d400640 1 -- 172.21.15.133:0/539404718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83100c63b0 msgr2=0x7f831015e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:47.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.476+0000 7f830e800640 1 --2- 172.21.15.133:0/539404718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83100c63b0 0x7f831015e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:47.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.476+0000 7f830d400640 1 --2- 172.21.15.133:0/539404718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83100c63b0 0x7f831015e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:47.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.476+0000 7f830d400640 1 -- 172.21.15.133:0/539404718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83101540a0 con 0x7f8310157630 2024-03-30T01:52:47.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.476+0000 7f830de00640 1 --2- 172.21.15.133:0/539404718 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82f40047c0 0x7f83101523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:47.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.476+0000 7f830d400640 1 --2- 172.21.15.133:0/539404718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8310157630 0x7f8310148c30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f82f802c250 tx=0x7f82f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:47.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.476+0000 7f8306000640 1 -- 172.21.15.133:0/539404718 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8003810 con 0x7f8310157630 2024-03-30T01:52:47.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.476+0000 7f8306000640 1 -- 172.21.15.133:0/539404718 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f8003970 con 0x7f8310157630 2024-03-30T01:52:47.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.476+0000 7f8306000640 1 -- 172.21.15.133:0/539404718 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8003d00 con 0x7f8310157630 2024-03-30T01:52:47.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.476+0000 7f8314a00640 1 -- 172.21.15.133:0/539404718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8310154380 con 0x7f8310157630 2024-03-30T01:52:47.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.477+0000 7f8314a00640 1 -- 172.21.15.133:0/539404718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8310154940 con 0x7f8310157630 2024-03-30T01:52:47.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.478+0000 7f8314a00640 1 -- 172.21.15.133:0/539404718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8310066d80 con 0x7f8310157630 2024-03-30T01:52:47.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.478+0000 7f8306000640 1 -- 172.21.15.133:0/539404718 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f82f8034440 con 0x7f8310157630 2024-03-30T01:52:47.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.479+0000 7f8306000640 1 --2- 172.21.15.133:0/539404718 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f82ec06ac30 0x7f82ec06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:47.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.479+0000 7f8306000640 1 -- 172.21.15.133:0/539404718 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82f80ab750 con 0x7f8310157630 2024-03-30T01:52:47.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.480+0000 7f830de00640 1 --2- 172.21.15.133:0/539404718 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f82ec06ac30 0x7f82ec06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:47.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.480+0000 7f830de00640 1 --2- 172.21.15.133:0/539404718 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f82ec06ac30 0x7f82ec06d0f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8310072b00 tx=0x7f8300009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:47.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.484+0000 7f8306000640 1 -- 172.21.15.133:0/539404718 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f82f8076af0 con 0x7f8310157630 2024-03-30T01:52:47.710 INFO:tasks.ceph.mds.a.smithi133.stderr:2024-03-30T01:52:47.704+0000 7f1384800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-30T01:52:47.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:47.720+0000 7f8314a00640 1 -- 172.21.15.133:0/539404718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f83100ca570 con 0x7f8310157630 2024-03-30T01:52:48.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.247+0000 7f8306000640 1 -- 172.21.15.133:0/539404718 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f82f8003e60 con 0x7f8310157630 2024-03-30T01:52:48.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.251+0000 7f8314a00640 1 -- 172.21.15.133:0/539404718 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f82ec06ac30 msgr2=0x7f82ec06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:48.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.251+0000 7f8314a00640 1 --2- 172.21.15.133:0/539404718 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f82ec06ac30 0x7f82ec06d0f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8310072b00 tx=0x7f8300009040 comp rx=0 tx=0).stop 2024-03-30T01:52:48.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.251+0000 7f8314a00640 1 -- 172.21.15.133:0/539404718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8310157630 msgr2=0x7f8310148c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:48.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.251+0000 7f8314a00640 1 --2- 172.21.15.133:0/539404718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8310157630 0x7f8310148c30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f82f802c250 tx=0x7f82f8004730 comp rx=0 tx=0).stop 2024-03-30T01:52:48.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.251+0000 7f8314a00640 1 -- 172.21.15.133:0/539404718 shutdown_connections 2024-03-30T01:52:48.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.251+0000 7f8314a00640 1 --2- 172.21.15.133:0/539404718 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f82ec06ac30 0x7f82ec06d0f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:48.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.251+0000 7f8314a00640 1 --2- 172.21.15.133:0/539404718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83100c63b0 0x7f831015e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:48.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.251+0000 7f8314a00640 1 --2- 172.21.15.133:0/539404718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8310157630 0x7f8310148c30 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:48.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.251+0000 7f8314a00640 1 --2- 172.21.15.133:0/539404718 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82f40047c0 0x7f83101523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:48.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.251+0000 7f8314a00640 1 -- 172.21.15.133:0/539404718 >> 172.21.15.133:0/539404718 conn(0x7f8310071a40 msgr2=0x7f83100caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:48.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.251+0000 7f8314a00640 1 -- 172.21.15.133:0/539404718 shutdown_connections 2024-03-30T01:52:48.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.251+0000 7f8314a00640 1 -- 172.21.15.133:0/539404718 wait complete. 2024-03-30T01:52:48.277 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-30T01:52:48.277 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T01:52:48.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.477+0000 7f47a7e00640 1 Processor -- start 2024-03-30T01:52:48.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.478+0000 7f47a7e00640 1 -- start start 2024-03-30T01:52:48.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.479+0000 7f47a7e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f47a815cac0 0x7f47a8160670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:48.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.479+0000 7f47a7e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f47a8160bb0 0x7f47a80cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:48.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.479+0000 7f47a7e00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a80b5b50 con 0x7f47a80cdbe0 2024-03-30T01:52:48.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.479+0000 7f47a7e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a80d1020 con 0x7f47a815cac0 2024-03-30T01:52:48.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.479+0000 7f47a7e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a80ce010 con 0x7f47a8160bb0 2024-03-30T01:52:48.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.479+0000 7f47a6a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f47a815cac0 0x7f47a8160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:48.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.479+0000 7f47a6a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f47a815cac0 0x7f47a8160670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35404/0 (socket says 172.21.15.133:35404) 2024-03-30T01:52:48.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.479+0000 7f47a6a00640 1 -- 172.21.15.133:0/159989340 learned_addr learned my addr 172.21.15.133:0/159989340 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:48.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.479+0000 7f47a7400640 1 --1- 172.21.15.133:0/159989340 >> v1:172.21.15.133:6789/0 conn(0x7f47a80cdbe0 0x7f47a806b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47754/0 (socket says 172.21.15.133:47754) 2024-03-30T01:52:48.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.480+0000 7f47a6a00640 1 -- 172.21.15.133:0/159989340 >> v2:172.21.15.137:3300/0 conn(0x7f47a8160bb0 msgr2=0x7f47a80cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:48.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.480+0000 7f47a6a00640 1 --2- 172.21.15.133:0/159989340 >> v2:172.21.15.137:3300/0 conn(0x7f47a8160bb0 0x7f47a80cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:48.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.480+0000 7f47a6a00640 1 -- 172.21.15.133:0/159989340 >> v1:172.21.15.133:6789/0 conn(0x7f47a80cdbe0 legacy=0x7f47a806b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:48.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.480+0000 7f47a6a00640 1 -- 172.21.15.133:0/159989340 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a8161100 con 0x7f47a815cac0 2024-03-30T01:52:48.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.481+0000 7f47a6a00640 1 --2- 172.21.15.133:0/159989340 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a815cac0 0x7f47a8160670 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f47a806c230 tx=0x7f479802b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dcaa46fcebb45c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:48.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.481+0000 7f47a5600640 1 -- 172.21.15.133:0/159989340 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798030870 con 0x7f47a815cac0 2024-03-30T01:52:48.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.481+0000 7f47a5600640 1 -- 172.21.15.133:0/159989340 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47980309d0 con 0x7f47a815cac0 2024-03-30T01:52:48.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.481+0000 7f47a5600640 1 -- 172.21.15.133:0/159989340 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798030d60 con 0x7f47a815cac0 2024-03-30T01:52:48.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.481+0000 7f47a7e00640 1 -- 172.21.15.133:0/159989340 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a815cac0 msgr2=0x7f47a8160670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:48.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.481+0000 7f47a7e00640 1 --2- 172.21.15.133:0/159989340 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a815cac0 0x7f47a8160670 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f47a806c230 tx=0x7f479802b9b0 comp rx=0 tx=0).stop 2024-03-30T01:52:48.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.482+0000 7f47a7e00640 1 -- 172.21.15.133:0/159989340 shutdown_connections 2024-03-30T01:52:48.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.482+0000 7f47a7e00640 1 --2- 172.21.15.133:0/159989340 >> v2:172.21.15.137:3300/0 conn(0x7f47a8160bb0 0x7f47a80cd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:48.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.482+0000 7f47a7e00640 1 --2- 172.21.15.133:0/159989340 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a815cac0 0x7f47a8160670 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:48.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.482+0000 7f47a7e00640 1 -- 172.21.15.133:0/159989340 >> 172.21.15.133:0/159989340 conn(0x7f47a80cf770 msgr2=0x7f47a80cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:48.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.482+0000 7f47a7e00640 1 -- 172.21.15.133:0/159989340 shutdown_connections 2024-03-30T01:52:48.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.482+0000 7f47a7e00640 1 -- 172.21.15.133:0/159989340 wait complete. 2024-03-30T01:52:48.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.483+0000 7f47a7e00640 1 Processor -- start 2024-03-30T01:52:48.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.483+0000 7f47a7e00640 1 -- start start 2024-03-30T01:52:48.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.484+0000 7f47a7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a80cdbe0 0x7f47a81f3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:48.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.484+0000 7f47a7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47a815cac0 0x7f47a8150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:48.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.484+0000 7f47a7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f47a8160bb0 0x7f47a80b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:48.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.484+0000 7f47a7e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a8151300 con 0x7f47a80cdbe0 2024-03-30T01:52:48.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.484+0000 7f47a7e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a80b70d0 con 0x7f47a815cac0 2024-03-30T01:52:48.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.484+0000 7f47a7e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a80b6df0 con 0x7f47a8160bb0 2024-03-30T01:52:48.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.484+0000 7f47a6a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a80cdbe0 0x7f47a81f3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:48.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.484+0000 7f47a6a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a80cdbe0 0x7f47a81f3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35418/0 (socket says 172.21.15.133:35418) 2024-03-30T01:52:48.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.485+0000 7f47a6a00640 1 -- 172.21.15.133:0/616886319 learned_addr learned my addr 172.21.15.133:0/616886319 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:48.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.485+0000 7f47a6a00640 1 -- 172.21.15.133:0/616886319 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f47a8160bb0 msgr2=0x7f47a80b65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:48.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.485+0000 7f47a6a00640 1 --2- 172.21.15.133:0/616886319 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f47a8160bb0 0x7f47a80b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:48.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.485+0000 7f47a6000640 1 --2- 172.21.15.133:0/616886319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47a815cac0 0x7f47a8150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:48.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.485+0000 7f47a6a00640 1 -- 172.21.15.133:0/616886319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47a815cac0 msgr2=0x7f47a8150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:48.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.485+0000 7f47a6a00640 1 --2- 172.21.15.133:0/616886319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47a815cac0 0x7f47a8150dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:48.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.485+0000 7f47a6a00640 1 -- 172.21.15.133:0/616886319 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47980094d0 con 0x7f47a80cdbe0 2024-03-30T01:52:48.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.485+0000 7f47a6a00640 1 --2- 172.21.15.133:0/616886319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a80cdbe0 0x7f47a81f3250 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4798000c00 tx=0x7f4798004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:48.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.486+0000 7f479ea00640 1 -- 172.21.15.133:0/616886319 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798030840 con 0x7f47a80cdbe0 2024-03-30T01:52:48.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.486+0000 7f479ea00640 1 -- 172.21.15.133:0/616886319 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4798043400 con 0x7f47a80cdbe0 2024-03-30T01:52:48.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.486+0000 7f479ea00640 1 -- 172.21.15.133:0/616886319 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47980437b0 con 0x7f47a80cdbe0 2024-03-30T01:52:48.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.486+0000 7f47a7e00640 1 -- 172.21.15.133:0/616886319 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a815d020 con 0x7f47a80cdbe0 2024-03-30T01:52:48.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.486+0000 7f47a7e00640 1 -- 172.21.15.133:0/616886319 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a81f3b60 con 0x7f47a80cdbe0 2024-03-30T01:52:48.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.487+0000 7f47a7e00640 1 -- 172.21.15.133:0/616886319 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a8073750 con 0x7f47a80cdbe0 2024-03-30T01:52:48.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.488+0000 7f479ea00640 1 -- 172.21.15.133:0/616886319 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f4798043910 con 0x7f47a80cdbe0 2024-03-30T01:52:48.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.489+0000 7f479ea00640 1 --2- 172.21.15.133:0/616886319 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f478806ac00 0x7f478806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:48.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.489+0000 7f479ea00640 1 -- 172.21.15.133:0/616886319 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f479803e070 con 0x7f47a80cdbe0 2024-03-30T01:52:48.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.489+0000 7f47a6000640 1 --2- 172.21.15.133:0/616886319 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f478806ac00 0x7f478806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:48.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.490+0000 7f47a6000640 1 --2- 172.21.15.133:0/616886319 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f478806ac00 0x7f478806d0c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f47a81f3790 tx=0x7f4794008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:48.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.493+0000 7f479ea00640 1 -- 172.21.15.133:0/616886319 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f4798077960 con 0x7f47a80cdbe0 2024-03-30T01:52:48.650 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T01:52:48.658 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T01:52:48.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.713+0000 7f47a7e00640 1 -- 172.21.15.133:0/616886319 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47a80d0570 con 0x7f47a80cdbe0 2024-03-30T01:52:48.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.714+0000 7f479ea00640 1 -- 172.21.15.133:0/616886319 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f479807af80 con 0x7f47a80cdbe0 2024-03-30T01:52:48.720 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:48.720 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/820901593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":820901593},{"type":"v1","addr":"172.21.15.137:6834","nonce":820901593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3524452213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3524452213},{"type":"v1","addr":"172.21.15.137:6835","nonce":3524452213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3989486478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3989486478},{"type":"v1","addr":"172.21.15.133:6837","nonce":3989486478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T01:52:45.211442+0000","modified":"2024-03-30T01:52:48.230722+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4801},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4801":{"gid":4801,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.133:6836/665764657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":665764657},{"type":"v1","addr":"172.21.15.133:6836","nonce":665764657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-30T01:52:48.720 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 15 2024-03-30T01:52:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.716+0000 7f47a7e00640 1 -- 172.21.15.133:0/616886319 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f478806ac00 msgr2=0x7f478806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.716+0000 7f47a7e00640 1 --2- 172.21.15.133:0/616886319 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f478806ac00 0x7f478806d0c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f47a81f3790 tx=0x7f4794008040 comp rx=0 tx=0).stop 2024-03-30T01:52:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.716+0000 7f47a7e00640 1 -- 172.21.15.133:0/616886319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a80cdbe0 msgr2=0x7f47a81f3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.716+0000 7f47a7e00640 1 --2- 172.21.15.133:0/616886319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a80cdbe0 0x7f47a81f3250 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4798000c00 tx=0x7f4798004730 comp rx=0 tx=0).stop 2024-03-30T01:52:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.716+0000 7f47a7e00640 1 -- 172.21.15.133:0/616886319 shutdown_connections 2024-03-30T01:52:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.716+0000 7f47a7e00640 1 --2- 172.21.15.133:0/616886319 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f478806ac00 0x7f478806d0c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.716+0000 7f47a7e00640 1 --2- 172.21.15.133:0/616886319 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f47a8160bb0 0x7f47a80b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.716+0000 7f47a7e00640 1 --2- 172.21.15.133:0/616886319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47a815cac0 0x7f47a8150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.716+0000 7f47a7e00640 1 --2- 172.21.15.133:0/616886319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a80cdbe0 0x7f47a81f3250 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.716+0000 7f47a7e00640 1 -- 172.21.15.133:0/616886319 >> 172.21.15.133:0/616886319 conn(0x7f47a80cf770 msgr2=0x7f47a80b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.716+0000 7f47a7e00640 1 -- 172.21.15.133:0/616886319 shutdown_connections 2024-03-30T01:52:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.716+0000 7f47a7e00640 1 -- 172.21.15.133:0/616886319 wait complete. 2024-03-30T01:52:48.739 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:52:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.925+0000 7f4999800640 1 Processor -- start 2024-03-30T01:52:48.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.925+0000 7f4999800640 1 -- start start 2024-03-30T01:52:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.927+0000 7f4999800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4994070500 0x7f4994070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.927+0000 7f4999800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49940cc530 0x7f49940cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.927+0000 7f4999800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49940a76a0 con 0x7f4994143790 2024-03-30T01:52:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.927+0000 7f4999800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4994070ed0 con 0x7f4994070500 2024-03-30T01:52:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.927+0000 7f4999800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49940b38e0 con 0x7f49940cc530 2024-03-30T01:52:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.927+0000 7f4992000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4994070500 0x7f4994070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.927+0000 7f4992000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4994070500 0x7f4994070990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35426/0 (socket says 172.21.15.133:35426) 2024-03-30T01:52:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.927+0000 7f4992000640 1 -- 172.21.15.133:0/4239845310 learned_addr learned my addr 172.21.15.133:0/4239845310 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.928+0000 7f4993400640 1 --2- 172.21.15.133:0/4239845310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49940cc530 0x7f49940cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.928+0000 7f4992000640 1 -- 172.21.15.133:0/4239845310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49940cc530 msgr2=0x7f49940cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:48.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.928+0000 7f4992000640 1 --2- 172.21.15.133:0/4239845310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49940cc530 0x7f49940cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:48.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.928+0000 7f4992000640 1 -- 172.21.15.133:0/4239845310 >> v1:172.21.15.137:6789/0 conn(0x7f4994143790 legacy=0x7f49940cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:48.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.928+0000 7f4992000640 1 -- 172.21.15.133:0/4239845310 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49940ccf00 con 0x7f4994070500 2024-03-30T01:52:48.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.929+0000 7f4992000640 1 --2- 172.21.15.133:0/4239845310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4994070500 0x7f4994070990 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f497c009870 tx=0x7f497c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b17a628cef87ea server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:48.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.929+0000 7f4991600640 1 -- 172.21.15.133:0/4239845310 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c030840 con 0x7f4994070500 2024-03-30T01:52:48.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.929+0000 7f4991600640 1 -- 172.21.15.133:0/4239845310 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497c0309a0 con 0x7f4994070500 2024-03-30T01:52:48.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.929+0000 7f4991600640 1 -- 172.21.15.133:0/4239845310 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c030d30 con 0x7f4994070500 2024-03-30T01:52:48.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.930+0000 7f4999800640 1 -- 172.21.15.133:0/4239845310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4994070500 msgr2=0x7f4994070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:48.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.930+0000 7f4999800640 1 --2- 172.21.15.133:0/4239845310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4994070500 0x7f4994070990 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f497c009870 tx=0x7f497c02b980 comp rx=0 tx=0).stop 2024-03-30T01:52:48.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.930+0000 7f4999800640 1 -- 172.21.15.133:0/4239845310 shutdown_connections 2024-03-30T01:52:48.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.930+0000 7f4999800640 1 --2- 172.21.15.133:0/4239845310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49940cc530 0x7f49940cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:48.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.930+0000 7f4999800640 1 --2- 172.21.15.133:0/4239845310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4994070500 0x7f4994070990 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:48.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.930+0000 7f4999800640 1 -- 172.21.15.133:0/4239845310 >> 172.21.15.133:0/4239845310 conn(0x7f49940b07a0 msgr2=0x7f49940b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:48.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.930+0000 7f4999800640 1 -- 172.21.15.133:0/4239845310 shutdown_connections 2024-03-30T01:52:48.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.930+0000 7f4999800640 1 -- 172.21.15.133:0/4239845310 wait complete. 2024-03-30T01:52:48.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.932+0000 7f4999800640 1 Processor -- start 2024-03-30T01:52:48.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.932+0000 7f4999800640 1 -- start start 2024-03-30T01:52:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.933+0000 7f4999800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4994070500 0x7f499406deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.933+0000 7f4999800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49940cc530 0x7f499406c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.933+0000 7f4999800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4994143790 0x7f499415a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.933+0000 7f4999800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499406da90 con 0x7f4994070500 2024-03-30T01:52:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.933+0000 7f4999800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499406cbb0 con 0x7f49940cc530 2024-03-30T01:52:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.933+0000 7f4999800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499406ce10 con 0x7f4994143790 2024-03-30T01:52:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.933+0000 7f4992a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4994070500 0x7f499406deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.933+0000 7f4992a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4994070500 0x7f499406deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35430/0 (socket says 172.21.15.133:35430) 2024-03-30T01:52:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.933+0000 7f4992a00640 1 -- 172.21.15.133:0/3167125975 learned_addr learned my addr 172.21.15.133:0/3167125975 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:48.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.934+0000 7f4993400640 1 --2- 172.21.15.133:0/3167125975 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4994143790 0x7f499415a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:48.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.934+0000 7f4992000640 1 --2- 172.21.15.133:0/3167125975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49940cc530 0x7f499406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:48.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.934+0000 7f4992a00640 1 -- 172.21.15.133:0/3167125975 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4994143790 msgr2=0x7f499415a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:48.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.934+0000 7f4992a00640 1 --2- 172.21.15.133:0/3167125975 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4994143790 0x7f499415a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:48.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.934+0000 7f4992a00640 1 -- 172.21.15.133:0/3167125975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49940cc530 msgr2=0x7f499406c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:48.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.934+0000 7f4992a00640 1 --2- 172.21.15.133:0/3167125975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49940cc530 0x7f499406c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:48.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.934+0000 7f4992a00640 1 -- 172.21.15.133:0/3167125975 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c0094d0 con 0x7f4994070500 2024-03-30T01:52:48.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.934+0000 7f4992000640 1 --2- 172.21.15.133:0/3167125975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49940cc530 0x7f499406c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:48.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.934+0000 7f4992a00640 1 --2- 172.21.15.133:0/3167125975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4994070500 0x7f499406deb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f498400b3f0 tx=0x7f498400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:48.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.934+0000 7f498aa00640 1 -- 172.21.15.133:0/3167125975 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4984011830 con 0x7f4994070500 2024-03-30T01:52:48.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.934+0000 7f498aa00640 1 -- 172.21.15.133:0/3167125975 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4984011990 con 0x7f4994070500 2024-03-30T01:52:48.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.934+0000 7f498aa00640 1 -- 172.21.15.133:0/3167125975 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4984011d40 con 0x7f4994070500 2024-03-30T01:52:48.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.934+0000 7f4999800640 1 -- 172.21.15.133:0/3167125975 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499406d0f0 con 0x7f4994070500 2024-03-30T01:52:48.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.935+0000 7f4999800640 1 -- 172.21.15.133:0/3167125975 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499406d6b0 con 0x7f4994070500 2024-03-30T01:52:48.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.936+0000 7f4999800640 1 -- 172.21.15.133:0/3167125975 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499406dbd0 con 0x7f4994070500 2024-03-30T01:52:48.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.937+0000 7f498aa00640 1 -- 172.21.15.133:0/3167125975 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f498401a400 con 0x7f4994070500 2024-03-30T01:52:48.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.938+0000 7f498aa00640 1 --2- 172.21.15.133:0/3167125975 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f497006ac30 0x7f497006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:48.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.938+0000 7f498aa00640 1 -- 172.21.15.133:0/3167125975 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4984089190 con 0x7f4994070500 2024-03-30T01:52:48.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.938+0000 7f4992000640 1 --2- 172.21.15.133:0/3167125975 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f497006ac30 0x7f497006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:48.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.939+0000 7f4992000640 1 --2- 172.21.15.133:0/3167125975 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f497006ac30 0x7f497006d0f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f497c036000 tx=0x7f497c03b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:48.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:48.943+0000 7f498aa00640 1 -- 172.21.15.133:0/3167125975 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f499406dbd0 con 0x7f4994070500 2024-03-30T01:52:49.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.136+0000 7f4999800640 1 -- 172.21.15.133:0/3167125975 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f499406dbd0 con 0x7f4994070500 2024-03-30T01:52:49.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.139+0000 7f498aa00640 1 -- 172.21.15.133:0/3167125975 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16149 (secure 0 0 0) 0x7f499406dbd0 con 0x7f4994070500 2024-03-30T01:52:49.146 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:49.146 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":34,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:52:46.215884+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:52:43.357481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-30T01:52:44.221573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:52:49.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.142+0000 7f4999800640 1 -- 172.21.15.133:0/3167125975 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f497006ac30 msgr2=0x7f497006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:49.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.142+0000 7f4999800640 1 --2- 172.21.15.133:0/3167125975 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f497006ac30 0x7f497006d0f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f497c036000 tx=0x7f497c03b040 comp rx=0 tx=0).stop 2024-03-30T01:52:49.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.142+0000 7f4999800640 1 -- 172.21.15.133:0/3167125975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4994070500 msgr2=0x7f499406deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:49.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.142+0000 7f4999800640 1 --2- 172.21.15.133:0/3167125975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4994070500 0x7f499406deb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f498400b3f0 tx=0x7f498400b8b0 comp rx=0 tx=0).stop 2024-03-30T01:52:49.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.142+0000 7f4999800640 1 -- 172.21.15.133:0/3167125975 shutdown_connections 2024-03-30T01:52:49.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.142+0000 7f4999800640 1 --2- 172.21.15.133:0/3167125975 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f497006ac30 0x7f497006d0f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:49.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.142+0000 7f4999800640 1 --2- 172.21.15.133:0/3167125975 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4994143790 0x7f499415a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:49.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.142+0000 7f4999800640 1 --2- 172.21.15.133:0/3167125975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49940cc530 0x7f499406c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:49.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.142+0000 7f4999800640 1 --2- 172.21.15.133:0/3167125975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4994070500 0x7f499406deb0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:49.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.142+0000 7f4999800640 1 -- 172.21.15.133:0/3167125975 >> 172.21.15.133:0/3167125975 conn(0x7f49940b07a0 msgr2=0x7f49940ae710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:49.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.142+0000 7f4999800640 1 -- 172.21.15.133:0/3167125975 shutdown_connections 2024-03-30T01:52:49.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.142+0000 7f4999800640 1 -- 172.21.15.133:0/3167125975 wait complete. 2024-03-30T01:52:49.168 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-30T01:52:49.168 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T01:52:49.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.362+0000 7f5364200640 1 Processor -- start 2024-03-30T01:52:49.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.362+0000 7f5364200640 1 -- start start 2024-03-30T01:52:49.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.363+0000 7f5364200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f535c15cbd0 0x7f535c0cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:49.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.363+0000 7f5364200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f535c0b5ac0 0x7f535c0b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:49.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.363+0000 7f5364200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f535c15cfb0 con 0x7f535c0d1750 2024-03-30T01:52:49.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.363+0000 7f5364200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f535c0d1ef0 con 0x7f535c0b5ac0 2024-03-30T01:52:49.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.363+0000 7f5364200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535c0d21d0 con 0x7f535c15cbd0 2024-03-30T01:52:49.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.364+0000 7f5361800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f535c15cbd0 0x7f535c0cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:49.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.364+0000 7f5362200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f535c0b5ac0 0x7f535c0b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:49.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.364+0000 7f5361800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f535c15cbd0 0x7f535c0cdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.133:35756/0 (socket says 172.21.15.133:35756) 2024-03-30T01:52:49.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.364+0000 7f5362200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f535c0b5ac0 0x7f535c0b5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.133:50040/0 (socket says 172.21.15.133:50040) 2024-03-30T01:52:49.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.364+0000 7f5361800640 1 -- 172.21.15.133:0/2036094021 learned_addr learned my addr 172.21.15.133:0/2036094021 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:49.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.365+0000 7f5361800640 1 -- 172.21.15.133:0/2036094021 >> v2:172.21.15.137:3300/0 conn(0x7f535c0b5ac0 msgr2=0x7f535c0b5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:49.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.365+0000 7f5361800640 1 --2- 172.21.15.133:0/2036094021 >> v2:172.21.15.137:3300/0 conn(0x7f535c0b5ac0 0x7f535c0b5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:49.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.365+0000 7f5361800640 1 -- 172.21.15.133:0/2036094021 >> v1:172.21.15.137:6789/0 conn(0x7f535c0d1750 legacy=0x7f535c0d2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:49.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.365+0000 7f5361800640 1 -- 172.21.15.133:0/2036094021 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c0d24b0 con 0x7f535c15cbd0 2024-03-30T01:52:49.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.366+0000 7f5361800640 1 --2- 172.21.15.133:0/2036094021 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f535c15cbd0 0x7f535c0cdc50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5350009870 tx=0x7f535002ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a696a89dbfd80e18 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:49.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.367+0000 7f535be00640 1 -- 172.21.15.133:0/2036094021 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535002f830 con 0x7f535c15cbd0 2024-03-30T01:52:49.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.367+0000 7f535be00640 1 -- 172.21.15.133:0/2036094021 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535002f990 con 0x7f535c15cbd0 2024-03-30T01:52:49.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.367+0000 7f535be00640 1 -- 172.21.15.133:0/2036094021 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535002fd20 con 0x7f535c15cbd0 2024-03-30T01:52:49.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.367+0000 7f5364200640 1 -- 172.21.15.133:0/2036094021 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f535c15cbd0 msgr2=0x7f535c0cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:49.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.367+0000 7f5364200640 1 --2- 172.21.15.133:0/2036094021 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f535c15cbd0 0x7f535c0cdc50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5350009870 tx=0x7f535002ba10 comp rx=0 tx=0).stop 2024-03-30T01:52:49.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.368+0000 7f5364200640 1 -- 172.21.15.133:0/2036094021 shutdown_connections 2024-03-30T01:52:49.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.368+0000 7f5364200640 1 --2- 172.21.15.133:0/2036094021 >> v2:172.21.15.137:3300/0 conn(0x7f535c0b5ac0 0x7f535c0b5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:49.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.368+0000 7f5364200640 1 --2- 172.21.15.133:0/2036094021 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f535c15cbd0 0x7f535c0cdc50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:49.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.368+0000 7f5364200640 1 -- 172.21.15.133:0/2036094021 >> 172.21.15.133:0/2036094021 conn(0x7f535c071830 msgr2=0x7f535c071c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:49.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.368+0000 7f5364200640 1 -- 172.21.15.133:0/2036094021 shutdown_connections 2024-03-30T01:52:49.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.368+0000 7f5364200640 1 -- 172.21.15.133:0/2036094021 wait complete. 2024-03-30T01:52:49.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.369+0000 7f5364200640 1 Processor -- start 2024-03-30T01:52:49.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.369+0000 7f5364200640 1 -- start start 2024-03-30T01:52:49.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.370+0000 7f5364200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f535c0b5ac0 0x7f535c0cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:49.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.370+0000 7f5364200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f535c0d1750 0x7f535c1efc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:49.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.370+0000 7f5364200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f535c15cbd0 0x7f535c0cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:49.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.370+0000 7f5364200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c1f01a0 con 0x7f535c15cbd0 2024-03-30T01:52:49.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.370+0000 7f5364200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c0c6580 con 0x7f535c0b5ac0 2024-03-30T01:52:49.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.370+0000 7f5364200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535c0c6860 con 0x7f535c0d1750 2024-03-30T01:52:49.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.371+0000 7f5362200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f535c15cbd0 0x7f535c0cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:49.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.371+0000 7f5362200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f535c15cbd0 0x7f535c0cab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35434/0 (socket says 172.21.15.133:35434) 2024-03-30T01:52:49.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.371+0000 7f5362200640 1 -- 172.21.15.133:0/2531048372 learned_addr learned my addr 172.21.15.133:0/2531048372 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:49.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.371+0000 7f5361800640 1 --2- 172.21.15.133:0/2531048372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f535c0b5ac0 0x7f535c0cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:49.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.371+0000 7f5360e00640 1 --2- 172.21.15.133:0/2531048372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f535c0d1750 0x7f535c1efc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:49.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.371+0000 7f5362200640 1 -- 172.21.15.133:0/2531048372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f535c0d1750 msgr2=0x7f535c1efc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:49.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.371+0000 7f5362200640 1 --2- 172.21.15.133:0/2531048372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f535c0d1750 0x7f535c1efc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:49.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.371+0000 7f5362200640 1 -- 172.21.15.133:0/2531048372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f535c0b5ac0 msgr2=0x7f535c0cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:49.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.371+0000 7f5362200640 1 --2- 172.21.15.133:0/2531048372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f535c0b5ac0 0x7f535c0cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:49.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.371+0000 7f5362200640 1 -- 172.21.15.133:0/2531048372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53500094d0 con 0x7f535c15cbd0 2024-03-30T01:52:49.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.372+0000 7f5362200640 1 --2- 172.21.15.133:0/2531048372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f535c15cbd0 0x7f535c0cab70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f535400efc0 tx=0x7f535400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:49.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.372+0000 7f5359600640 1 -- 172.21.15.133:0/2531048372 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5354009ba0 con 0x7f535c15cbd0 2024-03-30T01:52:49.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.372+0000 7f5359600640 1 -- 172.21.15.133:0/2531048372 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535400f040 con 0x7f535c15cbd0 2024-03-30T01:52:49.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.372+0000 7f5359600640 1 -- 172.21.15.133:0/2531048372 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53540146c0 con 0x7f535c15cbd0 2024-03-30T01:52:49.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.372+0000 7f5364200640 1 -- 172.21.15.133:0/2531048372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f535c0cb0b0 con 0x7f535c15cbd0 2024-03-30T01:52:49.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.372+0000 7f5364200640 1 -- 172.21.15.133:0/2531048372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f535c0cb630 con 0x7f535c15cbd0 2024-03-30T01:52:49.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.373+0000 7f5364200640 1 -- 172.21.15.133:0/2531048372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535c0c69d0 con 0x7f535c15cbd0 2024-03-30T01:52:49.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.374+0000 7f5359600640 1 -- 172.21.15.133:0/2531048372 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f5354014820 con 0x7f535c15cbd0 2024-03-30T01:52:49.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.375+0000 7f5359600640 1 --2- 172.21.15.133:0/2531048372 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f533c06ac00 0x7f533c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:49.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.375+0000 7f5359600640 1 -- 172.21.15.133:0/2531048372 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f535408a1a0 con 0x7f535c15cbd0 2024-03-30T01:52:49.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.375+0000 7f5361800640 1 --2- 172.21.15.133:0/2531048372 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f533c06ac00 0x7f533c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:49.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.376+0000 7f5361800640 1 --2- 172.21.15.133:0/2531048372 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f533c06ac00 0x7f533c06d0c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5350036000 tx=0x7f5350008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:49.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.379+0000 7f5359600640 1 -- 172.21.15.133:0/2531048372 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f5354055370 con 0x7f535c15cbd0 2024-03-30T01:52:49.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.568+0000 7f5364200640 1 -- 172.21.15.133:0/2531048372 --> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f535c0d1bb0 con 0x7f533c06ac00 2024-03-30T01:52:49.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.579+0000 7f5359600640 1 -- 172.21.15.133:0/2531048372 <== mgr.4105 v2:172.21.15.133:6832/37234 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286720 (secure 0 0 0) 0x7f535002fb80 con 0x7f533c06ac00 2024-03-30T01:52:49.589 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:49.591 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-03-30T01:52:49.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.585+0000 7f5364200640 1 -- 172.21.15.133:0/2531048372 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f533c06ac00 msgr2=0x7f533c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:49.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.585+0000 7f5364200640 1 --2- 172.21.15.133:0/2531048372 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f533c06ac00 0x7f533c06d0c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5350036000 tx=0x7f5350008030 comp rx=0 tx=0).stop 2024-03-30T01:52:49.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.585+0000 7f5364200640 1 -- 172.21.15.133:0/2531048372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f535c15cbd0 msgr2=0x7f535c0cab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:49.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.585+0000 7f5364200640 1 --2- 172.21.15.133:0/2531048372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f535c15cbd0 0x7f535c0cab70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f535400efc0 tx=0x7f535400c490 comp rx=0 tx=0).stop 2024-03-30T01:52:49.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.586+0000 7f5364200640 1 -- 172.21.15.133:0/2531048372 shutdown_connections 2024-03-30T01:52:49.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.586+0000 7f5364200640 1 --2- 172.21.15.133:0/2531048372 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f533c06ac00 0x7f533c06d0c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:49.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.586+0000 7f5364200640 1 --2- 172.21.15.133:0/2531048372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f535c15cbd0 0x7f535c0cab70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:49.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.586+0000 7f5364200640 1 --2- 172.21.15.133:0/2531048372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f535c0d1750 0x7f535c1efc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:49.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.586+0000 7f5364200640 1 --2- 172.21.15.133:0/2531048372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f535c0b5ac0 0x7f535c0cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:49.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.586+0000 7f5364200640 1 -- 172.21.15.133:0/2531048372 >> 172.21.15.133:0/2531048372 conn(0x7f535c071830 msgr2=0x7f535c071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:49.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.586+0000 7f5364200640 1 -- 172.21.15.133:0/2531048372 shutdown_connections 2024-03-30T01:52:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.586+0000 7f5364200640 1 -- 172.21.15.133:0/2531048372 wait complete. 2024-03-30T01:52:49.608 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-03-30T01:52:47.718623+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220364,"kb_used_data":4164,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754356,"statfs":{"total":773094113280,"available":772868460544,"internally_reserved":0,"allocated":4263936,"data_stored":2367082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001195"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.265519+0000","last_change":"2024-03-30T01:52:45.261389+0000","last_active":"2024-03-30T01:52:45.265519+0000","last_peered":"2024-03-30T01:52:45.265519+0000","last_clean":"2024-03-30T01:52:45.265519+0000","last_became_active":"2024-03-30T01:52:45.261094+0000","last_became_peered":"2024-03-30T01:52:45.261094+0000","last_unstale":"2024-03-30T01:52:45.265519+0000","last_undegraded":"2024-03-30T01:52:45.265519+0000","last_fullsized":"2024-03-30T01:52:45.265519+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:07:01.583648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232140+0000","last_change":"2024-03-30T01:52:45.240933+0000","last_active":"2024-03-30T01:52:46.232140+0000","last_peered":"2024-03-30T01:52:46.232140+0000","last_clean":"2024-03-30T01:52:46.232140+0000","last_became_active":"2024-03-30T01:52:45.238584+0000","last_became_peered":"2024-03-30T01:52:45.238584+0000","last_unstale":"2024-03-30T01:52:46.232140+0000","last_undegraded":"2024-03-30T01:52:46.232140+0000","last_fullsized":"2024-03-30T01:52:46.232140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:29:58.818874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.234609+0000","last_change":"2024-03-30T01:52:45.246468+0000","last_active":"2024-03-30T01:52:46.234609+0000","last_peered":"2024-03-30T01:52:46.234609+0000","last_clean":"2024-03-30T01:52:46.234609+0000","last_became_active":"2024-03-30T01:52:45.244877+0000","last_became_peered":"2024-03-30T01:52:45.244877+0000","last_unstale":"2024-03-30T01:52:46.234609+0000","last_undegraded":"2024-03-30T01:52:46.234609+0000","last_fullsized":"2024-03-30T01:52:46.234609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:37:49.475134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.239333+0000","last_change":"2024-03-30T01:52:45.236406+0000","last_active":"2024-03-30T01:52:45.239333+0000","last_peered":"2024-03-30T01:52:45.239333+0000","last_clean":"2024-03-30T01:52:45.239333+0000","last_became_active":"2024-03-30T01:52:45.236020+0000","last_became_peered":"2024-03-30T01:52:45.236020+0000","last_unstale":"2024-03-30T01:52:45.239333+0000","last_undegraded":"2024-03-30T01:52:45.239333+0000","last_fullsized":"2024-03-30T01:52:45.239333+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:48:40.316565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.335535+0000","last_change":"2024-03-30T01:52:45.238144+0000","last_active":"2024-03-30T01:52:46.335535+0000","last_peered":"2024-03-30T01:52:46.335535+0000","last_clean":"2024-03-30T01:52:46.335535+0000","last_became_active":"2024-03-30T01:52:45.237895+0000","last_became_peered":"2024-03-30T01:52:45.237895+0000","last_unstale":"2024-03-30T01:52:46.335535+0000","last_undegraded":"2024-03-30T01:52:46.335535+0000","last_fullsized":"2024-03-30T01:52:46.335535+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:07:01.583648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.231658+0000","last_change":"2024-03-30T01:52:45.254391+0000","last_active":"2024-03-30T01:52:46.231658+0000","last_peered":"2024-03-30T01:52:46.231658+0000","last_clean":"2024-03-30T01:52:46.231658+0000","last_became_active":"2024-03-30T01:52:45.254126+0000","last_became_peered":"2024-03-30T01:52:45.254126+0000","last_unstale":"2024-03-30T01:52:46.231658+0000","last_undegraded":"2024-03-30T01:52:46.231658+0000","last_fullsized":"2024-03-30T01:52:46.231658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:37:49.475134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232897+0000","last_change":"2024-03-30T01:52:45.263005+0000","last_active":"2024-03-30T01:52:46.232897+0000","last_peered":"2024-03-30T01:52:46.232897+0000","last_clean":"2024-03-30T01:52:46.232897+0000","last_became_active":"2024-03-30T01:52:45.262698+0000","last_became_peered":"2024-03-30T01:52:45.262698+0000","last_unstale":"2024-03-30T01:52:46.232897+0000","last_undegraded":"2024-03-30T01:52:46.232897+0000","last_fullsized":"2024-03-30T01:52:46.232897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:43:56.218523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232485+0000","last_change":"2024-03-30T01:52:45.253966+0000","last_active":"2024-03-30T01:52:46.232485+0000","last_peered":"2024-03-30T01:52:46.232485+0000","last_clean":"2024-03-30T01:52:46.232485+0000","last_became_active":"2024-03-30T01:52:45.252339+0000","last_became_peered":"2024-03-30T01:52:45.252339+0000","last_unstale":"2024-03-30T01:52:46.232485+0000","last_undegraded":"2024-03-30T01:52:46.232485+0000","last_fullsized":"2024-03-30T01:52:46.232485+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:53:18.855091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.247829+0000","last_change":"2024-03-30T01:52:45.244424+0000","last_active":"2024-03-30T01:52:45.247829+0000","last_peered":"2024-03-30T01:52:45.247829+0000","last_clean":"2024-03-30T01:52:45.247829+0000","last_became_active":"2024-03-30T01:52:45.243957+0000","last_became_peered":"2024-03-30T01:52:45.243957+0000","last_unstale":"2024-03-30T01:52:45.247829+0000","last_undegraded":"2024-03-30T01:52:45.247829+0000","last_fullsized":"2024-03-30T01:52:45.247829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:58:18.607454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.237416+0000","last_change":"2024-03-30T01:52:45.234105+0000","last_active":"2024-03-30T01:52:45.237416+0000","last_peered":"2024-03-30T01:52:45.237416+0000","last_clean":"2024-03-30T01:52:45.237416+0000","last_became_active":"2024-03-30T01:52:45.233567+0000","last_became_peered":"2024-03-30T01:52:45.233567+0000","last_unstale":"2024-03-30T01:52:45.237416+0000","last_undegraded":"2024-03-30T01:52:45.237416+0000","last_fullsized":"2024-03-30T01:52:45.237416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:59.079244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.234082+0000","last_change":"2024-03-30T01:52:45.250542+0000","last_active":"2024-03-30T01:52:46.234082+0000","last_peered":"2024-03-30T01:52:46.234082+0000","last_clean":"2024-03-30T01:52:46.234082+0000","last_became_active":"2024-03-30T01:52:45.249548+0000","last_became_peered":"2024-03-30T01:52:45.249548+0000","last_unstale":"2024-03-30T01:52:46.234082+0000","last_undegraded":"2024-03-30T01:52:46.234082+0000","last_fullsized":"2024-03-30T01:52:46.234082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:30:13.931533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.234638+0000","last_change":"2024-03-30T01:52:45.256509+0000","last_active":"2024-03-30T01:52:46.234638+0000","last_peered":"2024-03-30T01:52:46.234638+0000","last_clean":"2024-03-30T01:52:46.234638+0000","last_became_active":"2024-03-30T01:52:45.252627+0000","last_became_peered":"2024-03-30T01:52:45.252627+0000","last_unstale":"2024-03-30T01:52:46.234638+0000","last_undegraded":"2024-03-30T01:52:46.234638+0000","last_fullsized":"2024-03-30T01:52:46.234638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:30:30.623241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.335619+0000","last_change":"2024-03-30T01:52:45.232098+0000","last_active":"2024-03-30T01:52:46.335619+0000","last_peered":"2024-03-30T01:52:46.335619+0000","last_clean":"2024-03-30T01:52:46.335619+0000","last_became_active":"2024-03-30T01:52:45.229874+0000","last_became_peered":"2024-03-30T01:52:45.229874+0000","last_unstale":"2024-03-30T01:52:46.335619+0000","last_undegraded":"2024-03-30T01:52:46.335619+0000","last_fullsized":"2024-03-30T01:52:46.335619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T07:49:29.699134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.231790+0000","last_change":"2024-03-30T01:52:45.234072+0000","last_active":"2024-03-30T01:52:46.231790+0000","last_peered":"2024-03-30T01:52:46.231790+0000","last_clean":"2024-03-30T01:52:46.231790+0000","last_became_active":"2024-03-30T01:52:45.233895+0000","last_became_peered":"2024-03-30T01:52:45.233895+0000","last_unstale":"2024-03-30T01:52:46.231790+0000","last_undegraded":"2024-03-30T01:52:46.231790+0000","last_fullsized":"2024-03-30T01:52:46.231790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:44:45.959392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.233835+0000","last_change":"2024-03-30T01:52:45.262423+0000","last_active":"2024-03-30T01:52:46.233835+0000","last_peered":"2024-03-30T01:52:46.233835+0000","last_clean":"2024-03-30T01:52:46.233835+0000","last_became_active":"2024-03-30T01:52:45.262098+0000","last_became_peered":"2024-03-30T01:52:45.262098+0000","last_unstale":"2024-03-30T01:52:46.233835+0000","last_undegraded":"2024-03-30T01:52:46.233835+0000","last_fullsized":"2024-03-30T01:52:46.233835+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:20:37.140776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.233397+0000","last_change":"2024-03-30T01:52:45.253798+0000","last_active":"2024-03-30T01:52:46.233397+0000","last_peered":"2024-03-30T01:52:46.233397+0000","last_clean":"2024-03-30T01:52:46.233397+0000","last_became_active":"2024-03-30T01:52:45.253171+0000","last_became_peered":"2024-03-30T01:52:45.253171+0000","last_unstale":"2024-03-30T01:52:46.233397+0000","last_undegraded":"2024-03-30T01:52:46.233397+0000","last_fullsized":"2024-03-30T01:52:46.233397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:44:45.959392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.234446+0000","last_change":"2024-03-30T01:52:45.257943+0000","last_active":"2024-03-30T01:52:46.234446+0000","last_peered":"2024-03-30T01:52:46.234446+0000","last_clean":"2024-03-30T01:52:46.234446+0000","last_became_active":"2024-03-30T01:52:45.257689+0000","last_became_peered":"2024-03-30T01:52:45.257689+0000","last_unstale":"2024-03-30T01:52:46.234446+0000","last_undegraded":"2024-03-30T01:52:46.234446+0000","last_fullsized":"2024-03-30T01:52:46.234446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:32:09.525767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232330+0000","last_change":"2024-03-30T01:52:45.229401+0000","last_active":"2024-03-30T01:52:46.232330+0000","last_peered":"2024-03-30T01:52:46.232330+0000","last_clean":"2024-03-30T01:52:46.232330+0000","last_became_active":"2024-03-30T01:52:45.229064+0000","last_became_peered":"2024-03-30T01:52:45.229064+0000","last_unstale":"2024-03-30T01:52:46.232330+0000","last_undegraded":"2024-03-30T01:52:46.232330+0000","last_fullsized":"2024-03-30T01:52:46.232330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T04:10:54.309333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.231965+0000","last_change":"2024-03-30T01:52:45.233452+0000","last_active":"2024-03-30T01:52:46.231965+0000","last_peered":"2024-03-30T01:52:46.231965+0000","last_clean":"2024-03-30T01:52:46.231965+0000","last_became_active":"2024-03-30T01:52:45.232902+0000","last_became_peered":"2024-03-30T01:52:45.232902+0000","last_unstale":"2024-03-30T01:52:46.231965+0000","last_undegraded":"2024-03-30T01:52:46.231965+0000","last_fullsized":"2024-03-30T01:52:46.231965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:54:05.420218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.335912+0000","last_change":"2024-03-30T01:52:45.260839+0000","last_active":"2024-03-30T01:52:46.335912+0000","last_peered":"2024-03-30T01:52:46.335912+0000","last_clean":"2024-03-30T01:52:46.335912+0000","last_became_active":"2024-03-30T01:52:45.260570+0000","last_became_peered":"2024-03-30T01:52:45.260570+0000","last_unstale":"2024-03-30T01:52:46.335912+0000","last_undegraded":"2024-03-30T01:52:46.335912+0000","last_fullsized":"2024-03-30T01:52:46.335912+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:48:40.316565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.243346+0000","last_change":"2024-03-30T01:52:45.237135+0000","last_active":"2024-03-30T01:52:45.243346+0000","last_peered":"2024-03-30T01:52:45.243346+0000","last_clean":"2024-03-30T01:52:45.243346+0000","last_became_active":"2024-03-30T01:52:45.236274+0000","last_became_peered":"2024-03-30T01:52:45.236274+0000","last_unstale":"2024-03-30T01:52:45.243346+0000","last_undegraded":"2024-03-30T01:52:45.243346+0000","last_fullsized":"2024-03-30T01:52:45.243346+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:48:40.316565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.251726+0000","last_change":"2024-03-30T01:52:45.245791+0000","last_active":"2024-03-30T01:52:45.251726+0000","last_peered":"2024-03-30T01:52:45.251726+0000","last_clean":"2024-03-30T01:52:45.251726+0000","last_became_active":"2024-03-30T01:52:45.245305+0000","last_became_peered":"2024-03-30T01:52:45.245305+0000","last_unstale":"2024-03-30T01:52:45.251726+0000","last_undegraded":"2024-03-30T01:52:45.251726+0000","last_fullsized":"2024-03-30T01:52:45.251726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:59.079244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.252899+0000","last_change":"2024-03-30T01:52:45.251655+0000","last_active":"2024-03-30T01:52:45.252899+0000","last_peered":"2024-03-30T01:52:45.252899+0000","last_clean":"2024-03-30T01:52:45.252899+0000","last_became_active":"2024-03-30T01:52:45.251362+0000","last_became_peered":"2024-03-30T01:52:45.251362+0000","last_unstale":"2024-03-30T01:52:45.252899+0000","last_undegraded":"2024-03-30T01:52:45.252899+0000","last_fullsized":"2024-03-30T01:52:45.252899+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:54:43.100222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.233528+0000","last_change":"2024-03-30T01:52:45.243113+0000","last_active":"2024-03-30T01:52:46.233528+0000","last_peered":"2024-03-30T01:52:46.233528+0000","last_clean":"2024-03-30T01:52:46.233528+0000","last_became_active":"2024-03-30T01:52:45.242538+0000","last_became_peered":"2024-03-30T01:52:45.242538+0000","last_unstale":"2024-03-30T01:52:46.233528+0000","last_undegraded":"2024-03-30T01:52:46.233528+0000","last_fullsized":"2024-03-30T01:52:46.233528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:54:43.100222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.255621+0000","last_change":"2024-03-30T01:52:45.250582+0000","last_active":"2024-03-30T01:52:45.255621+0000","last_peered":"2024-03-30T01:52:45.255621+0000","last_clean":"2024-03-30T01:52:45.255621+0000","last_became_active":"2024-03-30T01:52:45.250292+0000","last_became_peered":"2024-03-30T01:52:45.250292+0000","last_unstale":"2024-03-30T01:52:45.255621+0000","last_undegraded":"2024-03-30T01:52:45.255621+0000","last_fullsized":"2024-03-30T01:52:45.255621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:20:37.140776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232416+0000","last_change":"2024-03-30T01:52:45.249414+0000","last_active":"2024-03-30T01:52:46.232416+0000","last_peered":"2024-03-30T01:52:46.232416+0000","last_clean":"2024-03-30T01:52:46.232416+0000","last_became_active":"2024-03-30T01:52:45.249039+0000","last_became_peered":"2024-03-30T01:52:45.249039+0000","last_unstale":"2024-03-30T01:52:46.232416+0000","last_undegraded":"2024-03-30T01:52:46.232416+0000","last_fullsized":"2024-03-30T01:52:46.232416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:04:09.706763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.247848+0000","last_change":"2024-03-30T01:52:45.246492+0000","last_active":"2024-03-30T01:52:45.247848+0000","last_peered":"2024-03-30T01:52:45.247848+0000","last_clean":"2024-03-30T01:52:45.247848+0000","last_became_active":"2024-03-30T01:52:45.245916+0000","last_became_peered":"2024-03-30T01:52:45.245916+0000","last_unstale":"2024-03-30T01:52:45.247848+0000","last_undegraded":"2024-03-30T01:52:45.247848+0000","last_fullsized":"2024-03-30T01:52:45.247848+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:05:41.223740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.234889+0000","last_change":"2024-03-30T01:52:45.257250+0000","last_active":"2024-03-30T01:52:46.234889+0000","last_peered":"2024-03-30T01:52:46.234889+0000","last_clean":"2024-03-30T01:52:46.234889+0000","last_became_active":"2024-03-30T01:52:45.252938+0000","last_became_peered":"2024-03-30T01:52:45.252938+0000","last_unstale":"2024-03-30T01:52:46.234889+0000","last_undegraded":"2024-03-30T01:52:46.234889+0000","last_fullsized":"2024-03-30T01:52:46.234889+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:00:40.832217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.243323+0000","last_change":"2024-03-30T01:52:45.236764+0000","last_active":"2024-03-30T01:52:45.243323+0000","last_peered":"2024-03-30T01:52:45.243323+0000","last_clean":"2024-03-30T01:52:45.243323+0000","last_became_active":"2024-03-30T01:52:45.235529+0000","last_became_peered":"2024-03-30T01:52:45.235529+0000","last_unstale":"2024-03-30T01:52:45.243323+0000","last_undegraded":"2024-03-30T01:52:45.243323+0000","last_fullsized":"2024-03-30T01:52:45.243323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:00:49.078516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.233020+0000","last_change":"2024-03-30T01:52:45.256582+0000","last_active":"2024-03-30T01:52:46.233020+0000","last_peered":"2024-03-30T01:52:46.233020+0000","last_clean":"2024-03-30T01:52:46.233020+0000","last_became_active":"2024-03-30T01:52:45.256334+0000","last_became_peered":"2024-03-30T01:52:45.256334+0000","last_unstale":"2024-03-30T01:52:46.233020+0000","last_undegraded":"2024-03-30T01:52:46.233020+0000","last_fullsized":"2024-03-30T01:52:46.233020+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:40:41.191709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.260261+0000","last_change":"2024-03-30T01:52:45.247808+0000","last_active":"2024-03-30T01:52:45.260261+0000","last_peered":"2024-03-30T01:52:45.260261+0000","last_clean":"2024-03-30T01:52:45.260261+0000","last_became_active":"2024-03-30T01:52:45.247495+0000","last_became_peered":"2024-03-30T01:52:45.247495+0000","last_unstale":"2024-03-30T01:52:45.260261+0000","last_undegraded":"2024-03-30T01:52:45.260261+0000","last_fullsized":"2024-03-30T01:52:45.260261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:54:43.100222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232542+0000","last_change":"2024-03-30T01:52:45.255506+0000","last_active":"2024-03-30T01:52:46.232542+0000","last_peered":"2024-03-30T01:52:46.232542+0000","last_clean":"2024-03-30T01:52:46.232542+0000","last_became_active":"2024-03-30T01:52:45.255247+0000","last_became_peered":"2024-03-30T01:52:45.255247+0000","last_unstale":"2024-03-30T01:52:46.232542+0000","last_undegraded":"2024-03-30T01:52:46.232542+0000","last_fullsized":"2024-03-30T01:52:46.232542+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:07:43.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.245417+0000","last_change":"2024-03-30T01:52:45.243586+0000","last_active":"2024-03-30T01:52:45.245417+0000","last_peered":"2024-03-30T01:52:45.245417+0000","last_clean":"2024-03-30T01:52:45.245417+0000","last_became_active":"2024-03-30T01:52:45.243347+0000","last_became_peered":"2024-03-30T01:52:45.243347+0000","last_unstale":"2024-03-30T01:52:45.245417+0000","last_undegraded":"2024-03-30T01:52:45.245417+0000","last_fullsized":"2024-03-30T01:52:45.245417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T04:20:38.429903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.268427+0000","last_change":"2024-03-30T01:52:44.765959+0000","last_active":"2024-03-30T01:52:45.268427+0000","last_peered":"2024-03-30T01:52:45.268427+0000","last_clean":"2024-03-30T01:52:45.268427+0000","last_became_active":"2024-03-30T01:52:44.765677+0000","last_became_peered":"2024-03-30T01:52:44.765677+0000","last_unstale":"2024-03-30T01:52:45.268427+0000","last_undegraded":"2024-03-30T01:52:45.268427+0000","last_fullsized":"2024-03-30T01:52:45.268427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:45.630452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.261432+0000","last_change":"2024-03-30T01:52:45.256738+0000","last_active":"2024-03-30T01:52:45.261432+0000","last_peered":"2024-03-30T01:52:45.261432+0000","last_clean":"2024-03-30T01:52:45.261432+0000","last_became_active":"2024-03-30T01:52:45.253488+0000","last_became_peered":"2024-03-30T01:52:45.253488+0000","last_unstale":"2024-03-30T01:52:45.261432+0000","last_undegraded":"2024-03-30T01:52:45.261432+0000","last_fullsized":"2024-03-30T01:52:45.261432+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:00:49.078516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.251149+0000","last_change":"2024-03-30T01:52:44.769833+0000","last_active":"2024-03-30T01:52:45.251149+0000","last_peered":"2024-03-30T01:52:45.251149+0000","last_clean":"2024-03-30T01:52:45.251149+0000","last_became_active":"2024-03-30T01:52:44.769540+0000","last_became_peered":"2024-03-30T01:52:44.769540+0000","last_unstale":"2024-03-30T01:52:45.251149+0000","last_undegraded":"2024-03-30T01:52:45.251149+0000","last_fullsized":"2024-03-30T01:52:45.251149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:01:00.175223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.250363+0000","last_change":"2024-03-30T01:52:45.247320+0000","last_active":"2024-03-30T01:52:45.250363+0000","last_peered":"2024-03-30T01:52:45.250363+0000","last_clean":"2024-03-30T01:52:45.250363+0000","last_became_active":"2024-03-30T01:52:45.247037+0000","last_became_peered":"2024-03-30T01:52:45.247037+0000","last_unstale":"2024-03-30T01:52:45.250363+0000","last_undegraded":"2024-03-30T01:52:45.250363+0000","last_fullsized":"2024-03-30T01:52:45.250363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:54:43.100222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232095+0000","last_change":"2024-03-30T01:52:44.763788+0000","last_active":"2024-03-30T01:52:46.232095+0000","last_peered":"2024-03-30T01:52:46.232095+0000","last_clean":"2024-03-30T01:52:46.232095+0000","last_became_active":"2024-03-30T01:52:44.763485+0000","last_became_peered":"2024-03-30T01:52:44.763485+0000","last_unstale":"2024-03-30T01:52:46.232095+0000","last_undegraded":"2024-03-30T01:52:46.232095+0000","last_fullsized":"2024-03-30T01:52:46.232095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:46:16.600667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.247831+0000","last_change":"2024-03-30T01:52:45.245966+0000","last_active":"2024-03-30T01:52:45.247831+0000","last_peered":"2024-03-30T01:52:45.247831+0000","last_clean":"2024-03-30T01:52:45.247831+0000","last_became_active":"2024-03-30T01:52:45.245719+0000","last_became_peered":"2024-03-30T01:52:45.245719+0000","last_unstale":"2024-03-30T01:52:45.247831+0000","last_undegraded":"2024-03-30T01:52:45.247831+0000","last_fullsized":"2024-03-30T01:52:45.247831+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:00:49.078516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.335925+0000","last_change":"2024-03-30T01:52:44.764496+0000","last_active":"2024-03-30T01:52:46.335925+0000","last_peered":"2024-03-30T01:52:46.335925+0000","last_clean":"2024-03-30T01:52:46.335925+0000","last_became_active":"2024-03-30T01:52:44.764184+0000","last_became_peered":"2024-03-30T01:52:44.764184+0000","last_unstale":"2024-03-30T01:52:46.335925+0000","last_undegraded":"2024-03-30T01:52:46.335925+0000","last_fullsized":"2024-03-30T01:52:46.335925+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:26:08.671043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.233072+0000","last_change":"2024-03-30T01:52:45.258895+0000","last_active":"2024-03-30T01:52:46.233072+0000","last_peered":"2024-03-30T01:52:46.233072+0000","last_clean":"2024-03-30T01:52:46.233072+0000","last_became_active":"2024-03-30T01:52:45.258604+0000","last_became_peered":"2024-03-30T01:52:45.258604+0000","last_unstale":"2024-03-30T01:52:46.233072+0000","last_undegraded":"2024-03-30T01:52:46.233072+0000","last_fullsized":"2024-03-30T01:52:46.233072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T04:10:54.309333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.264203+0000","last_change":"2024-03-30T01:52:44.767465+0000","last_active":"2024-03-30T01:52:45.264203+0000","last_peered":"2024-03-30T01:52:45.264203+0000","last_clean":"2024-03-30T01:52:45.264203+0000","last_became_active":"2024-03-30T01:52:44.767140+0000","last_became_peered":"2024-03-30T01:52:44.767140+0000","last_unstale":"2024-03-30T01:52:45.264203+0000","last_undegraded":"2024-03-30T01:52:45.264203+0000","last_fullsized":"2024-03-30T01:52:45.264203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:52:11.916895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.234369+0000","last_change":"2024-03-30T01:52:45.246757+0000","last_active":"2024-03-30T01:52:46.234369+0000","last_peered":"2024-03-30T01:52:46.234369+0000","last_clean":"2024-03-30T01:52:46.234369+0000","last_became_active":"2024-03-30T01:52:45.246464+0000","last_became_peered":"2024-03-30T01:52:45.246464+0000","last_unstale":"2024-03-30T01:52:46.234369+0000","last_undegraded":"2024-03-30T01:52:46.234369+0000","last_fullsized":"2024-03-30T01:52:46.234369+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:36:31.029273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.264191+0000","last_change":"2024-03-30T01:52:44.767992+0000","last_active":"2024-03-30T01:52:45.264191+0000","last_peered":"2024-03-30T01:52:45.264191+0000","last_clean":"2024-03-30T01:52:45.264191+0000","last_became_active":"2024-03-30T01:52:44.767694+0000","last_became_peered":"2024-03-30T01:52:44.767694+0000","last_unstale":"2024-03-30T01:52:45.264191+0000","last_undegraded":"2024-03-30T01:52:45.264191+0000","last_fullsized":"2024-03-30T01:52:45.264191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:29:52.364159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.250322+0000","last_change":"2024-03-30T01:52:45.245680+0000","last_active":"2024-03-30T01:52:45.250322+0000","last_peered":"2024-03-30T01:52:45.250322+0000","last_clean":"2024-03-30T01:52:45.250322+0000","last_became_active":"2024-03-30T01:52:45.245267+0000","last_became_peered":"2024-03-30T01:52:45.245267+0000","last_unstale":"2024-03-30T01:52:45.250322+0000","last_undegraded":"2024-03-30T01:52:45.250322+0000","last_fullsized":"2024-03-30T01:52:45.250322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:07:01.583648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.231247+0000","last_change":"2024-03-30T01:52:44.761351+0000","last_active":"2024-03-30T01:52:46.231247+0000","last_peered":"2024-03-30T01:52:46.231247+0000","last_clean":"2024-03-30T01:52:46.231247+0000","last_became_active":"2024-03-30T01:52:44.761073+0000","last_became_peered":"2024-03-30T01:52:44.761073+0000","last_unstale":"2024-03-30T01:52:46.231247+0000","last_undegraded":"2024-03-30T01:52:46.231247+0000","last_fullsized":"2024-03-30T01:52:46.231247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:07:00.578921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.246806+0000","last_change":"2024-03-30T01:52:45.243717+0000","last_active":"2024-03-30T01:52:45.246806+0000","last_peered":"2024-03-30T01:52:45.246806+0000","last_clean":"2024-03-30T01:52:45.246806+0000","last_became_active":"2024-03-30T01:52:45.243471+0000","last_became_peered":"2024-03-30T01:52:45.243471+0000","last_unstale":"2024-03-30T01:52:45.246806+0000","last_undegraded":"2024-03-30T01:52:45.246806+0000","last_fullsized":"2024-03-30T01:52:45.246806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:19:15.489873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.224379+0000","last_change":"2024-03-30T01:52:44.766673+0000","last_active":"2024-03-30T01:52:45.224379+0000","last_peered":"2024-03-30T01:52:45.224379+0000","last_clean":"2024-03-30T01:52:45.224379+0000","last_became_active":"2024-03-30T01:52:44.766431+0000","last_became_peered":"2024-03-30T01:52:44.766431+0000","last_unstale":"2024-03-30T01:52:45.224379+0000","last_undegraded":"2024-03-30T01:52:45.224379+0000","last_fullsized":"2024-03-30T01:52:45.224379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T04:41:26.499271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.235017+0000","last_change":"2024-03-30T01:52:45.254893+0000","last_active":"2024-03-30T01:52:46.235017+0000","last_peered":"2024-03-30T01:52:46.235017+0000","last_clean":"2024-03-30T01:52:46.235017+0000","last_became_active":"2024-03-30T01:52:45.254581+0000","last_became_peered":"2024-03-30T01:52:45.254581+0000","last_unstale":"2024-03-30T01:52:46.235017+0000","last_undegraded":"2024-03-30T01:52:46.235017+0000","last_fullsized":"2024-03-30T01:52:46.235017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:05:41.223740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232599+0000","last_change":"2024-03-30T01:52:44.771241+0000","last_active":"2024-03-30T01:52:46.232599+0000","last_peered":"2024-03-30T01:52:46.232599+0000","last_clean":"2024-03-30T01:52:46.232599+0000","last_became_active":"2024-03-30T01:52:44.770979+0000","last_became_peered":"2024-03-30T01:52:44.770979+0000","last_unstale":"2024-03-30T01:52:46.232599+0000","last_undegraded":"2024-03-30T01:52:46.232599+0000","last_fullsized":"2024-03-30T01:52:46.232599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:58:17.602727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232478+0000","last_change":"2024-03-30T01:52:45.234353+0000","last_active":"2024-03-30T01:52:46.232478+0000","last_peered":"2024-03-30T01:52:46.232478+0000","last_clean":"2024-03-30T01:52:46.232478+0000","last_became_active":"2024-03-30T01:52:45.234024+0000","last_became_peered":"2024-03-30T01:52:45.234024+0000","last_unstale":"2024-03-30T01:52:46.232478+0000","last_undegraded":"2024-03-30T01:52:46.232478+0000","last_fullsized":"2024-03-30T01:52:46.232478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T07:19:30.595172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.221235+0000","last_change":"2024-03-30T01:52:44.759831+0000","last_active":"2024-03-30T01:52:45.221235+0000","last_peered":"2024-03-30T01:52:45.221235+0000","last_clean":"2024-03-30T01:52:45.221235+0000","last_became_active":"2024-03-30T01:52:44.758597+0000","last_became_peered":"2024-03-30T01:52:44.758597+0000","last_unstale":"2024-03-30T01:52:45.221235+0000","last_undegraded":"2024-03-30T01:52:45.221235+0000","last_fullsized":"2024-03-30T01:52:45.221235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:31:34.391918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232006+0000","last_change":"2024-03-30T01:52:45.251201+0000","last_active":"2024-03-30T01:52:46.232006+0000","last_peered":"2024-03-30T01:52:46.232006+0000","last_clean":"2024-03-30T01:52:46.232006+0000","last_became_active":"2024-03-30T01:52:45.250985+0000","last_became_peered":"2024-03-30T01:52:45.250985+0000","last_unstale":"2024-03-30T01:52:46.232006+0000","last_undegraded":"2024-03-30T01:52:46.232006+0000","last_fullsized":"2024-03-30T01:52:46.232006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:53:18.855091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.234762+0000","last_change":"2024-03-30T01:52:44.771738+0000","last_active":"2024-03-30T01:52:46.234762+0000","last_peered":"2024-03-30T01:52:46.234762+0000","last_clean":"2024-03-30T01:52:46.234762+0000","last_became_active":"2024-03-30T01:52:44.771419+0000","last_became_peered":"2024-03-30T01:52:44.771419+0000","last_unstale":"2024-03-30T01:52:46.234762+0000","last_undegraded":"2024-03-30T01:52:46.234762+0000","last_fullsized":"2024-03-30T01:52:46.234762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:31:34.391918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.234344+0000","last_change":"2024-03-30T01:52:45.246574+0000","last_active":"2024-03-30T01:52:46.234344+0000","last_peered":"2024-03-30T01:52:46.234344+0000","last_clean":"2024-03-30T01:52:46.234344+0000","last_became_active":"2024-03-30T01:52:45.246011+0000","last_became_peered":"2024-03-30T01:52:45.246011+0000","last_unstale":"2024-03-30T01:52:46.234344+0000","last_undegraded":"2024-03-30T01:52:46.234344+0000","last_fullsized":"2024-03-30T01:52:46.234344+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:29:58.818874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232139+0000","last_change":"2024-03-30T01:52:44.756797+0000","last_active":"2024-03-30T01:52:46.232139+0000","last_peered":"2024-03-30T01:52:46.232139+0000","last_clean":"2024-03-30T01:52:46.232139+0000","last_became_active":"2024-03-30T01:52:44.756408+0000","last_became_peered":"2024-03-30T01:52:44.756408+0000","last_unstale":"2024-03-30T01:52:46.232139+0000","last_undegraded":"2024-03-30T01:52:46.232139+0000","last_fullsized":"2024-03-30T01:52:46.232139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:48:39.311839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.258776+0000","last_change":"2024-03-30T01:52:45.255011+0000","last_active":"2024-03-30T01:52:45.258776+0000","last_peered":"2024-03-30T01:52:45.258776+0000","last_clean":"2024-03-30T01:52:45.258776+0000","last_became_active":"2024-03-30T01:52:45.254731+0000","last_became_peered":"2024-03-30T01:52:45.254731+0000","last_unstale":"2024-03-30T01:52:45.258776+0000","last_undegraded":"2024-03-30T01:52:45.258776+0000","last_fullsized":"2024-03-30T01:52:45.258776+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:09:30.027957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.265774+0000","last_change":"2024-03-30T01:52:44.765178+0000","last_active":"2024-03-30T01:52:45.265774+0000","last_peered":"2024-03-30T01:52:45.265774+0000","last_clean":"2024-03-30T01:52:45.265774+0000","last_became_active":"2024-03-30T01:52:44.764520+0000","last_became_peered":"2024-03-30T01:52:44.764520+0000","last_unstale":"2024-03-30T01:52:45.265774+0000","last_undegraded":"2024-03-30T01:52:45.265774+0000","last_fullsized":"2024-03-30T01:52:45.265774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:09:32.610357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.231748+0000","last_change":"2024-03-30T01:52:45.235029+0000","last_active":"2024-03-30T01:52:46.231748+0000","last_peered":"2024-03-30T01:52:46.231748+0000","last_clean":"2024-03-30T01:52:46.231748+0000","last_became_active":"2024-03-30T01:52:45.234776+0000","last_became_peered":"2024-03-30T01:52:45.234776+0000","last_unstale":"2024-03-30T01:52:46.231748+0000","last_undegraded":"2024-03-30T01:52:46.231748+0000","last_fullsized":"2024-03-30T01:52:46.231748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:00:40.832217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.222847+0000","last_change":"2024-03-30T01:52:44.766753+0000","last_active":"2024-03-30T01:52:45.222847+0000","last_peered":"2024-03-30T01:52:45.222847+0000","last_clean":"2024-03-30T01:52:45.222847+0000","last_became_active":"2024-03-30T01:52:44.766460+0000","last_became_peered":"2024-03-30T01:52:44.766460+0000","last_unstale":"2024-03-30T01:52:45.222847+0000","last_undegraded":"2024-03-30T01:52:45.222847+0000","last_fullsized":"2024-03-30T01:52:45.222847+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:45.630452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232826+0000","last_change":"2024-03-30T01:52:45.259176+0000","last_active":"2024-03-30T01:52:46.232826+0000","last_peered":"2024-03-30T01:52:46.232826+0000","last_clean":"2024-03-30T01:52:46.232826+0000","last_became_active":"2024-03-30T01:52:45.258593+0000","last_became_peered":"2024-03-30T01:52:45.258593+0000","last_unstale":"2024-03-30T01:52:46.232826+0000","last_undegraded":"2024-03-30T01:52:46.232826+0000","last_fullsized":"2024-03-30T01:52:46.232826+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:18:41.596923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.231293+0000","last_change":"2024-03-30T01:52:44.768854+0000","last_active":"2024-03-30T01:52:46.231293+0000","last_peered":"2024-03-30T01:52:46.231293+0000","last_clean":"2024-03-30T01:52:46.231293+0000","last_became_active":"2024-03-30T01:52:44.768598+0000","last_became_peered":"2024-03-30T01:52:44.768598+0000","last_unstale":"2024-03-30T01:52:46.231293+0000","last_undegraded":"2024-03-30T01:52:46.231293+0000","last_fullsized":"2024-03-30T01:52:46.231293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:10:31.492030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.260284+0000","last_change":"2024-03-30T01:52:45.255790+0000","last_active":"2024-03-30T01:52:45.260284+0000","last_peered":"2024-03-30T01:52:45.260284+0000","last_clean":"2024-03-30T01:52:45.260284+0000","last_became_active":"2024-03-30T01:52:45.255461+0000","last_became_peered":"2024-03-30T01:52:45.255461+0000","last_unstale":"2024-03-30T01:52:45.260284+0000","last_undegraded":"2024-03-30T01:52:45.260284+0000","last_fullsized":"2024-03-30T01:52:45.260284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T04:20:38.429903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.231439+0000","last_change":"2024-03-30T01:52:44.757535+0000","last_active":"2024-03-30T01:52:46.231439+0000","last_peered":"2024-03-30T01:52:46.231439+0000","last_clean":"2024-03-30T01:52:46.231439+0000","last_became_active":"2024-03-30T01:52:44.755602+0000","last_became_peered":"2024-03-30T01:52:44.755602+0000","last_unstale":"2024-03-30T01:52:46.231439+0000","last_undegraded":"2024-03-30T01:52:46.231439+0000","last_fullsized":"2024-03-30T01:52:46.231439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T07:49:28.694408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.262463+0000","last_change":"2024-03-30T01:52:45.258254+0000","last_active":"2024-03-30T01:52:45.262463+0000","last_peered":"2024-03-30T01:52:45.262463+0000","last_clean":"2024-03-30T01:52:45.262463+0000","last_became_active":"2024-03-30T01:52:45.257759+0000","last_became_peered":"2024-03-30T01:52:45.257759+0000","last_unstale":"2024-03-30T01:52:45.262463+0000","last_undegraded":"2024-03-30T01:52:45.262463+0000","last_fullsized":"2024-03-30T01:52:45.262463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:19:15.489873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.246686+0000","last_change":"2024-03-30T01:52:44.770124+0000","last_active":"2024-03-30T01:52:45.246686+0000","last_peered":"2024-03-30T01:52:45.246686+0000","last_clean":"2024-03-30T01:52:45.246686+0000","last_became_active":"2024-03-30T01:52:44.769403+0000","last_became_peered":"2024-03-30T01:52:44.769403+0000","last_unstale":"2024-03-30T01:52:45.246686+0000","last_undegraded":"2024-03-30T01:52:45.246686+0000","last_fullsized":"2024-03-30T01:52:45.246686+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:27:20.979430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.235184+0000","last_change":"2024-03-30T01:52:45.252113+0000","last_active":"2024-03-30T01:52:46.235184+0000","last_peered":"2024-03-30T01:52:46.235184+0000","last_clean":"2024-03-30T01:52:46.235184+0000","last_became_active":"2024-03-30T01:52:45.251821+0000","last_became_peered":"2024-03-30T01:52:45.251821+0000","last_unstale":"2024-03-30T01:52:46.235184+0000","last_undegraded":"2024-03-30T01:52:46.235184+0000","last_fullsized":"2024-03-30T01:52:46.235184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:59.079244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.264456+0000","last_change":"2024-03-30T01:52:44.766114+0000","last_active":"2024-03-30T01:52:45.264456+0000","last_peered":"2024-03-30T01:52:45.264456+0000","last_clean":"2024-03-30T01:52:45.264456+0000","last_became_active":"2024-03-30T01:52:44.765823+0000","last_became_peered":"2024-03-30T01:52:44.765823+0000","last_unstale":"2024-03-30T01:52:45.264456+0000","last_undegraded":"2024-03-30T01:52:45.264456+0000","last_fullsized":"2024-03-30T01:52:45.264456+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:17:59.085482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.239312+0000","last_change":"2024-03-30T01:52:45.236061+0000","last_active":"2024-03-30T01:52:45.239312+0000","last_peered":"2024-03-30T01:52:45.239312+0000","last_clean":"2024-03-30T01:52:45.239312+0000","last_became_active":"2024-03-30T01:52:45.235789+0000","last_became_peered":"2024-03-30T01:52:45.235789+0000","last_unstale":"2024-03-30T01:52:45.239312+0000","last_undegraded":"2024-03-30T01:52:45.239312+0000","last_fullsized":"2024-03-30T01:52:45.239312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:46:17.605393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.263472+0000","last_change":"2024-03-30T01:52:44.761997+0000","last_active":"2024-03-30T01:52:45.263472+0000","last_peered":"2024-03-30T01:52:45.263472+0000","last_clean":"2024-03-30T01:52:45.263472+0000","last_became_active":"2024-03-30T01:52:44.761724+0000","last_became_peered":"2024-03-30T01:52:44.761724+0000","last_unstale":"2024-03-30T01:52:45.263472+0000","last_undegraded":"2024-03-30T01:52:45.263472+0000","last_fullsized":"2024-03-30T01:52:45.263472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:08:59.666326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.335993+0000","last_change":"2024-03-30T01:52:45.247952+0000","last_active":"2024-03-30T01:52:46.335993+0000","last_peered":"2024-03-30T01:52:46.335993+0000","last_clean":"2024-03-30T01:52:46.335993+0000","last_became_active":"2024-03-30T01:52:45.247631+0000","last_became_peered":"2024-03-30T01:52:45.247631+0000","last_unstale":"2024-03-30T01:52:46.335993+0000","last_undegraded":"2024-03-30T01:52:46.335993+0000","last_fullsized":"2024-03-30T01:52:46.335993+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:54:43.100222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.228816+0000","last_change":"2024-03-30T01:52:44.764413+0000","last_active":"2024-03-30T01:52:45.228816+0000","last_peered":"2024-03-30T01:52:45.228816+0000","last_clean":"2024-03-30T01:52:45.228816+0000","last_became_active":"2024-03-30T01:52:44.764145+0000","last_became_peered":"2024-03-30T01:52:44.764145+0000","last_unstale":"2024-03-30T01:52:45.228816+0000","last_undegraded":"2024-03-30T01:52:45.228816+0000","last_fullsized":"2024-03-30T01:52:45.228816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:26:08.671043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.335596+0000","last_change":"2024-03-30T01:52:45.242087+0000","last_active":"2024-03-30T01:52:46.335596+0000","last_peered":"2024-03-30T01:52:46.335596+0000","last_clean":"2024-03-30T01:52:46.335596+0000","last_became_active":"2024-03-30T01:52:45.241735+0000","last_became_peered":"2024-03-30T01:52:45.241735+0000","last_unstale":"2024-03-30T01:52:46.335596+0000","last_undegraded":"2024-03-30T01:52:46.335596+0000","last_fullsized":"2024-03-30T01:52:46.335596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:28:18.785682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.240965+0000","last_change":"2024-03-30T01:52:44.755025+0000","last_active":"2024-03-30T01:52:45.240965+0000","last_peered":"2024-03-30T01:52:45.240965+0000","last_clean":"2024-03-30T01:52:45.240965+0000","last_became_active":"2024-03-30T01:52:44.754739+0000","last_became_peered":"2024-03-30T01:52:44.754739+0000","last_unstale":"2024-03-30T01:52:45.240965+0000","last_undegraded":"2024-03-30T01:52:45.240965+0000","last_fullsized":"2024-03-30T01:52:45.240965+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:12:07.468613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.335659+0000","last_change":"2024-03-30T01:52:45.233315+0000","last_active":"2024-03-30T01:52:46.335659+0000","last_peered":"2024-03-30T01:52:46.335659+0000","last_clean":"2024-03-30T01:52:46.335659+0000","last_became_active":"2024-03-30T01:52:45.233027+0000","last_became_peered":"2024-03-30T01:52:45.233027+0000","last_unstale":"2024-03-30T01:52:46.335659+0000","last_undegraded":"2024-03-30T01:52:46.335659+0000","last_fullsized":"2024-03-30T01:52:46.335659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:10:32.496756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.250852+0000","last_change":"2024-03-30T01:52:44.770445+0000","last_active":"2024-03-30T01:52:45.250852+0000","last_peered":"2024-03-30T01:52:45.250852+0000","last_clean":"2024-03-30T01:52:45.250852+0000","last_became_active":"2024-03-30T01:52:44.770167+0000","last_became_peered":"2024-03-30T01:52:44.770167+0000","last_unstale":"2024-03-30T01:52:45.250852+0000","last_undegraded":"2024-03-30T01:52:45.250852+0000","last_fullsized":"2024-03-30T01:52:45.250852+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:12:07.468613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.335565+0000","last_change":"2024-03-30T01:52:45.228710+0000","last_active":"2024-03-30T01:52:46.335565+0000","last_peered":"2024-03-30T01:52:46.335565+0000","last_clean":"2024-03-30T01:52:46.335565+0000","last_became_active":"2024-03-30T01:52:45.228470+0000","last_became_peered":"2024-03-30T01:52:45.228470+0000","last_unstale":"2024-03-30T01:52:46.335565+0000","last_undegraded":"2024-03-30T01:52:46.335565+0000","last_fullsized":"2024-03-30T01:52:46.335565+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:46:17.605393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.226869+0000","last_change":"2024-03-30T01:52:44.760365+0000","last_active":"2024-03-30T01:52:45.226869+0000","last_peered":"2024-03-30T01:52:45.226869+0000","last_clean":"2024-03-30T01:52:45.226869+0000","last_became_active":"2024-03-30T01:52:44.760049+0000","last_became_peered":"2024-03-30T01:52:44.760049+0000","last_unstale":"2024-03-30T01:52:45.226869+0000","last_undegraded":"2024-03-30T01:52:45.226869+0000","last_fullsized":"2024-03-30T01:52:45.226869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:02:37.203707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232633+0000","last_change":"2024-03-30T01:52:45.256542+0000","last_active":"2024-03-30T01:52:46.232633+0000","last_peered":"2024-03-30T01:52:46.232633+0000","last_clean":"2024-03-30T01:52:46.232633+0000","last_became_active":"2024-03-30T01:52:45.256275+0000","last_became_peered":"2024-03-30T01:52:45.256275+0000","last_unstale":"2024-03-30T01:52:46.232633+0000","last_undegraded":"2024-03-30T01:52:46.232633+0000","last_fullsized":"2024-03-30T01:52:46.232633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:12:26.160745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.233491+0000","last_change":"2024-03-30T01:52:44.771285+0000","last_active":"2024-03-30T01:52:46.233491+0000","last_peered":"2024-03-30T01:52:46.233491+0000","last_clean":"2024-03-30T01:52:46.233491+0000","last_became_active":"2024-03-30T01:52:44.770929+0000","last_became_peered":"2024-03-30T01:52:44.770929+0000","last_unstale":"2024-03-30T01:52:46.233491+0000","last_undegraded":"2024-03-30T01:52:46.233491+0000","last_fullsized":"2024-03-30T01:52:46.233491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:01:00.175223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.336209+0000","last_change":"2024-03-30T01:52:45.261014+0000","last_active":"2024-03-30T01:52:46.336209+0000","last_peered":"2024-03-30T01:52:46.336209+0000","last_clean":"2024-03-30T01:52:46.336209+0000","last_became_active":"2024-03-30T01:52:45.260577+0000","last_became_peered":"2024-03-30T01:52:45.260577+0000","last_unstale":"2024-03-30T01:52:46.336209+0000","last_undegraded":"2024-03-30T01:52:46.336209+0000","last_fullsized":"2024-03-30T01:52:46.336209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:58:18.607454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.260772+0000","last_change":"2024-03-30T01:52:44.768791+0000","last_active":"2024-03-30T01:52:45.260772+0000","last_peered":"2024-03-30T01:52:45.260772+0000","last_clean":"2024-03-30T01:52:45.260772+0000","last_became_active":"2024-03-30T01:52:44.767077+0000","last_became_peered":"2024-03-30T01:52:44.767077+0000","last_unstale":"2024-03-30T01:52:45.260772+0000","last_undegraded":"2024-03-30T01:52:45.260772+0000","last_fullsized":"2024-03-30T01:52:45.260772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:17:59.085482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.235199+0000","last_change":"2024-03-30T01:52:45.251137+0000","last_active":"2024-03-30T01:52:46.235199+0000","last_peered":"2024-03-30T01:52:46.235199+0000","last_clean":"2024-03-30T01:52:46.235199+0000","last_became_active":"2024-03-30T01:52:45.249461+0000","last_became_peered":"2024-03-30T01:52:45.249461+0000","last_unstale":"2024-03-30T01:52:46.235199+0000","last_undegraded":"2024-03-30T01:52:46.235199+0000","last_fullsized":"2024-03-30T01:52:46.235199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:46:05.645391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.221371+0000","last_change":"2024-03-30T01:52:44.763644+0000","last_active":"2024-03-30T01:52:45.221371+0000","last_peered":"2024-03-30T01:52:45.221371+0000","last_clean":"2024-03-30T01:52:45.221371+0000","last_became_active":"2024-03-30T01:52:44.763354+0000","last_became_peered":"2024-03-30T01:52:44.763354+0000","last_unstale":"2024-03-30T01:52:45.221371+0000","last_undegraded":"2024-03-30T01:52:45.221371+0000","last_fullsized":"2024-03-30T01:52:45.221371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:45.630452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.234514+0000","last_change":"2024-03-30T01:52:45.232184+0000","last_active":"2024-03-30T01:52:45.234514+0000","last_peered":"2024-03-30T01:52:45.234514+0000","last_clean":"2024-03-30T01:52:45.234514+0000","last_became_active":"2024-03-30T01:52:45.231678+0000","last_became_peered":"2024-03-30T01:52:45.231678+0000","last_unstale":"2024-03-30T01:52:45.234514+0000","last_undegraded":"2024-03-30T01:52:45.234514+0000","last_fullsized":"2024-03-30T01:52:45.234514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:07:01.583648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.223449+0000","last_change":"2024-03-30T01:52:44.762993+0000","last_active":"2024-03-30T01:52:45.223449+0000","last_peered":"2024-03-30T01:52:45.223449+0000","last_clean":"2024-03-30T01:52:45.223449+0000","last_became_active":"2024-03-30T01:52:44.762709+0000","last_became_peered":"2024-03-30T01:52:44.762709+0000","last_unstale":"2024-03-30T01:52:45.223449+0000","last_undegraded":"2024-03-30T01:52:45.223449+0000","last_fullsized":"2024-03-30T01:52:45.223449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:12:07.468613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.259672+0000","last_change":"2024-03-30T01:52:45.254863+0000","last_active":"2024-03-30T01:52:45.259672+0000","last_peered":"2024-03-30T01:52:45.259672+0000","last_clean":"2024-03-30T01:52:45.259672+0000","last_became_active":"2024-03-30T01:52:45.254488+0000","last_became_peered":"2024-03-30T01:52:45.254488+0000","last_unstale":"2024-03-30T01:52:45.259672+0000","last_undegraded":"2024-03-30T01:52:45.259672+0000","last_fullsized":"2024-03-30T01:52:45.259672+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:46:17.605393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.221129+0000","last_change":"2024-03-30T01:52:44.766714+0000","last_active":"2024-03-30T01:52:45.221129+0000","last_peered":"2024-03-30T01:52:45.221129+0000","last_clean":"2024-03-30T01:52:45.221129+0000","last_became_active":"2024-03-30T01:52:44.766459+0000","last_became_peered":"2024-03-30T01:52:44.766459+0000","last_unstale":"2024-03-30T01:52:45.221129+0000","last_undegraded":"2024-03-30T01:52:45.221129+0000","last_fullsized":"2024-03-30T01:52:45.221129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:27:20.979430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.246008+0000","last_change":"2024-03-30T01:52:45.245131+0000","last_active":"2024-03-30T01:52:45.246008+0000","last_peered":"2024-03-30T01:52:45.246008+0000","last_clean":"2024-03-30T01:52:45.246008+0000","last_became_active":"2024-03-30T01:52:45.244896+0000","last_became_peered":"2024-03-30T01:52:45.244896+0000","last_unstale":"2024-03-30T01:52:45.246008+0000","last_undegraded":"2024-03-30T01:52:45.246008+0000","last_fullsized":"2024-03-30T01:52:45.246008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:58:18.607454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.222932+0000","last_change":"2024-03-30T01:52:44.769251+0000","last_active":"2024-03-30T01:52:45.222932+0000","last_peered":"2024-03-30T01:52:45.222932+0000","last_clean":"2024-03-30T01:52:45.222932+0000","last_became_active":"2024-03-30T01:52:44.767017+0000","last_became_peered":"2024-03-30T01:52:44.767017+0000","last_unstale":"2024-03-30T01:52:45.222932+0000","last_undegraded":"2024-03-30T01:52:45.222932+0000","last_fullsized":"2024-03-30T01:52:45.222932+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:09:32.610357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.231261+0000","last_change":"2024-03-30T01:52:45.229863+0000","last_active":"2024-03-30T01:52:46.231261+0000","last_peered":"2024-03-30T01:52:46.231261+0000","last_clean":"2024-03-30T01:52:46.231261+0000","last_became_active":"2024-03-30T01:52:45.229610+0000","last_became_peered":"2024-03-30T01:52:45.229610+0000","last_unstale":"2024-03-30T01:52:46.231261+0000","last_undegraded":"2024-03-30T01:52:46.231261+0000","last_fullsized":"2024-03-30T01:52:46.231261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:18:41.596923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.227152+0000","last_change":"2024-03-30T01:52:44.763397+0000","last_active":"2024-03-30T01:52:45.227152+0000","last_peered":"2024-03-30T01:52:45.227152+0000","last_clean":"2024-03-30T01:52:45.227152+0000","last_became_active":"2024-03-30T01:52:44.763114+0000","last_became_peered":"2024-03-30T01:52:44.763114+0000","last_unstale":"2024-03-30T01:52:45.227152+0000","last_undegraded":"2024-03-30T01:52:45.227152+0000","last_fullsized":"2024-03-30T01:52:45.227152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:02:18.337380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.252409+0000","last_change":"2024-03-30T01:52:45.248108+0000","last_active":"2024-03-30T01:52:45.252409+0000","last_peered":"2024-03-30T01:52:45.252409+0000","last_clean":"2024-03-30T01:52:45.252409+0000","last_became_active":"2024-03-30T01:52:45.246789+0000","last_became_peered":"2024-03-30T01:52:45.246789+0000","last_unstale":"2024-03-30T01:52:45.252409+0000","last_undegraded":"2024-03-30T01:52:45.252409+0000","last_fullsized":"2024-03-30T01:52:45.252409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T04:20:38.429903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.231499+0000","last_change":"2024-03-30T01:52:44.768925+0000","last_active":"2024-03-30T01:52:46.231499+0000","last_peered":"2024-03-30T01:52:46.231499+0000","last_clean":"2024-03-30T01:52:46.231499+0000","last_became_active":"2024-03-30T01:52:44.768652+0000","last_became_peered":"2024-03-30T01:52:44.768652+0000","last_unstale":"2024-03-30T01:52:46.231499+0000","last_undegraded":"2024-03-30T01:52:46.231499+0000","last_fullsized":"2024-03-30T01:52:46.231499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:28:17.780956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.233641+0000","last_change":"2024-03-30T01:52:45.248046+0000","last_active":"2024-03-30T01:52:46.233641+0000","last_peered":"2024-03-30T01:52:46.233641+0000","last_clean":"2024-03-30T01:52:46.233641+0000","last_became_active":"2024-03-30T01:52:45.247774+0000","last_became_peered":"2024-03-30T01:52:45.247774+0000","last_unstale":"2024-03-30T01:52:46.233641+0000","last_undegraded":"2024-03-30T01:52:46.233641+0000","last_fullsized":"2024-03-30T01:52:46.233641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:04:09.706763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.255120+0000","last_change":"2024-03-30T01:52:44.768816+0000","last_active":"2024-03-30T01:52:45.255120+0000","last_peered":"2024-03-30T01:52:45.255120+0000","last_clean":"2024-03-30T01:52:45.255120+0000","last_became_active":"2024-03-30T01:52:44.768546+0000","last_became_peered":"2024-03-30T01:52:44.768546+0000","last_unstale":"2024-03-30T01:52:45.255120+0000","last_undegraded":"2024-03-30T01:52:45.255120+0000","last_fullsized":"2024-03-30T01:52:45.255120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:31:34.391918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.239885+0000","last_change":"2024-03-30T01:51:23.358245+0000","last_active":"2024-03-30T01:52:45.239885+0000","last_peered":"2024-03-30T01:52:45.239885+0000","last_clean":"2024-03-30T01:52:45.239885+0000","last_became_active":"2024-03-30T01:51:23.355914+0000","last_became_peered":"2024-03-30T01:51:23.355914+0000","last_unstale":"2024-03-30T01:52:45.239885+0000","last_undegraded":"2024-03-30T01:52:45.239885+0000","last_fullsized":"2024-03-30T01:52:45.239885+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_clean_scrub_stamp":"2024-03-30T01:51:21.990253+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:21:19.291194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":742353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.1850000000000001}]},{"osd":1,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.623},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.88500000000000001}]},{"osd":2,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.05}]},{"osd":3,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.0860000000000001}]},{"osd":4,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":1.4990000000000001}]},{"osd":5,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.329},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.129,"5min":2.129,"15min":2.129},"last":1.2769999999999999}]},{"osd":6,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.2190000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":146211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.88200000000000001}]},{"osd":1,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.196},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.0800000000000001}]},{"osd":2,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.026}]},{"osd":3,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":1.2310000000000001}]},{"osd":4,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":1.319},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.5860000000000001}]},{"osd":5,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.6559999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.528,"5min":2.528,"15min":2.528},"last":1.2809999999999999}]},{"osd":7,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.776},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.4350000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":1.6299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":146267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":13.811999999999999,"5min":13.811999999999999,"15min":13.811999999999999},"last":3.278},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.5030000000000001,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":7.3049999999999997}]},{"osd":1,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":9.9900000000000002,"5min":9.9900000000000002,"15min":9.9900000000000002},"last":4.7370000000000001},{"interface":"front","average":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":6.024,"5min":6.024,"15min":6.024},"last":3.3889999999999998}]},{"osd":2,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":6.109,"5min":6.109,"15min":6.109},"last":3.3380000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":7.3609999999999998}]},{"osd":3,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":6.6950000000000003,"5min":6.6950000000000003,"15min":6.6950000000000003},"last":7.5049999999999999},{"interface":"front","average":{"1min":1.956,"5min":1.956,"15min":1.956},"min":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"max":{"1min":9.9489999999999998,"5min":9.9489999999999998,"15min":9.9489999999999998},"last":4.5030000000000001}]},{"osd":4,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":6.1520000000000001,"5min":6.1520000000000001,"15min":6.1520000000000001},"last":9.5879999999999992},{"interface":"front","average":{"1min":1.819,"5min":1.819,"15min":1.819},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":6.6100000000000003,"5min":6.6100000000000003,"15min":6.6100000000000003},"last":7.6769999999999996}]},{"osd":6,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":2.052,"5min":2.052,"15min":2.052},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":9.8160000000000007,"5min":9.8160000000000007,"15min":9.8160000000000007},"last":4.4390000000000001},{"interface":"front","average":{"1min":2,"5min":2,"15min":2},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":6.0679999999999996,"5min":6.0679999999999996,"15min":6.0679999999999996},"last":9.5199999999999996}]},{"osd":7,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":1.831,"15min":1.831},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":7.6340000000000003},{"interface":"front","average":{"1min":2.214,"5min":2.214,"15min":2.214},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":9.8650000000000002,"5min":9.8650000000000002,"15min":9.8650000000000002},"last":4.7889999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":145699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":1.0860000000000001}]},{"osd":1,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.143},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":1.296}]},{"osd":2,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.1859999999999999}]},{"osd":3,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":4.9969999999999999,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":1.393},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"min":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":4.6680000000000001,"5min":4.6680000000000001,"15min":4.6680000000000001},"last":1.5589999999999999}]},{"osd":5,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.9729999999999999,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":3.4790000000000001,"5min":3.4790000000000001,"15min":3.4790000000000001},"last":1.494}]},{"osd":6,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.333}]},{"osd":7,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.625,"5min":1.625,"15min":1.625},"min":{"1min":1.113,"5min":1.113,"15min":1.113},"max":{"1min":2.4409999999999998,"5min":2.4409999999999998,"15min":2.4409999999999998},"last":1.5329999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":153481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":9.298,"5min":9.298,"15min":9.298},"last":0.749},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.806,"5min":3.806,"15min":3.806},"last":0.79300000000000004}]},{"osd":1,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":3.1070000000000002,"5min":3.1070000000000002,"15min":3.1070000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":9.3659999999999997,"5min":9.3659999999999997,"15min":9.3659999999999997},"last":0.628}]},{"osd":2,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":5.7949999999999999,"5min":5.7949999999999999,"15min":5.7949999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":6.7240000000000002,"5min":6.7240000000000002,"15min":6.7240000000000002},"last":0.92300000000000004}]},{"osd":4,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":6.1280000000000001,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.97799999999999998}]},{"osd":5,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.125},{"interface":"front","average":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":18.904,"5min":18.904,"15min":18.904},"last":1.1080000000000001}]},{"osd":6,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":3.9209999999999998,"5min":3.9209999999999998,"15min":3.9209999999999998},"last":1.018},{"interface":"front","average":{"1min":1.738,"5min":1.738,"15min":1.738},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":5.0919999999999996,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":1.079}]},{"osd":7,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.903,"5min":1.903,"15min":1.903},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":6.8600000000000003,"5min":6.8600000000000003,"15min":6.8600000000000003},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":4.4669999999999996,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":0.95499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":150946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.78800000000000003}]},{"osd":1,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.63},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.56399999999999995}]},{"osd":3,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":4.742,"5min":4.742,"15min":4.742},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":0.71799999999999997}]},{"osd":4,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.5609999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.212}]},{"osd":5,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":3.012,"5min":3.012,"15min":3.012},"last":1.423},{"interface":"front","average":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":8.125,"5min":8.125,"15min":8.125},"last":1.3839999999999999}]},{"osd":6,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":5.6449999999999996,"5min":5.6449999999999996,"15min":5.6449999999999996},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.554}]},{"osd":7,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.228}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":147181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2,"5min":2,"15min":2},"last":1.083}]},{"osd":2,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.7549999999999999,"5min":4.7549999999999999,"15min":4.7549999999999999},"last":0.872}]},{"osd":3,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":3.0619999999999998,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":6.04,"5min":6.04,"15min":6.04},"last":1.3380000000000001}]},{"osd":4,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.629,"5min":2.629,"15min":2.629},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":3.7669999999999999,"5min":3.7669999999999999,"15min":3.7669999999999999},"last":1.6040000000000001}]},{"osd":5,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.532,"5min":1.532,"15min":1.532},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":4.2480000000000002,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":1.51},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":3.9359999999999999,"5min":3.9359999999999999,"15min":3.9359999999999999},"last":1.548}]},{"osd":6,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.4209999999999998,"5min":2.4209999999999998,"15min":2.4209999999999998},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":3.2559999999999998,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":1.571}]},{"osd":7,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.6869999999999998,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":1.47},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.1140000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":962560,"data_stored":734944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.6190000000000002,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":0.90300000000000002}]},{"osd":2,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.2070000000000001}]},{"osd":3,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":5.2679999999999998,"5min":5.2679999999999998,"15min":5.2679999999999998},"last":0.65500000000000003}]},{"osd":4,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.141},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":3.3540000000000001,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":1.502}]},{"osd":5,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.2969999999999999}]},{"osd":6,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.9279999999999999,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.8690000000000002,"5min":2.8690000000000002,"15min":2.8690000000000002},"last":1.325}]},{"osd":7,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.8010000000000002,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.595},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":4.923,"5min":4.923,"15min":4.923},"last":1.448}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T01:52:49.613 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T01:52:49.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.849+0000 7f9c6be00640 1 Processor -- start 2024-03-30T01:52:49.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.850+0000 7f9c6be00640 1 -- start start 2024-03-30T01:52:49.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.851+0000 7f9c6be00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9c6c15a6e0 0x7f9c6c0b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:49.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.851+0000 7f9c6be00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c0b3ca0 con 0x7f9c6c160520 2024-03-30T01:52:49.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.851+0000 7f9c6be00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c0b3f80 con 0x7f9c6c15a300 2024-03-30T01:52:49.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.851+0000 7f9c6be00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c6c0b4260 con 0x7f9c6c15a6e0 2024-03-30T01:52:49.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.852+0000 7f9c62000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9c6c15a6e0 0x7f9c6c0b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:49.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.852+0000 7f9c6b400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9c6c160520 0x7f9c6c0abee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47762/0 (socket says 172.21.15.133:47762) 2024-03-30T01:52:49.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.852+0000 7f9c62000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9c6c15a6e0 0x7f9c6c0b1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35446/0 (socket says 172.21.15.133:35446) 2024-03-30T01:52:49.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.852+0000 7f9c6b400640 1 -- 172.21.15.133:0/1662348636 learned_addr learned my addr 172.21.15.133:0/1662348636 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:49.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.852+0000 7f9c6a000640 1 -- 172.21.15.133:0/1662348636 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 78655120 0 0) 0x7f9c6c0b3ca0 con 0x7f9c6c160520 2024-03-30T01:52:49.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.852+0000 7f9c6a000640 1 -- 172.21.15.133:0/1662348636 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c50003520 con 0x7f9c6c160520 2024-03-30T01:52:49.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.852+0000 7f9c62000640 1 -- 172.21.15.133:0/1662348636 >> v1:172.21.15.137:6789/0 conn(0x7f9c6c15a300 legacy=0x7f9c6c0b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:49.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.852+0000 7f9c62000640 1 -- 172.21.15.133:0/1662348636 >> v1:172.21.15.133:6789/0 conn(0x7f9c6c160520 legacy=0x7f9c6c0abee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:49.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.852+0000 7f9c62000640 1 -- 172.21.15.133:0/1662348636 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c0b4540 con 0x7f9c6c15a6e0 2024-03-30T01:52:49.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.854+0000 7f9c62000640 1 --2- 172.21.15.133:0/1662348636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c6c15a6e0 0x7f9c6c0b1ad0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9c540097a0 tx=0x7f9c5402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa4089485ceb9b4a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:49.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.854+0000 7f9c6a000640 1 -- 172.21.15.133:0/1662348636 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c54030610 con 0x7f9c6c15a6e0 2024-03-30T01:52:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.854+0000 7f9c6a000640 1 -- 172.21.15.133:0/1662348636 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c54030770 con 0x7f9c6c15a6e0 2024-03-30T01:52:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.854+0000 7f9c6a000640 1 -- 172.21.15.133:0/1662348636 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c54030b00 con 0x7f9c6c15a6e0 2024-03-30T01:52:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.855+0000 7f9c6be00640 1 -- 172.21.15.133:0/1662348636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c6c15a6e0 msgr2=0x7f9c6c0b1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.855+0000 7f9c6be00640 1 --2- 172.21.15.133:0/1662348636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c6c15a6e0 0x7f9c6c0b1ad0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9c540097a0 tx=0x7f9c5402b960 comp rx=0 tx=0).stop 2024-03-30T01:52:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.855+0000 7f9c6be00640 1 -- 172.21.15.133:0/1662348636 shutdown_connections 2024-03-30T01:52:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.855+0000 7f9c6be00640 1 --2- 172.21.15.133:0/1662348636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c6c15a6e0 0x7f9c6c0b1ad0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.855+0000 7f9c6be00640 1 -- 172.21.15.133:0/1662348636 >> 172.21.15.133:0/1662348636 conn(0x7f9c6c0b05a0 msgr2=0x7f9c6c0b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.855+0000 7f9c6be00640 1 -- 172.21.15.133:0/1662348636 shutdown_connections 2024-03-30T01:52:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.855+0000 7f9c6be00640 1 -- 172.21.15.133:0/1662348636 wait complete. 2024-03-30T01:52:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.856+0000 7f9c6be00640 1 Processor -- start 2024-03-30T01:52:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.857+0000 7f9c6be00640 1 -- start start 2024-03-30T01:52:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.857+0000 7f9c6be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c6c15a300 0x7f9c6c156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.857+0000 7f9c6be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c6c15a6e0 0x7f9c6c14eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:49.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.857+0000 7f9c6be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c6c160520 0x7f9c6c152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:49.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.857+0000 7f9c6be00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c157fe0 con 0x7f9c6c15a300 2024-03-30T01:52:49.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.857+0000 7f9c6be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c1e6260 con 0x7f9c6c15a6e0 2024-03-30T01:52:49.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.857+0000 7f9c6be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c1e6540 con 0x7f9c6c160520 2024-03-30T01:52:49.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.858+0000 7f9c6aa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c6c15a300 0x7f9c6c156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:49.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.858+0000 7f9c6aa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c6c15a300 0x7f9c6c156cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35452/0 (socket says 172.21.15.133:35452) 2024-03-30T01:52:49.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.858+0000 7f9c6aa00640 1 -- 172.21.15.133:0/2419740558 learned_addr learned my addr 172.21.15.133:0/2419740558 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:49.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.858+0000 7f9c6b400640 1 --2- 172.21.15.133:0/2419740558 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c6c160520 0x7f9c6c152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:49.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.858+0000 7f9c62000640 1 --2- 172.21.15.133:0/2419740558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c6c15a6e0 0x7f9c6c14eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:49.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.858+0000 7f9c6aa00640 1 -- 172.21.15.133:0/2419740558 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c6c160520 msgr2=0x7f9c6c152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:49.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.858+0000 7f9c6aa00640 1 --2- 172.21.15.133:0/2419740558 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c6c160520 0x7f9c6c152d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:49.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.858+0000 7f9c6aa00640 1 -- 172.21.15.133:0/2419740558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c6c15a6e0 msgr2=0x7f9c6c14eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:49.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.858+0000 7f9c6aa00640 1 --2- 172.21.15.133:0/2419740558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c6c15a6e0 0x7f9c6c14eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:49.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.858+0000 7f9c6aa00640 1 -- 172.21.15.133:0/2419740558 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c54009400 con 0x7f9c6c15a300 2024-03-30T01:52:49.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.859+0000 7f9c6aa00640 1 --2- 172.21.15.133:0/2419740558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c6c15a300 0x7f9c6c156cd0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00c450 tx=0x7f9c5c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:49.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.859+0000 7f9c63e00640 1 -- 172.21.15.133:0/2419740558 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c0052d0 con 0x7f9c6c15a300 2024-03-30T01:52:49.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.859+0000 7f9c63e00640 1 -- 172.21.15.133:0/2419740558 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5c005430 con 0x7f9c6c15a300 2024-03-30T01:52:49.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.859+0000 7f9c63e00640 1 -- 172.21.15.133:0/2419740558 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c012870 con 0x7f9c6c15a300 2024-03-30T01:52:49.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.859+0000 7f9c6be00640 1 -- 172.21.15.133:0/2419740558 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c6c1e6820 con 0x7f9c6c15a300 2024-03-30T01:52:49.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.859+0000 7f9c6be00640 1 -- 172.21.15.133:0/2419740558 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6c1e6de0 con 0x7f9c6c15a300 2024-03-30T01:52:49.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.860+0000 7f9c6be00640 1 -- 172.21.15.133:0/2419740558 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c6c073750 con 0x7f9c6c15a300 2024-03-30T01:52:49.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.861+0000 7f9c63e00640 1 -- 172.21.15.133:0/2419740558 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9c5c0129d0 con 0x7f9c6c15a300 2024-03-30T01:52:49.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.862+0000 7f9c63e00640 1 --2- 172.21.15.133:0/2419740558 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9c4806ac00 0x7f9c4806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:49.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.862+0000 7f9c63e00640 1 -- 172.21.15.133:0/2419740558 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c5c088f60 con 0x7f9c6c15a300 2024-03-30T01:52:49.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.862+0000 7f9c62000640 1 --2- 172.21.15.133:0/2419740558 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9c4806ac00 0x7f9c4806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:49.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.863+0000 7f9c62000640 1 --2- 172.21.15.133:0/2419740558 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9c4806ac00 0x7f9c4806d0c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9c54036000 tx=0x7f9c5403b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:49.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:49.866+0000 7f9c63e00640 1 -- 172.21.15.133:0/2419740558 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f9c5c0540a0 con 0x7f9c6c15a300 2024-03-30T01:52:50.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.058+0000 7f9c6be00640 1 -- 172.21.15.133:0/2419740558 --> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9c6c06e510 con 0x7f9c4806ac00 2024-03-30T01:52:50.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.070+0000 7f9c63e00640 1 -- 172.21.15.133:0/2419740558 <== mgr.4105 v2:172.21.15.133:6832/37234 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286720 (secure 0 0 0) 0x7f9c6c06e510 con 0x7f9c4806ac00 2024-03-30T01:52:50.080 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:50.081 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-03-30T01:52:50.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.075+0000 7f9c6be00640 1 -- 172.21.15.133:0/2419740558 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9c4806ac00 msgr2=0x7f9c4806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:50.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.075+0000 7f9c6be00640 1 --2- 172.21.15.133:0/2419740558 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9c4806ac00 0x7f9c4806d0c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9c54036000 tx=0x7f9c5403b040 comp rx=0 tx=0).stop 2024-03-30T01:52:50.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.075+0000 7f9c6be00640 1 -- 172.21.15.133:0/2419740558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c6c15a300 msgr2=0x7f9c6c156cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:50.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.075+0000 7f9c6be00640 1 --2- 172.21.15.133:0/2419740558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c6c15a300 0x7f9c6c156cd0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00c450 tx=0x7f9c5c00c910 comp rx=0 tx=0).stop 2024-03-30T01:52:50.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.075+0000 7f9c6be00640 1 -- 172.21.15.133:0/2419740558 shutdown_connections 2024-03-30T01:52:50.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.075+0000 7f9c6be00640 1 --2- 172.21.15.133:0/2419740558 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9c4806ac00 0x7f9c4806d0c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:50.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.075+0000 7f9c6be00640 1 --2- 172.21.15.133:0/2419740558 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c6c160520 0x7f9c6c152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:50.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.075+0000 7f9c6be00640 1 --2- 172.21.15.133:0/2419740558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c6c15a6e0 0x7f9c6c14eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:50.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.075+0000 7f9c6be00640 1 --2- 172.21.15.133:0/2419740558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c6c15a300 0x7f9c6c156cd0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:50.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.075+0000 7f9c6be00640 1 -- 172.21.15.133:0/2419740558 >> 172.21.15.133:0/2419740558 conn(0x7f9c6c0b05a0 msgr2=0x7f9c6c15e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:50.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.075+0000 7f9c6be00640 1 -- 172.21.15.133:0/2419740558 shutdown_connections 2024-03-30T01:52:50.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.075+0000 7f9c6be00640 1 -- 172.21.15.133:0/2419740558 wait complete. 2024-03-30T01:52:50.101 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2024-03-30T01:52:49.719544+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220364,"kb_used_data":4164,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754356,"statfs":{"total":773094113280,"available":772868460544,"internally_reserved":0,"allocated":4263936,"data_stored":2367082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.992131"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.265519+0000","last_change":"2024-03-30T01:52:45.261389+0000","last_active":"2024-03-30T01:52:45.265519+0000","last_peered":"2024-03-30T01:52:45.265519+0000","last_clean":"2024-03-30T01:52:45.265519+0000","last_became_active":"2024-03-30T01:52:45.261094+0000","last_became_peered":"2024-03-30T01:52:45.261094+0000","last_unstale":"2024-03-30T01:52:45.265519+0000","last_undegraded":"2024-03-30T01:52:45.265519+0000","last_fullsized":"2024-03-30T01:52:45.265519+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:07:01.583648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232140+0000","last_change":"2024-03-30T01:52:45.240933+0000","last_active":"2024-03-30T01:52:46.232140+0000","last_peered":"2024-03-30T01:52:46.232140+0000","last_clean":"2024-03-30T01:52:46.232140+0000","last_became_active":"2024-03-30T01:52:45.238584+0000","last_became_peered":"2024-03-30T01:52:45.238584+0000","last_unstale":"2024-03-30T01:52:46.232140+0000","last_undegraded":"2024-03-30T01:52:46.232140+0000","last_fullsized":"2024-03-30T01:52:46.232140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:29:58.818874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.234609+0000","last_change":"2024-03-30T01:52:45.246468+0000","last_active":"2024-03-30T01:52:46.234609+0000","last_peered":"2024-03-30T01:52:46.234609+0000","last_clean":"2024-03-30T01:52:46.234609+0000","last_became_active":"2024-03-30T01:52:45.244877+0000","last_became_peered":"2024-03-30T01:52:45.244877+0000","last_unstale":"2024-03-30T01:52:46.234609+0000","last_undegraded":"2024-03-30T01:52:46.234609+0000","last_fullsized":"2024-03-30T01:52:46.234609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:37:49.475134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.239333+0000","last_change":"2024-03-30T01:52:45.236406+0000","last_active":"2024-03-30T01:52:45.239333+0000","last_peered":"2024-03-30T01:52:45.239333+0000","last_clean":"2024-03-30T01:52:45.239333+0000","last_became_active":"2024-03-30T01:52:45.236020+0000","last_became_peered":"2024-03-30T01:52:45.236020+0000","last_unstale":"2024-03-30T01:52:45.239333+0000","last_undegraded":"2024-03-30T01:52:45.239333+0000","last_fullsized":"2024-03-30T01:52:45.239333+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:48:40.316565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.335535+0000","last_change":"2024-03-30T01:52:45.238144+0000","last_active":"2024-03-30T01:52:46.335535+0000","last_peered":"2024-03-30T01:52:46.335535+0000","last_clean":"2024-03-30T01:52:46.335535+0000","last_became_active":"2024-03-30T01:52:45.237895+0000","last_became_peered":"2024-03-30T01:52:45.237895+0000","last_unstale":"2024-03-30T01:52:46.335535+0000","last_undegraded":"2024-03-30T01:52:46.335535+0000","last_fullsized":"2024-03-30T01:52:46.335535+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:07:01.583648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.231658+0000","last_change":"2024-03-30T01:52:45.254391+0000","last_active":"2024-03-30T01:52:46.231658+0000","last_peered":"2024-03-30T01:52:46.231658+0000","last_clean":"2024-03-30T01:52:46.231658+0000","last_became_active":"2024-03-30T01:52:45.254126+0000","last_became_peered":"2024-03-30T01:52:45.254126+0000","last_unstale":"2024-03-30T01:52:46.231658+0000","last_undegraded":"2024-03-30T01:52:46.231658+0000","last_fullsized":"2024-03-30T01:52:46.231658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:37:49.475134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232897+0000","last_change":"2024-03-30T01:52:45.263005+0000","last_active":"2024-03-30T01:52:46.232897+0000","last_peered":"2024-03-30T01:52:46.232897+0000","last_clean":"2024-03-30T01:52:46.232897+0000","last_became_active":"2024-03-30T01:52:45.262698+0000","last_became_peered":"2024-03-30T01:52:45.262698+0000","last_unstale":"2024-03-30T01:52:46.232897+0000","last_undegraded":"2024-03-30T01:52:46.232897+0000","last_fullsized":"2024-03-30T01:52:46.232897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:43:56.218523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232485+0000","last_change":"2024-03-30T01:52:45.253966+0000","last_active":"2024-03-30T01:52:46.232485+0000","last_peered":"2024-03-30T01:52:46.232485+0000","last_clean":"2024-03-30T01:52:46.232485+0000","last_became_active":"2024-03-30T01:52:45.252339+0000","last_became_peered":"2024-03-30T01:52:45.252339+0000","last_unstale":"2024-03-30T01:52:46.232485+0000","last_undegraded":"2024-03-30T01:52:46.232485+0000","last_fullsized":"2024-03-30T01:52:46.232485+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:53:18.855091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.247829+0000","last_change":"2024-03-30T01:52:45.244424+0000","last_active":"2024-03-30T01:52:45.247829+0000","last_peered":"2024-03-30T01:52:45.247829+0000","last_clean":"2024-03-30T01:52:45.247829+0000","last_became_active":"2024-03-30T01:52:45.243957+0000","last_became_peered":"2024-03-30T01:52:45.243957+0000","last_unstale":"2024-03-30T01:52:45.247829+0000","last_undegraded":"2024-03-30T01:52:45.247829+0000","last_fullsized":"2024-03-30T01:52:45.247829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:58:18.607454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.237416+0000","last_change":"2024-03-30T01:52:45.234105+0000","last_active":"2024-03-30T01:52:45.237416+0000","last_peered":"2024-03-30T01:52:45.237416+0000","last_clean":"2024-03-30T01:52:45.237416+0000","last_became_active":"2024-03-30T01:52:45.233567+0000","last_became_peered":"2024-03-30T01:52:45.233567+0000","last_unstale":"2024-03-30T01:52:45.237416+0000","last_undegraded":"2024-03-30T01:52:45.237416+0000","last_fullsized":"2024-03-30T01:52:45.237416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:59.079244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.234082+0000","last_change":"2024-03-30T01:52:45.250542+0000","last_active":"2024-03-30T01:52:46.234082+0000","last_peered":"2024-03-30T01:52:46.234082+0000","last_clean":"2024-03-30T01:52:46.234082+0000","last_became_active":"2024-03-30T01:52:45.249548+0000","last_became_peered":"2024-03-30T01:52:45.249548+0000","last_unstale":"2024-03-30T01:52:46.234082+0000","last_undegraded":"2024-03-30T01:52:46.234082+0000","last_fullsized":"2024-03-30T01:52:46.234082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:30:13.931533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.234638+0000","last_change":"2024-03-30T01:52:45.256509+0000","last_active":"2024-03-30T01:52:46.234638+0000","last_peered":"2024-03-30T01:52:46.234638+0000","last_clean":"2024-03-30T01:52:46.234638+0000","last_became_active":"2024-03-30T01:52:45.252627+0000","last_became_peered":"2024-03-30T01:52:45.252627+0000","last_unstale":"2024-03-30T01:52:46.234638+0000","last_undegraded":"2024-03-30T01:52:46.234638+0000","last_fullsized":"2024-03-30T01:52:46.234638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:30:30.623241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.335619+0000","last_change":"2024-03-30T01:52:45.232098+0000","last_active":"2024-03-30T01:52:46.335619+0000","last_peered":"2024-03-30T01:52:46.335619+0000","last_clean":"2024-03-30T01:52:46.335619+0000","last_became_active":"2024-03-30T01:52:45.229874+0000","last_became_peered":"2024-03-30T01:52:45.229874+0000","last_unstale":"2024-03-30T01:52:46.335619+0000","last_undegraded":"2024-03-30T01:52:46.335619+0000","last_fullsized":"2024-03-30T01:52:46.335619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T07:49:29.699134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.231790+0000","last_change":"2024-03-30T01:52:45.234072+0000","last_active":"2024-03-30T01:52:46.231790+0000","last_peered":"2024-03-30T01:52:46.231790+0000","last_clean":"2024-03-30T01:52:46.231790+0000","last_became_active":"2024-03-30T01:52:45.233895+0000","last_became_peered":"2024-03-30T01:52:45.233895+0000","last_unstale":"2024-03-30T01:52:46.231790+0000","last_undegraded":"2024-03-30T01:52:46.231790+0000","last_fullsized":"2024-03-30T01:52:46.231790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:44:45.959392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.233835+0000","last_change":"2024-03-30T01:52:45.262423+0000","last_active":"2024-03-30T01:52:46.233835+0000","last_peered":"2024-03-30T01:52:46.233835+0000","last_clean":"2024-03-30T01:52:46.233835+0000","last_became_active":"2024-03-30T01:52:45.262098+0000","last_became_peered":"2024-03-30T01:52:45.262098+0000","last_unstale":"2024-03-30T01:52:46.233835+0000","last_undegraded":"2024-03-30T01:52:46.233835+0000","last_fullsized":"2024-03-30T01:52:46.233835+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:20:37.140776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.233397+0000","last_change":"2024-03-30T01:52:45.253798+0000","last_active":"2024-03-30T01:52:46.233397+0000","last_peered":"2024-03-30T01:52:46.233397+0000","last_clean":"2024-03-30T01:52:46.233397+0000","last_became_active":"2024-03-30T01:52:45.253171+0000","last_became_peered":"2024-03-30T01:52:45.253171+0000","last_unstale":"2024-03-30T01:52:46.233397+0000","last_undegraded":"2024-03-30T01:52:46.233397+0000","last_fullsized":"2024-03-30T01:52:46.233397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:44:45.959392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.234446+0000","last_change":"2024-03-30T01:52:45.257943+0000","last_active":"2024-03-30T01:52:46.234446+0000","last_peered":"2024-03-30T01:52:46.234446+0000","last_clean":"2024-03-30T01:52:46.234446+0000","last_became_active":"2024-03-30T01:52:45.257689+0000","last_became_peered":"2024-03-30T01:52:45.257689+0000","last_unstale":"2024-03-30T01:52:46.234446+0000","last_undegraded":"2024-03-30T01:52:46.234446+0000","last_fullsized":"2024-03-30T01:52:46.234446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:32:09.525767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232330+0000","last_change":"2024-03-30T01:52:45.229401+0000","last_active":"2024-03-30T01:52:46.232330+0000","last_peered":"2024-03-30T01:52:46.232330+0000","last_clean":"2024-03-30T01:52:46.232330+0000","last_became_active":"2024-03-30T01:52:45.229064+0000","last_became_peered":"2024-03-30T01:52:45.229064+0000","last_unstale":"2024-03-30T01:52:46.232330+0000","last_undegraded":"2024-03-30T01:52:46.232330+0000","last_fullsized":"2024-03-30T01:52:46.232330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T04:10:54.309333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.231965+0000","last_change":"2024-03-30T01:52:45.233452+0000","last_active":"2024-03-30T01:52:46.231965+0000","last_peered":"2024-03-30T01:52:46.231965+0000","last_clean":"2024-03-30T01:52:46.231965+0000","last_became_active":"2024-03-30T01:52:45.232902+0000","last_became_peered":"2024-03-30T01:52:45.232902+0000","last_unstale":"2024-03-30T01:52:46.231965+0000","last_undegraded":"2024-03-30T01:52:46.231965+0000","last_fullsized":"2024-03-30T01:52:46.231965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:54:05.420218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.335912+0000","last_change":"2024-03-30T01:52:45.260839+0000","last_active":"2024-03-30T01:52:46.335912+0000","last_peered":"2024-03-30T01:52:46.335912+0000","last_clean":"2024-03-30T01:52:46.335912+0000","last_became_active":"2024-03-30T01:52:45.260570+0000","last_became_peered":"2024-03-30T01:52:45.260570+0000","last_unstale":"2024-03-30T01:52:46.335912+0000","last_undegraded":"2024-03-30T01:52:46.335912+0000","last_fullsized":"2024-03-30T01:52:46.335912+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:48:40.316565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.243346+0000","last_change":"2024-03-30T01:52:45.237135+0000","last_active":"2024-03-30T01:52:45.243346+0000","last_peered":"2024-03-30T01:52:45.243346+0000","last_clean":"2024-03-30T01:52:45.243346+0000","last_became_active":"2024-03-30T01:52:45.236274+0000","last_became_peered":"2024-03-30T01:52:45.236274+0000","last_unstale":"2024-03-30T01:52:45.243346+0000","last_undegraded":"2024-03-30T01:52:45.243346+0000","last_fullsized":"2024-03-30T01:52:45.243346+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:48:40.316565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.251726+0000","last_change":"2024-03-30T01:52:45.245791+0000","last_active":"2024-03-30T01:52:45.251726+0000","last_peered":"2024-03-30T01:52:45.251726+0000","last_clean":"2024-03-30T01:52:45.251726+0000","last_became_active":"2024-03-30T01:52:45.245305+0000","last_became_peered":"2024-03-30T01:52:45.245305+0000","last_unstale":"2024-03-30T01:52:45.251726+0000","last_undegraded":"2024-03-30T01:52:45.251726+0000","last_fullsized":"2024-03-30T01:52:45.251726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:59.079244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.252899+0000","last_change":"2024-03-30T01:52:45.251655+0000","last_active":"2024-03-30T01:52:45.252899+0000","last_peered":"2024-03-30T01:52:45.252899+0000","last_clean":"2024-03-30T01:52:45.252899+0000","last_became_active":"2024-03-30T01:52:45.251362+0000","last_became_peered":"2024-03-30T01:52:45.251362+0000","last_unstale":"2024-03-30T01:52:45.252899+0000","last_undegraded":"2024-03-30T01:52:45.252899+0000","last_fullsized":"2024-03-30T01:52:45.252899+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:54:43.100222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.233528+0000","last_change":"2024-03-30T01:52:45.243113+0000","last_active":"2024-03-30T01:52:46.233528+0000","last_peered":"2024-03-30T01:52:46.233528+0000","last_clean":"2024-03-30T01:52:46.233528+0000","last_became_active":"2024-03-30T01:52:45.242538+0000","last_became_peered":"2024-03-30T01:52:45.242538+0000","last_unstale":"2024-03-30T01:52:46.233528+0000","last_undegraded":"2024-03-30T01:52:46.233528+0000","last_fullsized":"2024-03-30T01:52:46.233528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:54:43.100222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.255621+0000","last_change":"2024-03-30T01:52:45.250582+0000","last_active":"2024-03-30T01:52:45.255621+0000","last_peered":"2024-03-30T01:52:45.255621+0000","last_clean":"2024-03-30T01:52:45.255621+0000","last_became_active":"2024-03-30T01:52:45.250292+0000","last_became_peered":"2024-03-30T01:52:45.250292+0000","last_unstale":"2024-03-30T01:52:45.255621+0000","last_undegraded":"2024-03-30T01:52:45.255621+0000","last_fullsized":"2024-03-30T01:52:45.255621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:20:37.140776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232416+0000","last_change":"2024-03-30T01:52:45.249414+0000","last_active":"2024-03-30T01:52:46.232416+0000","last_peered":"2024-03-30T01:52:46.232416+0000","last_clean":"2024-03-30T01:52:46.232416+0000","last_became_active":"2024-03-30T01:52:45.249039+0000","last_became_peered":"2024-03-30T01:52:45.249039+0000","last_unstale":"2024-03-30T01:52:46.232416+0000","last_undegraded":"2024-03-30T01:52:46.232416+0000","last_fullsized":"2024-03-30T01:52:46.232416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:04:09.706763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.247848+0000","last_change":"2024-03-30T01:52:45.246492+0000","last_active":"2024-03-30T01:52:45.247848+0000","last_peered":"2024-03-30T01:52:45.247848+0000","last_clean":"2024-03-30T01:52:45.247848+0000","last_became_active":"2024-03-30T01:52:45.245916+0000","last_became_peered":"2024-03-30T01:52:45.245916+0000","last_unstale":"2024-03-30T01:52:45.247848+0000","last_undegraded":"2024-03-30T01:52:45.247848+0000","last_fullsized":"2024-03-30T01:52:45.247848+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:05:41.223740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.234889+0000","last_change":"2024-03-30T01:52:45.257250+0000","last_active":"2024-03-30T01:52:46.234889+0000","last_peered":"2024-03-30T01:52:46.234889+0000","last_clean":"2024-03-30T01:52:46.234889+0000","last_became_active":"2024-03-30T01:52:45.252938+0000","last_became_peered":"2024-03-30T01:52:45.252938+0000","last_unstale":"2024-03-30T01:52:46.234889+0000","last_undegraded":"2024-03-30T01:52:46.234889+0000","last_fullsized":"2024-03-30T01:52:46.234889+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:00:40.832217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.243323+0000","last_change":"2024-03-30T01:52:45.236764+0000","last_active":"2024-03-30T01:52:45.243323+0000","last_peered":"2024-03-30T01:52:45.243323+0000","last_clean":"2024-03-30T01:52:45.243323+0000","last_became_active":"2024-03-30T01:52:45.235529+0000","last_became_peered":"2024-03-30T01:52:45.235529+0000","last_unstale":"2024-03-30T01:52:45.243323+0000","last_undegraded":"2024-03-30T01:52:45.243323+0000","last_fullsized":"2024-03-30T01:52:45.243323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:00:49.078516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.233020+0000","last_change":"2024-03-30T01:52:45.256582+0000","last_active":"2024-03-30T01:52:46.233020+0000","last_peered":"2024-03-30T01:52:46.233020+0000","last_clean":"2024-03-30T01:52:46.233020+0000","last_became_active":"2024-03-30T01:52:45.256334+0000","last_became_peered":"2024-03-30T01:52:45.256334+0000","last_unstale":"2024-03-30T01:52:46.233020+0000","last_undegraded":"2024-03-30T01:52:46.233020+0000","last_fullsized":"2024-03-30T01:52:46.233020+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:40:41.191709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.260261+0000","last_change":"2024-03-30T01:52:45.247808+0000","last_active":"2024-03-30T01:52:45.260261+0000","last_peered":"2024-03-30T01:52:45.260261+0000","last_clean":"2024-03-30T01:52:45.260261+0000","last_became_active":"2024-03-30T01:52:45.247495+0000","last_became_peered":"2024-03-30T01:52:45.247495+0000","last_unstale":"2024-03-30T01:52:45.260261+0000","last_undegraded":"2024-03-30T01:52:45.260261+0000","last_fullsized":"2024-03-30T01:52:45.260261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:54:43.100222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232542+0000","last_change":"2024-03-30T01:52:45.255506+0000","last_active":"2024-03-30T01:52:46.232542+0000","last_peered":"2024-03-30T01:52:46.232542+0000","last_clean":"2024-03-30T01:52:46.232542+0000","last_became_active":"2024-03-30T01:52:45.255247+0000","last_became_peered":"2024-03-30T01:52:45.255247+0000","last_unstale":"2024-03-30T01:52:46.232542+0000","last_undegraded":"2024-03-30T01:52:46.232542+0000","last_fullsized":"2024-03-30T01:52:46.232542+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:07:43.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.245417+0000","last_change":"2024-03-30T01:52:45.243586+0000","last_active":"2024-03-30T01:52:45.245417+0000","last_peered":"2024-03-30T01:52:45.245417+0000","last_clean":"2024-03-30T01:52:45.245417+0000","last_became_active":"2024-03-30T01:52:45.243347+0000","last_became_peered":"2024-03-30T01:52:45.243347+0000","last_unstale":"2024-03-30T01:52:45.245417+0000","last_undegraded":"2024-03-30T01:52:45.245417+0000","last_fullsized":"2024-03-30T01:52:45.245417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T04:20:38.429903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.268427+0000","last_change":"2024-03-30T01:52:44.765959+0000","last_active":"2024-03-30T01:52:45.268427+0000","last_peered":"2024-03-30T01:52:45.268427+0000","last_clean":"2024-03-30T01:52:45.268427+0000","last_became_active":"2024-03-30T01:52:44.765677+0000","last_became_peered":"2024-03-30T01:52:44.765677+0000","last_unstale":"2024-03-30T01:52:45.268427+0000","last_undegraded":"2024-03-30T01:52:45.268427+0000","last_fullsized":"2024-03-30T01:52:45.268427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:45.630452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.261432+0000","last_change":"2024-03-30T01:52:45.256738+0000","last_active":"2024-03-30T01:52:45.261432+0000","last_peered":"2024-03-30T01:52:45.261432+0000","last_clean":"2024-03-30T01:52:45.261432+0000","last_became_active":"2024-03-30T01:52:45.253488+0000","last_became_peered":"2024-03-30T01:52:45.253488+0000","last_unstale":"2024-03-30T01:52:45.261432+0000","last_undegraded":"2024-03-30T01:52:45.261432+0000","last_fullsized":"2024-03-30T01:52:45.261432+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:00:49.078516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.251149+0000","last_change":"2024-03-30T01:52:44.769833+0000","last_active":"2024-03-30T01:52:45.251149+0000","last_peered":"2024-03-30T01:52:45.251149+0000","last_clean":"2024-03-30T01:52:45.251149+0000","last_became_active":"2024-03-30T01:52:44.769540+0000","last_became_peered":"2024-03-30T01:52:44.769540+0000","last_unstale":"2024-03-30T01:52:45.251149+0000","last_undegraded":"2024-03-30T01:52:45.251149+0000","last_fullsized":"2024-03-30T01:52:45.251149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:01:00.175223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.250363+0000","last_change":"2024-03-30T01:52:45.247320+0000","last_active":"2024-03-30T01:52:45.250363+0000","last_peered":"2024-03-30T01:52:45.250363+0000","last_clean":"2024-03-30T01:52:45.250363+0000","last_became_active":"2024-03-30T01:52:45.247037+0000","last_became_peered":"2024-03-30T01:52:45.247037+0000","last_unstale":"2024-03-30T01:52:45.250363+0000","last_undegraded":"2024-03-30T01:52:45.250363+0000","last_fullsized":"2024-03-30T01:52:45.250363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:54:43.100222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232095+0000","last_change":"2024-03-30T01:52:44.763788+0000","last_active":"2024-03-30T01:52:46.232095+0000","last_peered":"2024-03-30T01:52:46.232095+0000","last_clean":"2024-03-30T01:52:46.232095+0000","last_became_active":"2024-03-30T01:52:44.763485+0000","last_became_peered":"2024-03-30T01:52:44.763485+0000","last_unstale":"2024-03-30T01:52:46.232095+0000","last_undegraded":"2024-03-30T01:52:46.232095+0000","last_fullsized":"2024-03-30T01:52:46.232095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:46:16.600667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.247831+0000","last_change":"2024-03-30T01:52:45.245966+0000","last_active":"2024-03-30T01:52:45.247831+0000","last_peered":"2024-03-30T01:52:45.247831+0000","last_clean":"2024-03-30T01:52:45.247831+0000","last_became_active":"2024-03-30T01:52:45.245719+0000","last_became_peered":"2024-03-30T01:52:45.245719+0000","last_unstale":"2024-03-30T01:52:45.247831+0000","last_undegraded":"2024-03-30T01:52:45.247831+0000","last_fullsized":"2024-03-30T01:52:45.247831+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:00:49.078516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.335925+0000","last_change":"2024-03-30T01:52:44.764496+0000","last_active":"2024-03-30T01:52:46.335925+0000","last_peered":"2024-03-30T01:52:46.335925+0000","last_clean":"2024-03-30T01:52:46.335925+0000","last_became_active":"2024-03-30T01:52:44.764184+0000","last_became_peered":"2024-03-30T01:52:44.764184+0000","last_unstale":"2024-03-30T01:52:46.335925+0000","last_undegraded":"2024-03-30T01:52:46.335925+0000","last_fullsized":"2024-03-30T01:52:46.335925+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:26:08.671043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.233072+0000","last_change":"2024-03-30T01:52:45.258895+0000","last_active":"2024-03-30T01:52:46.233072+0000","last_peered":"2024-03-30T01:52:46.233072+0000","last_clean":"2024-03-30T01:52:46.233072+0000","last_became_active":"2024-03-30T01:52:45.258604+0000","last_became_peered":"2024-03-30T01:52:45.258604+0000","last_unstale":"2024-03-30T01:52:46.233072+0000","last_undegraded":"2024-03-30T01:52:46.233072+0000","last_fullsized":"2024-03-30T01:52:46.233072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T04:10:54.309333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.264203+0000","last_change":"2024-03-30T01:52:44.767465+0000","last_active":"2024-03-30T01:52:45.264203+0000","last_peered":"2024-03-30T01:52:45.264203+0000","last_clean":"2024-03-30T01:52:45.264203+0000","last_became_active":"2024-03-30T01:52:44.767140+0000","last_became_peered":"2024-03-30T01:52:44.767140+0000","last_unstale":"2024-03-30T01:52:45.264203+0000","last_undegraded":"2024-03-30T01:52:45.264203+0000","last_fullsized":"2024-03-30T01:52:45.264203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:52:11.916895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.234369+0000","last_change":"2024-03-30T01:52:45.246757+0000","last_active":"2024-03-30T01:52:46.234369+0000","last_peered":"2024-03-30T01:52:46.234369+0000","last_clean":"2024-03-30T01:52:46.234369+0000","last_became_active":"2024-03-30T01:52:45.246464+0000","last_became_peered":"2024-03-30T01:52:45.246464+0000","last_unstale":"2024-03-30T01:52:46.234369+0000","last_undegraded":"2024-03-30T01:52:46.234369+0000","last_fullsized":"2024-03-30T01:52:46.234369+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:36:31.029273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.264191+0000","last_change":"2024-03-30T01:52:44.767992+0000","last_active":"2024-03-30T01:52:45.264191+0000","last_peered":"2024-03-30T01:52:45.264191+0000","last_clean":"2024-03-30T01:52:45.264191+0000","last_became_active":"2024-03-30T01:52:44.767694+0000","last_became_peered":"2024-03-30T01:52:44.767694+0000","last_unstale":"2024-03-30T01:52:45.264191+0000","last_undegraded":"2024-03-30T01:52:45.264191+0000","last_fullsized":"2024-03-30T01:52:45.264191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:29:52.364159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.250322+0000","last_change":"2024-03-30T01:52:45.245680+0000","last_active":"2024-03-30T01:52:45.250322+0000","last_peered":"2024-03-30T01:52:45.250322+0000","last_clean":"2024-03-30T01:52:45.250322+0000","last_became_active":"2024-03-30T01:52:45.245267+0000","last_became_peered":"2024-03-30T01:52:45.245267+0000","last_unstale":"2024-03-30T01:52:45.250322+0000","last_undegraded":"2024-03-30T01:52:45.250322+0000","last_fullsized":"2024-03-30T01:52:45.250322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:07:01.583648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.231247+0000","last_change":"2024-03-30T01:52:44.761351+0000","last_active":"2024-03-30T01:52:46.231247+0000","last_peered":"2024-03-30T01:52:46.231247+0000","last_clean":"2024-03-30T01:52:46.231247+0000","last_became_active":"2024-03-30T01:52:44.761073+0000","last_became_peered":"2024-03-30T01:52:44.761073+0000","last_unstale":"2024-03-30T01:52:46.231247+0000","last_undegraded":"2024-03-30T01:52:46.231247+0000","last_fullsized":"2024-03-30T01:52:46.231247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:07:00.578921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.246806+0000","last_change":"2024-03-30T01:52:45.243717+0000","last_active":"2024-03-30T01:52:45.246806+0000","last_peered":"2024-03-30T01:52:45.246806+0000","last_clean":"2024-03-30T01:52:45.246806+0000","last_became_active":"2024-03-30T01:52:45.243471+0000","last_became_peered":"2024-03-30T01:52:45.243471+0000","last_unstale":"2024-03-30T01:52:45.246806+0000","last_undegraded":"2024-03-30T01:52:45.246806+0000","last_fullsized":"2024-03-30T01:52:45.246806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:19:15.489873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.224379+0000","last_change":"2024-03-30T01:52:44.766673+0000","last_active":"2024-03-30T01:52:45.224379+0000","last_peered":"2024-03-30T01:52:45.224379+0000","last_clean":"2024-03-30T01:52:45.224379+0000","last_became_active":"2024-03-30T01:52:44.766431+0000","last_became_peered":"2024-03-30T01:52:44.766431+0000","last_unstale":"2024-03-30T01:52:45.224379+0000","last_undegraded":"2024-03-30T01:52:45.224379+0000","last_fullsized":"2024-03-30T01:52:45.224379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T04:41:26.499271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.235017+0000","last_change":"2024-03-30T01:52:45.254893+0000","last_active":"2024-03-30T01:52:46.235017+0000","last_peered":"2024-03-30T01:52:46.235017+0000","last_clean":"2024-03-30T01:52:46.235017+0000","last_became_active":"2024-03-30T01:52:45.254581+0000","last_became_peered":"2024-03-30T01:52:45.254581+0000","last_unstale":"2024-03-30T01:52:46.235017+0000","last_undegraded":"2024-03-30T01:52:46.235017+0000","last_fullsized":"2024-03-30T01:52:46.235017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:05:41.223740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232599+0000","last_change":"2024-03-30T01:52:44.771241+0000","last_active":"2024-03-30T01:52:46.232599+0000","last_peered":"2024-03-30T01:52:46.232599+0000","last_clean":"2024-03-30T01:52:46.232599+0000","last_became_active":"2024-03-30T01:52:44.770979+0000","last_became_peered":"2024-03-30T01:52:44.770979+0000","last_unstale":"2024-03-30T01:52:46.232599+0000","last_undegraded":"2024-03-30T01:52:46.232599+0000","last_fullsized":"2024-03-30T01:52:46.232599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:58:17.602727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232478+0000","last_change":"2024-03-30T01:52:45.234353+0000","last_active":"2024-03-30T01:52:46.232478+0000","last_peered":"2024-03-30T01:52:46.232478+0000","last_clean":"2024-03-30T01:52:46.232478+0000","last_became_active":"2024-03-30T01:52:45.234024+0000","last_became_peered":"2024-03-30T01:52:45.234024+0000","last_unstale":"2024-03-30T01:52:46.232478+0000","last_undegraded":"2024-03-30T01:52:46.232478+0000","last_fullsized":"2024-03-30T01:52:46.232478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T07:19:30.595172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.221235+0000","last_change":"2024-03-30T01:52:44.759831+0000","last_active":"2024-03-30T01:52:45.221235+0000","last_peered":"2024-03-30T01:52:45.221235+0000","last_clean":"2024-03-30T01:52:45.221235+0000","last_became_active":"2024-03-30T01:52:44.758597+0000","last_became_peered":"2024-03-30T01:52:44.758597+0000","last_unstale":"2024-03-30T01:52:45.221235+0000","last_undegraded":"2024-03-30T01:52:45.221235+0000","last_fullsized":"2024-03-30T01:52:45.221235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:31:34.391918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232006+0000","last_change":"2024-03-30T01:52:45.251201+0000","last_active":"2024-03-30T01:52:46.232006+0000","last_peered":"2024-03-30T01:52:46.232006+0000","last_clean":"2024-03-30T01:52:46.232006+0000","last_became_active":"2024-03-30T01:52:45.250985+0000","last_became_peered":"2024-03-30T01:52:45.250985+0000","last_unstale":"2024-03-30T01:52:46.232006+0000","last_undegraded":"2024-03-30T01:52:46.232006+0000","last_fullsized":"2024-03-30T01:52:46.232006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:53:18.855091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.234762+0000","last_change":"2024-03-30T01:52:44.771738+0000","last_active":"2024-03-30T01:52:46.234762+0000","last_peered":"2024-03-30T01:52:46.234762+0000","last_clean":"2024-03-30T01:52:46.234762+0000","last_became_active":"2024-03-30T01:52:44.771419+0000","last_became_peered":"2024-03-30T01:52:44.771419+0000","last_unstale":"2024-03-30T01:52:46.234762+0000","last_undegraded":"2024-03-30T01:52:46.234762+0000","last_fullsized":"2024-03-30T01:52:46.234762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:31:34.391918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.234344+0000","last_change":"2024-03-30T01:52:45.246574+0000","last_active":"2024-03-30T01:52:46.234344+0000","last_peered":"2024-03-30T01:52:46.234344+0000","last_clean":"2024-03-30T01:52:46.234344+0000","last_became_active":"2024-03-30T01:52:45.246011+0000","last_became_peered":"2024-03-30T01:52:45.246011+0000","last_unstale":"2024-03-30T01:52:46.234344+0000","last_undegraded":"2024-03-30T01:52:46.234344+0000","last_fullsized":"2024-03-30T01:52:46.234344+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:29:58.818874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232139+0000","last_change":"2024-03-30T01:52:44.756797+0000","last_active":"2024-03-30T01:52:46.232139+0000","last_peered":"2024-03-30T01:52:46.232139+0000","last_clean":"2024-03-30T01:52:46.232139+0000","last_became_active":"2024-03-30T01:52:44.756408+0000","last_became_peered":"2024-03-30T01:52:44.756408+0000","last_unstale":"2024-03-30T01:52:46.232139+0000","last_undegraded":"2024-03-30T01:52:46.232139+0000","last_fullsized":"2024-03-30T01:52:46.232139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:48:39.311839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.258776+0000","last_change":"2024-03-30T01:52:45.255011+0000","last_active":"2024-03-30T01:52:45.258776+0000","last_peered":"2024-03-30T01:52:45.258776+0000","last_clean":"2024-03-30T01:52:45.258776+0000","last_became_active":"2024-03-30T01:52:45.254731+0000","last_became_peered":"2024-03-30T01:52:45.254731+0000","last_unstale":"2024-03-30T01:52:45.258776+0000","last_undegraded":"2024-03-30T01:52:45.258776+0000","last_fullsized":"2024-03-30T01:52:45.258776+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:09:30.027957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.265774+0000","last_change":"2024-03-30T01:52:44.765178+0000","last_active":"2024-03-30T01:52:45.265774+0000","last_peered":"2024-03-30T01:52:45.265774+0000","last_clean":"2024-03-30T01:52:45.265774+0000","last_became_active":"2024-03-30T01:52:44.764520+0000","last_became_peered":"2024-03-30T01:52:44.764520+0000","last_unstale":"2024-03-30T01:52:45.265774+0000","last_undegraded":"2024-03-30T01:52:45.265774+0000","last_fullsized":"2024-03-30T01:52:45.265774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:09:32.610357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.231748+0000","last_change":"2024-03-30T01:52:45.235029+0000","last_active":"2024-03-30T01:52:46.231748+0000","last_peered":"2024-03-30T01:52:46.231748+0000","last_clean":"2024-03-30T01:52:46.231748+0000","last_became_active":"2024-03-30T01:52:45.234776+0000","last_became_peered":"2024-03-30T01:52:45.234776+0000","last_unstale":"2024-03-30T01:52:46.231748+0000","last_undegraded":"2024-03-30T01:52:46.231748+0000","last_fullsized":"2024-03-30T01:52:46.231748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:00:40.832217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.222847+0000","last_change":"2024-03-30T01:52:44.766753+0000","last_active":"2024-03-30T01:52:45.222847+0000","last_peered":"2024-03-30T01:52:45.222847+0000","last_clean":"2024-03-30T01:52:45.222847+0000","last_became_active":"2024-03-30T01:52:44.766460+0000","last_became_peered":"2024-03-30T01:52:44.766460+0000","last_unstale":"2024-03-30T01:52:45.222847+0000","last_undegraded":"2024-03-30T01:52:45.222847+0000","last_fullsized":"2024-03-30T01:52:45.222847+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:45.630452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232826+0000","last_change":"2024-03-30T01:52:45.259176+0000","last_active":"2024-03-30T01:52:46.232826+0000","last_peered":"2024-03-30T01:52:46.232826+0000","last_clean":"2024-03-30T01:52:46.232826+0000","last_became_active":"2024-03-30T01:52:45.258593+0000","last_became_peered":"2024-03-30T01:52:45.258593+0000","last_unstale":"2024-03-30T01:52:46.232826+0000","last_undegraded":"2024-03-30T01:52:46.232826+0000","last_fullsized":"2024-03-30T01:52:46.232826+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:18:41.596923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.231293+0000","last_change":"2024-03-30T01:52:44.768854+0000","last_active":"2024-03-30T01:52:46.231293+0000","last_peered":"2024-03-30T01:52:46.231293+0000","last_clean":"2024-03-30T01:52:46.231293+0000","last_became_active":"2024-03-30T01:52:44.768598+0000","last_became_peered":"2024-03-30T01:52:44.768598+0000","last_unstale":"2024-03-30T01:52:46.231293+0000","last_undegraded":"2024-03-30T01:52:46.231293+0000","last_fullsized":"2024-03-30T01:52:46.231293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:10:31.492030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.260284+0000","last_change":"2024-03-30T01:52:45.255790+0000","last_active":"2024-03-30T01:52:45.260284+0000","last_peered":"2024-03-30T01:52:45.260284+0000","last_clean":"2024-03-30T01:52:45.260284+0000","last_became_active":"2024-03-30T01:52:45.255461+0000","last_became_peered":"2024-03-30T01:52:45.255461+0000","last_unstale":"2024-03-30T01:52:45.260284+0000","last_undegraded":"2024-03-30T01:52:45.260284+0000","last_fullsized":"2024-03-30T01:52:45.260284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T04:20:38.429903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.231439+0000","last_change":"2024-03-30T01:52:44.757535+0000","last_active":"2024-03-30T01:52:46.231439+0000","last_peered":"2024-03-30T01:52:46.231439+0000","last_clean":"2024-03-30T01:52:46.231439+0000","last_became_active":"2024-03-30T01:52:44.755602+0000","last_became_peered":"2024-03-30T01:52:44.755602+0000","last_unstale":"2024-03-30T01:52:46.231439+0000","last_undegraded":"2024-03-30T01:52:46.231439+0000","last_fullsized":"2024-03-30T01:52:46.231439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T07:49:28.694408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.262463+0000","last_change":"2024-03-30T01:52:45.258254+0000","last_active":"2024-03-30T01:52:45.262463+0000","last_peered":"2024-03-30T01:52:45.262463+0000","last_clean":"2024-03-30T01:52:45.262463+0000","last_became_active":"2024-03-30T01:52:45.257759+0000","last_became_peered":"2024-03-30T01:52:45.257759+0000","last_unstale":"2024-03-30T01:52:45.262463+0000","last_undegraded":"2024-03-30T01:52:45.262463+0000","last_fullsized":"2024-03-30T01:52:45.262463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:19:15.489873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.246686+0000","last_change":"2024-03-30T01:52:44.770124+0000","last_active":"2024-03-30T01:52:45.246686+0000","last_peered":"2024-03-30T01:52:45.246686+0000","last_clean":"2024-03-30T01:52:45.246686+0000","last_became_active":"2024-03-30T01:52:44.769403+0000","last_became_peered":"2024-03-30T01:52:44.769403+0000","last_unstale":"2024-03-30T01:52:45.246686+0000","last_undegraded":"2024-03-30T01:52:45.246686+0000","last_fullsized":"2024-03-30T01:52:45.246686+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:27:20.979430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.235184+0000","last_change":"2024-03-30T01:52:45.252113+0000","last_active":"2024-03-30T01:52:46.235184+0000","last_peered":"2024-03-30T01:52:46.235184+0000","last_clean":"2024-03-30T01:52:46.235184+0000","last_became_active":"2024-03-30T01:52:45.251821+0000","last_became_peered":"2024-03-30T01:52:45.251821+0000","last_unstale":"2024-03-30T01:52:46.235184+0000","last_undegraded":"2024-03-30T01:52:46.235184+0000","last_fullsized":"2024-03-30T01:52:46.235184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:59.079244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.264456+0000","last_change":"2024-03-30T01:52:44.766114+0000","last_active":"2024-03-30T01:52:45.264456+0000","last_peered":"2024-03-30T01:52:45.264456+0000","last_clean":"2024-03-30T01:52:45.264456+0000","last_became_active":"2024-03-30T01:52:44.765823+0000","last_became_peered":"2024-03-30T01:52:44.765823+0000","last_unstale":"2024-03-30T01:52:45.264456+0000","last_undegraded":"2024-03-30T01:52:45.264456+0000","last_fullsized":"2024-03-30T01:52:45.264456+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:17:59.085482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.239312+0000","last_change":"2024-03-30T01:52:45.236061+0000","last_active":"2024-03-30T01:52:45.239312+0000","last_peered":"2024-03-30T01:52:45.239312+0000","last_clean":"2024-03-30T01:52:45.239312+0000","last_became_active":"2024-03-30T01:52:45.235789+0000","last_became_peered":"2024-03-30T01:52:45.235789+0000","last_unstale":"2024-03-30T01:52:45.239312+0000","last_undegraded":"2024-03-30T01:52:45.239312+0000","last_fullsized":"2024-03-30T01:52:45.239312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:46:17.605393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.263472+0000","last_change":"2024-03-30T01:52:44.761997+0000","last_active":"2024-03-30T01:52:45.263472+0000","last_peered":"2024-03-30T01:52:45.263472+0000","last_clean":"2024-03-30T01:52:45.263472+0000","last_became_active":"2024-03-30T01:52:44.761724+0000","last_became_peered":"2024-03-30T01:52:44.761724+0000","last_unstale":"2024-03-30T01:52:45.263472+0000","last_undegraded":"2024-03-30T01:52:45.263472+0000","last_fullsized":"2024-03-30T01:52:45.263472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:08:59.666326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.335993+0000","last_change":"2024-03-30T01:52:45.247952+0000","last_active":"2024-03-30T01:52:46.335993+0000","last_peered":"2024-03-30T01:52:46.335993+0000","last_clean":"2024-03-30T01:52:46.335993+0000","last_became_active":"2024-03-30T01:52:45.247631+0000","last_became_peered":"2024-03-30T01:52:45.247631+0000","last_unstale":"2024-03-30T01:52:46.335993+0000","last_undegraded":"2024-03-30T01:52:46.335993+0000","last_fullsized":"2024-03-30T01:52:46.335993+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:54:43.100222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.228816+0000","last_change":"2024-03-30T01:52:44.764413+0000","last_active":"2024-03-30T01:52:45.228816+0000","last_peered":"2024-03-30T01:52:45.228816+0000","last_clean":"2024-03-30T01:52:45.228816+0000","last_became_active":"2024-03-30T01:52:44.764145+0000","last_became_peered":"2024-03-30T01:52:44.764145+0000","last_unstale":"2024-03-30T01:52:45.228816+0000","last_undegraded":"2024-03-30T01:52:45.228816+0000","last_fullsized":"2024-03-30T01:52:45.228816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:26:08.671043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.335596+0000","last_change":"2024-03-30T01:52:45.242087+0000","last_active":"2024-03-30T01:52:46.335596+0000","last_peered":"2024-03-30T01:52:46.335596+0000","last_clean":"2024-03-30T01:52:46.335596+0000","last_became_active":"2024-03-30T01:52:45.241735+0000","last_became_peered":"2024-03-30T01:52:45.241735+0000","last_unstale":"2024-03-30T01:52:46.335596+0000","last_undegraded":"2024-03-30T01:52:46.335596+0000","last_fullsized":"2024-03-30T01:52:46.335596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:28:18.785682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.240965+0000","last_change":"2024-03-30T01:52:44.755025+0000","last_active":"2024-03-30T01:52:45.240965+0000","last_peered":"2024-03-30T01:52:45.240965+0000","last_clean":"2024-03-30T01:52:45.240965+0000","last_became_active":"2024-03-30T01:52:44.754739+0000","last_became_peered":"2024-03-30T01:52:44.754739+0000","last_unstale":"2024-03-30T01:52:45.240965+0000","last_undegraded":"2024-03-30T01:52:45.240965+0000","last_fullsized":"2024-03-30T01:52:45.240965+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:12:07.468613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.335659+0000","last_change":"2024-03-30T01:52:45.233315+0000","last_active":"2024-03-30T01:52:46.335659+0000","last_peered":"2024-03-30T01:52:46.335659+0000","last_clean":"2024-03-30T01:52:46.335659+0000","last_became_active":"2024-03-30T01:52:45.233027+0000","last_became_peered":"2024-03-30T01:52:45.233027+0000","last_unstale":"2024-03-30T01:52:46.335659+0000","last_undegraded":"2024-03-30T01:52:46.335659+0000","last_fullsized":"2024-03-30T01:52:46.335659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:10:32.496756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.250852+0000","last_change":"2024-03-30T01:52:44.770445+0000","last_active":"2024-03-30T01:52:45.250852+0000","last_peered":"2024-03-30T01:52:45.250852+0000","last_clean":"2024-03-30T01:52:45.250852+0000","last_became_active":"2024-03-30T01:52:44.770167+0000","last_became_peered":"2024-03-30T01:52:44.770167+0000","last_unstale":"2024-03-30T01:52:45.250852+0000","last_undegraded":"2024-03-30T01:52:45.250852+0000","last_fullsized":"2024-03-30T01:52:45.250852+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:12:07.468613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.335565+0000","last_change":"2024-03-30T01:52:45.228710+0000","last_active":"2024-03-30T01:52:46.335565+0000","last_peered":"2024-03-30T01:52:46.335565+0000","last_clean":"2024-03-30T01:52:46.335565+0000","last_became_active":"2024-03-30T01:52:45.228470+0000","last_became_peered":"2024-03-30T01:52:45.228470+0000","last_unstale":"2024-03-30T01:52:46.335565+0000","last_undegraded":"2024-03-30T01:52:46.335565+0000","last_fullsized":"2024-03-30T01:52:46.335565+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:46:17.605393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.226869+0000","last_change":"2024-03-30T01:52:44.760365+0000","last_active":"2024-03-30T01:52:45.226869+0000","last_peered":"2024-03-30T01:52:45.226869+0000","last_clean":"2024-03-30T01:52:45.226869+0000","last_became_active":"2024-03-30T01:52:44.760049+0000","last_became_peered":"2024-03-30T01:52:44.760049+0000","last_unstale":"2024-03-30T01:52:45.226869+0000","last_undegraded":"2024-03-30T01:52:45.226869+0000","last_fullsized":"2024-03-30T01:52:45.226869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:02:37.203707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.232633+0000","last_change":"2024-03-30T01:52:45.256542+0000","last_active":"2024-03-30T01:52:46.232633+0000","last_peered":"2024-03-30T01:52:46.232633+0000","last_clean":"2024-03-30T01:52:46.232633+0000","last_became_active":"2024-03-30T01:52:45.256275+0000","last_became_peered":"2024-03-30T01:52:45.256275+0000","last_unstale":"2024-03-30T01:52:46.232633+0000","last_undegraded":"2024-03-30T01:52:46.232633+0000","last_fullsized":"2024-03-30T01:52:46.232633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:12:26.160745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.233491+0000","last_change":"2024-03-30T01:52:44.771285+0000","last_active":"2024-03-30T01:52:46.233491+0000","last_peered":"2024-03-30T01:52:46.233491+0000","last_clean":"2024-03-30T01:52:46.233491+0000","last_became_active":"2024-03-30T01:52:44.770929+0000","last_became_peered":"2024-03-30T01:52:44.770929+0000","last_unstale":"2024-03-30T01:52:46.233491+0000","last_undegraded":"2024-03-30T01:52:46.233491+0000","last_fullsized":"2024-03-30T01:52:46.233491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:01:00.175223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.336209+0000","last_change":"2024-03-30T01:52:45.261014+0000","last_active":"2024-03-30T01:52:46.336209+0000","last_peered":"2024-03-30T01:52:46.336209+0000","last_clean":"2024-03-30T01:52:46.336209+0000","last_became_active":"2024-03-30T01:52:45.260577+0000","last_became_peered":"2024-03-30T01:52:45.260577+0000","last_unstale":"2024-03-30T01:52:46.336209+0000","last_undegraded":"2024-03-30T01:52:46.336209+0000","last_fullsized":"2024-03-30T01:52:46.336209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:58:18.607454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.260772+0000","last_change":"2024-03-30T01:52:44.768791+0000","last_active":"2024-03-30T01:52:45.260772+0000","last_peered":"2024-03-30T01:52:45.260772+0000","last_clean":"2024-03-30T01:52:45.260772+0000","last_became_active":"2024-03-30T01:52:44.767077+0000","last_became_peered":"2024-03-30T01:52:44.767077+0000","last_unstale":"2024-03-30T01:52:45.260772+0000","last_undegraded":"2024-03-30T01:52:45.260772+0000","last_fullsized":"2024-03-30T01:52:45.260772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:17:59.085482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.235199+0000","last_change":"2024-03-30T01:52:45.251137+0000","last_active":"2024-03-30T01:52:46.235199+0000","last_peered":"2024-03-30T01:52:46.235199+0000","last_clean":"2024-03-30T01:52:46.235199+0000","last_became_active":"2024-03-30T01:52:45.249461+0000","last_became_peered":"2024-03-30T01:52:45.249461+0000","last_unstale":"2024-03-30T01:52:46.235199+0000","last_undegraded":"2024-03-30T01:52:46.235199+0000","last_fullsized":"2024-03-30T01:52:46.235199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T08:46:05.645391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.221371+0000","last_change":"2024-03-30T01:52:44.763644+0000","last_active":"2024-03-30T01:52:45.221371+0000","last_peered":"2024-03-30T01:52:45.221371+0000","last_clean":"2024-03-30T01:52:45.221371+0000","last_became_active":"2024-03-30T01:52:44.763354+0000","last_became_peered":"2024-03-30T01:52:44.763354+0000","last_unstale":"2024-03-30T01:52:45.221371+0000","last_undegraded":"2024-03-30T01:52:45.221371+0000","last_fullsized":"2024-03-30T01:52:45.221371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:45.630452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.234514+0000","last_change":"2024-03-30T01:52:45.232184+0000","last_active":"2024-03-30T01:52:45.234514+0000","last_peered":"2024-03-30T01:52:45.234514+0000","last_clean":"2024-03-30T01:52:45.234514+0000","last_became_active":"2024-03-30T01:52:45.231678+0000","last_became_peered":"2024-03-30T01:52:45.231678+0000","last_unstale":"2024-03-30T01:52:45.234514+0000","last_undegraded":"2024-03-30T01:52:45.234514+0000","last_fullsized":"2024-03-30T01:52:45.234514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:07:01.583648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.223449+0000","last_change":"2024-03-30T01:52:44.762993+0000","last_active":"2024-03-30T01:52:45.223449+0000","last_peered":"2024-03-30T01:52:45.223449+0000","last_clean":"2024-03-30T01:52:45.223449+0000","last_became_active":"2024-03-30T01:52:44.762709+0000","last_became_peered":"2024-03-30T01:52:44.762709+0000","last_unstale":"2024-03-30T01:52:45.223449+0000","last_undegraded":"2024-03-30T01:52:45.223449+0000","last_fullsized":"2024-03-30T01:52:45.223449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:12:07.468613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.259672+0000","last_change":"2024-03-30T01:52:45.254863+0000","last_active":"2024-03-30T01:52:45.259672+0000","last_peered":"2024-03-30T01:52:45.259672+0000","last_clean":"2024-03-30T01:52:45.259672+0000","last_became_active":"2024-03-30T01:52:45.254488+0000","last_became_peered":"2024-03-30T01:52:45.254488+0000","last_unstale":"2024-03-30T01:52:45.259672+0000","last_undegraded":"2024-03-30T01:52:45.259672+0000","last_fullsized":"2024-03-30T01:52:45.259672+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:46:17.605393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.221129+0000","last_change":"2024-03-30T01:52:44.766714+0000","last_active":"2024-03-30T01:52:45.221129+0000","last_peered":"2024-03-30T01:52:45.221129+0000","last_clean":"2024-03-30T01:52:45.221129+0000","last_became_active":"2024-03-30T01:52:44.766459+0000","last_became_peered":"2024-03-30T01:52:44.766459+0000","last_unstale":"2024-03-30T01:52:45.221129+0000","last_undegraded":"2024-03-30T01:52:45.221129+0000","last_fullsized":"2024-03-30T01:52:45.221129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:27:20.979430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.246008+0000","last_change":"2024-03-30T01:52:45.245131+0000","last_active":"2024-03-30T01:52:45.246008+0000","last_peered":"2024-03-30T01:52:45.246008+0000","last_clean":"2024-03-30T01:52:45.246008+0000","last_became_active":"2024-03-30T01:52:45.244896+0000","last_became_peered":"2024-03-30T01:52:45.244896+0000","last_unstale":"2024-03-30T01:52:45.246008+0000","last_undegraded":"2024-03-30T01:52:45.246008+0000","last_fullsized":"2024-03-30T01:52:45.246008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T05:58:18.607454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.222932+0000","last_change":"2024-03-30T01:52:44.769251+0000","last_active":"2024-03-30T01:52:45.222932+0000","last_peered":"2024-03-30T01:52:45.222932+0000","last_clean":"2024-03-30T01:52:45.222932+0000","last_became_active":"2024-03-30T01:52:44.767017+0000","last_became_peered":"2024-03-30T01:52:44.767017+0000","last_unstale":"2024-03-30T01:52:45.222932+0000","last_undegraded":"2024-03-30T01:52:45.222932+0000","last_fullsized":"2024-03-30T01:52:45.222932+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:09:32.610357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.231261+0000","last_change":"2024-03-30T01:52:45.229863+0000","last_active":"2024-03-30T01:52:46.231261+0000","last_peered":"2024-03-30T01:52:46.231261+0000","last_clean":"2024-03-30T01:52:46.231261+0000","last_became_active":"2024-03-30T01:52:45.229610+0000","last_became_peered":"2024-03-30T01:52:45.229610+0000","last_unstale":"2024-03-30T01:52:46.231261+0000","last_undegraded":"2024-03-30T01:52:46.231261+0000","last_fullsized":"2024-03-30T01:52:46.231261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T09:18:41.596923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.227152+0000","last_change":"2024-03-30T01:52:44.763397+0000","last_active":"2024-03-30T01:52:45.227152+0000","last_peered":"2024-03-30T01:52:45.227152+0000","last_clean":"2024-03-30T01:52:45.227152+0000","last_became_active":"2024-03-30T01:52:44.763114+0000","last_became_peered":"2024-03-30T01:52:44.763114+0000","last_unstale":"2024-03-30T01:52:45.227152+0000","last_undegraded":"2024-03-30T01:52:45.227152+0000","last_fullsized":"2024-03-30T01:52:45.227152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:02:18.337380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.252409+0000","last_change":"2024-03-30T01:52:45.248108+0000","last_active":"2024-03-30T01:52:45.252409+0000","last_peered":"2024-03-30T01:52:45.252409+0000","last_clean":"2024-03-30T01:52:45.252409+0000","last_became_active":"2024-03-30T01:52:45.246789+0000","last_became_peered":"2024-03-30T01:52:45.246789+0000","last_unstale":"2024-03-30T01:52:45.252409+0000","last_undegraded":"2024-03-30T01:52:45.252409+0000","last_fullsized":"2024-03-30T01:52:45.252409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T04:20:38.429903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.231499+0000","last_change":"2024-03-30T01:52:44.768925+0000","last_active":"2024-03-30T01:52:46.231499+0000","last_peered":"2024-03-30T01:52:46.231499+0000","last_clean":"2024-03-30T01:52:46.231499+0000","last_became_active":"2024-03-30T01:52:44.768652+0000","last_became_peered":"2024-03-30T01:52:44.768652+0000","last_unstale":"2024-03-30T01:52:46.231499+0000","last_undegraded":"2024-03-30T01:52:46.231499+0000","last_fullsized":"2024-03-30T01:52:46.231499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T11:28:17.780956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T01:52:46.233641+0000","last_change":"2024-03-30T01:52:45.248046+0000","last_active":"2024-03-30T01:52:46.233641+0000","last_peered":"2024-03-30T01:52:46.233641+0000","last_clean":"2024-03-30T01:52:46.233641+0000","last_became_active":"2024-03-30T01:52:45.247774+0000","last_became_peered":"2024-03-30T01:52:45.247774+0000","last_unstale":"2024-03-30T01:52:46.233641+0000","last_undegraded":"2024-03-30T01:52:46.233641+0000","last_fullsized":"2024-03-30T01:52:46.233641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:44.725968+0000","last_clean_scrub_stamp":"2024-03-30T01:52:44.725968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T02:04:09.706763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.255120+0000","last_change":"2024-03-30T01:52:44.768816+0000","last_active":"2024-03-30T01:52:45.255120+0000","last_peered":"2024-03-30T01:52:45.255120+0000","last_clean":"2024-03-30T01:52:45.255120+0000","last_became_active":"2024-03-30T01:52:44.768546+0000","last_became_peered":"2024-03-30T01:52:44.768546+0000","last_unstale":"2024-03-30T01:52:45.255120+0000","last_undegraded":"2024-03-30T01:52:45.255120+0000","last_fullsized":"2024-03-30T01:52:45.255120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:52:43.721242+0000","last_clean_scrub_stamp":"2024-03-30T01:52:43.721242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T06:31:34.391918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T01:52:45.239885+0000","last_change":"2024-03-30T01:51:23.358245+0000","last_active":"2024-03-30T01:52:45.239885+0000","last_peered":"2024-03-30T01:52:45.239885+0000","last_clean":"2024-03-30T01:52:45.239885+0000","last_became_active":"2024-03-30T01:51:23.355914+0000","last_became_peered":"2024-03-30T01:51:23.355914+0000","last_unstale":"2024-03-30T01:52:45.239885+0000","last_undegraded":"2024-03-30T01:52:45.239885+0000","last_fullsized":"2024-03-30T01:52:45.239885+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_clean_scrub_stamp":"2024-03-30T01:51:21.990253+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:21:19.291194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":742353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.1850000000000001}]},{"osd":1,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.623},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.88500000000000001}]},{"osd":2,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.05}]},{"osd":3,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.0860000000000001}]},{"osd":4,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":1.4990000000000001}]},{"osd":5,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.329},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.129,"5min":2.129,"15min":2.129},"last":1.2769999999999999}]},{"osd":6,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.2190000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":146211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.88200000000000001}]},{"osd":1,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.196},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.0800000000000001}]},{"osd":2,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.026}]},{"osd":3,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":1.2310000000000001}]},{"osd":4,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":1.319},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.5860000000000001}]},{"osd":5,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.6559999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.528,"5min":2.528,"15min":2.528},"last":1.2809999999999999}]},{"osd":7,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.776},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.4350000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":1.6299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":146267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":13.811999999999999,"5min":13.811999999999999,"15min":13.811999999999999},"last":3.278},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.5030000000000001,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":7.3049999999999997}]},{"osd":1,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":9.9900000000000002,"5min":9.9900000000000002,"15min":9.9900000000000002},"last":4.7370000000000001},{"interface":"front","average":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":6.024,"5min":6.024,"15min":6.024},"last":3.3889999999999998}]},{"osd":2,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":6.109,"5min":6.109,"15min":6.109},"last":3.3380000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":7.3609999999999998}]},{"osd":3,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":6.6950000000000003,"5min":6.6950000000000003,"15min":6.6950000000000003},"last":7.5049999999999999},{"interface":"front","average":{"1min":1.956,"5min":1.956,"15min":1.956},"min":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"max":{"1min":9.9489999999999998,"5min":9.9489999999999998,"15min":9.9489999999999998},"last":4.5030000000000001}]},{"osd":4,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":6.1520000000000001,"5min":6.1520000000000001,"15min":6.1520000000000001},"last":9.5879999999999992},{"interface":"front","average":{"1min":1.819,"5min":1.819,"15min":1.819},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":6.6100000000000003,"5min":6.6100000000000003,"15min":6.6100000000000003},"last":7.6769999999999996}]},{"osd":6,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":2.052,"5min":2.052,"15min":2.052},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":9.8160000000000007,"5min":9.8160000000000007,"15min":9.8160000000000007},"last":4.4390000000000001},{"interface":"front","average":{"1min":2,"5min":2,"15min":2},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":6.0679999999999996,"5min":6.0679999999999996,"15min":6.0679999999999996},"last":9.5199999999999996}]},{"osd":7,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":1.831,"15min":1.831},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":7.6340000000000003},{"interface":"front","average":{"1min":2.214,"5min":2.214,"15min":2.214},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":9.8650000000000002,"5min":9.8650000000000002,"15min":9.8650000000000002},"last":4.7889999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":145699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":1.0860000000000001}]},{"osd":1,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.143},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":1.296}]},{"osd":2,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.1859999999999999}]},{"osd":3,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":4.9969999999999999,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":1.393},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"min":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":4.6680000000000001,"5min":4.6680000000000001,"15min":4.6680000000000001},"last":1.5589999999999999}]},{"osd":5,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.9729999999999999,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":3.4790000000000001,"5min":3.4790000000000001,"15min":3.4790000000000001},"last":1.494}]},{"osd":6,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.333}]},{"osd":7,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.625,"5min":1.625,"15min":1.625},"min":{"1min":1.113,"5min":1.113,"15min":1.113},"max":{"1min":2.4409999999999998,"5min":2.4409999999999998,"15min":2.4409999999999998},"last":1.5329999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":153481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":9.298,"5min":9.298,"15min":9.298},"last":0.749},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.806,"5min":3.806,"15min":3.806},"last":0.79300000000000004}]},{"osd":1,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":3.1070000000000002,"5min":3.1070000000000002,"15min":3.1070000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":9.3659999999999997,"5min":9.3659999999999997,"15min":9.3659999999999997},"last":0.628}]},{"osd":2,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":5.7949999999999999,"5min":5.7949999999999999,"15min":5.7949999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":6.7240000000000002,"5min":6.7240000000000002,"15min":6.7240000000000002},"last":0.92300000000000004}]},{"osd":4,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":6.1280000000000001,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.97799999999999998}]},{"osd":5,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.125},{"interface":"front","average":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":18.904,"5min":18.904,"15min":18.904},"last":1.1080000000000001}]},{"osd":6,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":3.9209999999999998,"5min":3.9209999999999998,"15min":3.9209999999999998},"last":1.018},{"interface":"front","average":{"1min":1.738,"5min":1.738,"15min":1.738},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":5.0919999999999996,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":1.079}]},{"osd":7,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.903,"5min":1.903,"15min":1.903},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":6.8600000000000003,"5min":6.8600000000000003,"15min":6.8600000000000003},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":4.4669999999999996,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":0.95499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":150946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.78800000000000003}]},{"osd":1,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.63},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.56399999999999995}]},{"osd":3,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":4.742,"5min":4.742,"15min":4.742},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":0.71799999999999997}]},{"osd":4,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.5609999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.212}]},{"osd":5,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":3.012,"5min":3.012,"15min":3.012},"last":1.423},{"interface":"front","average":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":8.125,"5min":8.125,"15min":8.125},"last":1.3839999999999999}]},{"osd":6,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":5.6449999999999996,"5min":5.6449999999999996,"15min":5.6449999999999996},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.554}]},{"osd":7,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.228}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":147181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2,"5min":2,"15min":2},"last":1.083}]},{"osd":2,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.7549999999999999,"5min":4.7549999999999999,"15min":4.7549999999999999},"last":0.872}]},{"osd":3,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":3.0619999999999998,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":6.04,"5min":6.04,"15min":6.04},"last":1.3380000000000001}]},{"osd":4,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.629,"5min":2.629,"15min":2.629},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":3.7669999999999999,"5min":3.7669999999999999,"15min":3.7669999999999999},"last":1.6040000000000001}]},{"osd":5,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.532,"5min":1.532,"15min":1.532},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":4.2480000000000002,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":1.51},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":3.9359999999999999,"5min":3.9359999999999999,"15min":3.9359999999999999},"last":1.548}]},{"osd":6,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.4209999999999998,"5min":2.4209999999999998,"15min":2.4209999999999998},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":3.2559999999999998,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":1.571}]},{"osd":7,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.6869999999999998,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":1.47},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.1140000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":962560,"data_stored":734944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.6190000000000002,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":0.90300000000000002}]},{"osd":2,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.2070000000000001}]},{"osd":3,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":5.2679999999999998,"5min":5.2679999999999998,"15min":5.2679999999999998},"last":0.65500000000000003}]},{"osd":4,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.141},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":3.3540000000000001,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":1.502}]},{"osd":5,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.2969999999999999}]},{"osd":6,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.9279999999999999,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.8690000000000002,"5min":2.8690000000000002,"15min":2.8690000000000002},"last":1.325}]},{"osd":7,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.8010000000000002,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.595},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":4.923,"5min":4.923,"15min":4.923},"last":1.448}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T01:52:50.106 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-30T01:52:50.106 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-30T01:52:50.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.359+0000 7f48c1c00640 1 Processor -- start 2024-03-30T01:52:50.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.360+0000 7f48c1c00640 1 -- start start 2024-03-30T01:52:50.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.361+0000 7f48c1c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f48bc1443d0 0x7f48bc15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:50.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.361+0000 7f48c1c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f48bc0cc0c0 0x7f48bc0b2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:50.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.361+0000 7f48c1c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48bc0b23d0 con 0x7f48bc0cddd0 2024-03-30T01:52:50.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.361+0000 7f48c1c00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48bc15b5a0 con 0x7f48bc0cc0c0 2024-03-30T01:52:50.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.361+0000 7f48c1c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48bc15b880 con 0x7f48bc1443d0 2024-03-30T01:52:50.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.362+0000 7f48bb400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f48bc0cc0c0 0x7f48bc0b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:50.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.362+0000 7f48bb400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f48bc0cc0c0 0x7f48bc0b2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35456/0 (socket says 172.21.15.133:35456) 2024-03-30T01:52:50.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.362+0000 7f48bb400640 1 -- 172.21.15.133:0/654498066 learned_addr learned my addr 172.21.15.133:0/654498066 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:50.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.362+0000 7f48baa00640 1 --2- 172.21.15.133:0/654498066 >> v2:172.21.15.137:3300/0 conn(0x7f48bc1443d0 0x7f48bc15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:50.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.362+0000 7f48bb400640 1 -- 172.21.15.133:0/654498066 >> v2:172.21.15.137:3300/0 conn(0x7f48bc1443d0 msgr2=0x7f48bc15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:50.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.362+0000 7f48bb400640 1 --2- 172.21.15.133:0/654498066 >> v2:172.21.15.137:3300/0 conn(0x7f48bc1443d0 0x7f48bc15afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:50.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.362+0000 7f48bb400640 1 -- 172.21.15.133:0/654498066 >> v1:172.21.15.137:6789/0 conn(0x7f48bc0cddd0 legacy=0x7f48bc0cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:50.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.362+0000 7f48bb400640 1 -- 172.21.15.133:0/654498066 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc15bb60 con 0x7f48bc0cc0c0 2024-03-30T01:52:50.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.363+0000 7f48bb400640 1 --2- 172.21.15.133:0/654498066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48bc0cc0c0 0x7f48bc0b2860 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f48bc0664e0 tx=0x7f48b402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4f94c6082303fc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:50.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.364+0000 7f48ba000640 1 -- 172.21.15.133:0/654498066 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b402c9f0 con 0x7f48bc0cc0c0 2024-03-30T01:52:50.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.364+0000 7f48ba000640 1 -- 172.21.15.133:0/654498066 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b402cb50 con 0x7f48bc0cc0c0 2024-03-30T01:52:50.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.364+0000 7f48ba000640 1 -- 172.21.15.133:0/654498066 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b40343f0 con 0x7f48bc0cc0c0 2024-03-30T01:52:50.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.364+0000 7f48c1c00640 1 -- 172.21.15.133:0/654498066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48bc0cc0c0 msgr2=0x7f48bc0b2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:50.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.364+0000 7f48c1c00640 1 --2- 172.21.15.133:0/654498066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48bc0cc0c0 0x7f48bc0b2860 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f48bc0664e0 tx=0x7f48b402be50 comp rx=0 tx=0).stop 2024-03-30T01:52:50.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.364+0000 7f48c1c00640 1 -- 172.21.15.133:0/654498066 shutdown_connections 2024-03-30T01:52:50.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.364+0000 7f48c1c00640 1 --2- 172.21.15.133:0/654498066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48bc0cc0c0 0x7f48bc0b2860 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:50.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.364+0000 7f48c1c00640 1 --2- 172.21.15.133:0/654498066 >> v2:172.21.15.137:3300/0 conn(0x7f48bc1443d0 0x7f48bc15afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:50.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.364+0000 7f48c1c00640 1 -- 172.21.15.133:0/654498066 >> 172.21.15.133:0/654498066 conn(0x7f48bc069ce0 msgr2=0x7f48bc06a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:50.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.365+0000 7f48c1c00640 1 -- 172.21.15.133:0/654498066 shutdown_connections 2024-03-30T01:52:50.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.365+0000 7f48c1c00640 1 -- 172.21.15.133:0/654498066 wait complete. 2024-03-30T01:52:50.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.367+0000 7f48c1c00640 1 Processor -- start 2024-03-30T01:52:50.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.367+0000 7f48c1c00640 1 -- start start 2024-03-30T01:52:50.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.368+0000 7f48c1c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48bc0cc0c0 0x7f48bc1f3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:50.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.368+0000 7f48c1c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48bc0cddd0 0x7f48bc13edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:50.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.368+0000 7f48c1c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48bc1443d0 0x7f48bc0a9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:50.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.368+0000 7f48c1c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc0a8e50 con 0x7f48bc1443d0 2024-03-30T01:52:50.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.368+0000 7f48c1c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc1f4320 con 0x7f48bc0cddd0 2024-03-30T01:52:50.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.368+0000 7f48c1c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc13f300 con 0x7f48bc0cc0c0 2024-03-30T01:52:50.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.368+0000 7f48bb400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48bc1443d0 0x7f48bc0a9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:50.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.368+0000 7f48bb400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48bc1443d0 0x7f48bc0a9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35464/0 (socket says 172.21.15.133:35464) 2024-03-30T01:52:50.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.368+0000 7f48bb400640 1 -- 172.21.15.133:0/1437673272 learned_addr learned my addr 172.21.15.133:0/1437673272 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:50.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.369+0000 7f48baa00640 1 --2- 172.21.15.133:0/1437673272 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48bc0cc0c0 0x7f48bc1f3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:50.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.369+0000 7f48b2000640 1 --2- 172.21.15.133:0/1437673272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48bc0cddd0 0x7f48bc13edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:50.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.369+0000 7f48bb400640 1 -- 172.21.15.133:0/1437673272 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48bc0cc0c0 msgr2=0x7f48bc1f3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:50.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.369+0000 7f48bb400640 1 --2- 172.21.15.133:0/1437673272 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48bc0cc0c0 0x7f48bc1f3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:50.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.369+0000 7f48bb400640 1 -- 172.21.15.133:0/1437673272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48bc0cddd0 msgr2=0x7f48bc13edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:50.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.369+0000 7f48bb400640 1 --2- 172.21.15.133:0/1437673272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48bc0cddd0 0x7f48bc13edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:50.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.369+0000 7f48bb400640 1 -- 172.21.15.133:0/1437673272 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b4009b30 con 0x7f48bc1443d0 2024-03-30T01:52:50.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.369+0000 7f48bb400640 1 --2- 172.21.15.133:0/1437673272 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48bc1443d0 0x7f48bc0a9400 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f48b4036040 tx=0x7f48b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:50.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.369+0000 7f48b3400640 1 -- 172.21.15.133:0/1437673272 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b4009510 con 0x7f48bc1443d0 2024-03-30T01:52:50.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.370+0000 7f48b3400640 1 -- 172.21.15.133:0/1437673272 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b403e450 con 0x7f48bc1443d0 2024-03-30T01:52:50.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.370+0000 7f48c1c00640 1 -- 172.21.15.133:0/1437673272 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48bc1f0350 con 0x7f48bc1443d0 2024-03-30T01:52:50.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.370+0000 7f48b3400640 1 -- 172.21.15.133:0/1437673272 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b403e7e0 con 0x7f48bc1443d0 2024-03-30T01:52:50.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.370+0000 7f48c1c00640 1 -- 172.21.15.133:0/1437673272 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48bc1f0910 con 0x7f48bc1443d0 2024-03-30T01:52:50.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.371+0000 7f48c1c00640 1 -- 172.21.15.133:0/1437673272 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48bc066d80 con 0x7f48bc1443d0 2024-03-30T01:52:50.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.372+0000 7f48b3400640 1 -- 172.21.15.133:0/1437673272 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f48b403e940 con 0x7f48bc1443d0 2024-03-30T01:52:50.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.373+0000 7f48b3400640 1 --2- 172.21.15.133:0/1437673272 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f489806ac00 0x7f489806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:50.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.373+0000 7f48b3400640 1 -- 172.21.15.133:0/1437673272 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48b40ac0f0 con 0x7f48bc1443d0 2024-03-30T01:52:50.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.373+0000 7f48baa00640 1 --2- 172.21.15.133:0/1437673272 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f489806ac00 0x7f489806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:50.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.373+0000 7f48baa00640 1 --2- 172.21.15.133:0/1437673272 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f489806ac00 0x7f489806d0c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f48ac006fd0 tx=0x7f48ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:50.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.377+0000 7f48b3400640 1 -- 172.21.15.133:0/1437673272 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f48b4077360 con 0x7f48bc1443d0 2024-03-30T01:52:50.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.641+0000 7f48c1c00640 1 -- 172.21.15.133:0/1437673272 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f48bc0a91e0 con 0x7f48bc1443d0 2024-03-30T01:52:50.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.649+0000 7f48b3400640 1 -- 172.21.15.133:0/1437673272 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7f48b407a980 con 0x7f48bc1443d0 2024-03-30T01:52:50.655 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2024-03-30T01:52:50.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.652+0000 7f48c1c00640 1 -- 172.21.15.133:0/1437673272 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f489806ac00 msgr2=0x7f489806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:50.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.652+0000 7f48c1c00640 1 --2- 172.21.15.133:0/1437673272 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f489806ac00 0x7f489806d0c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f48ac006fd0 tx=0x7f48ac008040 comp rx=0 tx=0).stop 2024-03-30T01:52:50.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.652+0000 7f48c1c00640 1 -- 172.21.15.133:0/1437673272 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48bc1443d0 msgr2=0x7f48bc0a9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:50.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.652+0000 7f48c1c00640 1 --2- 172.21.15.133:0/1437673272 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48bc1443d0 0x7f48bc0a9400 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f48b4036040 tx=0x7f48b4004a40 comp rx=0 tx=0).stop 2024-03-30T01:52:50.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.652+0000 7f48c1c00640 1 -- 172.21.15.133:0/1437673272 shutdown_connections 2024-03-30T01:52:50.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.652+0000 7f48c1c00640 1 --2- 172.21.15.133:0/1437673272 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f489806ac00 0x7f489806d0c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:50.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.652+0000 7f48c1c00640 1 --2- 172.21.15.133:0/1437673272 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48bc1443d0 0x7f48bc0a9400 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:50.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.652+0000 7f48c1c00640 1 --2- 172.21.15.133:0/1437673272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48bc0cddd0 0x7f48bc13edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:50.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.652+0000 7f48c1c00640 1 --2- 172.21.15.133:0/1437673272 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48bc0cc0c0 0x7f48bc1f3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:50.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.652+0000 7f48c1c00640 1 -- 172.21.15.133:0/1437673272 >> 172.21.15.133:0/1437673272 conn(0x7f48bc069ce0 msgr2=0x7f48bc0ae250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:50.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.652+0000 7f48c1c00640 1 -- 172.21.15.133:0/1437673272 shutdown_connections 2024-03-30T01:52:50.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.652+0000 7f48c1c00640 1 -- 172.21.15.133:0/1437673272 wait complete. 2024-03-30T01:52:50.676 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T01:52:50.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.876+0000 7f4673400640 1 Processor -- start 2024-03-30T01:52:50.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.876+0000 7f4673400640 1 -- start start 2024-03-30T01:52:50.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.877+0000 7f4673400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f466c15cc50 0x7f466c0d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:50.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.877+0000 7f4673400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f466c0cfb80 0x7f466c0b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:50.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.877+0000 7f4673400640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466c15d030 con 0x7f466c0d2240 2024-03-30T01:52:50.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.877+0000 7f4673400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f466c0d1c50 con 0x7f466c0cfb80 2024-03-30T01:52:50.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.877+0000 7f4673400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466c0b5af0 con 0x7f466c15cc50 2024-03-30T01:52:50.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.877+0000 7f466be00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f466c0d2240 0x7f466c0cf470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47778/0 (socket says 172.21.15.133:47778) 2024-03-30T01:52:50.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.877+0000 7f466be00640 1 -- 172.21.15.133:0/3889084038 learned_addr learned my addr 172.21.15.133:0/3889084038 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:50.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.877+0000 7f4671400640 1 --2- 172.21.15.133:0/3889084038 >> v2:172.21.15.133:3300/0 conn(0x7f466c0cfb80 0x7f466c0b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:50.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.878+0000 7f4670a00640 1 --2- 172.21.15.133:0/3889084038 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f466c15cc50 0x7f466c0d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:50.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.878+0000 7f466b400640 1 -- 172.21.15.133:0/3889084038 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642275786 0 0) 0x7f466c15d030 con 0x7f466c0d2240 2024-03-30T01:52:50.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.878+0000 7f466b400640 1 -- 172.21.15.133:0/3889084038 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4654003520 con 0x7f466c0d2240 2024-03-30T01:52:50.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.878+0000 7f4671400640 1 -- 172.21.15.133:0/3889084038 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f466c15cc50 msgr2=0x7f466c0d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:50.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.878+0000 7f4671400640 1 --2- 172.21.15.133:0/3889084038 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f466c15cc50 0x7f466c0d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:50.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.878+0000 7f4671400640 1 -- 172.21.15.133:0/3889084038 >> v1:172.21.15.133:6789/0 conn(0x7f466c0d2240 legacy=0x7f466c0cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:50.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.878+0000 7f4671400640 1 -- 172.21.15.133:0/3889084038 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c0d10d0 con 0x7f466c0cfb80 2024-03-30T01:52:50.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.879+0000 7f4671400640 1 --2- 172.21.15.133:0/3889084038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f466c0cfb80 0x7f466c0b14f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4664009d90 tx=0x7f466402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7763c45c9053daf2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:50.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.879+0000 7f466b400640 1 -- 172.21.15.133:0/3889084038 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466402cc50 con 0x7f466c0cfb80 2024-03-30T01:52:50.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.879+0000 7f466b400640 1 -- 172.21.15.133:0/3889084038 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466402cdb0 con 0x7f466c0cfb80 2024-03-30T01:52:50.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.879+0000 7f466b400640 1 -- 172.21.15.133:0/3889084038 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4664034660 con 0x7f466c0cfb80 2024-03-30T01:52:50.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.880+0000 7f4673400640 1 -- 172.21.15.133:0/3889084038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f466c0cfb80 msgr2=0x7f466c0b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:50.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.880+0000 7f4673400640 1 --2- 172.21.15.133:0/3889084038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f466c0cfb80 0x7f466c0b14f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4664009d90 tx=0x7f466402bea0 comp rx=0 tx=0).stop 2024-03-30T01:52:50.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.880+0000 7f4673400640 1 -- 172.21.15.133:0/3889084038 shutdown_connections 2024-03-30T01:52:50.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.880+0000 7f4673400640 1 --2- 172.21.15.133:0/3889084038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f466c0cfb80 0x7f466c0b14f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:50.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.880+0000 7f4673400640 1 --2- 172.21.15.133:0/3889084038 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f466c15cc50 0x7f466c0d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:50.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.880+0000 7f4673400640 1 -- 172.21.15.133:0/3889084038 >> 172.21.15.133:0/3889084038 conn(0x7f466c071a40 msgr2=0x7f466c06b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:50.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.880+0000 7f4673400640 1 -- 172.21.15.133:0/3889084038 shutdown_connections 2024-03-30T01:52:50.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.880+0000 7f4673400640 1 -- 172.21.15.133:0/3889084038 wait complete. 2024-03-30T01:52:50.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.882+0000 7f4673400640 1 Processor -- start 2024-03-30T01:52:50.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.882+0000 7f4673400640 1 -- start start 2024-03-30T01:52:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.883+0000 7f4673400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f466c0cfb80 0x7f466c14bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.883+0000 7f4673400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f466c0d2240 0x7f466c0c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.883+0000 7f4673400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f466c15cc50 0x7f466c14fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.883+0000 7f4673400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c0c9240 con 0x7f466c15cc50 2024-03-30T01:52:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.883+0000 7f4673400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c14ffd0 con 0x7f466c0d2240 2024-03-30T01:52:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.883+0000 7f4673400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466c14cbb0 con 0x7f466c0cfb80 2024-03-30T01:52:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.883+0000 7f4671400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f466c15cc50 0x7f466c14fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.883+0000 7f4671400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f466c15cc50 0x7f466c14fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35490/0 (socket says 172.21.15.133:35490) 2024-03-30T01:52:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.883+0000 7f4671400640 1 -- 172.21.15.133:0/3241169123 learned_addr learned my addr 172.21.15.133:0/3241169123 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.884+0000 7f4670a00640 1 --2- 172.21.15.133:0/3241169123 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f466c0cfb80 0x7f466c14bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.884+0000 7f4671400640 1 -- 172.21.15.133:0/3241169123 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f466c0cfb80 msgr2=0x7f466c14bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.884+0000 7f4671400640 1 --2- 172.21.15.133:0/3241169123 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f466c0cfb80 0x7f466c14bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.884+0000 7f4671400640 1 -- 172.21.15.133:0/3241169123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f466c0d2240 msgr2=0x7f466c0c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.884+0000 7f466be00640 1 --2- 172.21.15.133:0/3241169123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f466c0d2240 0x7f466c0c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.884+0000 7f4671400640 1 --2- 172.21.15.133:0/3241169123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f466c0d2240 0x7f466c0c8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.884+0000 7f4671400640 1 -- 172.21.15.133:0/3241169123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4664009a70 con 0x7f466c15cc50 2024-03-30T01:52:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.884+0000 7f4671400640 1 --2- 172.21.15.133:0/3241169123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f466c15cc50 0x7f466c14fa90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4664009d90 tx=0x7f4664004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.884+0000 7f4668c00640 1 -- 172.21.15.133:0/3241169123 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4664040650 con 0x7f466c15cc50 2024-03-30T01:52:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.884+0000 7f4668c00640 1 -- 172.21.15.133:0/3241169123 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46640407b0 con 0x7f466c15cc50 2024-03-30T01:52:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.884+0000 7f4668c00640 1 -- 172.21.15.133:0/3241169123 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4664040b60 con 0x7f466c15cc50 2024-03-30T01:52:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.885+0000 7f4673400640 1 -- 172.21.15.133:0/3241169123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466c14c310 con 0x7f466c15cc50 2024-03-30T01:52:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.885+0000 7f4673400640 1 -- 172.21.15.133:0/3241169123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466c14c8d0 con 0x7f466c15cc50 2024-03-30T01:52:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.886+0000 7f4673400640 1 -- 172.21.15.133:0/3241169123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466c066d80 con 0x7f466c15cc50 2024-03-30T01:52:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.887+0000 7f4668c00640 1 -- 172.21.15.133:0/3241169123 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f4664040cc0 con 0x7f466c15cc50 2024-03-30T01:52:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.887+0000 7f4668c00640 1 --2- 172.21.15.133:0/3241169123 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f464c06ac00 0x7f464c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.887+0000 7f4668c00640 1 -- 172.21.15.133:0/3241169123 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46640ac190 con 0x7f466c15cc50 2024-03-30T01:52:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.888+0000 7f4670a00640 1 --2- 172.21.15.133:0/3241169123 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f464c06ac00 0x7f464c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:50.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.888+0000 7f4670a00640 1 --2- 172.21.15.133:0/3241169123 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f464c06ac00 0x7f464c06d0c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4660006fd0 tx=0x7f4660008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:50.892+0000 7f4668c00640 1 -- 172.21.15.133:0/3241169123 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f46640772d0 con 0x7f466c15cc50 2024-03-30T01:52:51.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.118+0000 7f4673400640 1 -- 172.21.15.133:0/3241169123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f466c0ca3a0 con 0x7f466c15cc50 2024-03-30T01:52:51.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.119+0000 7f4668c00640 1 -- 172.21.15.133:0/3241169123 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f4664009450 con 0x7f466c15cc50 2024-03-30T01:52:51.126 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:51.126 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/820901593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":820901593},{"type":"v1","addr":"172.21.15.137:6834","nonce":820901593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3524452213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3524452213},{"type":"v1","addr":"172.21.15.137:6835","nonce":3524452213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3989486478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3989486478},{"type":"v1","addr":"172.21.15.133:6837","nonce":3989486478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T01:52:45.211442+0000","modified":"2024-03-30T01:52:48.230722+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4801},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4801":{"gid":4801,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.133:6836/665764657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":665764657},{"type":"v1","addr":"172.21.15.133:6836","nonce":665764657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-30T01:52:51.126 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 15 2024-03-30T01:52:51.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.122+0000 7f4673400640 1 -- 172.21.15.133:0/3241169123 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f464c06ac00 msgr2=0x7f464c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:51.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.122+0000 7f4673400640 1 --2- 172.21.15.133:0/3241169123 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f464c06ac00 0x7f464c06d0c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4660006fd0 tx=0x7f4660008040 comp rx=0 tx=0).stop 2024-03-30T01:52:51.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.122+0000 7f4673400640 1 -- 172.21.15.133:0/3241169123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f466c15cc50 msgr2=0x7f466c14fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:51.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.122+0000 7f4673400640 1 --2- 172.21.15.133:0/3241169123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f466c15cc50 0x7f466c14fa90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4664009d90 tx=0x7f4664004a40 comp rx=0 tx=0).stop 2024-03-30T01:52:51.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.122+0000 7f4673400640 1 -- 172.21.15.133:0/3241169123 shutdown_connections 2024-03-30T01:52:51.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.122+0000 7f4673400640 1 --2- 172.21.15.133:0/3241169123 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f464c06ac00 0x7f464c06d0c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.122+0000 7f4673400640 1 --2- 172.21.15.133:0/3241169123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f466c15cc50 0x7f466c14fa90 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.122+0000 7f4673400640 1 --2- 172.21.15.133:0/3241169123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f466c0d2240 0x7f466c0c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.122+0000 7f4673400640 1 --2- 172.21.15.133:0/3241169123 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f466c0cfb80 0x7f466c14bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.122+0000 7f4673400640 1 -- 172.21.15.133:0/3241169123 >> 172.21.15.133:0/3241169123 conn(0x7f466c071a40 msgr2=0x7f466c15f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:51.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.122+0000 7f4673400640 1 -- 172.21.15.133:0/3241169123 shutdown_connections 2024-03-30T01:52:51.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.122+0000 7f4673400640 1 -- 172.21.15.133:0/3241169123 wait complete. 2024-03-30T01:52:51.548 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-30T01:52:45.211442+0000', 'modified': '2024-03-30T01:52:48.230722+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4801}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4801': {'gid': 4801, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.133:6836/665764657', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 665764657}, {'type': 'v1', 'addr': '172.21.15.133:6836', 'nonce': 665764657}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-03-30T01:52:51.548 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-30T01:52:51.549 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-30T01:52:51.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.760+0000 7f4bd4a00640 1 Processor -- start 2024-03-30T01:52:51.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.760+0000 7f4bd4a00640 1 -- start start 2024-03-30T01:52:51.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.762+0000 7f4bd4a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4bd00d0af0 0x7f4bd00cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:51.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.762+0000 7f4bd4a00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd015d030 con 0x7f4bd015cc50 2024-03-30T01:52:51.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.762+0000 7f4bd4a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd00cfe20 con 0x7f4bd00cf9b0 2024-03-30T01:52:51.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.762+0000 7f4bd4a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd00d1c50 con 0x7f4bd00d0af0 2024-03-30T01:52:51.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.762+0000 7f4bcde00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4bd015cc50 0x7f4bd00d2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47786/0 (socket says 172.21.15.133:47786) 2024-03-30T01:52:51.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.762+0000 7f4bcde00640 1 -- 172.21.15.133:0/840068209 learned_addr learned my addr 172.21.15.133:0/840068209 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:51.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.762+0000 7f4bcd400640 1 --2- 172.21.15.133:0/840068209 >> v2:172.21.15.137:3300/0 conn(0x7f4bd00d0af0 0x7f4bd00cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:51.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.762+0000 7f4bcca00640 1 -- 172.21.15.133:0/840068209 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1764558497 0 0) 0x7f4bd015d030 con 0x7f4bd015cc50 2024-03-30T01:52:51.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.762+0000 7f4bcca00640 1 -- 172.21.15.133:0/840068209 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bb4003520 con 0x7f4bd015cc50 2024-03-30T01:52:51.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.763+0000 7f4bcca00640 1 -- 172.21.15.133:0/840068209 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1286872743 0 0) 0x7f4bb4003520 con 0x7f4bd015cc50 2024-03-30T01:52:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.763+0000 7f4bcca00640 1 -- 172.21.15.133:0/840068209 >> v2:172.21.15.137:3300/0 conn(0x7f4bd00d0af0 msgr2=0x7f4bd00cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.763+0000 7f4bcca00640 1 --2- 172.21.15.133:0/840068209 >> v2:172.21.15.137:3300/0 conn(0x7f4bd00d0af0 0x7f4bd00cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.763+0000 7f4bcca00640 1 -- 172.21.15.133:0/840068209 >> v1:172.21.15.137:6789/0 conn(0x7f4bd00cf9b0 legacy=0x7f4bd00b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.763+0000 7f4bcca00640 1 -- 172.21.15.133:0/840068209 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd00b5af0 con 0x7f4bd015cc50 2024-03-30T01:52:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.763+0000 7f4bcca00640 1 -- 172.21.15.133:0/840068209 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f4bc0001690 con 0x7f4bd015cc50 2024-03-30T01:52:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.763+0000 7f4bcca00640 1 -- 172.21.15.133:0/840068209 >> v1:172.21.15.133:6789/0 conn(0x7f4bd015cc50 legacy=0x7f4bd00d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.763+0000 7f4bcca00640 1 --2- 172.21.15.133:0/840068209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bb40039c0 0x7f4bb4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.763+0000 7f4bcca00640 1 --2- 172.21.15.133:0/840068209 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bb40047c0 0x7f4bb4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.763+0000 7f4bcca00640 1 --2- 172.21.15.133:0/840068209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb4005180 0x7f4bb400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.763+0000 7f4bcca00640 1 -- 172.21.15.133:0/840068209 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd00d1c50 con 0x7f4bb4005180 2024-03-30T01:52:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.763+0000 7f4bcca00640 1 -- 172.21.15.133:0/840068209 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb400c080 con 0x7f4bb40039c0 2024-03-30T01:52:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.763+0000 7f4bcca00640 1 -- 172.21.15.133:0/840068209 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb400c240 con 0x7f4bb40047c0 2024-03-30T01:52:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.763+0000 7f4bce800640 1 --2- 172.21.15.133:0/840068209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb4005180 0x7f4bb400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.764+0000 7f4bcde00640 1 --2- 172.21.15.133:0/840068209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bb40039c0 0x7f4bb4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.764+0000 7f4bce800640 1 -- 172.21.15.133:0/840068209 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bb40047c0 msgr2=0x7f4bb4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:51.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.764+0000 7f4bce800640 1 --2- 172.21.15.133:0/840068209 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bb40047c0 0x7f4bb4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.764+0000 7f4bce800640 1 -- 172.21.15.133:0/840068209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bb40039c0 msgr2=0x7f4bb4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:51.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.764+0000 7f4bce800640 1 --2- 172.21.15.133:0/840068209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bb40039c0 0x7f4bb4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.764+0000 7f4bce800640 1 -- 172.21.15.133:0/840068209 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb4003520 con 0x7f4bb4005180 2024-03-30T01:52:51.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.765+0000 7f4bce800640 1 -- 172.21.15.133:0/840068209 reap_dead start 2024-03-30T01:52:51.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.765+0000 7f4bce800640 1 --2- 172.21.15.133:0/840068209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb4005180 0x7f4bb400b980 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8001e50 tx=0x7f4bb40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681305b4516c7507 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:51.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.765+0000 7f4bcca00640 1 -- 172.21.15.133:0/840068209 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8003b70 con 0x7f4bb4005180 2024-03-30T01:52:51.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.765+0000 7f4bcca00640 1 -- 172.21.15.133:0/840068209 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc8003d10 con 0x7f4bb4005180 2024-03-30T01:52:51.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.765+0000 7f4bcca00640 1 -- 172.21.15.133:0/840068209 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8005310 con 0x7f4bb4005180 2024-03-30T01:52:51.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.766+0000 7f4bd4a00640 1 -- 172.21.15.133:0/840068209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb4005180 msgr2=0x7f4bb400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:51.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.766+0000 7f4bd4a00640 1 --2- 172.21.15.133:0/840068209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb4005180 0x7f4bb400b980 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8001e50 tx=0x7f4bb40057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.766+0000 7f4bd4a00640 1 -- 172.21.15.133:0/840068209 shutdown_connections 2024-03-30T01:52:51.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.766+0000 7f4bd4a00640 1 --2- 172.21.15.133:0/840068209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb4005180 0x7f4bb400b980 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.766+0000 7f4bd4a00640 1 -- 172.21.15.133:0/840068209 >> 172.21.15.133:0/840068209 conn(0x7f4bd0071a40 msgr2=0x7f4bd006b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:51.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.766+0000 7f4bd4a00640 1 -- 172.21.15.133:0/840068209 shutdown_connections 2024-03-30T01:52:51.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.766+0000 7f4bd4a00640 1 -- 172.21.15.133:0/840068209 wait complete. 2024-03-30T01:52:51.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.768+0000 7f4bd4a00640 1 Processor -- start 2024-03-30T01:52:51.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.768+0000 7f4bd4a00640 1 -- start start 2024-03-30T01:52:51.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.768+0000 7f4bd4a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb4005180 0x7f4bd01efac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:51.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.768+0000 7f4bd4a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bd00c6310 0x7f4bd00c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:51.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.768+0000 7f4bd4a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bd00c6e00 0x7f4bd015aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:51.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.768+0000 7f4bd4a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd01f5c70 con 0x7f4bb4005180 2024-03-30T01:52:51.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.768+0000 7f4bd4a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd01f0000 con 0x7f4bd00c6e00 2024-03-30T01:52:51.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.768+0000 7f4bd4a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd01f5f10 con 0x7f4bd00c6310 2024-03-30T01:52:51.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.768+0000 7f4bcde00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb4005180 0x7f4bd01efac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:51.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.768+0000 7f4bcde00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb4005180 0x7f4bd01efac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35512/0 (socket says 172.21.15.133:35512) 2024-03-30T01:52:51.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.768+0000 7f4bcde00640 1 -- 172.21.15.133:0/463939936 learned_addr learned my addr 172.21.15.133:0/463939936 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:51.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.768+0000 7f4bcd400640 1 --2- 172.21.15.133:0/463939936 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bd00c6310 0x7f4bd00c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:51.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.768+0000 7f4bce800640 1 --2- 172.21.15.133:0/463939936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bd00c6e00 0x7f4bd015aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:51.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.768+0000 7f4bcde00640 1 -- 172.21.15.133:0/463939936 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bd00c6310 msgr2=0x7f4bd00c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:51.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.768+0000 7f4bcde00640 1 --2- 172.21.15.133:0/463939936 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bd00c6310 0x7f4bd00c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.768+0000 7f4bcde00640 1 -- 172.21.15.133:0/463939936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bd00c6e00 msgr2=0x7f4bd015aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:51.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.768+0000 7f4bcde00640 1 --2- 172.21.15.133:0/463939936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bd00c6e00 0x7f4bd015aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.768+0000 7f4bcde00640 1 -- 172.21.15.133:0/463939936 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd01f61f0 con 0x7f4bb4005180 2024-03-30T01:52:51.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.768+0000 7f4bcd400640 1 --2- 172.21.15.133:0/463939936 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bd00c6310 0x7f4bd00c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:51.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.770+0000 7f4bcde00640 1 --2- 172.21.15.133:0/463939936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb4005180 0x7f4bd01efac0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4bc000e780 tx=0x7f4bc000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:51.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.770+0000 7f4bc6000640 1 -- 172.21.15.133:0/463939936 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc000c660 con 0x7f4bb4005180 2024-03-30T01:52:51.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.770+0000 7f4bc6000640 1 -- 172.21.15.133:0/463939936 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc000c7c0 con 0x7f4bb4005180 2024-03-30T01:52:51.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.770+0000 7f4bd4a00640 1 -- 172.21.15.133:0/463939936 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd01f64d0 con 0x7f4bb4005180 2024-03-30T01:52:51.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.770+0000 7f4bc6000640 1 -- 172.21.15.133:0/463939936 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc000cb50 con 0x7f4bb4005180 2024-03-30T01:52:51.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.770+0000 7f4bd4a00640 1 -- 172.21.15.133:0/463939936 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd015e140 con 0x7f4bb4005180 2024-03-30T01:52:51.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.772+0000 7f4bc6000640 1 -- 172.21.15.133:0/463939936 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f4bc000ccb0 con 0x7f4bb4005180 2024-03-30T01:52:51.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.774+0000 7f4bc6000640 1 --2- 172.21.15.133:0/463939936 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4bb006ac30 0x7f4bb006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:51.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.774+0000 7f4bc6000640 1 -- 172.21.15.133:0/463939936 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4bc0089190 con 0x7f4bb4005180 2024-03-30T01:52:51.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.774+0000 7f4bcd400640 1 --2- 172.21.15.133:0/463939936 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4bb006ac30 0x7f4bb006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:51.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.774+0000 7f4bd7679740 1 Processor -- start 2024-03-30T01:52:51.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.774+0000 7f4bd7679740 1 -- start start 2024-03-30T01:52:51.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.775+0000 7f4bcd400640 1 --2- 172.21.15.133:0/463939936 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4bb006ac30 0x7f4bb006d0f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00b5530 tx=0x7f4bbc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:51.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.775+0000 7f4bd7679740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b53d00 0x55c620b26ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:51.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.775+0000 7f4bd7679740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c620b540e0 0x55c620b56a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:51.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.775+0000 7f4bd7679740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c620b271e0 0x55c620b56fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:51.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.775+0000 7f4bd7679740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c620b022c0 con 0x55c620b53d00 2024-03-30T01:52:51.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.775+0000 7f4bd7679740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c620a978f0 con 0x55c620b540e0 2024-03-30T01:52:51.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.775+0000 7f4bd7679740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c620a95080 con 0x55c620b271e0 2024-03-30T01:52:51.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.776+0000 7f4bcde00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b53d00 0x55c620b26ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:51.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.776+0000 7f4bcde00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b53d00 0x55c620b26ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35528/0 (socket says 172.21.15.133:35528) 2024-03-30T01:52:51.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.776+0000 7f4bcde00640 1 -- 172.21.15.133:0/3589085003 learned_addr learned my addr 172.21.15.133:0/3589085003 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:51.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.776+0000 7f4bcde00640 1 -- 172.21.15.133:0/3589085003 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c620b271e0 msgr2=0x55c620b56fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:51.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.776+0000 7f4bcde00640 1 --2- 172.21.15.133:0/3589085003 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c620b271e0 0x55c620b56fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.776+0000 7f4bcde00640 1 -- 172.21.15.133:0/3589085003 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c620b540e0 msgr2=0x55c620b56a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:51.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.776+0000 7f4bcde00640 1 --2- 172.21.15.133:0/3589085003 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c620b540e0 0x55c620b56a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.776+0000 7f4bcde00640 1 -- 172.21.15.133:0/3589085003 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c620a5ba10 con 0x55c620b53d00 2024-03-30T01:52:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.776+0000 7f4bcde00640 1 --2- 172.21.15.133:0/3589085003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b53d00 0x55c620b26ca0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0054520 tx=0x7f4bc0058720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0b470f369fe6c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.776+0000 7f4bbaa00640 1 -- 172.21.15.133:0/3589085003 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0060410 con 0x55c620b53d00 2024-03-30T01:52:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.776+0000 7f4bbaa00640 1 -- 172.21.15.133:0/3589085003 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc0056160 con 0x55c620b53d00 2024-03-30T01:52:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.776+0000 7f4bbaa00640 1 -- 172.21.15.133:0/3589085003 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0054730 con 0x55c620b53d00 2024-03-30T01:52:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.777+0000 7f4bd7679740 1 -- 172.21.15.133:0/3589085003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b53d00 msgr2=0x55c620b26ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.777+0000 7f4bd7679740 1 --2- 172.21.15.133:0/3589085003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b53d00 0x55c620b26ca0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0054520 tx=0x7f4bc0058720 comp rx=0 tx=0).stop 2024-03-30T01:52:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.777+0000 7f4bd7679740 1 -- 172.21.15.133:0/3589085003 shutdown_connections 2024-03-30T01:52:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.777+0000 7f4bd7679740 1 --2- 172.21.15.133:0/3589085003 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c620b271e0 0x55c620b56fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.777+0000 7f4bd7679740 1 --2- 172.21.15.133:0/3589085003 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c620b540e0 0x55c620b56a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.777+0000 7f4bd7679740 1 --2- 172.21.15.133:0/3589085003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b53d00 0x55c620b26ca0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.777+0000 7f4bd7679740 1 -- 172.21.15.133:0/3589085003 >> 172.21.15.133:0/3589085003 conn(0x55c620b28f10 msgr2=0x55c620b71a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.777+0000 7f4bd7679740 1 -- 172.21.15.133:0/3589085003 shutdown_connections 2024-03-30T01:52:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.777+0000 7f4bd7679740 1 -- 172.21.15.133:0/3589085003 wait complete. 2024-03-30T01:52:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.778+0000 7f4bd7679740 1 -- start start 2024-03-30T01:52:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.778+0000 7f4bd7679740 1 Processor -- start 2024-03-30T01:52:51.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.779+0000 7f4bd7679740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c620b53d00 0x55c620b52540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:51.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.779+0000 7f4bd7679740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b540e0 0x55c620b735f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:51.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.779+0000 7f4bd7679740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c620b41380 0x55c620b73b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:51.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.779+0000 7f4bd7679740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c620a90970 con 0x55c620b540e0 2024-03-30T01:52:51.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.779+0000 7f4bd7679740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c620a320a0 con 0x55c620b41380 2024-03-30T01:52:51.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.779+0000 7f4bd7679740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c620a31d40 con 0x55c620b53d00 2024-03-30T01:52:51.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.779+0000 7f4bd7679740 10 client.0 _ll_register_callbacks cb 0x55c620a89fe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T01:52:51.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.779+0000 7f4bcd400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b540e0 0x55c620b735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:51.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.779+0000 7f4bcd400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b540e0 0x55c620b735f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35530/0 (socket says 172.21.15.133:35530) 2024-03-30T01:52:51.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.779+0000 7f4bcd400640 1 -- 172.21.15.133:0/1643937939 learned_addr learned my addr 172.21.15.133:0/1643937939 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:51.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.780+0000 7f4bcd400640 1 -- 172.21.15.133:0/1643937939 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c620b53d00 msgr2=0x55c620b52540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:51.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.780+0000 7f4bcde00640 1 --2- 172.21.15.133:0/1643937939 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c620b53d00 0x55c620b52540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:51.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.780+0000 7f4bcd400640 1 --2- 172.21.15.133:0/1643937939 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c620b53d00 0x55c620b52540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.780+0000 7f4bcd400640 1 -- 172.21.15.133:0/1643937939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c620b41380 msgr2=0x55c620b73b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:51.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.780+0000 7f4bce800640 1 --2- 172.21.15.133:0/1643937939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c620b41380 0x55c620b73b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:51.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.780+0000 7f4bcd400640 1 --2- 172.21.15.133:0/1643937939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c620b41380 0x55c620b73b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.780+0000 7f4bcd400640 1 -- 172.21.15.133:0/1643937939 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd015e140 con 0x55c620b540e0 2024-03-30T01:52:51.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.780+0000 7f4bcd400640 1 --2- 172.21.15.133:0/1643937939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b540e0 0x55c620b735f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc015780 tx=0x7f4bbc015b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e5e51c4cb49990 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:51.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.780+0000 7f4baf400640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-03-30T01:52:51.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.780+0000 7f4baf400640 1 -- 172.21.15.133:0/1643937939 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc004220 con 0x55c620b540e0 2024-03-30T01:52:51.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.780+0000 7f4baf400640 1 -- 172.21.15.133:0/1643937939 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4bbc004380 con 0x55c620b540e0 2024-03-30T01:52:51.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.781+0000 7f4bd7679740 1 -- 172.21.15.133:0/1643937939 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c620abab10 con 0x55c620b540e0 2024-03-30T01:52:51.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.781+0000 7f4baf400640 1 -- 172.21.15.133:0/1643937939 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bbc009690 con 0x55c620b540e0 2024-03-30T01:52:51.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.781+0000 7f4bd7679740 10 client.5301 fetch_fsmap learned FSMap version 15 2024-03-30T01:52:51.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.781+0000 7f4bd7679740 1 -- 172.21.15.133:0/1643937939 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55c620a8eff0 con 0x55c620b540e0 2024-03-30T01:52:51.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.781+0000 7f4baf400640 1 -- 172.21.15.133:0/1643937939 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c620abab10 con 0x55c620b540e0 2024-03-30T01:52:51.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.781+0000 7f4baf400640 1 -- 172.21.15.133:0/1643937939 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 15) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f4bbc016920 con 0x55c620b540e0 2024-03-30T01:52:51.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.781+0000 7f4bd7679740 10 client.5301 fetch_fsmap finished waiting for FSMap version 15 2024-03-30T01:52:51.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.781+0000 7f4bd7679740 10 client.5301 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-30T01:52:51.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.781+0000 7f4bd7679740 20 client.5301 populate_metadata read hostname 'smithi133' 2024-03-30T01:52:51.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.781+0000 7f4bd7679740 1 --2- 172.21.15.133:0/1643937939 >> [v2:172.21.15.133:6834/665764657,v1:172.21.15.133:6836/665764657] conn(0x55c620b42000 0x55c620b423e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:51.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.781+0000 7f4bd7679740 4 client.5301 mds_command: new command op to 4801 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T01:52:51.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.781+0000 7f4bd7679740 1 -- 172.21.15.133:0/1643937939 --> [v2:172.21.15.133:6834/665764657,v1:172.21.15.133:6836/665764657] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c6207843c0 con 0x55c620b42000 2024-03-30T01:52:51.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.781+0000 7f4bcde00640 1 --2- 172.21.15.133:0/1643937939 >> [v2:172.21.15.133:6834/665764657,v1:172.21.15.133:6836/665764657] conn(0x55c620b42000 0x55c620b423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:51.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.782+0000 7f4bcde00640 1 --2- 172.21.15.133:0/1643937939 >> [v2:172.21.15.133:6834/665764657,v1:172.21.15.133:6836/665764657] conn(0x55c620b42000 0x55c620b423e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d44361a1d67f54e server_cookie=8f4aeb3dc20ad6cd in_seq=0 out_seq=0 2024-03-30T01:52:51.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.782+0000 7f4baf400640 10 client.5301 ms_handle_connect on v2:172.21.15.133:6834/665764657 2024-03-30T01:52:51.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.783+0000 7f4baf400640 1 -- 172.21.15.133:0/1643937939 <== mds.0 v2:172.21.15.133:6834/665764657 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c6207843c0 con 0x55c620b42000 2024-03-30T01:52:51.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.783+0000 7f4baf400640 10 client.5301 handle_command_reply: tid=0 2024-03-30T01:52:51.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.783+0000 7f4bd7679740 1 client.5301 shutdown 2024-03-30T01:52:51.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.783+0000 7f4bd7679740 1 -- 172.21.15.133:0/1643937939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b540e0 msgr2=0x55c620b735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:51.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.783+0000 7f4bd7679740 1 --2- 172.21.15.133:0/1643937939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b540e0 0x55c620b735f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc015780 tx=0x7f4bbc015b80 comp rx=0 tx=0).stop 2024-03-30T01:52:51.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.783+0000 7f4bd7679740 1 -- 172.21.15.133:0/1643937939 shutdown_connections 2024-03-30T01:52:51.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.783+0000 7f4bd7679740 1 --2- 172.21.15.133:0/1643937939 >> [v2:172.21.15.133:6834/665764657,v1:172.21.15.133:6836/665764657] conn(0x55c620b42000 0x55c620b423e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.783+0000 7f4bd7679740 1 --2- 172.21.15.133:0/1643937939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c620b41380 0x55c620b73b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.783+0000 7f4bd7679740 1 --2- 172.21.15.133:0/1643937939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b540e0 0x55c620b735f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.783+0000 7f4bd7679740 1 --2- 172.21.15.133:0/1643937939 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c620b53d00 0x55c620b52540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.783+0000 7f4baf400640 0 client.5301 ms_handle_reset on v2:172.21.15.133:6834/665764657 2024-03-30T01:52:51.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.783+0000 7f4bd7679740 1 -- 172.21.15.133:0/1643937939 >> 172.21.15.133:0/1643937939 conn(0x55c620b271e0 msgr2=0x55c620b2acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:51.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.783+0000 7f4bd7679740 1 -- 172.21.15.133:0/1643937939 shutdown_connections 2024-03-30T01:52:51.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.783+0000 7f4bd7679740 1 -- 172.21.15.133:0/1643937939 wait complete. 2024-03-30T01:52:51.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.783+0000 7f4bd7679740 20 client.5301 trim_cache size 0 max 16384 2024-03-30T01:52:51.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.799+0000 7f4bd7679740 1 Processor -- start 2024-03-30T01:52:51.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.800+0000 7f4bd7679740 1 -- start start 2024-03-30T01:52:51.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.800+0000 7f4bd7679740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c620b41380 0x55c620b570e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:51.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.800+0000 7f4bd7679740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b53d00 0x55c620bd1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:51.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.800+0000 7f4bd7679740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c620b540e0 0x55c620b223c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:51.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.800+0000 7f4bd7679740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6207f7f20 con 0x55c620b53d00 2024-03-30T01:52:51.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.800+0000 7f4bd7679740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c620b74070 con 0x55c620b540e0 2024-03-30T01:52:51.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.800+0000 7f4bd7679740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c620b75220 con 0x55c620b41380 2024-03-30T01:52:51.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.801+0000 7f4bcd400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b53d00 0x55c620bd1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:51.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.801+0000 7f4bcd400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b53d00 0x55c620bd1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35544/0 (socket says 172.21.15.133:35544) 2024-03-30T01:52:51.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.801+0000 7f4bcd400640 1 -- 172.21.15.133:0/3244162016 learned_addr learned my addr 172.21.15.133:0/3244162016 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:51.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.801+0000 7f4bce800640 1 --2- 172.21.15.133:0/3244162016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c620b540e0 0x55c620b223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:51.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.801+0000 7f4bcd400640 1 -- 172.21.15.133:0/3244162016 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c620b41380 msgr2=0x55c620b570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:51.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.801+0000 7f4bcd400640 1 --2- 172.21.15.133:0/3244162016 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c620b41380 0x55c620b570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.801+0000 7f4bcd400640 1 -- 172.21.15.133:0/3244162016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c620b540e0 msgr2=0x55c620b223c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:51.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.801+0000 7f4bcd400640 1 --2- 172.21.15.133:0/3244162016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c620b540e0 0x55c620b223c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.801+0000 7f4bcd400640 1 -- 172.21.15.133:0/3244162016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c620ac47c0 con 0x55c620b53d00 2024-03-30T01:52:51.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.801+0000 7f4bcd400640 1 --2- 172.21.15.133:0/3244162016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b53d00 0x55c620bd1250 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc008010 tx=0x7f4bbc01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45bfd19ad1b5f44d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:51.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.802+0000 7f4bbb400640 1 -- 172.21.15.133:0/3244162016 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc0169f0 con 0x55c620b53d00 2024-03-30T01:52:51.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.802+0000 7f4bbb400640 1 -- 172.21.15.133:0/3244162016 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bbc01a040 con 0x55c620b53d00 2024-03-30T01:52:51.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.802+0000 7f4bbb400640 1 -- 172.21.15.133:0/3244162016 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc021640 con 0x55c620b53d00 2024-03-30T01:52:51.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.802+0000 7f4bd7679740 1 -- 172.21.15.133:0/3244162016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b53d00 msgr2=0x55c620bd1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:51.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.802+0000 7f4bd7679740 1 --2- 172.21.15.133:0/3244162016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b53d00 0x55c620bd1250 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc008010 tx=0x7f4bbc01f000 comp rx=0 tx=0).stop 2024-03-30T01:52:51.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.802+0000 7f4bd7679740 1 -- 172.21.15.133:0/3244162016 shutdown_connections 2024-03-30T01:52:51.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.802+0000 7f4bd7679740 1 --2- 172.21.15.133:0/3244162016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c620b540e0 0x55c620b223c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.802+0000 7f4bd7679740 1 --2- 172.21.15.133:0/3244162016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b53d00 0x55c620bd1250 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.802+0000 7f4bd7679740 1 --2- 172.21.15.133:0/3244162016 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c620b41380 0x55c620b570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.802+0000 7f4bd7679740 1 -- 172.21.15.133:0/3244162016 >> 172.21.15.133:0/3244162016 conn(0x55c620b271e0 msgr2=0x55c620b2cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:51.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.802+0000 7f4bd7679740 1 -- 172.21.15.133:0/3244162016 shutdown_connections 2024-03-30T01:52:51.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.802+0000 7f4bd7679740 1 -- 172.21.15.133:0/3244162016 wait complete. 2024-03-30T01:52:51.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.803+0000 7f4bd7679740 1 -- start start 2024-03-30T01:52:51.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.803+0000 7f4bd7679740 1 Processor -- start 2024-03-30T01:52:51.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.804+0000 7f4bd7679740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b41380 0x55c620bdaa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:51.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.804+0000 7f4bd7679740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c620b53d00 0x55c620bce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:51.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.804+0000 7f4bd7679740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c620b540e0 0x55c620b80800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:51.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.804+0000 7f4bd7679740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c620bdaf70 con 0x55c620b41380 2024-03-30T01:52:51.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.804+0000 7f4bd7679740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c620bdb3a0 con 0x55c620b540e0 2024-03-30T01:52:51.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.804+0000 7f4bd7679740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c620b43fc0 con 0x55c620b53d00 2024-03-30T01:52:51.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.804+0000 7f4bd7679740 10 client.0 _ll_register_callbacks cb 0x7f4bbc010db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T01:52:51.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.804+0000 7f4bcde00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b41380 0x55c620bdaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:51.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.804+0000 7f4bcde00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b41380 0x55c620bdaa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35558/0 (socket says 172.21.15.133:35558) 2024-03-30T01:52:51.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.804+0000 7f4bcde00640 1 -- 172.21.15.133:0/660836476 learned_addr learned my addr 172.21.15.133:0/660836476 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:51.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.805+0000 7f4bcde00640 1 -- 172.21.15.133:0/660836476 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c620b53d00 msgr2=0x55c620bce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:51.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.805+0000 7f4bcde00640 1 --2- 172.21.15.133:0/660836476 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c620b53d00 0x55c620bce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.805+0000 7f4bcde00640 1 -- 172.21.15.133:0/660836476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c620b540e0 msgr2=0x55c620b80800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:51.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.805+0000 7f4bcde00640 1 --2- 172.21.15.133:0/660836476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c620b540e0 0x55c620b80800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.805+0000 7f4bcde00640 1 -- 172.21.15.133:0/660836476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c620a8eff0 con 0x55c620b41380 2024-03-30T01:52:51.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.805+0000 7f4bcde00640 1 --2- 172.21.15.133:0/660836476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b41380 0x55c620bdaa30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4bc000c4b0 tx=0x7f4bc0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76ce4365e44f6a8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:51.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.805+0000 7f4baf400640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-03-30T01:52:51.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.805+0000 7f4baf400640 1 -- 172.21.15.133:0/660836476 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc00563c0 con 0x55c620b41380 2024-03-30T01:52:51.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.805+0000 7f4baf400640 1 -- 172.21.15.133:0/660836476 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4bc00872b0 con 0x55c620b41380 2024-03-30T01:52:51.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.805+0000 7f4bd7679740 1 -- 172.21.15.133:0/660836476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4bc0056160 con 0x55c620b41380 2024-03-30T01:52:51.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.805+0000 7f4baf400640 1 -- 172.21.15.133:0/660836476 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bc0054730 con 0x55c620b41380 2024-03-30T01:52:51.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.805+0000 7f4bd7679740 10 client.5307 fetch_fsmap learned FSMap version 15 2024-03-30T01:52:51.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.805+0000 7f4bd7679740 1 -- 172.21.15.133:0/660836476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55c620a312b0 con 0x55c620b41380 2024-03-30T01:52:51.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.805+0000 7f4baf400640 1 -- 172.21.15.133:0/660836476 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc0056160 con 0x55c620b41380 2024-03-30T01:52:51.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.806+0000 7f4baf400640 1 -- 172.21.15.133:0/660836476 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 15) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f4bc005ff80 con 0x55c620b41380 2024-03-30T01:52:51.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.806+0000 7f4bd7679740 10 client.5307 fetch_fsmap finished waiting for FSMap version 15 2024-03-30T01:52:51.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.806+0000 7f4bd7679740 10 client.5307 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-30T01:52:51.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.806+0000 7f4bd7679740 20 client.5307 populate_metadata read hostname 'smithi133' 2024-03-30T01:52:51.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.806+0000 7f4bd7679740 1 --2- 172.21.15.133:0/660836476 >> [v2:172.21.15.133:6834/665764657,v1:172.21.15.133:6836/665764657] conn(0x55c620b80dc0 0x55c620b3e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.806+0000 7f4bd7679740 4 client.5307 mds_command: new command op to 4801 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-30T01:52:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.806+0000 7f4bd7679740 1 -- 172.21.15.133:0/660836476 --> [v2:172.21.15.133:6834/665764657,v1:172.21.15.133:6836/665764657] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c6207956c0 con 0x55c620b80dc0 2024-03-30T01:52:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.806+0000 7f4bcd400640 1 --2- 172.21.15.133:0/660836476 >> [v2:172.21.15.133:6834/665764657,v1:172.21.15.133:6836/665764657] conn(0x55c620b80dc0 0x55c620b3e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.806+0000 7f4bcd400640 1 --2- 172.21.15.133:0/660836476 >> [v2:172.21.15.133:6834/665764657,v1:172.21.15.133:6836/665764657] conn(0x55c620b80dc0 0x55c620b3e820 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc0147447fda7bee server_cookie=c44de5201ac6f519 in_seq=0 out_seq=0 2024-03-30T01:52:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.806+0000 7f4baf400640 10 client.5307 ms_handle_connect on v2:172.21.15.133:6834/665764657 2024-03-30T01:52:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.807+0000 7f4baf400640 1 -- 172.21.15.133:0/660836476 <== mds.0 v2:172.21.15.133:6834/665764657 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55c6207956c0 con 0x55c620b80dc0 2024-03-30T01:52:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.807+0000 7f4baf400640 10 client.5307 handle_command_reply: tid=0 2024-03-30T01:52:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.807+0000 7f4bd7679740 1 client.5307 shutdown 2024-03-30T01:52:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.807+0000 7f4bd7679740 1 -- 172.21.15.133:0/660836476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b41380 msgr2=0x55c620bdaa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.807+0000 7f4bd7679740 1 --2- 172.21.15.133:0/660836476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b41380 0x55c620bdaa30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4bc000c4b0 tx=0x7f4bc0000bc0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.807+0000 7f4bd7679740 1 -- 172.21.15.133:0/660836476 shutdown_connections 2024-03-30T01:52:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.807+0000 7f4bd7679740 1 --2- 172.21.15.133:0/660836476 >> [v2:172.21.15.133:6834/665764657,v1:172.21.15.133:6836/665764657] conn(0x55c620b80dc0 0x55c620b3e820 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.807+0000 7f4bd7679740 1 --2- 172.21.15.133:0/660836476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c620b540e0 0x55c620b80800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.807+0000 7f4bd7679740 1 --2- 172.21.15.133:0/660836476 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c620b53d00 0x55c620bce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.807+0000 7f4bd7679740 1 --2- 172.21.15.133:0/660836476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c620b41380 0x55c620bdaa30 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.807+0000 7f4baf400640 0 client.5307 ms_handle_reset on v2:172.21.15.133:6834/665764657 2024-03-30T01:52:51.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.807+0000 7f4bd7679740 1 -- 172.21.15.133:0/660836476 >> 172.21.15.133:0/660836476 conn(0x55c620b271e0 msgr2=0x55c620b74500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:51.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.807+0000 7f4bd7679740 1 -- 172.21.15.133:0/660836476 shutdown_connections 2024-03-30T01:52:51.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.807+0000 7f4bd7679740 1 -- 172.21.15.133:0/660836476 wait complete. 2024-03-30T01:52:51.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.807+0000 7f4bd7679740 20 client.5307 trim_cache size 0 max 16384 2024-03-30T01:52:51.817 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-03-30T01:52:51.817 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "10e5f47a-7547-42f1-8bb3-a8ac3aae8cad", 2024-03-30T01:52:51.817 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2024-03-30T01:52:51.817 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 4801, 2024-03-30T01:52:51.818 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2024-03-30T01:52:51.818 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2024-03-30T01:52:51.818 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2024-03-30T01:52:51.818 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 6.5896353650000004, 2024-03-30T01:52:51.818 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 15, 2024-03-30T01:52:51.818 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 34, 2024-03-30T01:52:51.818 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 34, 2024-03-30T01:52:51.818 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 14.852992493 2024-03-30T01:52:51.818 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-03-30T01:52:51.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.808+0000 7f4bd4a00640 1 -- 172.21.15.133:0/463939936 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4bb006ac30 msgr2=0x7f4bb006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:51.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.808+0000 7f4bd4a00640 1 --2- 172.21.15.133:0/463939936 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4bb006ac30 0x7f4bb006d0f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00b5530 tx=0x7f4bbc008040 comp rx=0 tx=0).stop 2024-03-30T01:52:51.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.808+0000 7f4bd4a00640 1 -- 172.21.15.133:0/463939936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb4005180 msgr2=0x7f4bd01efac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:51.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.808+0000 7f4bd4a00640 1 --2- 172.21.15.133:0/463939936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb4005180 0x7f4bd01efac0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4bc000e780 tx=0x7f4bc000ec40 comp rx=0 tx=0).stop 2024-03-30T01:52:51.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.808+0000 7f4bd4a00640 1 -- 172.21.15.133:0/463939936 shutdown_connections 2024-03-30T01:52:51.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.808+0000 7f4bd4a00640 1 --2- 172.21.15.133:0/463939936 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f4bb006ac30 0x7f4bb006d0f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.808+0000 7f4bd4a00640 1 --2- 172.21.15.133:0/463939936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bd00c6e00 0x7f4bd015aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.808+0000 7f4bd4a00640 1 --2- 172.21.15.133:0/463939936 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bd00c6310 0x7f4bd00c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.808+0000 7f4bd4a00640 1 --2- 172.21.15.133:0/463939936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb4005180 0x7f4bd01efac0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:51.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.808+0000 7f4bd4a00640 1 -- 172.21.15.133:0/463939936 >> 172.21.15.133:0/463939936 conn(0x7f4bd0071a40 msgr2=0x7f4bd00d2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:51.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.808+0000 7f4bd4a00640 1 -- 172.21.15.133:0/463939936 shutdown_connections 2024-03-30T01:52:51.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:51.808+0000 7f4bd4a00640 1 -- 172.21.15.133:0/463939936 wait complete. 2024-03-30T01:52:51.829 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T01:52:52.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.014+0000 7efc1be00640 1 Processor -- start 2024-03-30T01:52:52.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.014+0000 7efc1be00640 1 -- start start 2024-03-30T01:52:52.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.015+0000 7efc1be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc140cf860 0x7efc140cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:52.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.015+0000 7efc1be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efc140d0ed0 0x7efc140d1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:52.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.015+0000 7efc1be00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc140b5ba0 con 0x7efc1415cec0 2024-03-30T01:52:52.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.015+0000 7efc1be00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc14161810 con 0x7efc140d0ed0 2024-03-30T01:52:52.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.015+0000 7efc1be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc140d0230 con 0x7efc140cf860 2024-03-30T01:52:52.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.016+0000 7efc19400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7efc1415cec0 0x7efc140b8420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47800/0 (socket says 172.21.15.133:47800) 2024-03-30T01:52:52.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.016+0000 7efc19400640 1 -- 172.21.15.133:0/2312974705 learned_addr learned my addr 172.21.15.133:0/2312974705 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:52.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.016+0000 7efc18a00640 1 --2- 172.21.15.133:0/2312974705 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc140cf860 0x7efc140cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:52.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.016+0000 7efc13e00640 1 -- 172.21.15.133:0/2312974705 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897033438 0 0) 0x7efc140b5ba0 con 0x7efc1415cec0 2024-03-30T01:52:52.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.016+0000 7efc19e00640 1 --2- 172.21.15.133:0/2312974705 >> v2:172.21.15.137:3300/0 conn(0x7efc140d0ed0 0x7efc140d1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:52.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.016+0000 7efc13e00640 1 -- 172.21.15.133:0/2312974705 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbfc003520 con 0x7efc1415cec0 2024-03-30T01:52:52.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.017+0000 7efc13e00640 1 -- 172.21.15.133:0/2312974705 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 239816050 0 0) 0x7efbfc003520 con 0x7efc1415cec0 2024-03-30T01:52:52.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.017+0000 7efc13e00640 1 -- 172.21.15.133:0/2312974705 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc140cf860 msgr2=0x7efc140cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:52.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.017+0000 7efc13e00640 1 --2- 172.21.15.133:0/2312974705 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc140cf860 0x7efc140cfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:52.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.017+0000 7efc13e00640 1 -- 172.21.15.133:0/2312974705 >> v2:172.21.15.137:3300/0 conn(0x7efc140d0ed0 msgr2=0x7efc140d1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:52.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.017+0000 7efc13e00640 1 --2- 172.21.15.133:0/2312974705 >> v2:172.21.15.137:3300/0 conn(0x7efc140d0ed0 0x7efc140d1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:52.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.017+0000 7efc13e00640 1 -- 172.21.15.133:0/2312974705 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc14160b90 con 0x7efc1415cec0 2024-03-30T01:52:52.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.017+0000 7efc13e00640 1 -- 172.21.15.133:0/2312974705 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7efc08001670 con 0x7efc1415cec0 2024-03-30T01:52:52.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.017+0000 7efc13e00640 1 -- 172.21.15.133:0/2312974705 >> v1:172.21.15.133:6789/0 conn(0x7efc1415cec0 legacy=0x7efc140b8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:52.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.017+0000 7efc13e00640 1 --2- 172.21.15.133:0/2312974705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbfc003970 0x7efbfc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:52.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.017+0000 7efc13e00640 1 --2- 172.21.15.133:0/2312974705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efbfc0047c0 0x7efbfc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:52.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.017+0000 7efc13e00640 1 --2- 172.21.15.133:0/2312974705 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc140cf860 0x7efbfc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:52.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.017+0000 7efc13e00640 1 -- 172.21.15.133:0/2312974705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc14161810 con 0x7efbfc003970 2024-03-30T01:52:52.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.017+0000 7efc13e00640 1 -- 172.21.15.133:0/2312974705 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc140d0230 con 0x7efbfc0047c0 2024-03-30T01:52:52.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.017+0000 7efc13e00640 1 -- 172.21.15.133:0/2312974705 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc00bb40 con 0x7efc140cf860 2024-03-30T01:52:52.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.017+0000 7efc19400640 1 --2- 172.21.15.133:0/2312974705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbfc003970 0x7efbfc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:52.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.017+0000 7efc19e00640 1 --2- 172.21.15.133:0/2312974705 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc140cf860 0x7efbfc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:52.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.017+0000 7efc19400640 1 -- 172.21.15.133:0/2312974705 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc140cf860 msgr2=0x7efbfc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:52.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.017+0000 7efc18a00640 1 --2- 172.21.15.133:0/2312974705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efbfc0047c0 0x7efbfc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:52.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.017+0000 7efc19400640 1 --2- 172.21.15.133:0/2312974705 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc140cf860 0x7efbfc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:52.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.017+0000 7efc19400640 1 -- 172.21.15.133:0/2312974705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efbfc0047c0 msgr2=0x7efbfc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:52.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.017+0000 7efc19400640 1 --2- 172.21.15.133:0/2312974705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efbfc0047c0 0x7efbfc004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:52.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.017+0000 7efc19400640 1 -- 172.21.15.133:0/2312974705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc003520 con 0x7efbfc003970 2024-03-30T01:52:52.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.017+0000 7efc19e00640 1 --2- 172.21.15.133:0/2312974705 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc140cf860 0x7efbfc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:52.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.019+0000 7efc19400640 1 --2- 172.21.15.133:0/2312974705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbfc003970 0x7efbfc003d90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efc0800c0e0 tx=0x7efbfc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5453243b6b9448cb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:52.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.019+0000 7efc13e00640 1 -- 172.21.15.133:0/2312974705 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc08005ad0 con 0x7efbfc003970 2024-03-30T01:52:52.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.019+0000 7efc13e00640 1 -- 172.21.15.133:0/2312974705 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc08005c50 con 0x7efbfc003970 2024-03-30T01:52:52.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.019+0000 7efc13e00640 1 -- 172.21.15.133:0/2312974705 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0802c7d0 con 0x7efbfc003970 2024-03-30T01:52:52.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.019+0000 7efc1be00640 1 -- 172.21.15.133:0/2312974705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbfc003970 msgr2=0x7efbfc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:52.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.019+0000 7efc1be00640 1 --2- 172.21.15.133:0/2312974705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbfc003970 0x7efbfc003d90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efc0800c0e0 tx=0x7efbfc0057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:52.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.019+0000 7efc19e00640 1 -- 172.21.15.133:0/2312974705 reap_dead start 2024-03-30T01:52:52.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.020+0000 7efc1be00640 1 -- 172.21.15.133:0/2312974705 shutdown_connections 2024-03-30T01:52:52.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.020+0000 7efc1be00640 1 -- 172.21.15.133:0/2312974705 >> 172.21.15.133:0/2312974705 conn(0x7efc1406b5e0 msgr2=0x7efc1406b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:52.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.020+0000 7efc1be00640 1 -- 172.21.15.133:0/2312974705 shutdown_connections 2024-03-30T01:52:52.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.020+0000 7efc1be00640 1 -- 172.21.15.133:0/2312974705 wait complete. 2024-03-30T01:52:52.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.021+0000 7efc1be00640 1 Processor -- start 2024-03-30T01:52:52.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.022+0000 7efc1be00640 1 -- start start 2024-03-30T01:52:52.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.022+0000 7efc1be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efbfc003970 0x7efc140c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:52.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.023+0000 7efc1be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc14151350 0x7efc140c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:52.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.023+0000 7efc1be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc140b4340 0x7efc140b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:52.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.023+0000 7efc1be00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc140b4d30 con 0x7efc14151350 2024-03-30T01:52:52.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.023+0000 7efc1be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc140c9420 con 0x7efbfc003970 2024-03-30T01:52:52.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.023+0000 7efc1be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc140b32f0 con 0x7efc140b4340 2024-03-30T01:52:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.023+0000 7efc18a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc14151350 0x7efc140c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.023+0000 7efc18a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc14151350 0x7efc140c8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35580/0 (socket says 172.21.15.133:35580) 2024-03-30T01:52:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.023+0000 7efc18a00640 1 -- 172.21.15.133:0/1956893783 learned_addr learned my addr 172.21.15.133:0/1956893783 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.023+0000 7efc19400640 1 --2- 172.21.15.133:0/1956893783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efbfc003970 0x7efc140c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.023+0000 7efc19e00640 1 --2- 172.21.15.133:0/1956893783 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc140b4340 0x7efc140b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.023+0000 7efc18a00640 1 -- 172.21.15.133:0/1956893783 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc140b4340 msgr2=0x7efc140b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.023+0000 7efc18a00640 1 --2- 172.21.15.133:0/1956893783 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc140b4340 0x7efc140b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.023+0000 7efc18a00640 1 -- 172.21.15.133:0/1956893783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efbfc003970 msgr2=0x7efc140c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.023+0000 7efc18a00640 1 --2- 172.21.15.133:0/1956893783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efbfc003970 0x7efc140c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.023+0000 7efc18a00640 1 -- 172.21.15.133:0/1956893783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc140b3540 con 0x7efc14151350 2024-03-30T01:52:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.024+0000 7efc18a00640 1 --2- 172.21.15.133:0/1956893783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc14151350 0x7efc140c8ee0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7efc0000e840 tx=0x7efc0000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.024+0000 7efc11600640 1 -- 172.21.15.133:0/1956893783 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0000c6d0 con 0x7efc14151350 2024-03-30T01:52:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.024+0000 7efc11600640 1 -- 172.21.15.133:0/1956893783 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0000c830 con 0x7efc14151350 2024-03-30T01:52:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.024+0000 7efc11600640 1 -- 172.21.15.133:0/1956893783 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0000cbc0 con 0x7efc14151350 2024-03-30T01:52:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.024+0000 7efc1be00640 1 -- 172.21.15.133:0/1956893783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc140b3820 con 0x7efc14151350 2024-03-30T01:52:52.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.024+0000 7efc1be00640 1 -- 172.21.15.133:0/1956893783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc140b3b00 con 0x7efc14151350 2024-03-30T01:52:52.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.025+0000 7efc1be00640 1 -- 172.21.15.133:0/1956893783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc140cac30 con 0x7efc14151350 2024-03-30T01:52:52.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.026+0000 7efc11600640 1 -- 172.21.15.133:0/1956893783 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7efc0000cd20 con 0x7efc14151350 2024-03-30T01:52:52.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.027+0000 7efc11600640 1 --2- 172.21.15.133:0/1956893783 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efbf406ac30 0x7efbf406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:52.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.027+0000 7efc11600640 1 -- 172.21.15.133:0/1956893783 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc000890a0 con 0x7efc14151350 2024-03-30T01:52:52.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.027+0000 7efc19400640 1 --2- 172.21.15.133:0/1956893783 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efbf406ac30 0x7efbf406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:52.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.028+0000 7efc19400640 1 --2- 172.21.15.133:0/1956893783 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efbf406ac30 0x7efbf406d0f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efc08034000 tx=0x7efc08007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:52.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.031+0000 7efc11600640 1 -- 172.21.15.133:0/1956893783 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7efc140cac30 con 0x7efc14151350 2024-03-30T01:52:52.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.250+0000 7efc1be00640 1 -- 172.21.15.133:0/1956893783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efc140cac30 con 0x7efc14151350 2024-03-30T01:52:52.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.251+0000 7efc11600640 1 -- 172.21.15.133:0/1956893783 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7efc140cac30 con 0x7efc14151350 2024-03-30T01:52:52.257 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-30T01:52:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.254+0000 7efc1be00640 1 -- 172.21.15.133:0/1956893783 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efbf406ac30 msgr2=0x7efbf406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.254+0000 7efc1be00640 1 --2- 172.21.15.133:0/1956893783 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efbf406ac30 0x7efbf406d0f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efc08034000 tx=0x7efc08007000 comp rx=0 tx=0).stop 2024-03-30T01:52:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.254+0000 7efc1be00640 1 -- 172.21.15.133:0/1956893783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc14151350 msgr2=0x7efc140c8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.254+0000 7efc1be00640 1 --2- 172.21.15.133:0/1956893783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc14151350 0x7efc140c8ee0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7efc0000e840 tx=0x7efc0000ed00 comp rx=0 tx=0).stop 2024-03-30T01:52:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.254+0000 7efc1be00640 1 -- 172.21.15.133:0/1956893783 shutdown_connections 2024-03-30T01:52:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.254+0000 7efc1be00640 1 --2- 172.21.15.133:0/1956893783 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efbf406ac30 0x7efbf406d0f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.254+0000 7efc1be00640 1 --2- 172.21.15.133:0/1956893783 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc140b4340 0x7efc140b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.254+0000 7efc1be00640 1 --2- 172.21.15.133:0/1956893783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc14151350 0x7efc140c8ee0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.254+0000 7efc1be00640 1 --2- 172.21.15.133:0/1956893783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efbfc003970 0x7efc140c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.254+0000 7efc1be00640 1 -- 172.21.15.133:0/1956893783 >> 172.21.15.133:0/1956893783 conn(0x7efc1406b5e0 msgr2=0x7efc140b5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.254+0000 7efc1be00640 1 -- 172.21.15.133:0/1956893783 shutdown_connections 2024-03-30T01:52:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:52.254+0000 7efc1be00640 1 -- 172.21.15.133:0/1956893783 wait complete. 2024-03-30T01:52:52.278 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-30T01:52:52.279 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T01:52:52.279 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2024-03-30T01:52:52.279 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-30T01:52:52.279 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-30T01:52:52.279 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-30T01:52:52.279 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-03-30T01:52:52.279 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T01:52:52.279 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-30T01:52:52.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:52.279 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2024-03-30T01:52:52.327 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T01:52:52.327 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T01:52:52.328 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T01:52:52.328 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:52.328 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-03-30T01:52:52.328 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:52.328 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T01:52:52.328 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2024-03-30T01:52:52.328 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2024-03-30T01:52:52.328 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T01:52:52.328 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2024-03-30T01:52:52.328 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2024-03-30T01:52:52.328 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T01:52:52.328 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2024-03-30T01:52:52.328 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T01:52:52.328 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2024-03-30T01:52:52.329 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-30T01:52:52.329 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42483sec preferred_lft 42483sec 2024-03-30T01:52:52.329 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2024-03-30T01:52:52.329 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:52.329 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T01:52:52.329 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 8a:6b:af:70:0d:57 brd ff:ff:ff:ff:ff:ff 2024-03-30T01:52:52.329 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-30T01:52:52.329 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:52.329 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c9e:e4ff:fe1f:eb21/64 scope link 2024-03-30T01:52:52.329 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:52.329 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-30T01:52:52.329 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether e2:c1:fe:aa:32:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T01:52:52.329 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::e0c1:feff:feaa:325e/64 scope link 2024-03-30T01:52:52.329 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:52.329 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-30T01:52:52.330 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 8a:6b:af:70:0d:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T01:52:52.330 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::886b:afff:fe70:d57/64 scope link 2024-03-30T01:52:52.330 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-03-30T01:52:52.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:52.331 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T01:52:52.413 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-03-30T01:52:52.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:52.418 DEBUG:teuthology.orchestra.run.smithi133:> route 2024-03-30T01:52:52.470 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2024-03-30T01:52:52.470 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T01:52:52.470 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-30T01:52:52.470 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-30T01:52:52.470 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T01:52:52.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:52.471 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-03-30T01:52:52.471 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-03-30T01:52:52.471 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-30T01:52:52.471 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-30T01:52:52.471 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-30T01:52:52.471 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-03-30T01:52:52.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:52.658 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-03-30T01:52:52.710 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-30T01:52:52.711 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-30T01:52:52.711 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-30T01:52:52.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:52.711 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2024-03-30T01:52:52.811 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T01:52:52.811 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-30T01:52:52.862 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-30T01:52:52.862 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T01:52:52.862 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-30T01:52:52.912 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-30T01:52:52.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:52.912 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T01:52:53.050 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T01:52:53.050 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-30T01:52:53.050 INFO:teuthology.orchestra.run.smithi133.stdout:invalid new device string format 2024-03-30T01:52:53.073 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T01:52:53.073 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-30T01:52:53.073 INFO:teuthology.orchestra.run.smithi133.stdout:invalid new device string format 2024-03-30T01:52:53.074 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-03-30T01:52:53.074 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T01:52:53.100 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T01:52:53.100 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-30T01:52:53.100 INFO:teuthology.orchestra.run.smithi133.stdout:invalid new device string format 2024-03-30T01:52:53.100 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-03-30T01:52:53.100 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T01:52:53.100 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.133:6789,172.21.15.137:6789,172.21.15.137:6790" 2024-03-30T01:52:53.100 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.133:6789,172.21.15.137:6789,172.21.15.137:6790:/ 2024-03-30T01:52:53.100 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=10e5f47a-7547-42f1-8bb3-a8ac3aae8cad" will pass to kernel 2024-03-30T01:52:53.102 INFO:teuthology.orchestra.run.smithi133.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-30T01:52:53.103 INFO:teuthology.orchestra.run.smithi133.stdout: You just mounted a file system that supports labels which does not 2024-03-30T01:52:53.103 INFO:teuthology.orchestra.run.smithi133.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-30T01:52:53.103 INFO:teuthology.orchestra.run.smithi133.stdout: applications will generate AVC messages and not be allowed access to 2024-03-30T01:52:53.103 INFO:teuthology.orchestra.run.smithi133.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-30T01:52:53.108 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-30T01:52:53.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:53.108 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-30T01:52:53.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:52:53.193 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T01:52:53.259 INFO:teuthology.orchestra.run.smithi133.stdout:client4885 2024-03-30T01:52:53.259 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:52:53.259 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:52:53.307 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:52:53.308 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:52:53.403 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-30T01:52:53.403 DEBUG:teuthology.orchestra.run.smithi133:> import os 2024-03-30T01:52:53.404 DEBUG:teuthology.orchestra.run.smithi133:> import uuid 2024-03-30T01:52:53.404 DEBUG:teuthology.orchestra.run.smithi133:> 2024-03-30T01:52:53.404 DEBUG:teuthology.orchestra.run.smithi133:> n = 1 2024-03-30T01:52:53.404 DEBUG:teuthology.orchestra.run.smithi133:> create_hard_links = False 2024-03-30T01:52:53.404 DEBUG:teuthology.orchestra.run.smithi133:> if 0 > 0: 2024-03-30T01:52:53.404 DEBUG:teuthology.orchestra.run.smithi133:> create_hard_links = True 2024-03-30T01:52:53.404 DEBUG:teuthology.orchestra.run.smithi133:> path = "/home/ubuntu/cephtest/mnt.0/file_on_fs" 2024-03-30T01:52:53.404 DEBUG:teuthology.orchestra.run.smithi133:> 2024-03-30T01:52:53.404 DEBUG:teuthology.orchestra.run.smithi133:> dpath = os.path.dirname(path) 2024-03-30T01:52:53.404 DEBUG:teuthology.orchestra.run.smithi133:> fnameprefix = os.path.basename(path) 2024-03-30T01:52:53.404 DEBUG:teuthology.orchestra.run.smithi133:> os.makedirs(dpath, exist_ok=True) 2024-03-30T01:52:53.404 DEBUG:teuthology.orchestra.run.smithi133:> 2024-03-30T01:52:53.404 DEBUG:teuthology.orchestra.run.smithi133:> try: 2024-03-30T01:52:53.404 DEBUG:teuthology.orchestra.run.smithi133:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-03-30T01:52:53.404 DEBUG:teuthology.orchestra.run.smithi133:> 2024-03-30T01:52:53.404 DEBUG:teuthology.orchestra.run.smithi133:> for i in range(n): 2024-03-30T01:52:53.405 DEBUG:teuthology.orchestra.run.smithi133:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-03-30T01:52:53.405 DEBUG:teuthology.orchestra.run.smithi133:> with open(fpath, '"'"'w'"'"') as f: 2024-03-30T01:52:53.405 DEBUG:teuthology.orchestra.run.smithi133:> f.write(f"{i}") 2024-03-30T01:52:53.405 DEBUG:teuthology.orchestra.run.smithi133:> if True: 2024-03-30T01:52:53.405 DEBUG:teuthology.orchestra.run.smithi133:> f.flush() 2024-03-30T01:52:53.405 DEBUG:teuthology.orchestra.run.smithi133:> os.fsync(f.fileno()) 2024-03-30T01:52:53.405 DEBUG:teuthology.orchestra.run.smithi133:> if False: 2024-03-30T01:52:53.405 DEBUG:teuthology.orchestra.run.smithi133:> os.unlink(fpath) 2024-03-30T01:52:53.405 DEBUG:teuthology.orchestra.run.smithi133:> if False: 2024-03-30T01:52:53.405 DEBUG:teuthology.orchestra.run.smithi133:> os.fsync(dirfd) 2024-03-30T01:52:53.405 DEBUG:teuthology.orchestra.run.smithi133:> if create_hard_links: 2024-03-30T01:52:53.405 DEBUG:teuthology.orchestra.run.smithi133:> for j in range(0): 2024-03-30T01:52:53.405 DEBUG:teuthology.orchestra.run.smithi133:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-03-30T01:52:53.405 DEBUG:teuthology.orchestra.run.smithi133:> if False: 2024-03-30T01:52:53.405 DEBUG:teuthology.orchestra.run.smithi133:> os.fsync(dirfd) 2024-03-30T01:52:53.405 DEBUG:teuthology.orchestra.run.smithi133:> finally: 2024-03-30T01:52:53.405 DEBUG:teuthology.orchestra.run.smithi133:> os.close(dirfd) 2024-03-30T01:52:53.406 DEBUG:teuthology.orchestra.run.smithi133:> ' 2024-03-30T01:52:53.729 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-30T01:52:53.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.984+0000 7f88a9400640 1 Processor -- start 2024-03-30T01:52:53.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.985+0000 7f88a9400640 1 -- start start 2024-03-30T01:52:53.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.986+0000 7f88a9400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f88a4070500 0x7f88a4070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:53.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.986+0000 7f88a9400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88a40cc530 0x7f88a40cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:53.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.986+0000 7f88a9400640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a40a76a0 con 0x7f88a4143790 2024-03-30T01:52:53.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.986+0000 7f88a9400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a4070ed0 con 0x7f88a40cc530 2024-03-30T01:52:53.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.986+0000 7f88a9400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a40b38e0 con 0x7f88a4070500 2024-03-30T01:52:53.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.986+0000 7f88a3200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88a40cc530 0x7f88a40cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:53.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.986+0000 7f88a3200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88a40cc530 0x7f88a40cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35590/0 (socket says 172.21.15.133:35590) 2024-03-30T01:52:53.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.986+0000 7f88a3200640 1 -- 172.21.15.133:0/1835521174 learned_addr learned my addr 172.21.15.133:0/1835521174 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:53.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.987+0000 7f889be00640 1 --2- 172.21.15.133:0/1835521174 >> v2:172.21.15.137:3300/0 conn(0x7f88a4070500 0x7f88a4070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:53.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.987+0000 7f88a3200640 1 -- 172.21.15.133:0/1835521174 >> v2:172.21.15.137:3300/0 conn(0x7f88a4070500 msgr2=0x7f88a4070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:53.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.987+0000 7f88a3200640 1 --2- 172.21.15.133:0/1835521174 >> v2:172.21.15.137:3300/0 conn(0x7f88a4070500 0x7f88a4070990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:53.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.987+0000 7f88a3200640 1 -- 172.21.15.133:0/1835521174 >> v1:172.21.15.133:6789/0 conn(0x7f88a4143790 legacy=0x7f88a40cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:53.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.987+0000 7f88a3200640 1 -- 172.21.15.133:0/1835521174 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a40ccee0 con 0x7f88a40cc530 2024-03-30T01:52:53.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.987+0000 7f88a1e00640 1 -- 172.21.15.133:0/1835521174 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136565467 0 0) 0x7f88a40a76a0 con 0x7f88a4143790 2024-03-30T01:52:53.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.987+0000 7f889be00640 1 --2- 172.21.15.133:0/1835521174 >> v2:172.21.15.137:3300/0 conn(0x7f88a4070500 0x7f88a4070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:53.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.988+0000 7f88a3200640 1 --2- 172.21.15.133:0/1835521174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a40cc530 0x7f88a40cc9a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f88a406e6a0 tx=0x7f889c02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8e4383a1ad77bf server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:53.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.988+0000 7f88a1e00640 1 -- 172.21.15.133:0/1835521174 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c02cbb0 con 0x7f88a40cc530 2024-03-30T01:52:53.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.988+0000 7f88a1e00640 1 -- 172.21.15.133:0/1835521174 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889c02cd10 con 0x7f88a40cc530 2024-03-30T01:52:53.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.988+0000 7f88a1e00640 1 -- 172.21.15.133:0/1835521174 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c034610 con 0x7f88a40cc530 2024-03-30T01:52:53.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.989+0000 7f88a9400640 1 -- 172.21.15.133:0/1835521174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a40cc530 msgr2=0x7f88a40cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:53.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.989+0000 7f88a9400640 1 --2- 172.21.15.133:0/1835521174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a40cc530 0x7f88a40cc9a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f88a406e6a0 tx=0x7f889c02c010 comp rx=0 tx=0).stop 2024-03-30T01:52:53.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.989+0000 7f88a9400640 1 -- 172.21.15.133:0/1835521174 shutdown_connections 2024-03-30T01:52:53.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.989+0000 7f88a9400640 1 --2- 172.21.15.133:0/1835521174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a40cc530 0x7f88a40cc9a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:53.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.989+0000 7f88a9400640 1 --2- 172.21.15.133:0/1835521174 >> v2:172.21.15.137:3300/0 conn(0x7f88a4070500 0x7f88a4070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:53.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.989+0000 7f88a9400640 1 -- 172.21.15.133:0/1835521174 >> 172.21.15.133:0/1835521174 conn(0x7f88a40b07a0 msgr2=0x7f88a40b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:53.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.989+0000 7f88a9400640 1 -- 172.21.15.133:0/1835521174 shutdown_connections 2024-03-30T01:52:53.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.989+0000 7f88a9400640 1 -- 172.21.15.133:0/1835521174 wait complete. 2024-03-30T01:52:53.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.991+0000 7f88a9400640 1 Processor -- start 2024-03-30T01:52:53.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.991+0000 7f88a9400640 1 -- start start 2024-03-30T01:52:53.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.992+0000 7f88a9400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88a4070500 0x7f88a413a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:53.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.992+0000 7f88a9400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a40cc530 0x7f88a40ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:53.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.992+0000 7f88a9400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f88a4143790 0x7f88a40abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:53.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.992+0000 7f88a9400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a414e450 con 0x7f88a40cc530 2024-03-30T01:52:53.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.992+0000 7f88a9400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a41f1000 con 0x7f88a4070500 2024-03-30T01:52:53.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.992+0000 7f88a9400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a413a810 con 0x7f88a4143790 2024-03-30T01:52:53.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.992+0000 7f889be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a40cc530 0x7f88a40ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:53.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.992+0000 7f889be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a40cc530 0x7f88a40ab6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35604/0 (socket says 172.21.15.133:35604) 2024-03-30T01:52:53.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.992+0000 7f889be00640 1 -- 172.21.15.133:0/1213038361 learned_addr learned my addr 172.21.15.133:0/1213038361 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:54.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.993+0000 7f88a2800640 1 --2- 172.21.15.133:0/1213038361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88a4070500 0x7f88a413a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:54.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.993+0000 7f889be00640 1 -- 172.21.15.133:0/1213038361 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f88a4143790 msgr2=0x7f88a40abbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:54.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.993+0000 7f889be00640 1 --2- 172.21.15.133:0/1213038361 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f88a4143790 0x7f88a40abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:54.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.993+0000 7f889be00640 1 -- 172.21.15.133:0/1213038361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88a4070500 msgr2=0x7f88a413a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:54.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.993+0000 7f889be00640 1 --2- 172.21.15.133:0/1213038361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88a4070500 0x7f88a413a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:54.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.993+0000 7f889be00640 1 -- 172.21.15.133:0/1213038361 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c009b30 con 0x7f88a40cc530 2024-03-30T01:52:54.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.993+0000 7f88a2800640 1 --2- 172.21.15.133:0/1213038361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88a4070500 0x7f88a413a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:54.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.993+0000 7f889be00640 1 --2- 172.21.15.133:0/1213038361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a40cc530 0x7f88a40ab6a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f888c00c820 tx=0x7f888c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:54.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.993+0000 7f889aa00640 1 -- 172.21.15.133:0/1213038361 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c007a30 con 0x7f88a40cc530 2024-03-30T01:52:54.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.993+0000 7f889aa00640 1 -- 172.21.15.133:0/1213038361 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c007b90 con 0x7f88a40cc530 2024-03-30T01:52:54.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.993+0000 7f889aa00640 1 -- 172.21.15.133:0/1213038361 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c00ce70 con 0x7f88a40cc530 2024-03-30T01:52:54.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.993+0000 7f88a9400640 1 -- 172.21.15.133:0/1213038361 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a41f27e0 con 0x7f88a40cc530 2024-03-30T01:52:54.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.994+0000 7f88a9400640 1 -- 172.21.15.133:0/1213038361 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a41f2da0 con 0x7f88a40cc530 2024-03-30T01:52:54.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.995+0000 7f88a9400640 1 -- 172.21.15.133:0/1213038361 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a414e590 con 0x7f88a40cc530 2024-03-30T01:52:54.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.995+0000 7f889aa00640 1 -- 172.21.15.133:0/1213038361 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f888c0113f0 con 0x7f88a40cc530 2024-03-30T01:52:54.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.996+0000 7f889aa00640 1 --2- 172.21.15.133:0/1213038361 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f888006ac80 0x7f888006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:54.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.996+0000 7f889aa00640 1 -- 172.21.15.133:0/1213038361 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f888c089510 con 0x7f88a40cc530 2024-03-30T01:52:54.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.997+0000 7f88a2800640 1 --2- 172.21.15.133:0/1213038361 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f888006ac80 0x7f888006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:54.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:53.997+0000 7f88a2800640 1 --2- 172.21.15.133:0/1213038361 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f888006ac80 0x7f888006d140 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8894000f60 tx=0x7f8894009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:54.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.001+0000 7f889aa00640 1 -- 172.21.15.133:0/1213038361 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f888c0546d0 con 0x7f88a40cc530 2024-03-30T01:52:54.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.231+0000 7f88a9400640 1 -- 172.21.15.133:0/1213038361 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f88a4066d80 con 0x7f88a40cc530 2024-03-30T01:52:54.239 INFO:tasks.ceph.mon.a.smithi133.stderr:2024-03-30T01:52:54.234+0000 7fa124c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-30T01:52:54.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.250+0000 7f889aa00640 1 -- 172.21.15.133:0/1213038361 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7f888c057cf0 con 0x7f88a40cc530 2024-03-30T01:52:54.255 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-30T01:52:54.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.253+0000 7f88a9400640 1 -- 172.21.15.133:0/1213038361 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f888006ac80 msgr2=0x7f888006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:54.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.253+0000 7f88a9400640 1 --2- 172.21.15.133:0/1213038361 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f888006ac80 0x7f888006d140 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8894000f60 tx=0x7f8894009040 comp rx=0 tx=0).stop 2024-03-30T01:52:54.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.253+0000 7f88a9400640 1 -- 172.21.15.133:0/1213038361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a40cc530 msgr2=0x7f88a40ab6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:54.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.253+0000 7f88a9400640 1 --2- 172.21.15.133:0/1213038361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a40cc530 0x7f88a40ab6a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f888c00c820 tx=0x7f888c00cc20 comp rx=0 tx=0).stop 2024-03-30T01:52:54.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.253+0000 7f88a9400640 1 -- 172.21.15.133:0/1213038361 shutdown_connections 2024-03-30T01:52:54.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.253+0000 7f88a9400640 1 --2- 172.21.15.133:0/1213038361 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f888006ac80 0x7f888006d140 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:54.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.253+0000 7f88a9400640 1 --2- 172.21.15.133:0/1213038361 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f88a4143790 0x7f88a40abbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:54.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.253+0000 7f88a9400640 1 --2- 172.21.15.133:0/1213038361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a40cc530 0x7f88a40ab6a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:54.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.253+0000 7f88a9400640 1 --2- 172.21.15.133:0/1213038361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88a4070500 0x7f88a413a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:54.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.253+0000 7f88a9400640 1 -- 172.21.15.133:0/1213038361 >> 172.21.15.133:0/1213038361 conn(0x7f88a40b07a0 msgr2=0x7f88a40ae8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:54.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.253+0000 7f88a9400640 1 -- 172.21.15.133:0/1213038361 shutdown_connections 2024-03-30T01:52:54.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.253+0000 7f88a9400640 1 -- 172.21.15.133:0/1213038361 wait complete. 2024-03-30T01:52:54.272 INFO:tasks.ceph.mds.a.smithi133.stderr: -1960> 2024-03-30T01:52:47.704+0000 7f1384800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-30T01:52:54.276 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-30T01:52:54.337 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2024-03-30T01:52:54.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.465+0000 7f0005c00640 1 Processor -- start 2024-03-30T01:52:54.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.465+0000 7f0005c00640 1 -- start start 2024-03-30T01:52:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.467+0000 7f0005c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0000070500 0x7f0000070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.467+0000 7f0005c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f00000cc530 0x7f00000cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.467+0000 7f0005c00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00000a76a0 con 0x7f0000143790 2024-03-30T01:52:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.467+0000 7f0005c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00000b38e0 con 0x7f00000cc530 2024-03-30T01:52:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.467+0000 7f0005c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00000ccf00 con 0x7f0000070500 2024-03-30T01:52:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.467+0000 7efffea00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0000143790 0x7f00000cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47826/0 (socket says 172.21.15.133:47826) 2024-03-30T01:52:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.467+0000 7efffea00640 1 -- 172.21.15.133:0/3491202008 learned_addr learned my addr 172.21.15.133:0/3491202008 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.467+0000 7efffe000640 1 --2- 172.21.15.133:0/3491202008 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0000070500 0x7f0000070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.467+0000 7effff400640 1 --2- 172.21.15.133:0/3491202008 >> v2:172.21.15.137:3300/0 conn(0x7f00000cc530 0x7f00000cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:54.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.467+0000 7efffd600640 1 -- 172.21.15.133:0/3491202008 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 29831349 0 0) 0x7f00000a76a0 con 0x7f0000143790 2024-03-30T01:52:54.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.467+0000 7efffd600640 1 -- 172.21.15.133:0/3491202008 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effe4003520 con 0x7f0000143790 2024-03-30T01:52:54.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.468+0000 7efffd600640 1 -- 172.21.15.133:0/3491202008 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2310937205 0 0) 0x7effe4003520 con 0x7f0000143790 2024-03-30T01:52:54.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.468+0000 7efffd600640 1 -- 172.21.15.133:0/3491202008 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0000070500 msgr2=0x7f0000070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:54.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.468+0000 7efffd600640 1 --2- 172.21.15.133:0/3491202008 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0000070500 0x7f0000070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:54.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.468+0000 7efffd600640 1 -- 172.21.15.133:0/3491202008 >> v2:172.21.15.137:3300/0 conn(0x7f00000cc530 msgr2=0x7f00000cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:54.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.468+0000 7efffd600640 1 --2- 172.21.15.133:0/3491202008 >> v2:172.21.15.137:3300/0 conn(0x7f00000cc530 0x7f00000cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:54.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.468+0000 7efffd600640 1 -- 172.21.15.133:0/3491202008 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0000070ea0 con 0x7f0000143790 2024-03-30T01:52:54.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.468+0000 7efffd600640 1 -- 172.21.15.133:0/3491202008 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7efff0001670 con 0x7f0000143790 2024-03-30T01:52:54.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.468+0000 7efffd600640 1 -- 172.21.15.133:0/3491202008 >> v1:172.21.15.133:6789/0 conn(0x7f0000143790 legacy=0x7f00000cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:54.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.468+0000 7efffd600640 1 --2- 172.21.15.133:0/3491202008 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0000070500 0x7effe4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:54.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.468+0000 7efffd600640 1 --2- 172.21.15.133:0/3491202008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effe4003f40 0x7effe40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:54.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.468+0000 7efffd600640 1 --2- 172.21.15.133:0/3491202008 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effe4004d00 0x7effe4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:54.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.468+0000 7efffd600640 1 -- 172.21.15.133:0/3491202008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00000b38e0 con 0x7effe4003f40 2024-03-30T01:52:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.468+0000 7efffd600640 1 -- 172.21.15.133:0/3491202008 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00000ccf00 con 0x7effe4004d00 2024-03-30T01:52:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.468+0000 7efffd600640 1 -- 172.21.15.133:0/3491202008 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe400ba00 con 0x7f0000070500 2024-03-30T01:52:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.468+0000 7efffe000640 1 --2- 172.21.15.133:0/3491202008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effe4003f40 0x7effe40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.469+0000 7efffea00640 1 --2- 172.21.15.133:0/3491202008 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0000070500 0x7effe4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.469+0000 7efffe000640 1 -- 172.21.15.133:0/3491202008 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0000070500 msgr2=0x7effe4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.469+0000 7efffe000640 1 --2- 172.21.15.133:0/3491202008 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0000070500 0x7effe4003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.469+0000 7efffe000640 1 -- 172.21.15.133:0/3491202008 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effe4004d00 msgr2=0x7effe4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.469+0000 7efffe000640 1 --2- 172.21.15.133:0/3491202008 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effe4004d00 0x7effe4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:54.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.469+0000 7efffe000640 1 -- 172.21.15.133:0/3491202008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe4003520 con 0x7effe4003f40 2024-03-30T01:52:54.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.470+0000 7efffe000640 1 --2- 172.21.15.133:0/3491202008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effe4003f40 0x7effe40047c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7effec009ac0 tx=0x7effe40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab1f5d2883c85da server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:54.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.470+0000 7efffd600640 1 -- 172.21.15.133:0/3491202008 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec02c6b0 con 0x7effe4003f40 2024-03-30T01:52:54.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.470+0000 7efffd600640 1 -- 172.21.15.133:0/3491202008 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec02c810 con 0x7effe4003f40 2024-03-30T01:52:54.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.470+0000 7efffd600640 1 -- 172.21.15.133:0/3491202008 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec02cba0 con 0x7effe4003f40 2024-03-30T01:52:54.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.471+0000 7f0005c00640 1 -- 172.21.15.133:0/3491202008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effe4003f40 msgr2=0x7effe40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:54.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.471+0000 7f0005c00640 1 --2- 172.21.15.133:0/3491202008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effe4003f40 0x7effe40047c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7effec009ac0 tx=0x7effe40057f0 comp rx=0 tx=0).stop 2024-03-30T01:52:54.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.471+0000 7effff400640 1 -- 172.21.15.133:0/3491202008 reap_dead start 2024-03-30T01:52:54.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.471+0000 7f0005c00640 1 -- 172.21.15.133:0/3491202008 shutdown_connections 2024-03-30T01:52:54.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.471+0000 7f0005c00640 1 -- 172.21.15.133:0/3491202008 >> 172.21.15.133:0/3491202008 conn(0x7f00000b07a0 msgr2=0x7f00000b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:54.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.471+0000 7f0005c00640 1 -- 172.21.15.133:0/3491202008 shutdown_connections 2024-03-30T01:52:54.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.471+0000 7f0005c00640 1 -- 172.21.15.133:0/3491202008 wait complete. 2024-03-30T01:52:54.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.473+0000 7f0005c00640 1 Processor -- start 2024-03-30T01:52:54.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.473+0000 7f0005c00640 1 -- start start 2024-03-30T01:52:54.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.474+0000 7f0005c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effe4003f40 0x7f000013bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:54.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.474+0000 7f0005c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f000015a810 0x7f000013c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:54.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.474+0000 7f0005c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f000006c280 0x7f000006c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:54.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.474+0000 7f0005c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000006e2d0 con 0x7f000015a810 2024-03-30T01:52:54.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.474+0000 7f0005c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00000ac9d0 con 0x7effe4003f40 2024-03-30T01:52:54.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.474+0000 7f0005c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000006dac0 con 0x7f000006c280 2024-03-30T01:52:54.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.474+0000 7efffe000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f000015a810 0x7f000013c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:54.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.474+0000 7efffe000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f000015a810 0x7f000013c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35632/0 (socket says 172.21.15.133:35632) 2024-03-30T01:52:54.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.474+0000 7efffe000640 1 -- 172.21.15.133:0/1973341961 learned_addr learned my addr 172.21.15.133:0/1973341961 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:54.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.474+0000 7effff400640 1 --2- 172.21.15.133:0/1973341961 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f000006c280 0x7f000006c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:54.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.474+0000 7efffea00640 1 --2- 172.21.15.133:0/1973341961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effe4003f40 0x7f000013bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:54.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.474+0000 7efffe000640 1 -- 172.21.15.133:0/1973341961 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f000006c280 msgr2=0x7f000006c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:54.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.474+0000 7efffe000640 1 --2- 172.21.15.133:0/1973341961 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f000006c280 0x7f000006c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:54.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.474+0000 7efffe000640 1 -- 172.21.15.133:0/1973341961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effe4003f40 msgr2=0x7f000013bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:54.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.474+0000 7efffe000640 1 --2- 172.21.15.133:0/1973341961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effe4003f40 0x7f000013bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:54.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.474+0000 7efffe000640 1 -- 172.21.15.133:0/1973341961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000006dd10 con 0x7f000015a810 2024-03-30T01:52:54.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.475+0000 7efffe000640 1 --2- 172.21.15.133:0/1973341961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f000015a810 0x7f000013c190 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7effec037040 tx=0x7effec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:54.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.475+0000 7efff6a00640 1 -- 172.21.15.133:0/1973341961 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec003810 con 0x7f000015a810 2024-03-30T01:52:54.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.475+0000 7efff6a00640 1 -- 172.21.15.133:0/1973341961 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec003970 con 0x7f000015a810 2024-03-30T01:52:54.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.475+0000 7efff6a00640 1 -- 172.21.15.133:0/1973341961 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec003d20 con 0x7f000015a810 2024-03-30T01:52:54.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.475+0000 7f0005c00640 1 -- 172.21.15.133:0/1973341961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f000006dff0 con 0x7f000015a810 2024-03-30T01:52:54.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.475+0000 7f0005c00640 1 -- 172.21.15.133:0/1973341961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00000acdf0 con 0x7f000015a810 2024-03-30T01:52:54.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.476+0000 7f0005c00640 1 -- 172.21.15.133:0/1973341961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00000ac450 con 0x7f000015a810 2024-03-30T01:52:54.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.477+0000 7efff6a00640 1 -- 172.21.15.133:0/1973341961 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7effec034440 con 0x7f000015a810 2024-03-30T01:52:54.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.478+0000 7efff6a00640 1 --2- 172.21.15.133:0/1973341961 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7effe006ac30 0x7effe006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:54.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.478+0000 7efff6a00640 1 -- 172.21.15.133:0/1973341961 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7effec0ab690 con 0x7f000015a810 2024-03-30T01:52:54.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.479+0000 7efffea00640 1 --2- 172.21.15.133:0/1973341961 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7effe006ac30 0x7effe006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:54.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.479+0000 7efffea00640 1 --2- 172.21.15.133:0/1973341961 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7effe006ac30 0x7effe006d0f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efff0001050 tx=0x7efff0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:54.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.483+0000 7efff6a00640 1 -- 172.21.15.133:0/1973341961 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f00000ac450 con 0x7f000015a810 2024-03-30T01:52:54.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:54.719+0000 7f0005c00640 1 -- 172.21.15.133:0/1973341961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f00000acb10 con 0x7f000015a810 2024-03-30T01:52:55.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.254+0000 7efff6a00640 1 -- 172.21.15.133:0/1973341961 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f00000acb10 con 0x7f000015a810 2024-03-30T01:52:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.257+0000 7f0005c00640 1 -- 172.21.15.133:0/1973341961 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7effe006ac30 msgr2=0x7effe006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.257+0000 7f0005c00640 1 --2- 172.21.15.133:0/1973341961 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7effe006ac30 0x7effe006d0f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efff0001050 tx=0x7efff0009040 comp rx=0 tx=0).stop 2024-03-30T01:52:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.257+0000 7f0005c00640 1 -- 172.21.15.133:0/1973341961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f000015a810 msgr2=0x7f000013c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.257+0000 7f0005c00640 1 --2- 172.21.15.133:0/1973341961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f000015a810 0x7f000013c190 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7effec037040 tx=0x7effec004730 comp rx=0 tx=0).stop 2024-03-30T01:52:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.257+0000 7f0005c00640 1 -- 172.21.15.133:0/1973341961 shutdown_connections 2024-03-30T01:52:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.258+0000 7f0005c00640 1 --2- 172.21.15.133:0/1973341961 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7effe006ac30 0x7effe006d0f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.258+0000 7f0005c00640 1 --2- 172.21.15.133:0/1973341961 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f000006c280 0x7f000006c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.258+0000 7f0005c00640 1 --2- 172.21.15.133:0/1973341961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f000015a810 0x7f000013c190 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.258+0000 7f0005c00640 1 --2- 172.21.15.133:0/1973341961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effe4003f40 0x7f000013bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.258+0000 7f0005c00640 1 -- 172.21.15.133:0/1973341961 >> 172.21.15.133:0/1973341961 conn(0x7f00000b07a0 msgr2=0x7f00000afa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.258+0000 7f0005c00640 1 -- 172.21.15.133:0/1973341961 shutdown_connections 2024-03-30T01:52:55.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.258+0000 7f0005c00640 1 -- 172.21.15.133:0/1973341961 wait complete. 2024-03-30T01:52:55.284 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --recover --force --fscid 2 2024-03-30T01:52:55.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.495+0000 7f0250e00640 1 Processor -- start 2024-03-30T01:52:55.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.496+0000 7f0250e00640 1 -- start start 2024-03-30T01:52:55.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.497+0000 7f0250e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f024c0b37f0 0x7f024c159db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.497+0000 7f0250e00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f024c15b6d0 con 0x7f024c15d3f0 2024-03-30T01:52:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.497+0000 7f0250e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f024c15d9d0 con 0x7f024c0adbb0 2024-03-30T01:52:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.497+0000 7f0250e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f024c15dcb0 con 0x7f024c0b37f0 2024-03-30T01:52:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.498+0000 7f0241400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f024c15d3f0 0x7f024c0b30e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47838/0 (socket says 172.21.15.133:47838) 2024-03-30T01:52:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.498+0000 7f0241400640 1 -- 172.21.15.133:0/4022245973 learned_addr learned my addr 172.21.15.133:0/4022245973 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.498+0000 7f024a800640 1 --2- 172.21.15.133:0/4022245973 >> v2:172.21.15.137:3300/0 conn(0x7f024c0b37f0 0x7f024c159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.498+0000 7f0249400640 1 -- 172.21.15.133:0/4022245973 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352578104 0 0) 0x7f024c15b6d0 con 0x7f024c15d3f0 2024-03-30T01:52:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.498+0000 7f0249400640 1 -- 172.21.15.133:0/4022245973 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0230005730 con 0x7f024c15d3f0 2024-03-30T01:52:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.498+0000 7f0249400640 1 -- 172.21.15.133:0/4022245973 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3151330963 0 0) 0x7f0230005730 con 0x7f024c15d3f0 2024-03-30T01:52:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.498+0000 7f0249400640 1 -- 172.21.15.133:0/4022245973 >> v2:172.21.15.137:3300/0 conn(0x7f024c0b37f0 msgr2=0x7f024c159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.498+0000 7f0249400640 1 --2- 172.21.15.133:0/4022245973 >> v2:172.21.15.137:3300/0 conn(0x7f024c0b37f0 0x7f024c159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.498+0000 7f0249400640 1 -- 172.21.15.133:0/4022245973 >> v1:172.21.15.137:6789/0 conn(0x7f024c0adbb0 legacy=0x7f024c15afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.498+0000 7f0249400640 1 -- 172.21.15.133:0/4022245973 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c15df90 con 0x7f024c15d3f0 2024-03-30T01:52:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.498+0000 7f0249400640 1 -- 172.21.15.133:0/4022245973 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f0234001670 con 0x7f024c15d3f0 2024-03-30T01:52:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.499+0000 7f0249400640 1 -- 172.21.15.133:0/4022245973 >> v1:172.21.15.133:6789/0 conn(0x7f024c15d3f0 legacy=0x7f024c0b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.499+0000 7f0249400640 1 --2- 172.21.15.133:0/4022245973 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0230005bd0 0x7f0230005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.499+0000 7f0249400640 1 --2- 172.21.15.133:0/4022245973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02300069d0 0x7f0230006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.499+0000 7f0249400640 1 --2- 172.21.15.133:0/4022245973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0230007390 0x7f023000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.499+0000 7f0249400640 1 -- 172.21.15.133:0/4022245973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024c15dcb0 con 0x7f0230007390 2024-03-30T01:52:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.499+0000 7f0249400640 1 -- 172.21.15.133:0/4022245973 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023000e290 con 0x7f02300069d0 2024-03-30T01:52:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.499+0000 7f0249400640 1 -- 172.21.15.133:0/4022245973 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023000e450 con 0x7f0230005bd0 2024-03-30T01:52:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.499+0000 7f024a800640 1 --2- 172.21.15.133:0/4022245973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0230007390 0x7f023000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.499+0000 7f0241400640 1 --2- 172.21.15.133:0/4022245973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02300069d0 0x7f0230006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.499+0000 7f0249e00640 1 --2- 172.21.15.133:0/4022245973 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0230005bd0 0x7f0230005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.499+0000 7f024a800640 1 -- 172.21.15.133:0/4022245973 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0230005bd0 msgr2=0x7f0230005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.499+0000 7f024a800640 1 --2- 172.21.15.133:0/4022245973 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0230005bd0 0x7f0230005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.499+0000 7f024a800640 1 -- 172.21.15.133:0/4022245973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02300069d0 msgr2=0x7f0230006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.499+0000 7f024a800640 1 --2- 172.21.15.133:0/4022245973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02300069d0 0x7f0230006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:55.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.499+0000 7f024a800640 1 -- 172.21.15.133:0/4022245973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0230005730 con 0x7f0230007390 2024-03-30T01:52:55.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.499+0000 7f0249e00640 1 --2- 172.21.15.133:0/4022245973 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0230005bd0 0x7f0230005ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.500+0000 7f024a800640 1 -- 172.21.15.133:0/4022245973 reap_dead start 2024-03-30T01:52:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.501+0000 7f024a800640 1 --2- 172.21.15.133:0/4022245973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0230007390 0x7f023000db90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0244009fc0 tx=0x7f0230007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df66b5a1a2a5dc79 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.501+0000 7f0249400640 1 -- 172.21.15.133:0/4022245973 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024402cc60 con 0x7f0230007390 2024-03-30T01:52:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.501+0000 7f0249400640 1 -- 172.21.15.133:0/4022245973 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024400f040 con 0x7f0230007390 2024-03-30T01:52:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.501+0000 7f0249400640 1 -- 172.21.15.133:0/4022245973 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0244003990 con 0x7f0230007390 2024-03-30T01:52:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.502+0000 7f0250e00640 1 -- 172.21.15.133:0/4022245973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0230007390 msgr2=0x7f023000db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.502+0000 7f0250e00640 1 --2- 172.21.15.133:0/4022245973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0230007390 0x7f023000db90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0244009fc0 tx=0x7f0230007a00 comp rx=0 tx=0).stop 2024-03-30T01:52:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.502+0000 7f0250e00640 1 -- 172.21.15.133:0/4022245973 shutdown_connections 2024-03-30T01:52:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.502+0000 7f0250e00640 1 --2- 172.21.15.133:0/4022245973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0230007390 0x7f023000db90 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.502+0000 7f0250e00640 1 -- 172.21.15.133:0/4022245973 >> 172.21.15.133:0/4022245973 conn(0x7f024c069ce0 msgr2=0x7f024c06a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.502+0000 7f0250e00640 1 -- 172.21.15.133:0/4022245973 shutdown_connections 2024-03-30T01:52:55.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.502+0000 7f0250e00640 1 -- 172.21.15.133:0/4022245973 wait complete. 2024-03-30T01:52:55.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.504+0000 7f0250e00640 1 Processor -- start 2024-03-30T01:52:55.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.504+0000 7f0250e00640 1 -- start start 2024-03-30T01:52:55.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.505+0000 7f0250e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0230007390 0x7f024c0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:55.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.505+0000 7f0250e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f024c14b250 0x7f024c15b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:55.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.505+0000 7f0250e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f024c154ec0 0x7f024c13fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:55.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.505+0000 7f0250e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024c0cdaa0 con 0x7f0230007390 2024-03-30T01:52:55.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.505+0000 7f0250e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024c0cd290 con 0x7f024c14b250 2024-03-30T01:52:55.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.505+0000 7f0250e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f024c0ce140 con 0x7f024c154ec0 2024-03-30T01:52:55.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.505+0000 7f0249e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0230007390 0x7f024c0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:55.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.505+0000 7f0249e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0230007390 0x7f024c0cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35646/0 (socket says 172.21.15.133:35646) 2024-03-30T01:52:55.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.505+0000 7f0249e00640 1 -- 172.21.15.133:0/235200905 learned_addr learned my addr 172.21.15.133:0/235200905 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:55.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.505+0000 7f024a800640 1 --2- 172.21.15.133:0/235200905 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f024c154ec0 0x7f024c13fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:55.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.505+0000 7f0241400640 1 --2- 172.21.15.133:0/235200905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f024c14b250 0x7f024c15b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:55.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.505+0000 7f0249e00640 1 -- 172.21.15.133:0/235200905 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f024c154ec0 msgr2=0x7f024c13fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:55.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.505+0000 7f0249e00640 1 --2- 172.21.15.133:0/235200905 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f024c154ec0 0x7f024c13fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:55.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.505+0000 7f0249e00640 1 -- 172.21.15.133:0/235200905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f024c14b250 msgr2=0x7f024c15b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:55.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.505+0000 7f0249e00640 1 --2- 172.21.15.133:0/235200905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f024c14b250 0x7f024c15b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:55.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.505+0000 7f0249e00640 1 -- 172.21.15.133:0/235200905 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c0cd4e0 con 0x7f0230007390 2024-03-30T01:52:55.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.505+0000 7f0241400640 1 --2- 172.21.15.133:0/235200905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f024c14b250 0x7f024c15b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:55.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.506+0000 7f0249e00640 1 --2- 172.21.15.133:0/235200905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0230007390 0x7f024c0cdc00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f023c000f60 tx=0x7f023c00d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:55.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.506+0000 7f0242a00640 1 -- 172.21.15.133:0/235200905 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c005480 con 0x7f0230007390 2024-03-30T01:52:55.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.506+0000 7f0242a00640 1 -- 172.21.15.133:0/235200905 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023c003610 con 0x7f0230007390 2024-03-30T01:52:55.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.506+0000 7f0242a00640 1 -- 172.21.15.133:0/235200905 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c0039c0 con 0x7f0230007390 2024-03-30T01:52:55.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.506+0000 7f0250e00640 1 -- 172.21.15.133:0/235200905 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f024c0cd7c0 con 0x7f0230007390 2024-03-30T01:52:55.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.506+0000 7f0250e00640 1 -- 172.21.15.133:0/235200905 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f024c15b010 con 0x7f0230007390 2024-03-30T01:52:55.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.507+0000 7f0250e00640 1 -- 172.21.15.133:0/235200905 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f024c15b1d0 con 0x7f0230007390 2024-03-30T01:52:55.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.508+0000 7f0242a00640 1 -- 172.21.15.133:0/235200905 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f023c003b20 con 0x7f0230007390 2024-03-30T01:52:55.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.509+0000 7f0242a00640 1 --2- 172.21.15.133:0/235200905 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f022806ac00 0x7f022806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:55.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.509+0000 7f0242a00640 1 -- 172.21.15.133:0/235200905 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f023c0892c0 con 0x7f0230007390 2024-03-30T01:52:55.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.509+0000 7f0241400640 1 --2- 172.21.15.133:0/235200905 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f022806ac00 0x7f022806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:55.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.510+0000 7f0241400640 1 --2- 172.21.15.133:0/235200905 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f022806ac00 0x7f022806d0c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f024c14b670 tx=0x7f0234000ef0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:55.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.514+0000 7f0242a00640 1 -- 172.21.15.133:0/235200905 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f023c0544f0 con 0x7f0230007390 2024-03-30T01:52:55.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.752+0000 7f0250e00640 1 -- 172.21.15.133:0/235200905 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "recover": true, "force": true, "fscid": 2} v 0) v1 -- 0x7f024c15ab90 con 0x7f0230007390 2024-03-30T01:52:55.758 INFO:tasks.ceph.mon.a.smithi133.stderr:2024-03-30T01:52:55.753+0000 7fa124c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-30T01:52:55.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.762+0000 7f0242a00640 1 -- 172.21.15.133:0/235200905 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "recover": true, "force": true, "fscid": 2}]=0 new fs with metadata pool 4 and data pool 5 v18) v1 ==== 216+0+0 (secure 0 0 0) 0x7f024c15ab90 con 0x7f0230007390 2024-03-30T01:52:55.768 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 4 and data pool 5 2024-03-30T01:52:55.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.765+0000 7f0250e00640 1 -- 172.21.15.133:0/235200905 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f022806ac00 msgr2=0x7f022806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:55.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.765+0000 7f0250e00640 1 --2- 172.21.15.133:0/235200905 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f022806ac00 0x7f022806d0c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f024c14b670 tx=0x7f0234000ef0 comp rx=0 tx=0).stop 2024-03-30T01:52:55.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.765+0000 7f0250e00640 1 -- 172.21.15.133:0/235200905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0230007390 msgr2=0x7f024c0cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:55.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.765+0000 7f0250e00640 1 --2- 172.21.15.133:0/235200905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0230007390 0x7f024c0cdc00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f023c000f60 tx=0x7f023c00d9f0 comp rx=0 tx=0).stop 2024-03-30T01:52:55.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.766+0000 7f0250e00640 1 -- 172.21.15.133:0/235200905 shutdown_connections 2024-03-30T01:52:55.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.766+0000 7f0250e00640 1 --2- 172.21.15.133:0/235200905 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f022806ac00 0x7f022806d0c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:55.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.766+0000 7f0250e00640 1 --2- 172.21.15.133:0/235200905 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f024c154ec0 0x7f024c13fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:55.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.766+0000 7f0250e00640 1 --2- 172.21.15.133:0/235200905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f024c14b250 0x7f024c15b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:55.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.766+0000 7f0250e00640 1 --2- 172.21.15.133:0/235200905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0230007390 0x7f024c0cdc00 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:55.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.766+0000 7f0250e00640 1 -- 172.21.15.133:0/235200905 >> 172.21.15.133:0/235200905 conn(0x7f024c069ce0 msgr2=0x7f024c1593d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:55.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.766+0000 7f0250e00640 1 -- 172.21.15.133:0/235200905 shutdown_connections 2024-03-30T01:52:55.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.766+0000 7f0250e00640 1 -- 172.21.15.133:0/235200905 wait complete. 2024-03-30T01:52:55.793 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-03-30T01:52:56.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.998+0000 7fb5ebe00640 1 Processor -- start 2024-03-30T01:52:56.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.998+0000 7fb5ebe00640 1 -- start start 2024-03-30T01:52:56.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.999+0000 7fb5ebe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb5e4070c10 0x7fb5e4164740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:56.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.999+0000 7fb5ebe00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e40ce400 con 0x7fb5e406e2e0 2024-03-30T01:52:56.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.999+0000 7fb5ebe00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e406d0e0 con 0x7fb5e4143220 2024-03-30T01:52:56.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:55.999+0000 7fb5ebe00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e40cc5c0 con 0x7fb5e4070c10 2024-03-30T01:52:56.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.000+0000 7fb5e8a00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb5e406e2e0 0x7fb5e4070500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35144/0 (socket says 172.21.15.133:35144) 2024-03-30T01:52:56.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.000+0000 7fb5e8a00640 1 -- 172.21.15.133:0/634641226 learned_addr learned my addr 172.21.15.133:0/634641226 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:52:56.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.000+0000 7fb5e9e00640 1 --2- 172.21.15.133:0/634641226 >> v2:172.21.15.137:3300/0 conn(0x7fb5e4070c10 0x7fb5e4164740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:56.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.000+0000 7fb5e3e00640 1 -- 172.21.15.133:0/634641226 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109126589 0 0) 0x7fb5e40ce400 con 0x7fb5e406e2e0 2024-03-30T01:52:56.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.000+0000 7fb5e3e00640 1 -- 172.21.15.133:0/634641226 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5cc005730 con 0x7fb5e406e2e0 2024-03-30T01:52:56.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.001+0000 7fb5e3e00640 1 -- 172.21.15.133:0/634641226 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3451086420 0 0) 0x7fb5cc005730 con 0x7fb5e406e2e0 2024-03-30T01:52:56.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.001+0000 7fb5e3e00640 1 -- 172.21.15.133:0/634641226 >> v2:172.21.15.137:3300/0 conn(0x7fb5e4070c10 msgr2=0x7fb5e4164740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:56.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.001+0000 7fb5e3e00640 1 --2- 172.21.15.133:0/634641226 >> v2:172.21.15.137:3300/0 conn(0x7fb5e4070c10 0x7fb5e4164740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:56.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.001+0000 7fb5e3e00640 1 -- 172.21.15.133:0/634641226 >> v1:172.21.15.137:6789/0 conn(0x7fb5e4143220 legacy=0x7fb5e40cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:56.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.001+0000 7fb5e3e00640 1 -- 172.21.15.133:0/634641226 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e406d3c0 con 0x7fb5e406e2e0 2024-03-30T01:52:56.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.001+0000 7fb5e3e00640 1 -- 172.21.15.133:0/634641226 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fb5d0001670 con 0x7fb5e406e2e0 2024-03-30T01:52:56.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.001+0000 7fb5e3e00640 1 -- 172.21.15.133:0/634641226 >> v1:172.21.15.133:6789/0 conn(0x7fb5e406e2e0 legacy=0x7fb5e4070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:56.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.001+0000 7fb5e3e00640 1 --2- 172.21.15.133:0/634641226 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5cc005b80 0x7fb5cc005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:56.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.001+0000 7fb5e3e00640 1 --2- 172.21.15.133:0/634641226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5cc0069d0 0x7fb5cc006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:56.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.001+0000 7fb5e3e00640 1 --2- 172.21.15.133:0/634641226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5cc007390 0x7fb5cc00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:56.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.001+0000 7fb5e3e00640 1 -- 172.21.15.133:0/634641226 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc00e200 con 0x7fb5cc0069d0 2024-03-30T01:52:56.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.001+0000 7fb5e3e00640 1 -- 172.21.15.133:0/634641226 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc00e370 con 0x7fb5cc007390 2024-03-30T01:52:56.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.001+0000 7fb5e3e00640 1 -- 172.21.15.133:0/634641226 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc00e530 con 0x7fb5cc005b80 2024-03-30T01:52:56.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.001+0000 7fb5e8a00640 1 --2- 172.21.15.133:0/634641226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5cc0069d0 0x7fb5cc006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:56.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.002+0000 7fb5e9e00640 1 --2- 172.21.15.133:0/634641226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5cc007390 0x7fb5cc00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:56.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.002+0000 7fb5e9400640 1 --2- 172.21.15.133:0/634641226 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5cc005b80 0x7fb5cc005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:56.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.002+0000 7fb5e8a00640 1 -- 172.21.15.133:0/634641226 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5cc005b80 msgr2=0x7fb5cc005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:56.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.002+0000 7fb5e8a00640 1 --2- 172.21.15.133:0/634641226 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5cc005b80 0x7fb5cc005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:56.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.002+0000 7fb5e8a00640 1 -- 172.21.15.133:0/634641226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5cc007390 msgr2=0x7fb5cc00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:56.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.002+0000 7fb5e8a00640 1 --2- 172.21.15.133:0/634641226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5cc007390 0x7fb5cc00db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:56.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.002+0000 7fb5e8a00640 1 -- 172.21.15.133:0/634641226 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5cc005730 con 0x7fb5cc0069d0 2024-03-30T01:52:56.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.002+0000 7fb5e9e00640 1 -- 172.21.15.133:0/634641226 reap_dead start 2024-03-30T01:52:56.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.002+0000 7fb5e9400640 1 --2- 172.21.15.133:0/634641226 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5cc005b80 0x7fb5cc005fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:56.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.003+0000 7fb5e8a00640 1 --2- 172.21.15.133:0/634641226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5cc0069d0 0x7fb5cc006e50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb5d000c240 tx=0x7fb5cc007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43cc4e8f257908b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:56.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.003+0000 7fb5e3e00640 1 -- 172.21.15.133:0/634641226 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0005ad0 con 0x7fb5cc0069d0 2024-03-30T01:52:56.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.003+0000 7fb5e3e00640 1 -- 172.21.15.133:0/634641226 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d0005c30 con 0x7fb5cc0069d0 2024-03-30T01:52:56.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.003+0000 7fb5e3e00640 1 -- 172.21.15.133:0/634641226 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d002cab0 con 0x7fb5cc0069d0 2024-03-30T01:52:56.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.004+0000 7fb5ebe00640 1 -- 172.21.15.133:0/634641226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5cc0069d0 msgr2=0x7fb5cc006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:56.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.004+0000 7fb5ebe00640 1 --2- 172.21.15.133:0/634641226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5cc0069d0 0x7fb5cc006e50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb5d000c240 tx=0x7fb5cc007a00 comp rx=0 tx=0).stop 2024-03-30T01:52:56.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.004+0000 7fb5ebe00640 1 -- 172.21.15.133:0/634641226 shutdown_connections 2024-03-30T01:52:56.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.004+0000 7fb5ebe00640 1 --2- 172.21.15.133:0/634641226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5cc0069d0 0x7fb5cc006e50 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:56.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.004+0000 7fb5ebe00640 1 -- 172.21.15.133:0/634641226 >> 172.21.15.133:0/634641226 conn(0x7fb5e40b07a0 msgr2=0x7fb5e40b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:56.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.004+0000 7fb5ebe00640 1 -- 172.21.15.133:0/634641226 shutdown_connections 2024-03-30T01:52:56.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.004+0000 7fb5ebe00640 1 -- 172.21.15.133:0/634641226 wait complete. 2024-03-30T01:52:56.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.006+0000 7fb5ebe00640 1 Processor -- start 2024-03-30T01:52:56.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.006+0000 7fb5ebe00640 1 -- start start 2024-03-30T01:52:56.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.007+0000 7fb5ebe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5cc0069d0 0x7fb5e40b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:56.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.007+0000 7fb5ebe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5e413e090 0x7fb5e4154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:56.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.007+0000 7fb5ebe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5e4155340 0x7fb5e413c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:56.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.007+0000 7fb5ebe00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e413dc70 con 0x7fb5cc0069d0 2024-03-30T01:52:56.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.007+0000 7fb5ebe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e41557f0 con 0x7fb5e413e090 2024-03-30T01:52:56.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.007+0000 7fb5ebe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e413cff0 con 0x7fb5e4155340 2024-03-30T01:52:56.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.007+0000 7fb5e9400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5cc0069d0 0x7fb5e40b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:56.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.007+0000 7fb5e9400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5cc0069d0 0x7fb5e40b2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36166/0 (socket says 172.21.15.133:36166) 2024-03-30T01:52:56.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.007+0000 7fb5e9400640 1 -- 172.21.15.133:0/2731501035 learned_addr learned my addr 172.21.15.133:0/2731501035 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:56.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.007+0000 7fb5e8a00640 1 --2- 172.21.15.133:0/2731501035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5e413e090 0x7fb5e4154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:56.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.007+0000 7fb5e9400640 1 -- 172.21.15.133:0/2731501035 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5e4155340 msgr2=0x7fb5e413c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:56.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.007+0000 7fb5e9400640 1 --2- 172.21.15.133:0/2731501035 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5e4155340 0x7fb5e413c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:56.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.008+0000 7fb5e9400640 1 -- 172.21.15.133:0/2731501035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5e413e090 msgr2=0x7fb5e4154e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:56.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.008+0000 7fb5e9400640 1 --2- 172.21.15.133:0/2731501035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5e413e090 0x7fb5e4154e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:56.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.008+0000 7fb5e9400640 1 -- 172.21.15.133:0/2731501035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e413d2d0 con 0x7fb5cc0069d0 2024-03-30T01:52:56.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.008+0000 7fb5e8a00640 1 --2- 172.21.15.133:0/2731501035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5e413e090 0x7fb5e4154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:56.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.008+0000 7fb5e9400640 1 --2- 172.21.15.133:0/2731501035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5cc0069d0 0x7fb5e40b2d70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800d480 tx=0x7fb5d800d940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:56.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.008+0000 7fb5e1600640 1 -- 172.21.15.133:0/2731501035 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d800b070 con 0x7fb5cc0069d0 2024-03-30T01:52:56.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.008+0000 7fb5e1600640 1 -- 172.21.15.133:0/2731501035 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d80054e0 con 0x7fb5cc0069d0 2024-03-30T01:52:56.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.008+0000 7fb5ebe00640 1 -- 172.21.15.133:0/2731501035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e413d5b0 con 0x7fb5cc0069d0 2024-03-30T01:52:56.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.008+0000 7fb5e1600640 1 -- 172.21.15.133:0/2731501035 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8003850 con 0x7fb5cc0069d0 2024-03-30T01:52:56.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.008+0000 7fb5ebe00640 1 -- 172.21.15.133:0/2731501035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e40b32b0 con 0x7fb5cc0069d0 2024-03-30T01:52:56.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.010+0000 7fb5ebe00640 1 -- 172.21.15.133:0/2731501035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e40b3440 con 0x7fb5cc0069d0 2024-03-30T01:52:56.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.010+0000 7fb5e1600640 1 -- 172.21.15.133:0/2731501035 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb5d80039b0 con 0x7fb5cc0069d0 2024-03-30T01:52:56.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.011+0000 7fb5e1600640 1 --2- 172.21.15.133:0/2731501035 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb5c406ac00 0x7fb5c406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:56.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.011+0000 7fb5e1600640 1 -- 172.21.15.133:0/2731501035 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb5d8088bd0 con 0x7fb5cc0069d0 2024-03-30T01:52:56.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.011+0000 7fb5e8a00640 1 --2- 172.21.15.133:0/2731501035 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb5c406ac00 0x7fb5c406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:56.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.012+0000 7fb5e8a00640 1 --2- 172.21.15.133:0/2731501035 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb5c406ac00 0x7fb5c406d0c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0034000 tx=0x7fb5d0009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:56.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.015+0000 7fb5e1600640 1 -- 172.21.15.133:0/2731501035 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fb5d8053eb0 con 0x7fb5cc0069d0 2024-03-30T01:52:56.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.247+0000 7fb5ebe00640 1 -- 172.21.15.133:0/2731501035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fb5e4066d80 con 0x7fb5cc0069d0 2024-03-30T01:52:56.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.765+0000 7fb5e1600640 1 -- 172.21.15.133:0/2731501035 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v19) v1 ==== 162+0+0 (secure 0 0 0) 0x7fb5d8018020 con 0x7fb5cc0069d0 2024-03-30T01:52:56.770 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked joinable; MDS may join as newly active. 2024-03-30T01:52:56.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.769+0000 7fb5ebe00640 1 -- 172.21.15.133:0/2731501035 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb5c406ac00 msgr2=0x7fb5c406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:56.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.769+0000 7fb5ebe00640 1 --2- 172.21.15.133:0/2731501035 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb5c406ac00 0x7fb5c406d0c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0034000 tx=0x7fb5d0009030 comp rx=0 tx=0).stop 2024-03-30T01:52:56.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.769+0000 7fb5ebe00640 1 -- 172.21.15.133:0/2731501035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5cc0069d0 msgr2=0x7fb5e40b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:56.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.769+0000 7fb5ebe00640 1 --2- 172.21.15.133:0/2731501035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5cc0069d0 0x7fb5e40b2d70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800d480 tx=0x7fb5d800d940 comp rx=0 tx=0).stop 2024-03-30T01:52:56.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.769+0000 7fb5ebe00640 1 -- 172.21.15.133:0/2731501035 shutdown_connections 2024-03-30T01:52:56.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.769+0000 7fb5ebe00640 1 --2- 172.21.15.133:0/2731501035 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb5c406ac00 0x7fb5c406d0c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:56.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.769+0000 7fb5ebe00640 1 --2- 172.21.15.133:0/2731501035 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5e4155340 0x7fb5e413c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:56.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.769+0000 7fb5ebe00640 1 --2- 172.21.15.133:0/2731501035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5e413e090 0x7fb5e4154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:56.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.769+0000 7fb5ebe00640 1 --2- 172.21.15.133:0/2731501035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5cc0069d0 0x7fb5e40b2d70 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:56.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.769+0000 7fb5ebe00640 1 -- 172.21.15.133:0/2731501035 >> 172.21.15.133:0/2731501035 conn(0x7fb5e40b07a0 msgr2=0x7fb5e415a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:56.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.770+0000 7fb5ebe00640 1 -- 172.21.15.133:0/2731501035 shutdown_connections 2024-03-30T01:52:56.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.770+0000 7fb5ebe00640 1 -- 172.21.15.133:0/2731501035 wait complete. 2024-03-30T01:52:56.796 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T01:52:56.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.977+0000 7f770d800640 1 Processor -- start 2024-03-30T01:52:56.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.977+0000 7f770d800640 1 -- start start 2024-03-30T01:52:56.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.978+0000 7f770d800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7708143790 0x7f77080cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:56.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.978+0000 7f770d800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7708070500 0x7f7708070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:56.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.978+0000 7f770d800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f77080cc530 0x7f77080cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:56.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.978+0000 7f770d800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77080a76a0 con 0x7f77080cc530 2024-03-30T01:52:56.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.979+0000 7f770d800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7708070ea0 con 0x7f7708070500 2024-03-30T01:52:56.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.979+0000 7f770d800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77080b38e0 con 0x7f7708143790 2024-03-30T01:52:56.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.979+0000 7f7707400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f77080cc530 0x7f77080cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:56.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.979+0000 7f7707400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f77080cc530 0x7f77080cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36182/0 (socket says 172.21.15.133:36182) 2024-03-30T01:52:56.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.979+0000 7f7707400640 1 -- 172.21.15.133:0/1362560909 learned_addr learned my addr 172.21.15.133:0/1362560909 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:56.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.979+0000 7f7706a00640 1 --2- 172.21.15.133:0/1362560909 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7708143790 0x7f77080cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:56.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.979+0000 7f7706000640 1 --2- 172.21.15.133:0/1362560909 >> v2:172.21.15.137:3300/0 conn(0x7f7708070500 0x7f7708070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:56.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.979+0000 7f7707400640 1 -- 172.21.15.133:0/1362560909 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7708143790 msgr2=0x7f77080cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:56.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.979+0000 7f7707400640 1 --2- 172.21.15.133:0/1362560909 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7708143790 0x7f77080cbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:56.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.979+0000 7f7707400640 1 -- 172.21.15.133:0/1362560909 >> v2:172.21.15.137:3300/0 conn(0x7f7708070500 msgr2=0x7f7708070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:56.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.979+0000 7f7707400640 1 --2- 172.21.15.133:0/1362560909 >> v2:172.21.15.137:3300/0 conn(0x7f7708070500 0x7f7708070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:56.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.979+0000 7f7707400640 1 -- 172.21.15.133:0/1362560909 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77080ccf00 con 0x7f77080cc530 2024-03-30T01:52:56.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.979+0000 7f7706000640 1 --2- 172.21.15.133:0/1362560909 >> v2:172.21.15.137:3300/0 conn(0x7f7708070500 0x7f7708070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:56.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.980+0000 7f7707400640 1 --2- 172.21.15.133:0/1362560909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77080cc530 0x7f77080cc9c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f770806e5b0 tx=0x7f770002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7aa1c77a3c172de server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:56.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.981+0000 7f7705600640 1 -- 172.21.15.133:0/1362560909 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770002cb00 con 0x7f77080cc530 2024-03-30T01:52:56.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.981+0000 7f7705600640 1 -- 172.21.15.133:0/1362560909 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770002cc60 con 0x7f77080cc530 2024-03-30T01:52:56.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.981+0000 7f7705600640 1 -- 172.21.15.133:0/1362560909 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77000343f0 con 0x7f77080cc530 2024-03-30T01:52:56.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.981+0000 7f770d800640 1 -- 172.21.15.133:0/1362560909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77080cc530 msgr2=0x7f77080cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:56.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.981+0000 7f770d800640 1 --2- 172.21.15.133:0/1362560909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77080cc530 0x7f77080cc9c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f770806e5b0 tx=0x7f770002bf60 comp rx=0 tx=0).stop 2024-03-30T01:52:56.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.982+0000 7f770d800640 1 -- 172.21.15.133:0/1362560909 shutdown_connections 2024-03-30T01:52:56.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.982+0000 7f770d800640 1 --2- 172.21.15.133:0/1362560909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77080cc530 0x7f77080cc9c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:56.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.982+0000 7f770d800640 1 --2- 172.21.15.133:0/1362560909 >> v2:172.21.15.137:3300/0 conn(0x7f7708070500 0x7f7708070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:56.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.982+0000 7f770d800640 1 --2- 172.21.15.133:0/1362560909 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7708143790 0x7f77080cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:56.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.982+0000 7f770d800640 1 -- 172.21.15.133:0/1362560909 >> 172.21.15.133:0/1362560909 conn(0x7f77080b07a0 msgr2=0x7f77080b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:56.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.982+0000 7f770d800640 1 -- 172.21.15.133:0/1362560909 shutdown_connections 2024-03-30T01:52:56.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.982+0000 7f770d800640 1 -- 172.21.15.133:0/1362560909 wait complete. 2024-03-30T01:52:56.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.983+0000 7f770d800640 1 Processor -- start 2024-03-30T01:52:56.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.984+0000 7f770d800640 1 -- start start 2024-03-30T01:52:56.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.984+0000 7f770d800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7708070500 0x7f77081efa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:56.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.984+0000 7f770d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77080cc530 0x7f77080ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.984+0000 7f770d800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7708143790 0x7f77080ad270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.985+0000 7f770d800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77081eff80 con 0x7f7708070500 2024-03-30T01:52:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.985+0000 7f770d800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770815bf10 con 0x7f77080cc530 2024-03-30T01:52:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.985+0000 7f770d800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77080c3c40 con 0x7f7708143790 2024-03-30T01:52:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.985+0000 7f7706a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7708070500 0x7f77081efa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.985+0000 7f7706a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7708070500 0x7f77081efa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36184/0 (socket says 172.21.15.133:36184) 2024-03-30T01:52:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.985+0000 7f7706a00640 1 -- 172.21.15.133:0/2837303750 learned_addr learned my addr 172.21.15.133:0/2837303750 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.985+0000 7f7706000640 1 --2- 172.21.15.133:0/2837303750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77080cc530 0x7f77080ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.985+0000 7f7707400640 1 --2- 172.21.15.133:0/2837303750 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7708143790 0x7f77080ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.985+0000 7f7706a00640 1 -- 172.21.15.133:0/2837303750 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7708143790 msgr2=0x7f77080ad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.985+0000 7f7706a00640 1 --2- 172.21.15.133:0/2837303750 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7708143790 0x7f77080ad270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.985+0000 7f7706a00640 1 -- 172.21.15.133:0/2837303750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77080cc530 msgr2=0x7f77080ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.985+0000 7f7706a00640 1 --2- 172.21.15.133:0/2837303750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77080cc530 0x7f77080ab2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.985+0000 7f7706a00640 1 -- 172.21.15.133:0/2837303750 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7700009b30 con 0x7f7708070500 2024-03-30T01:52:56.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.985+0000 7f7706000640 1 --2- 172.21.15.133:0/2837303750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77080cc530 0x7f77080ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:52:56.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.986+0000 7f7706a00640 1 --2- 172.21.15.133:0/2837303750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7708070500 0x7f77081efa40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f76f800c7f0 tx=0x7f76f800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:56.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.986+0000 7f76fea00640 1 -- 172.21.15.133:0/2837303750 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f8004220 con 0x7f7708070500 2024-03-30T01:52:56.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.986+0000 7f76fea00640 1 -- 172.21.15.133:0/2837303750 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f8004380 con 0x7f7708070500 2024-03-30T01:52:56.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.986+0000 7f76fea00640 1 -- 172.21.15.133:0/2837303750 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f8007840 con 0x7f7708070500 2024-03-30T01:52:56.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.986+0000 7f770d800640 1 -- 172.21.15.133:0/2837303750 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77080abba0 con 0x7f7708070500 2024-03-30T01:52:56.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.986+0000 7f770d800640 1 -- 172.21.15.133:0/2837303750 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77080ac160 con 0x7f7708070500 2024-03-30T01:52:56.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.987+0000 7f770d800640 1 -- 172.21.15.133:0/2837303750 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7708066d80 con 0x7f7708070500 2024-03-30T01:52:56.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.988+0000 7f76fea00640 1 -- 172.21.15.133:0/2837303750 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f76f8007bb0 con 0x7f7708070500 2024-03-30T01:52:56.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.989+0000 7f76fea00640 1 --2- 172.21.15.133:0/2837303750 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f76e806ac00 0x7f76e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:56.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.989+0000 7f76fea00640 1 -- 172.21.15.133:0/2837303750 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f76f80892e0 con 0x7f7708070500 2024-03-30T01:52:56.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.989+0000 7f7706000640 1 --2- 172.21.15.133:0/2837303750 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f76e806ac00 0x7f76e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:56.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.990+0000 7f7706000640 1 --2- 172.21.15.133:0/2837303750 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f76e806ac00 0x7f76e806d0c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f76f4006fd0 tx=0x7f76f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:56.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:56.994+0000 7f76fea00640 1 -- 172.21.15.133:0/2837303750 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f76f80543c0 con 0x7f7708070500 2024-03-30T01:52:57.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:57.223+0000 7f770d800640 1 -- 172.21.15.133:0/2837303750 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f770815e1d0 con 0x7f7708070500 2024-03-30T01:52:57.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:57.224+0000 7f76fea00640 1 -- 172.21.15.133:0/2837303750 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f76f8007e60 con 0x7f7708070500 2024-03-30T01:52:57.230 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:57.230 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/820901593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":820901593},{"type":"v1","addr":"172.21.15.137:6834","nonce":820901593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3524452213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3524452213},{"type":"v1","addr":"172.21.15.137:6835","nonce":3524452213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3989486478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3989486478},{"type":"v1","addr":"172.21.15.133:6837","nonce":3989486478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T01:52:55.753449+0000","modified":"2024-03-30T01:52:56.764978+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"a","rank":0,"incarnation":20,"state":"up:replay","state_seq":1,"addr":"172.21.15.133:6836/1431848593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1431848593},{"type":"v1","addr":"172.21.15.133:6836","nonce":1431848593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-30T01:52:57.230 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 20 2024-03-30T01:52:57.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:57.227+0000 7f770d800640 1 -- 172.21.15.133:0/2837303750 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f76e806ac00 msgr2=0x7f76e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:57.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:57.227+0000 7f770d800640 1 --2- 172.21.15.133:0/2837303750 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f76e806ac00 0x7f76e806d0c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f76f4006fd0 tx=0x7f76f4008040 comp rx=0 tx=0).stop 2024-03-30T01:52:57.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:57.227+0000 7f770d800640 1 -- 172.21.15.133:0/2837303750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7708070500 msgr2=0x7f77081efa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:57.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:57.227+0000 7f770d800640 1 --2- 172.21.15.133:0/2837303750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7708070500 0x7f77081efa40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f76f800c7f0 tx=0x7f76f800ccb0 comp rx=0 tx=0).stop 2024-03-30T01:52:57.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:57.227+0000 7f770d800640 1 -- 172.21.15.133:0/2837303750 shutdown_connections 2024-03-30T01:52:57.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:57.227+0000 7f770d800640 1 --2- 172.21.15.133:0/2837303750 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f76e806ac00 0x7f76e806d0c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:57.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:57.227+0000 7f770d800640 1 --2- 172.21.15.133:0/2837303750 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7708143790 0x7f77080ad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:57.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:57.227+0000 7f770d800640 1 --2- 172.21.15.133:0/2837303750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77080cc530 0x7f77080ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:57.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:57.227+0000 7f770d800640 1 --2- 172.21.15.133:0/2837303750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7708070500 0x7f77081efa40 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:57.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:57.227+0000 7f770d800640 1 -- 172.21.15.133:0/2837303750 >> 172.21.15.133:0/2837303750 conn(0x7f77080b07a0 msgr2=0x7f7708140430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:57.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:57.227+0000 7f770d800640 1 -- 172.21.15.133:0/2837303750 shutdown_connections 2024-03-30T01:52:57.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:57.227+0000 7f770d800640 1 -- 172.21.15.133:0/2837303750 wait complete. 2024-03-30T01:52:57.652 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-30T01:52:55.753449+0000', 'modified': '2024-03-30T01:52:56.764978+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5328}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5328': {'gid': 5328, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.133:6836/1431848593', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 1431848593}, {'type': 'v1', 'addr': '172.21.15.133:6836', 'nonce': 1431848593}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-03-30T01:52:57.652 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5328:up:replay 2024-03-30T01:52:58.653 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T01:52:58.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.870+0000 7feadfc00640 1 Processor -- start 2024-03-30T01:52:58.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.870+0000 7feadfc00640 1 -- start start 2024-03-30T01:52:58.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.871+0000 7feadfc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fead81431c0 0x7fead815dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:58.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.871+0000 7feadfc00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fead806dd10 0x7fead806e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:58.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.871+0000 7feadfc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead815db60 con 0x7fead8142bd0 2024-03-30T01:52:58.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.871+0000 7feadfc00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead8142fb0 con 0x7fead806dd10 2024-03-30T01:52:58.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.871+0000 7feadfc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead80cbaf0 con 0x7fead81431c0 2024-03-30T01:52:58.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.872+0000 7feaddc00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fead806dd10 0x7fead806e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:58.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.872+0000 7feaddc00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fead806dd10 0x7fead806e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36192/0 (socket says 172.21.15.133:36192) 2024-03-30T01:52:58.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.872+0000 7feaddc00640 1 -- 172.21.15.133:0/2509898871 learned_addr learned my addr 172.21.15.133:0/2509898871 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:58.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.872+0000 7fead7e00640 1 --2- 172.21.15.133:0/2509898871 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fead81431c0 0x7fead815dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:58.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.872+0000 7feaddc00640 1 -- 172.21.15.133:0/2509898871 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fead81431c0 msgr2=0x7fead815dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:58.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.872+0000 7feaddc00640 1 --2- 172.21.15.133:0/2509898871 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fead81431c0 0x7fead815dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:58.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.872+0000 7feaddc00640 1 -- 172.21.15.133:0/2509898871 >> v1:172.21.15.137:6789/0 conn(0x7fead8142bd0 legacy=0x7fead80cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:52:58.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.872+0000 7feaddc00640 1 -- 172.21.15.133:0/2509898871 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead80cbdd0 con 0x7fead806dd10 2024-03-30T01:52:58.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.873+0000 7feaddc00640 1 --2- 172.21.15.133:0/2509898871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fead806dd10 0x7fead806e180 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fead0009e50 tx=0x7fead002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed858895fdbcbca server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:58.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.874+0000 7fead7400640 1 -- 172.21.15.133:0/2509898871 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead002ca70 con 0x7fead806dd10 2024-03-30T01:52:58.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.874+0000 7fead7400640 1 -- 172.21.15.133:0/2509898871 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead002cbd0 con 0x7fead806dd10 2024-03-30T01:52:58.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.874+0000 7fead7400640 1 -- 172.21.15.133:0/2509898871 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead00343f0 con 0x7fead806dd10 2024-03-30T01:52:58.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.874+0000 7feadfc00640 1 -- 172.21.15.133:0/2509898871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fead806dd10 msgr2=0x7fead806e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:58.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.874+0000 7feadfc00640 1 --2- 172.21.15.133:0/2509898871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fead806dd10 0x7fead806e180 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fead0009e50 tx=0x7fead002bed0 comp rx=0 tx=0).stop 2024-03-30T01:52:58.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.874+0000 7feadfc00640 1 -- 172.21.15.133:0/2509898871 shutdown_connections 2024-03-30T01:52:58.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.874+0000 7feadfc00640 1 --2- 172.21.15.133:0/2509898871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fead806dd10 0x7fead806e180 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:58.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.874+0000 7feadfc00640 1 --2- 172.21.15.133:0/2509898871 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fead81431c0 0x7fead815dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:58.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.874+0000 7feadfc00640 1 -- 172.21.15.133:0/2509898871 >> 172.21.15.133:0/2509898871 conn(0x7fead80b05c0 msgr2=0x7fead80b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:58.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.874+0000 7feadfc00640 1 -- 172.21.15.133:0/2509898871 shutdown_connections 2024-03-30T01:52:58.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.874+0000 7feadfc00640 1 -- 172.21.15.133:0/2509898871 wait complete. 2024-03-30T01:52:58.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.876+0000 7feadfc00640 1 Processor -- start 2024-03-30T01:52:58.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.876+0000 7feadfc00640 1 -- start start 2024-03-30T01:52:58.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.877+0000 7feadfc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fead806dd10 0x7fead80c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:58.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.877+0000 7feadfc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fead8142bd0 0x7fead815b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:58.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.877+0000 7feadfc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fead81431c0 0x7fead81e5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:58.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.877+0000 7feadfc00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead81e5170 con 0x7fead8142bd0 2024-03-30T01:52:58.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.877+0000 7feadfc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead80c8620 con 0x7fead81431c0 2024-03-30T01:52:58.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.877+0000 7feadfc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead81e4e20 con 0x7fead806dd10 2024-03-30T01:52:58.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.878+0000 7fead7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fead8142bd0 0x7fead815b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:58.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.878+0000 7fead7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fead8142bd0 0x7fead815b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36202/0 (socket says 172.21.15.133:36202) 2024-03-30T01:52:58.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.878+0000 7fead7e00640 1 -- 172.21.15.133:0/1786897893 learned_addr learned my addr 172.21.15.133:0/1786897893 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:52:58.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.878+0000 7fead7e00640 1 -- 172.21.15.133:0/1786897893 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fead806dd10 msgr2=0x7fead80c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:58.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.878+0000 7fead7e00640 1 --2- 172.21.15.133:0/1786897893 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fead806dd10 0x7fead80c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:58.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.878+0000 7fead7e00640 1 -- 172.21.15.133:0/1786897893 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fead81431c0 msgr2=0x7fead81e5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:58.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.878+0000 7fead7e00640 1 --2- 172.21.15.133:0/1786897893 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fead81431c0 0x7fead81e5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:58.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.878+0000 7fead7e00640 1 -- 172.21.15.133:0/1786897893 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead0009b30 con 0x7fead8142bd0 2024-03-30T01:52:58.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.878+0000 7fead7e00640 1 --2- 172.21.15.133:0/1786897893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fead8142bd0 0x7fead815b6b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7feac400c820 tx=0x7feac400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:58.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.879+0000 7fead4c00640 1 -- 172.21.15.133:0/1786897893 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac4004020 con 0x7fead8142bd0 2024-03-30T01:52:58.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.879+0000 7fead4c00640 1 -- 172.21.15.133:0/1786897893 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac4004180 con 0x7fead8142bd0 2024-03-30T01:52:58.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.879+0000 7fead4c00640 1 -- 172.21.15.133:0/1786897893 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac40077d0 con 0x7fead8142bd0 2024-03-30T01:52:58.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.879+0000 7feadfc00640 1 -- 172.21.15.133:0/1786897893 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead80c9f70 con 0x7fead8142bd0 2024-03-30T01:52:58.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.879+0000 7feadfc00640 1 -- 172.21.15.133:0/1786897893 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead80ca530 con 0x7fead8142bd0 2024-03-30T01:52:58.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.880+0000 7feadfc00640 1 -- 172.21.15.133:0/1786897893 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead81e52b0 con 0x7fead8142bd0 2024-03-30T01:52:58.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.881+0000 7fead4c00640 1 -- 172.21.15.133:0/1786897893 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7feac4007930 con 0x7fead8142bd0 2024-03-30T01:52:58.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.881+0000 7fead4c00640 1 --2- 172.21.15.133:0/1786897893 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7feab806ac00 0x7feab806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:52:58.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.882+0000 7fead4c00640 1 -- 172.21.15.133:0/1786897893 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7feac4089060 con 0x7fead8142bd0 2024-03-30T01:52:58.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.882+0000 7feadd200640 1 --2- 172.21.15.133:0/1786897893 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7feab806ac00 0x7feab806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:52:58.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.882+0000 7feadd200640 1 --2- 172.21.15.133:0/1786897893 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7feab806ac00 0x7feab806d0c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feacc003cc0 tx=0x7feacc0079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:52:58.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:58.886+0000 7fead4c00640 1 -- 172.21.15.133:0/1786897893 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7feac40bc580 con 0x7fead8142bd0 2024-03-30T01:52:59.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:59.117+0000 7feadfc00640 1 -- 172.21.15.133:0/1786897893 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fead8073750 con 0x7fead8142bd0 2024-03-30T01:52:59.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:59.118+0000 7fead4c00640 1 -- 172.21.15.133:0/1786897893 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4743 (secure 0 0 0) 0x7feac401e090 con 0x7fead8142bd0 2024-03-30T01:52:59.124 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:52:59.124 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/820901593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":820901593},{"type":"v1","addr":"172.21.15.137:6834","nonce":820901593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3524452213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3524452213},{"type":"v1","addr":"172.21.15.137:6835","nonce":3524452213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3989486478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3989486478},{"type":"v1","addr":"172.21.15.133:6837","nonce":3989486478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T01:52:55.753449+0000","modified":"2024-03-30T01:52:58.771477+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"a","rank":0,"incarnation":20,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.133:6836/1431848593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1431848593},{"type":"v1","addr":"172.21.15.133:6836","nonce":1431848593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-30T01:52:59.124 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 22 2024-03-30T01:52:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:59.121+0000 7feadfc00640 1 -- 172.21.15.133:0/1786897893 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7feab806ac00 msgr2=0x7feab806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:59.121+0000 7feadfc00640 1 --2- 172.21.15.133:0/1786897893 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7feab806ac00 0x7feab806d0c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feacc003cc0 tx=0x7feacc0079b0 comp rx=0 tx=0).stop 2024-03-30T01:52:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:59.121+0000 7feadfc00640 1 -- 172.21.15.133:0/1786897893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fead8142bd0 msgr2=0x7fead815b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:52:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:59.121+0000 7feadfc00640 1 --2- 172.21.15.133:0/1786897893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fead8142bd0 0x7fead815b6b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7feac400c820 tx=0x7feac400cce0 comp rx=0 tx=0).stop 2024-03-30T01:52:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:59.121+0000 7feadfc00640 1 -- 172.21.15.133:0/1786897893 shutdown_connections 2024-03-30T01:52:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:59.121+0000 7feadfc00640 1 --2- 172.21.15.133:0/1786897893 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7feab806ac00 0x7feab806d0c0 secure :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feacc003cc0 tx=0x7feacc0079b0 comp rx=0 tx=0).stop 2024-03-30T01:52:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:59.121+0000 7feadfc00640 1 --2- 172.21.15.133:0/1786897893 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fead81431c0 0x7fead81e5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:59.121+0000 7feadfc00640 1 --2- 172.21.15.133:0/1786897893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fead8142bd0 0x7fead815b6b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:59.121+0000 7feadfc00640 1 --2- 172.21.15.133:0/1786897893 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fead806dd10 0x7fead80c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:52:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:59.121+0000 7feadfc00640 1 -- 172.21.15.133:0/1786897893 >> 172.21.15.133:0/1786897893 conn(0x7fead80b05c0 msgr2=0x7fead813c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:52:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:59.121+0000 7feadfc00640 1 -- 172.21.15.133:0/1786897893 shutdown_connections 2024-03-30T01:52:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:52:59.122+0000 7feadfc00640 1 -- 172.21.15.133:0/1786897893 wait complete. 2024-03-30T01:52:59.547 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-30T01:52:55.753449+0000', 'modified': '2024-03-30T01:52:58.771477+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5328}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5328': {'gid': 5328, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.133:6836/1431848593', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 1431848593}, {'type': 'v1', 'addr': '172.21.15.133:6836', 'nonce': 1431848593}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-03-30T01:52:59.547 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5328:up:rejoin 2024-03-30T01:53:00.270 INFO:tasks.ceph.mds.a.smithi133.stderr:2024-03-30T01:53:00.263+0000 7f925da00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-30T01:53:00.548 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T01:53:00.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.757+0000 7fb4a7000640 1 Processor -- start 2024-03-30T01:53:00.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.757+0000 7fb4a7000640 1 -- start start 2024-03-30T01:53:00.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.759+0000 7fb4a7000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a015cac0 0x7fb4a0160670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:00.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.759+0000 7fb4a7000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4a00cddb0 0x7fb4a00d1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:00.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.759+0000 7fb4a7000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a00b5b50 con 0x7fb4a0160bb0 2024-03-30T01:53:00.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.759+0000 7fb4a7000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a00d1020 con 0x7fb4a00cddb0 2024-03-30T01:53:00.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.759+0000 7fb4a7000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a0161100 con 0x7fb4a015cac0 2024-03-30T01:53:00.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.759+0000 7fb4a6600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4a00cddb0 0x7fb4a00d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:00.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.759+0000 7fb4a5200640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb4a0160bb0 0x7fb4a00cd6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35158/0 (socket says 172.21.15.133:35158) 2024-03-30T01:53:00.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.759+0000 7fb4a5200640 1 -- 172.21.15.133:0/3267742215 learned_addr learned my addr 172.21.15.133:0/3267742215 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:00.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.759+0000 7fb4a5c00640 1 --2- 172.21.15.133:0/3267742215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a015cac0 0x7fb4a0160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:00.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.760+0000 7fb4a6600640 1 -- 172.21.15.133:0/3267742215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a015cac0 msgr2=0x7fb4a0160670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:00.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.760+0000 7fb4a6600640 1 --2- 172.21.15.133:0/3267742215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a015cac0 0x7fb4a0160670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:00.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.760+0000 7fb4a6600640 1 -- 172.21.15.133:0/3267742215 >> v1:172.21.15.133:6789/0 conn(0x7fb4a0160bb0 legacy=0x7fb4a00cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:00.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.760+0000 7fb4a6600640 1 -- 172.21.15.133:0/3267742215 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a01613e0 con 0x7fb4a00cddb0 2024-03-30T01:53:00.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.760+0000 7fb49fe00640 1 -- 172.21.15.133:0/3267742215 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555067894 0 0) 0x7fb4a00b5b50 con 0x7fb4a0160bb0 2024-03-30T01:53:00.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.761+0000 7fb4a6600640 1 --2- 172.21.15.133:0/3267742215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4a00cddb0 0x7fb4a00d1440 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb4980097a0 tx=0x7fb49802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c88220d88c877f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:00.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.761+0000 7fb49fe00640 1 -- 172.21.15.133:0/3267742215 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49802d040 con 0x7fb4a00cddb0 2024-03-30T01:53:00.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.761+0000 7fb49fe00640 1 -- 172.21.15.133:0/3267742215 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb498031810 con 0x7fb4a00cddb0 2024-03-30T01:53:00.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.761+0000 7fb49fe00640 1 -- 172.21.15.133:0/3267742215 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb498031ba0 con 0x7fb4a00cddb0 2024-03-30T01:53:00.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.762+0000 7fb4a7000640 1 -- 172.21.15.133:0/3267742215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4a00cddb0 msgr2=0x7fb4a00d1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:00.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.762+0000 7fb4a7000640 1 --2- 172.21.15.133:0/3267742215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4a00cddb0 0x7fb4a00d1440 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb4980097a0 tx=0x7fb49802b8b0 comp rx=0 tx=0).stop 2024-03-30T01:53:00.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.762+0000 7fb4a7000640 1 -- 172.21.15.133:0/3267742215 shutdown_connections 2024-03-30T01:53:00.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.762+0000 7fb4a7000640 1 --2- 172.21.15.133:0/3267742215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4a00cddb0 0x7fb4a00d1440 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:00.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.762+0000 7fb4a7000640 1 --2- 172.21.15.133:0/3267742215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a015cac0 0x7fb4a0160670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:00.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.762+0000 7fb4a7000640 1 -- 172.21.15.133:0/3267742215 >> 172.21.15.133:0/3267742215 conn(0x7fb4a00cf770 msgr2=0x7fb4a00cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:00.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.762+0000 7fb4a7000640 1 -- 172.21.15.133:0/3267742215 shutdown_connections 2024-03-30T01:53:00.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.762+0000 7fb4a7000640 1 -- 172.21.15.133:0/3267742215 wait complete. 2024-03-30T01:53:00.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.764+0000 7fb4a7000640 1 Processor -- start 2024-03-30T01:53:00.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.764+0000 7fb4a7000640 1 -- start start 2024-03-30T01:53:00.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.765+0000 7fb4a7000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a00cddb0 0x7fb4a0158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:00.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.765+0000 7fb4a7000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a015cac0 0x7fb4a01560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:00.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.765+0000 7fb4a7000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4a0160bb0 0x7fb4a01f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:00.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.765+0000 7fb4a7000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a0159a70 con 0x7fb4a0160bb0 2024-03-30T01:53:00.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.765+0000 7fb4a7000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a01594b0 con 0x7fb4a00cddb0 2024-03-30T01:53:00.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.765+0000 7fb4a7000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a0159790 con 0x7fb4a015cac0 2024-03-30T01:53:00.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.765+0000 7fb4a6600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4a0160bb0 0x7fb4a01f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:00.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.765+0000 7fb4a6600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4a0160bb0 0x7fb4a01f1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36222/0 (socket says 172.21.15.133:36222) 2024-03-30T01:53:00.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.765+0000 7fb4a6600640 1 -- 172.21.15.133:0/3155006002 learned_addr learned my addr 172.21.15.133:0/3155006002 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:00.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.766+0000 7fb4a6600640 1 -- 172.21.15.133:0/3155006002 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a015cac0 msgr2=0x7fb4a01560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:00.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.766+0000 7fb4a6600640 1 --2- 172.21.15.133:0/3155006002 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a015cac0 0x7fb4a01560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:00.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.766+0000 7fb4a5c00640 1 --2- 172.21.15.133:0/3155006002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a00cddb0 0x7fb4a0158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:00.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.766+0000 7fb4a6600640 1 -- 172.21.15.133:0/3155006002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a00cddb0 msgr2=0x7fb4a0158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:00.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.766+0000 7fb4a6600640 1 --2- 172.21.15.133:0/3155006002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a00cddb0 0x7fb4a0158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:00.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.766+0000 7fb4a6600640 1 -- 172.21.15.133:0/3155006002 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb498009400 con 0x7fb4a0160bb0 2024-03-30T01:53:00.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.766+0000 7fb4a6600640 1 --2- 172.21.15.133:0/3155006002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4a0160bb0 0x7fb4a01f1920 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb49802b8f0 tx=0x7fb4980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:00.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.766+0000 7fb49d600640 1 -- 172.21.15.133:0/3155006002 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49803ace0 con 0x7fb4a0160bb0 2024-03-30T01:53:00.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.766+0000 7fb49d600640 1 -- 172.21.15.133:0/3155006002 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49803ae60 con 0x7fb4a0160bb0 2024-03-30T01:53:00.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.766+0000 7fb49d600640 1 -- 172.21.15.133:0/3155006002 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb498044630 con 0x7fb4a0160bb0 2024-03-30T01:53:00.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.766+0000 7fb4a7000640 1 -- 172.21.15.133:0/3155006002 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a015d020 con 0x7fb4a0160bb0 2024-03-30T01:53:00.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.767+0000 7fb4a7000640 1 -- 172.21.15.133:0/3155006002 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a00cae70 con 0x7fb4a0160bb0 2024-03-30T01:53:00.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.768+0000 7fb4a7000640 1 -- 172.21.15.133:0/3155006002 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a00ca9f0 con 0x7fb4a0160bb0 2024-03-30T01:53:00.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.769+0000 7fb49d600640 1 -- 172.21.15.133:0/3155006002 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb498044790 con 0x7fb4a0160bb0 2024-03-30T01:53:00.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.770+0000 7fb49d600640 1 --2- 172.21.15.133:0/3155006002 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb48006ac00 0x7fb48006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:00.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.770+0000 7fb49d600640 1 -- 172.21.15.133:0/3155006002 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb4980ab6e0 con 0x7fb4a0160bb0 2024-03-30T01:53:00.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.770+0000 7fb4a5c00640 1 --2- 172.21.15.133:0/3155006002 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb48006ac00 0x7fb48006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:00.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.771+0000 7fb4a5c00640 1 --2- 172.21.15.133:0/3155006002 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb48006ac00 0x7fb48006d0c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb494009f30 tx=0x7fb49400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:00.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:00.774+0000 7fb49d600640 1 -- 172.21.15.133:0/3155006002 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fb4a00ca9f0 con 0x7fb4a0160bb0 2024-03-30T01:53:01.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.003+0000 7fb4a7000640 1 -- 172.21.15.133:0/3155006002 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4a00ca9f0 con 0x7fb4a0160bb0 2024-03-30T01:53:01.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.004+0000 7fb49d600640 1 -- 172.21.15.133:0/3155006002 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4743 (secure 0 0 0) 0x7fb4a00ca9f0 con 0x7fb4a0160bb0 2024-03-30T01:53:01.010 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:53:01.011 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/820901593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":820901593},{"type":"v1","addr":"172.21.15.137:6834","nonce":820901593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3524452213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3524452213},{"type":"v1","addr":"172.21.15.137:6835","nonce":3524452213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3989486478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3989486478},{"type":"v1","addr":"172.21.15.133:6837","nonce":3989486478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T01:52:55.753449+0000","modified":"2024-03-30T01:52:59.774372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.133:6836/1431848593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1431848593},{"type":"v1","addr":"172.21.15.133:6836","nonce":1431848593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":2}]} 2024-03-30T01:53:01.011 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 24 2024-03-30T01:53:01.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.007+0000 7fb4a7000640 1 -- 172.21.15.133:0/3155006002 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb48006ac00 msgr2=0x7fb48006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:01.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.007+0000 7fb4a7000640 1 --2- 172.21.15.133:0/3155006002 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb48006ac00 0x7fb48006d0c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb494009f30 tx=0x7fb49400b040 comp rx=0 tx=0).stop 2024-03-30T01:53:01.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.007+0000 7fb4a7000640 1 -- 172.21.15.133:0/3155006002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4a0160bb0 msgr2=0x7fb4a01f1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:01.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.007+0000 7fb4a7000640 1 --2- 172.21.15.133:0/3155006002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4a0160bb0 0x7fb4a01f1920 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb49802b8f0 tx=0x7fb4980046c0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.007+0000 7fb4a7000640 1 -- 172.21.15.133:0/3155006002 shutdown_connections 2024-03-30T01:53:01.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.007+0000 7fb4a7000640 1 --2- 172.21.15.133:0/3155006002 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb48006ac00 0x7fb48006d0c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.007+0000 7fb4a7000640 1 --2- 172.21.15.133:0/3155006002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4a0160bb0 0x7fb4a01f1920 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.007+0000 7fb4a7000640 1 --2- 172.21.15.133:0/3155006002 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a015cac0 0x7fb4a01560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.007+0000 7fb4a7000640 1 --2- 172.21.15.133:0/3155006002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a00cddb0 0x7fb4a0158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.007+0000 7fb4a7000640 1 -- 172.21.15.133:0/3155006002 >> 172.21.15.133:0/3155006002 conn(0x7fb4a00cf770 msgr2=0x7fb4a006b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:01.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.007+0000 7fb4a7000640 1 -- 172.21.15.133:0/3155006002 shutdown_connections 2024-03-30T01:53:01.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.007+0000 7fb4a7000640 1 -- 172.21.15.133:0/3155006002 wait complete. 2024-03-30T01:53:01.434 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-30T01:52:55.753449+0000', 'modified': '2024-03-30T01:52:59.774372+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5328}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5328': {'gid': 5328, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.133:6836/1431848593', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 1431848593}, {'type': 'v1', 'addr': '172.21.15.133:6836', 'nonce': 1431848593}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-03-30T01:53:01.434 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-30T01:53:01.434 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-30T01:53:01.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.644+0000 7efc04c00640 1 Processor -- start 2024-03-30T01:53:01.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.644+0000 7efc04c00640 1 -- start start 2024-03-30T01:53:01.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.646+0000 7efc04c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efc000cfb80 0x7efc000b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:01.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.646+0000 7efc04c00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc0015d030 con 0x7efc0015cc50 2024-03-30T01:53:01.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.646+0000 7efc04c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc000b5af0 con 0x7efc000d0af0 2024-03-30T01:53:01.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.646+0000 7efc04c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc000d1c50 con 0x7efc000cfb80 2024-03-30T01:53:01.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.646+0000 7efbfde00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7efc0015cc50 0x7efc000d2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35170/0 (socket says 172.21.15.133:35170) 2024-03-30T01:53:01.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.646+0000 7efbfde00640 1 -- 172.21.15.133:0/516021286 learned_addr learned my addr 172.21.15.133:0/516021286 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:01.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.647+0000 7efbfca00640 1 -- 172.21.15.133:0/516021286 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513558975 0 0) 0x7efc0015d030 con 0x7efc0015cc50 2024-03-30T01:53:01.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.647+0000 7efbfca00640 1 -- 172.21.15.133:0/516021286 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbe4003520 con 0x7efc0015cc50 2024-03-30T01:53:01.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.647+0000 7efbfe800640 1 --2- 172.21.15.133:0/516021286 >> v2:172.21.15.137:3300/0 conn(0x7efc000cfb80 0x7efc000b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:01.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.647+0000 7efbfca00640 1 -- 172.21.15.133:0/516021286 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 758197196 0 0) 0x7efbe4003520 con 0x7efc0015cc50 2024-03-30T01:53:01.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.647+0000 7efbfca00640 1 -- 172.21.15.133:0/516021286 >> v2:172.21.15.137:3300/0 conn(0x7efc000cfb80 msgr2=0x7efc000b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:01.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.647+0000 7efbfca00640 1 --2- 172.21.15.133:0/516021286 >> v2:172.21.15.137:3300/0 conn(0x7efc000cfb80 0x7efc000b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.647+0000 7efbfca00640 1 -- 172.21.15.133:0/516021286 >> v1:172.21.15.137:6789/0 conn(0x7efc000d0af0 legacy=0x7efc000cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:01.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.647+0000 7efbfca00640 1 -- 172.21.15.133:0/516021286 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc000d10d0 con 0x7efc0015cc50 2024-03-30T01:53:01.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.647+0000 7efbfca00640 1 -- 172.21.15.133:0/516021286 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7efbe8001690 con 0x7efc0015cc50 2024-03-30T01:53:01.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.647+0000 7efbfca00640 1 -- 172.21.15.133:0/516021286 >> v1:172.21.15.133:6789/0 conn(0x7efc0015cc50 legacy=0x7efc000d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:01.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.647+0000 7efbfca00640 1 --2- 172.21.15.133:0/516021286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe4003970 0x7efbe4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:01.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.647+0000 7efbfca00640 1 --2- 172.21.15.133:0/516021286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efbe40047c0 0x7efbe4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:01.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.647+0000 7efbfca00640 1 --2- 172.21.15.133:0/516021286 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efbe4005180 0x7efbe400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:01.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.647+0000 7efbfca00640 1 -- 172.21.15.133:0/516021286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc000d1c50 con 0x7efbe4003970 2024-03-30T01:53:01.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.647+0000 7efbfca00640 1 -- 172.21.15.133:0/516021286 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbe400c0d0 con 0x7efbe40047c0 2024-03-30T01:53:01.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.647+0000 7efbfca00640 1 -- 172.21.15.133:0/516021286 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbe400c290 con 0x7efbe4005180 2024-03-30T01:53:01.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.647+0000 7efbfe800640 1 --2- 172.21.15.133:0/516021286 >> v2:172.21.15.137:3300/0 conn(0x7efc000cfb80 0x7efc000b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:53:01.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.647+0000 7efbfde00640 1 --2- 172.21.15.133:0/516021286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe4003970 0x7efbe4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:01.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.648+0000 7efbfd400640 1 --2- 172.21.15.133:0/516021286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efbe40047c0 0x7efbe4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:01.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.648+0000 7efbfde00640 1 -- 172.21.15.133:0/516021286 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efbe4005180 msgr2=0x7efbe400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:01.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.648+0000 7efbfde00640 1 --2- 172.21.15.133:0/516021286 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efbe4005180 0x7efbe400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.648+0000 7efbfde00640 1 -- 172.21.15.133:0/516021286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efbe40047c0 msgr2=0x7efbe4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:01.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.648+0000 7efbfde00640 1 --2- 172.21.15.133:0/516021286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efbe40047c0 0x7efbe4004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.648+0000 7efbfde00640 1 -- 172.21.15.133:0/516021286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe4003520 con 0x7efbe4003970 2024-03-30T01:53:01.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.648+0000 7efbfe800640 1 -- 172.21.15.133:0/516021286 reap_dead start 2024-03-30T01:53:01.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.649+0000 7efbfde00640 1 --2- 172.21.15.133:0/516021286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe4003970 0x7efbe4003d90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7efc0006ac90 tx=0x7efbe40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7915ad5217f6d426 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:01.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.649+0000 7efbfca00640 1 -- 172.21.15.133:0/516021286 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8005ad0 con 0x7efbe4003970 2024-03-30T01:53:01.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.649+0000 7efbfca00640 1 -- 172.21.15.133:0/516021286 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe8005c30 con 0x7efbe4003970 2024-03-30T01:53:01.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.649+0000 7efbfca00640 1 -- 172.21.15.133:0/516021286 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe802c890 con 0x7efbe4003970 2024-03-30T01:53:01.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.649+0000 7efc04c00640 1 -- 172.21.15.133:0/516021286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe4003970 msgr2=0x7efbe4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:01.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.649+0000 7efc04c00640 1 --2- 172.21.15.133:0/516021286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe4003970 0x7efbe4003d90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7efc0006ac90 tx=0x7efbe40057f0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.650+0000 7efc04c00640 1 -- 172.21.15.133:0/516021286 shutdown_connections 2024-03-30T01:53:01.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.650+0000 7efc04c00640 1 --2- 172.21.15.133:0/516021286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe4003970 0x7efbe4003d90 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.650+0000 7efc04c00640 1 -- 172.21.15.133:0/516021286 >> 172.21.15.133:0/516021286 conn(0x7efc00071a40 msgr2=0x7efc0006b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:01.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.650+0000 7efc04c00640 1 -- 172.21.15.133:0/516021286 shutdown_connections 2024-03-30T01:53:01.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.650+0000 7efc04c00640 1 -- 172.21.15.133:0/516021286 wait complete. 2024-03-30T01:53:01.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.651+0000 7efc04c00640 1 Processor -- start 2024-03-30T01:53:01.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.651+0000 7efc04c00640 1 -- start start 2024-03-30T01:53:01.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.652+0000 7efc04c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe4003970 0x7efc001f1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:01.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.652+0000 7efc04c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc000c8070 0x7efc000c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:01.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.652+0000 7efc04c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc000c84d0 0x7efc000ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:01.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.652+0000 7efc04c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc00156270 con 0x7efbe4003970 2024-03-30T01:53:01.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.652+0000 7efc04c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc00156550 con 0x7efc000c8070 2024-03-30T01:53:01.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.652+0000 7efc04c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc00156830 con 0x7efc000c84d0 2024-03-30T01:53:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.653+0000 7efbfde00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe4003970 0x7efc001f1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.653+0000 7efbfde00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe4003970 0x7efc001f1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36238/0 (socket says 172.21.15.133:36238) 2024-03-30T01:53:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.653+0000 7efbfde00640 1 -- 172.21.15.133:0/573544542 learned_addr learned my addr 172.21.15.133:0/573544542 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.653+0000 7efbfe800640 1 --2- 172.21.15.133:0/573544542 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc000c84d0 0x7efc000ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.653+0000 7efbfd400640 1 --2- 172.21.15.133:0/573544542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc000c8070 0x7efc000c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.653+0000 7efbfde00640 1 -- 172.21.15.133:0/573544542 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc000c84d0 msgr2=0x7efc000ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.653+0000 7efbfde00640 1 --2- 172.21.15.133:0/573544542 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc000c84d0 0x7efc000ca070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.653+0000 7efbfde00640 1 -- 172.21.15.133:0/573544542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc000c8070 msgr2=0x7efc000c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.653+0000 7efbfde00640 1 --2- 172.21.15.133:0/573544542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc000c8070 0x7efc000c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.653+0000 7efbfde00640 1 -- 172.21.15.133:0/573544542 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc00156b10 con 0x7efbe4003970 2024-03-30T01:53:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.653+0000 7efbfd400640 1 --2- 172.21.15.133:0/573544542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc000c8070 0x7efc000c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.653+0000 7efbfde00640 1 --2- 172.21.15.133:0/573544542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe4003970 0x7efc001f1e80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7efbe8000f60 tx=0x7efbe802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.654+0000 7efbf6000640 1 -- 172.21.15.133:0/573544542 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe803c040 con 0x7efbe4003970 2024-03-30T01:53:01.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.654+0000 7efbf6000640 1 -- 172.21.15.133:0/573544542 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe802cca0 con 0x7efbe4003970 2024-03-30T01:53:01.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.654+0000 7efc04c00640 1 -- 172.21.15.133:0/573544542 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc00156df0 con 0x7efbe4003970 2024-03-30T01:53:01.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.654+0000 7efbf6000640 1 -- 172.21.15.133:0/573544542 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe80072b0 con 0x7efbe4003970 2024-03-30T01:53:01.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.654+0000 7efc04c00640 1 -- 172.21.15.133:0/573544542 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc00155e00 con 0x7efbe4003970 2024-03-30T01:53:01.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.656+0000 7efbf6000640 1 -- 172.21.15.133:0/573544542 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7efbe8032070 con 0x7efbe4003970 2024-03-30T01:53:01.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.657+0000 7efbf6000640 1 --2- 172.21.15.133:0/573544542 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efbdc06ac30 0x7efbdc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:01.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.657+0000 7efbf6000640 1 -- 172.21.15.133:0/573544542 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7efbe80aa580 con 0x7efbe4003970 2024-03-30T01:53:01.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.657+0000 7efbfd400640 1 --2- 172.21.15.133:0/573544542 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efbdc06ac30 0x7efbdc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:01.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.658+0000 7efc07a25740 1 Processor -- start 2024-03-30T01:53:01.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.658+0000 7efbfd400640 1 --2- 172.21.15.133:0/573544542 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efbdc06ac30 0x7efbdc06d0f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efc00160150 tx=0x7efbf0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:01.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.658+0000 7efc07a25740 1 -- start start 2024-03-30T01:53:01.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.659+0000 7efc07a25740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f148274d00 0x55f148247ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:01.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.659+0000 7efc07a25740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1482750e0 0x55f148277a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:01.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.659+0000 7efc07a25740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f1482481e0 0x55f148277fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:01.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.659+0000 7efc07a25740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1482232c0 con 0x55f148274d00 2024-03-30T01:53:01.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.659+0000 7efc07a25740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1481b88f0 con 0x55f1482750e0 2024-03-30T01:53:01.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.659+0000 7efc07a25740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f1481b6080 con 0x55f1482481e0 2024-03-30T01:53:01.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.659+0000 7efbfde00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f148274d00 0x55f148247ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:01.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.659+0000 7efbfde00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f148274d00 0x55f148247ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36250/0 (socket says 172.21.15.133:36250) 2024-03-30T01:53:01.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.659+0000 7efbfde00640 1 -- 172.21.15.133:0/2720149947 learned_addr learned my addr 172.21.15.133:0/2720149947 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:01.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.659+0000 7efbfde00640 1 -- 172.21.15.133:0/2720149947 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f1482481e0 msgr2=0x55f148277fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:01.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.659+0000 7efbfde00640 1 --2- 172.21.15.133:0/2720149947 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f1482481e0 0x55f148277fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.659+0000 7efbfde00640 1 -- 172.21.15.133:0/2720149947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1482750e0 msgr2=0x55f148277a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:01.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.659+0000 7efbfde00640 1 --2- 172.21.15.133:0/2720149947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1482750e0 0x55f148277a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.659+0000 7efbfde00640 1 -- 172.21.15.133:0/2720149947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f14817ca10 con 0x55f148274d00 2024-03-30T01:53:01.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.659+0000 7efbfde00640 1 --2- 172.21.15.133:0/2720149947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f148274d00 0x55f148247ca0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7efbe80811e0 tx=0x7efbe8079a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f4fce7ea3f9321 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:01.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.660+0000 7efbeea00640 1 -- 172.21.15.133:0/2720149947 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe807d150 con 0x55f148274d00 2024-03-30T01:53:01.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.660+0000 7efbeea00640 1 -- 172.21.15.133:0/2720149947 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe8081710 con 0x55f148274d00 2024-03-30T01:53:01.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.660+0000 7efbeea00640 1 -- 172.21.15.133:0/2720149947 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8007d10 con 0x55f148274d00 2024-03-30T01:53:01.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.660+0000 7efc07a25740 1 -- 172.21.15.133:0/2720149947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f148274d00 msgr2=0x55f148247ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:01.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.660+0000 7efc07a25740 1 --2- 172.21.15.133:0/2720149947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f148274d00 0x55f148247ca0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7efbe80811e0 tx=0x7efbe8079a20 comp rx=0 tx=0).stop 2024-03-30T01:53:01.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.660+0000 7efc07a25740 1 -- 172.21.15.133:0/2720149947 shutdown_connections 2024-03-30T01:53:01.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.660+0000 7efc07a25740 1 --2- 172.21.15.133:0/2720149947 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f1482481e0 0x55f148277fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.660+0000 7efc07a25740 1 --2- 172.21.15.133:0/2720149947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1482750e0 0x55f148277a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.660+0000 7efc07a25740 1 --2- 172.21.15.133:0/2720149947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f148274d00 0x55f148247ca0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.660+0000 7efc07a25740 1 -- 172.21.15.133:0/2720149947 >> 172.21.15.133:0/2720149947 conn(0x55f148249f10 msgr2=0x55f148292a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:01.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.660+0000 7efc07a25740 1 -- 172.21.15.133:0/2720149947 shutdown_connections 2024-03-30T01:53:01.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.660+0000 7efc07a25740 1 -- 172.21.15.133:0/2720149947 wait complete. 2024-03-30T01:53:01.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.661+0000 7efc07a25740 1 -- start start 2024-03-30T01:53:01.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.661+0000 7efc07a25740 1 Processor -- start 2024-03-30T01:53:01.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.662+0000 7efc07a25740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f148274d00 0x55f14826f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.662+0000 7efc07a25740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1482750e0 0x55f14827af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.662+0000 7efc07a25740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f1482a2040 0x55f14828c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.662+0000 7efc07a25740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1481b1970 con 0x55f1482a2040 2024-03-30T01:53:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.662+0000 7efc07a25740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1481530a0 con 0x55f1482750e0 2024-03-30T01:53:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.662+0000 7efc07a25740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f148152d40 con 0x55f148274d00 2024-03-30T01:53:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.662+0000 7efc07a25740 10 client.0 _ll_register_callbacks cb 0x55f1481aafe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T01:53:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.662+0000 7efbfe800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f1482a2040 0x55f14828c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.663+0000 7efbfe800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f1482a2040 0x55f14828c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36260/0 (socket says 172.21.15.133:36260) 2024-03-30T01:53:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.663+0000 7efbfe800640 1 -- 172.21.15.133:0/1739631438 learned_addr learned my addr 172.21.15.133:0/1739631438 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.663+0000 7efbfe800640 1 -- 172.21.15.133:0/1739631438 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f148274d00 msgr2=0x55f14826f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.663+0000 7efbfde00640 1 --2- 172.21.15.133:0/1739631438 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f148274d00 0x55f14826f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.663+0000 7efbfe800640 1 --2- 172.21.15.133:0/1739631438 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f148274d00 0x55f14826f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.663+0000 7efbfe800640 1 -- 172.21.15.133:0/1739631438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1482750e0 msgr2=0x55f14827af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.663+0000 7efbfe800640 1 --2- 172.21.15.133:0/1739631438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1482750e0 0x55f14827af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.663+0000 7efbfe800640 1 -- 172.21.15.133:0/1739631438 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc00155e00 con 0x55f1482a2040 2024-03-30T01:53:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.663+0000 7efbfe800640 1 --2- 172.21.15.133:0/1739631438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f1482a2040 0x55f14828c4c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efc000723f0 tx=0x7efbf800f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388b50542261333a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.663+0000 7efbe3400640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-03-30T01:53:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.663+0000 7efbe3400640 1 -- 172.21.15.133:0/1739631438 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf800fe10 con 0x55f1482a2040 2024-03-30T01:53:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.663+0000 7efbe3400640 1 -- 172.21.15.133:0/1739631438 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7efbf8004030 con 0x55f1482a2040 2024-03-30T01:53:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.663+0000 7efc07a25740 1 -- 172.21.15.133:0/1739631438 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f1481dbb10 con 0x55f1482a2040 2024-03-30T01:53:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.664+0000 7efbe3400640 1 -- 172.21.15.133:0/1739631438 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7efbf80041f0 con 0x55f1482a2040 2024-03-30T01:53:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.664+0000 7efc07a25740 10 client.5379 fetch_fsmap learned FSMap version 24 2024-03-30T01:53:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.664+0000 7efc07a25740 1 -- 172.21.15.133:0/1739631438 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55f1481afff0 con 0x55f1482a2040 2024-03-30T01:53:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.664+0000 7efbe3400640 1 -- 172.21.15.133:0/1739631438 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f1481dbb10 con 0x55f1482a2040 2024-03-30T01:53:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.664+0000 7efbe3400640 1 -- 172.21.15.133:0/1739631438 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 24) v1 ==== 3114+0+0 (secure 0 0 0) 0x7efbf8004350 con 0x55f1482a2040 2024-03-30T01:53:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.664+0000 7efc07a25740 10 client.5379 fetch_fsmap finished waiting for FSMap version 24 2024-03-30T01:53:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.664+0000 7efc07a25740 10 client.5379 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-30T01:53:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.664+0000 7efc07a25740 20 client.5379 populate_metadata read hostname 'smithi133' 2024-03-30T01:53:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.664+0000 7efc07a25740 1 --2- 172.21.15.133:0/1739631438 >> [v2:172.21.15.133:6834/1431848593,v1:172.21.15.133:6836/1431848593] conn(0x55f14828a480 0x55f14828a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.664+0000 7efc07a25740 4 client.5379 mds_command: new command op to 5328 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T01:53:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.664+0000 7efc07a25740 1 -- 172.21.15.133:0/1739631438 --> [v2:172.21.15.133:6834/1431848593,v1:172.21.15.133:6836/1431848593] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f147ea53c0 con 0x55f14828a480 2024-03-30T01:53:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.664+0000 7efbfde00640 1 --2- 172.21.15.133:0/1739631438 >> [v2:172.21.15.133:6834/1431848593,v1:172.21.15.133:6836/1431848593] conn(0x55f14828a480 0x55f14828a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.665+0000 7efbfde00640 1 --2- 172.21.15.133:0/1739631438 >> [v2:172.21.15.133:6834/1431848593,v1:172.21.15.133:6836/1431848593] conn(0x55f14828a480 0x55f14828a860 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a50e8098223a16 server_cookie=ebfc6821e0434407 in_seq=0 out_seq=0 2024-03-30T01:53:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.665+0000 7efbe3400640 10 client.5379 ms_handle_connect on v2:172.21.15.133:6834/1431848593 2024-03-30T01:53:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.665+0000 7efbe3400640 1 -- 172.21.15.133:0/1739631438 <== mds.0 v2:172.21.15.133:6834/1431848593 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f147ea53c0 con 0x55f14828a480 2024-03-30T01:53:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.665+0000 7efbe3400640 10 client.5379 handle_command_reply: tid=0 2024-03-30T01:53:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.666+0000 7efc07a25740 1 client.5379 shutdown 2024-03-30T01:53:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.666+0000 7efc07a25740 1 -- 172.21.15.133:0/1739631438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f1482a2040 msgr2=0x55f14828c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.666+0000 7efc07a25740 1 --2- 172.21.15.133:0/1739631438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f1482a2040 0x55f14828c4c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efc000723f0 tx=0x7efbf800f5b0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.666+0000 7efc07a25740 1 -- 172.21.15.133:0/1739631438 shutdown_connections 2024-03-30T01:53:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.666+0000 7efc07a25740 1 --2- 172.21.15.133:0/1739631438 >> [v2:172.21.15.133:6834/1431848593,v1:172.21.15.133:6836/1431848593] conn(0x55f14828a480 0x55f14828a860 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.666+0000 7efc07a25740 1 --2- 172.21.15.133:0/1739631438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f1482a2040 0x55f14828c4c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.666+0000 7efc07a25740 1 --2- 172.21.15.133:0/1739631438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1482750e0 0x55f14827af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.666+0000 7efc07a25740 1 --2- 172.21.15.133:0/1739631438 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f148274d00 0x55f14826f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.666+0000 7efc07a25740 1 -- 172.21.15.133:0/1739631438 >> 172.21.15.133:0/1739631438 conn(0x55f1482481e0 msgr2=0x55f148295fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:01.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.666+0000 7efbe3400640 0 client.5379 ms_handle_reset on v2:172.21.15.133:6834/1431848593 2024-03-30T01:53:01.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.666+0000 7efc07a25740 1 -- 172.21.15.133:0/1739631438 shutdown_connections 2024-03-30T01:53:01.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.666+0000 7efc07a25740 1 -- 172.21.15.133:0/1739631438 wait complete. 2024-03-30T01:53:01.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.666+0000 7efc07a25740 20 client.5379 trim_cache size 0 max 16384 2024-03-30T01:53:01.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.682+0000 7efc07a25740 1 Processor -- start 2024-03-30T01:53:01.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.682+0000 7efc07a25740 1 -- start start 2024-03-30T01:53:01.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.683+0000 7efc07a25740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f148274d00 0x55f14826a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:01.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.683+0000 7efc07a25740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f1482750e0 0x55f148295fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:01.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.683+0000 7efc07a25740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1482a2040 0x55f1482964e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:01.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.683+0000 7efc07a25740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f14824c800 con 0x55f148274d00 2024-03-30T01:53:01.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.683+0000 7efc07a25740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f147f18f20 con 0x55f1482a2040 2024-03-30T01:53:01.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.683+0000 7efc07a25740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f14828a2b0 con 0x55f1482750e0 2024-03-30T01:53:01.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.683+0000 7efbfde00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f148274d00 0x55f14826a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:01.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.683+0000 7efbfde00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f148274d00 0x55f14826a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36266/0 (socket says 172.21.15.133:36266) 2024-03-30T01:53:01.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.683+0000 7efbfde00640 1 -- 172.21.15.133:0/304976866 learned_addr learned my addr 172.21.15.133:0/304976866 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:01.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.683+0000 7efbfde00640 1 -- 172.21.15.133:0/304976866 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f1482750e0 msgr2=0x55f148295fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:01.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.683+0000 7efbfde00640 1 --2- 172.21.15.133:0/304976866 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f1482750e0 0x55f148295fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.683+0000 7efbfde00640 1 -- 172.21.15.133:0/304976866 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1482a2040 msgr2=0x55f1482964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:01.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.683+0000 7efbfde00640 1 --2- 172.21.15.133:0/304976866 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1482a2040 0x55f1482964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.683+0000 7efbfde00640 1 -- 172.21.15.133:0/304976866 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1481e57c0 con 0x55f148274d00 2024-03-30T01:53:01.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.684+0000 7efbfde00640 1 --2- 172.21.15.133:0/304976866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f148274d00 0x55f14826a1c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efbe80017c0 tx=0x7efbe80aa000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8f974f91f32f3e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:01.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.684+0000 7efbef400640 1 -- 172.21.15.133:0/304976866 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8007d10 con 0x55f148274d00 2024-03-30T01:53:01.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.684+0000 7efbef400640 1 -- 172.21.15.133:0/304976866 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe80776c0 con 0x55f148274d00 2024-03-30T01:53:01.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.684+0000 7efbef400640 1 -- 172.21.15.133:0/304976866 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8081280 con 0x55f148274d00 2024-03-30T01:53:01.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.684+0000 7efc07a25740 1 -- 172.21.15.133:0/304976866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f148274d00 msgr2=0x55f14826a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:01.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.684+0000 7efc07a25740 1 --2- 172.21.15.133:0/304976866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f148274d00 0x55f14826a1c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efbe80017c0 tx=0x7efbe80aa000 comp rx=0 tx=0).stop 2024-03-30T01:53:01.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.684+0000 7efc07a25740 1 -- 172.21.15.133:0/304976866 shutdown_connections 2024-03-30T01:53:01.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.684+0000 7efc07a25740 1 --2- 172.21.15.133:0/304976866 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1482a2040 0x55f1482964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.684+0000 7efc07a25740 1 --2- 172.21.15.133:0/304976866 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f1482750e0 0x55f148295fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.684+0000 7efc07a25740 1 --2- 172.21.15.133:0/304976866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f148274d00 0x55f14826a1c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.684+0000 7efc07a25740 1 -- 172.21.15.133:0/304976866 >> 172.21.15.133:0/304976866 conn(0x55f1482481e0 msgr2=0x55f148277e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:01.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.685+0000 7efc07a25740 1 -- 172.21.15.133:0/304976866 shutdown_connections 2024-03-30T01:53:01.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.685+0000 7efc07a25740 1 -- 172.21.15.133:0/304976866 wait complete. 2024-03-30T01:53:01.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.685+0000 7efc07a25740 1 -- start start 2024-03-30T01:53:01.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.685+0000 7efc07a25740 1 Processor -- start 2024-03-30T01:53:01.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.686+0000 7efc07a25740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f148274d00 0x55f14824c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:01.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.686+0000 7efc07a25740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f1482750e0 0x55f14826c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:01.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.686+0000 7efc07a25740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1482a2040 0x55f14826cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:01.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.686+0000 7efc07a25740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f14826e170 con 0x55f148274d00 2024-03-30T01:53:01.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.686+0000 7efc07a25740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f14824d390 con 0x55f1482a2040 2024-03-30T01:53:01.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.686+0000 7efc07a25740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f14826a260 con 0x55f1482750e0 2024-03-30T01:53:01.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.686+0000 7efc07a25740 10 client.0 _ll_register_callbacks cb 0x7efbf8006c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T01:53:01.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.687+0000 7efbfde00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f148274d00 0x55f14824c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:01.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.687+0000 7efbfde00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f148274d00 0x55f14824c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36274/0 (socket says 172.21.15.133:36274) 2024-03-30T01:53:01.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.687+0000 7efbfde00640 1 -- 172.21.15.133:0/2245771715 learned_addr learned my addr 172.21.15.133:0/2245771715 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:01.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.687+0000 7efbfde00640 1 -- 172.21.15.133:0/2245771715 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f1482750e0 msgr2=0x55f14826c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:01.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.687+0000 7efbfde00640 1 --2- 172.21.15.133:0/2245771715 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f1482750e0 0x55f14826c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.687+0000 7efbfde00640 1 -- 172.21.15.133:0/2245771715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1482a2040 msgr2=0x55f14826cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:01.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.687+0000 7efbfde00640 1 --2- 172.21.15.133:0/2245771715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1482a2040 0x55f14826cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.687+0000 7efbfde00640 1 -- 172.21.15.133:0/2245771715 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f14817ca10 con 0x55f148274d00 2024-03-30T01:53:01.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.687+0000 7efbfde00640 1 --2- 172.21.15.133:0/2245771715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f148274d00 0x55f14824c9a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7efbe80794e0 tx=0x7efbe807b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91bd1e47e72bf9d9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:01.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.687+0000 7efbe3400640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-03-30T01:53:01.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.687+0000 7efbe3400640 1 -- 172.21.15.133:0/2245771715 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8075a30 con 0x55f148274d00 2024-03-30T01:53:01.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.687+0000 7efbe3400640 1 -- 172.21.15.133:0/2245771715 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7efbe8096070 con 0x55f148274d00 2024-03-30T01:53:01.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.687+0000 7efc07a25740 1 -- 172.21.15.133:0/2245771715 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efbe8081710 con 0x55f148274d00 2024-03-30T01:53:01.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.688+0000 7efbe3400640 1 -- 172.21.15.133:0/2245771715 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7efbe8075b90 con 0x55f148274d00 2024-03-30T01:53:01.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.688+0000 7efc07a25740 10 client.5385 fetch_fsmap learned FSMap version 24 2024-03-30T01:53:01.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.688+0000 7efc07a25740 1 -- 172.21.15.133:0/2245771715 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55f1481522b0 con 0x55f148274d00 2024-03-30T01:53:01.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.688+0000 7efbe3400640 1 -- 172.21.15.133:0/2245771715 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe8081710 con 0x55f148274d00 2024-03-30T01:53:01.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.688+0000 7efbe3400640 1 -- 172.21.15.133:0/2245771715 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 24) v1 ==== 3114+0+0 (secure 0 0 0) 0x7efbe8081280 con 0x55f148274d00 2024-03-30T01:53:01.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.688+0000 7efc07a25740 10 client.5385 fetch_fsmap finished waiting for FSMap version 24 2024-03-30T01:53:01.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.688+0000 7efc07a25740 10 client.5385 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-30T01:53:01.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.688+0000 7efc07a25740 20 client.5385 populate_metadata read hostname 'smithi133' 2024-03-30T01:53:01.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.688+0000 7efc07a25740 1 --2- 172.21.15.133:0/2245771715 >> [v2:172.21.15.133:6834/1431848593,v1:172.21.15.133:6836/1431848593] conn(0x55f14827b5e0 0x55f14826d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:01.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.688+0000 7efc07a25740 4 client.5385 mds_command: new command op to 5328 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-30T01:53:01.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.688+0000 7efc07a25740 1 -- 172.21.15.133:0/2245771715 --> [v2:172.21.15.133:6834/1431848593,v1:172.21.15.133:6836/1431848593] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f147eb66c0 con 0x55f14827b5e0 2024-03-30T01:53:01.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.688+0000 7efbfd400640 1 --2- 172.21.15.133:0/2245771715 >> [v2:172.21.15.133:6834/1431848593,v1:172.21.15.133:6836/1431848593] conn(0x55f14827b5e0 0x55f14826d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:01.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.689+0000 7efbfd400640 1 --2- 172.21.15.133:0/2245771715 >> [v2:172.21.15.133:6834/1431848593,v1:172.21.15.133:6836/1431848593] conn(0x55f14827b5e0 0x55f14826d1b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7c894d9e429f26f server_cookie=157b4321c8fc2584 in_seq=0 out_seq=0 2024-03-30T01:53:01.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.689+0000 7efbe3400640 10 client.5385 ms_handle_connect on v2:172.21.15.133:6834/1431848593 2024-03-30T01:53:01.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.689+0000 7efbe3400640 1 -- 172.21.15.133:0/2245771715 <== mds.0 v2:172.21.15.133:6834/1431848593 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55f147eb66c0 con 0x55f14827b5e0 2024-03-30T01:53:01.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.689+0000 7efbe3400640 10 client.5385 handle_command_reply: tid=0 2024-03-30T01:53:01.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.689+0000 7efc07a25740 1 client.5385 shutdown 2024-03-30T01:53:01.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.689+0000 7efc07a25740 1 -- 172.21.15.133:0/2245771715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f148274d00 msgr2=0x55f14824c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:01.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.689+0000 7efc07a25740 1 --2- 172.21.15.133:0/2245771715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f148274d00 0x55f14824c9a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7efbe80794e0 tx=0x7efbe807b000 comp rx=0 tx=0).stop 2024-03-30T01:53:01.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.689+0000 7efc07a25740 1 -- 172.21.15.133:0/2245771715 shutdown_connections 2024-03-30T01:53:01.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.689+0000 7efc07a25740 1 --2- 172.21.15.133:0/2245771715 >> [v2:172.21.15.133:6834/1431848593,v1:172.21.15.133:6836/1431848593] conn(0x55f14827b5e0 0x55f14826d1b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.689+0000 7efc07a25740 1 --2- 172.21.15.133:0/2245771715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1482a2040 0x55f14826cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.689+0000 7efc07a25740 1 --2- 172.21.15.133:0/2245771715 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f1482750e0 0x55f14826c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.689+0000 7efbe3400640 0 client.5385 ms_handle_reset on v2:172.21.15.133:6834/1431848593 2024-03-30T01:53:01.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.689+0000 7efc07a25740 1 --2- 172.21.15.133:0/2245771715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f148274d00 0x55f14824c9a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.689+0000 7efc07a25740 1 -- 172.21.15.133:0/2245771715 >> 172.21.15.133:0/2245771715 conn(0x55f1482481e0 msgr2=0x55f148295fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:01.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.689+0000 7efc07a25740 1 -- 172.21.15.133:0/2245771715 shutdown_connections 2024-03-30T01:53:01.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.689+0000 7efc07a25740 1 -- 172.21.15.133:0/2245771715 wait complete. 2024-03-30T01:53:01.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.689+0000 7efc07a25740 20 client.5385 trim_cache size 0 max 16384 2024-03-30T01:53:01.699 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-03-30T01:53:01.699 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "10e5f47a-7547-42f1-8bb3-a8ac3aae8cad", 2024-03-30T01:53:01.699 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2024-03-30T01:53:01.699 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 5328, 2024-03-30T01:53:01.699 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2024-03-30T01:53:01.699 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2024-03-30T01:53:01.699 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2024-03-30T01:53:01.700 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 4.9209969469999999, 2024-03-30T01:53:01.700 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 23, 2024-03-30T01:53:01.700 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 36, 2024-03-30T01:53:01.700 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 36, 2024-03-30T01:53:01.700 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 7.3541760160000003 2024-03-30T01:53:01.700 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-03-30T01:53:01.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.690+0000 7efc04c00640 1 -- 172.21.15.133:0/573544542 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efbdc06ac30 msgr2=0x7efbdc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:01.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.690+0000 7efc04c00640 1 --2- 172.21.15.133:0/573544542 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efbdc06ac30 0x7efbdc06d0f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efc00160150 tx=0x7efbf0009040 comp rx=0 tx=0).stop 2024-03-30T01:53:01.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.690+0000 7efc04c00640 1 -- 172.21.15.133:0/573544542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe4003970 msgr2=0x7efc001f1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:01.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.690+0000 7efc04c00640 1 --2- 172.21.15.133:0/573544542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe4003970 0x7efc001f1e80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7efbe8000f60 tx=0x7efbe802e070 comp rx=0 tx=0).stop 2024-03-30T01:53:01.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.690+0000 7efc04c00640 1 -- 172.21.15.133:0/573544542 shutdown_connections 2024-03-30T01:53:01.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.690+0000 7efc04c00640 1 --2- 172.21.15.133:0/573544542 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efbdc06ac30 0x7efbdc06d0f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.690+0000 7efc04c00640 1 --2- 172.21.15.133:0/573544542 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc000c84d0 0x7efc000ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.690+0000 7efc04c00640 1 --2- 172.21.15.133:0/573544542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc000c8070 0x7efc000c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.690+0000 7efc04c00640 1 --2- 172.21.15.133:0/573544542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe4003970 0x7efc001f1e80 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:01.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.690+0000 7efc04c00640 1 -- 172.21.15.133:0/573544542 >> 172.21.15.133:0/573544542 conn(0x7efc00071a40 msgr2=0x7efc000c91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:01.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.690+0000 7efc04c00640 1 -- 172.21.15.133:0/573544542 shutdown_connections 2024-03-30T01:53:01.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:01.690+0000 7efc04c00640 1 -- 172.21.15.133:0/573544542 wait complete. 2024-03-30T01:53:01.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:53:01.712 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/file_on_fs_0) 2024-03-30T01:53:01.766 INFO:teuthology.orchestra.run.smithi133.stdout:0 2024-03-30T01:53:01.766 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-30T01:53:01.767 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-30T01:53:01.888 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-30T01:53:02.005 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-30T01:53:02.005 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:53:02.005 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:53:02.061 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:53:02.061 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:53:02.115 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:53:02.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.319+0000 7f174b400640 1 Processor -- start 2024-03-30T01:53:02.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.319+0000 7f174b400640 1 -- start start 2024-03-30T01:53:02.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.321+0000 7f174b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f17441457b0 0x7f17440b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:02.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.321+0000 7f174b400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1744145d30 0x7f1744070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:02.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.321+0000 7f174b400640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17440b28d0 con 0x7f1744070a40 2024-03-30T01:53:02.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.321+0000 7f174b400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1744070ed0 con 0x7f1744145d30 2024-03-30T01:53:02.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.321+0000 7f174b400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1744145b90 con 0x7f17441457b0 2024-03-30T01:53:02.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.321+0000 7f173be00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1744145d30 0x7f1744070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:02.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.321+0000 7f1749400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1744070a40 0x7f1744160620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35178/0 (socket says 172.21.15.133:35178) 2024-03-30T01:53:02.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.322+0000 7f1749400640 1 -- 172.21.15.133:0/2887201141 learned_addr learned my addr 172.21.15.133:0/2887201141 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:02.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.322+0000 7f1748a00640 1 --2- 172.21.15.133:0/2887201141 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f17441457b0 0x7f17440b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:02.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.322+0000 7f173be00640 1 -- 172.21.15.133:0/2887201141 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f17441457b0 msgr2=0x7f17440b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:02.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.322+0000 7f173be00640 1 --2- 172.21.15.133:0/2887201141 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f17441457b0 0x7f17440b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:02.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.322+0000 7f173be00640 1 -- 172.21.15.133:0/2887201141 >> v1:172.21.15.133:6789/0 conn(0x7f1744070a40 legacy=0x7f1744160620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:02.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.322+0000 7f173be00640 1 -- 172.21.15.133:0/2887201141 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174406c320 con 0x7f1744145d30 2024-03-30T01:53:02.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.322+0000 7f1743e00640 1 -- 172.21.15.133:0/2887201141 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065142219 0 0) 0x7f17440b28d0 con 0x7f1744070a40 2024-03-30T01:53:02.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.323+0000 7f173be00640 1 --2- 172.21.15.133:0/2887201141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1744145d30 0x7f1744070500 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f172c0097d0 tx=0x7f172c02b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618b862b97feb760 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:02.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.324+0000 7f1743e00640 1 -- 172.21.15.133:0/2887201141 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c031800 con 0x7f1744145d30 2024-03-30T01:53:02.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.324+0000 7f1743e00640 1 -- 172.21.15.133:0/2887201141 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172c031960 con 0x7f1744145d30 2024-03-30T01:53:02.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.324+0000 7f1743e00640 1 -- 172.21.15.133:0/2887201141 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c031cf0 con 0x7f1744145d30 2024-03-30T01:53:02.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.324+0000 7f174b400640 1 -- 172.21.15.133:0/2887201141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1744145d30 msgr2=0x7f1744070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:02.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.324+0000 7f174b400640 1 --2- 172.21.15.133:0/2887201141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1744145d30 0x7f1744070500 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f172c0097d0 tx=0x7f172c02b8a0 comp rx=0 tx=0).stop 2024-03-30T01:53:02.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.324+0000 7f174b400640 1 -- 172.21.15.133:0/2887201141 shutdown_connections 2024-03-30T01:53:02.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.324+0000 7f174b400640 1 --2- 172.21.15.133:0/2887201141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1744145d30 0x7f1744070500 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:02.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.324+0000 7f174b400640 1 --2- 172.21.15.133:0/2887201141 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f17441457b0 0x7f17440b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:02.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.324+0000 7f174b400640 1 -- 172.21.15.133:0/2887201141 >> 172.21.15.133:0/2887201141 conn(0x7f17440b07a0 msgr2=0x7f17440b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:02.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.324+0000 7f174b400640 1 -- 172.21.15.133:0/2887201141 shutdown_connections 2024-03-30T01:53:02.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.324+0000 7f174b400640 1 -- 172.21.15.133:0/2887201141 wait complete. 2024-03-30T01:53:02.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.326+0000 7f174b400640 1 Processor -- start 2024-03-30T01:53:02.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.326+0000 7f174b400640 1 -- start start 2024-03-30T01:53:02.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.327+0000 7f174b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1744070a40 0x7f174413cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:02.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.327+0000 7f174b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17441457b0 0x7f17440cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:02.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.327+0000 7f174b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1744145d30 0x7f17440aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:02.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.327+0000 7f174b400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17441f2160 con 0x7f17441457b0 2024-03-30T01:53:02.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.327+0000 7f174b400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17440cbdd0 con 0x7f1744145d30 2024-03-30T01:53:02.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.327+0000 7f174b400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17440cc670 con 0x7f1744070a40 2024-03-30T01:53:02.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.327+0000 7f173be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17441457b0 0x7f17440cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:02.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.327+0000 7f173be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17441457b0 0x7f17440cdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36298/0 (socket says 172.21.15.133:36298) 2024-03-30T01:53:02.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.327+0000 7f173be00640 1 -- 172.21.15.133:0/4028597535 learned_addr learned my addr 172.21.15.133:0/4028597535 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:02.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.328+0000 7f1748a00640 1 --2- 172.21.15.133:0/4028597535 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1744070a40 0x7f174413cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:02.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.328+0000 7f1749400640 1 --2- 172.21.15.133:0/4028597535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1744145d30 0x7f17440aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:02.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.328+0000 7f173be00640 1 -- 172.21.15.133:0/4028597535 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1744070a40 msgr2=0x7f174413cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:02.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.328+0000 7f173be00640 1 --2- 172.21.15.133:0/4028597535 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1744070a40 0x7f174413cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:02.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.328+0000 7f173be00640 1 -- 172.21.15.133:0/4028597535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1744145d30 msgr2=0x7f17440aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:02.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.328+0000 7f173be00640 1 --2- 172.21.15.133:0/4028597535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1744145d30 0x7f17440aed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:02.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.328+0000 7f173be00640 1 -- 172.21.15.133:0/4028597535 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172c009400 con 0x7f17441457b0 2024-03-30T01:53:02.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.328+0000 7f173be00640 1 --2- 172.21.15.133:0/4028597535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17441457b0 0x7f17440cdc30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f172c009720 tx=0x7f172c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:02.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.329+0000 7f1741600640 1 -- 172.21.15.133:0/4028597535 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c03cc00 con 0x7f17441457b0 2024-03-30T01:53:02.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.329+0000 7f1741600640 1 -- 172.21.15.133:0/4028597535 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172c03cd60 con 0x7f17441457b0 2024-03-30T01:53:02.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.329+0000 7f1741600640 1 -- 172.21.15.133:0/4028597535 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c004250 con 0x7f17441457b0 2024-03-30T01:53:02.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.329+0000 7f174b400640 1 -- 172.21.15.133:0/4028597535 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17440cd8c0 con 0x7f17441457b0 2024-03-30T01:53:02.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.329+0000 7f174b400640 1 -- 172.21.15.133:0/4028597535 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17440cc300 con 0x7f17441457b0 2024-03-30T01:53:02.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.330+0000 7f174b400640 1 -- 172.21.15.133:0/4028597535 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1744066d80 con 0x7f17441457b0 2024-03-30T01:53:02.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.331+0000 7f1741600640 1 -- 172.21.15.133:0/4028597535 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f172c0043b0 con 0x7f17441457b0 2024-03-30T01:53:02.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.332+0000 7f1741600640 1 --2- 172.21.15.133:0/4028597535 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f172006ac00 0x7f172006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:02.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.332+0000 7f1741600640 1 -- 172.21.15.133:0/4028597535 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f172c02e070 con 0x7f17441457b0 2024-03-30T01:53:02.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.332+0000 7f1748a00640 1 --2- 172.21.15.133:0/4028597535 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f172006ac00 0x7f172006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:02.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.333+0000 7f1748a00640 1 --2- 172.21.15.133:0/4028597535 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f172006ac00 0x7f172006d0c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1734006fd0 tx=0x7f1734008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:02.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.336+0000 7f1741600640 1 -- 172.21.15.133:0/4028597535 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f172c076e40 con 0x7f17441457b0 2024-03-30T01:53:02.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.531+0000 7f174b400640 1 -- 172.21.15.133:0/4028597535 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17440b19f0 con 0x7f17441457b0 2024-03-30T01:53:02.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.534+0000 7f1741600640 1 -- 172.21.15.133:0/4028597535 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16278 (secure 0 0 0) 0x7f172c035020 con 0x7f17441457b0 2024-03-30T01:53:02.542 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:53:02.542 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":36,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:52:55.753199+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:52:43.357481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-30T01:52:44.221573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6836/665764657":"2024-03-31T01:52:54.232727+0000","172.21.15.133:6834/665764657":"2024-03-31T01:52:54.232727+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:53:02.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.538+0000 7f174b400640 1 -- 172.21.15.133:0/4028597535 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f172006ac00 msgr2=0x7f172006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:02.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.538+0000 7f174b400640 1 --2- 172.21.15.133:0/4028597535 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f172006ac00 0x7f172006d0c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1734006fd0 tx=0x7f1734008040 comp rx=0 tx=0).stop 2024-03-30T01:53:02.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.538+0000 7f174b400640 1 -- 172.21.15.133:0/4028597535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17441457b0 msgr2=0x7f17440cdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:02.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.538+0000 7f174b400640 1 --2- 172.21.15.133:0/4028597535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17441457b0 0x7f17440cdc30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f172c009720 tx=0x7f172c0046c0 comp rx=0 tx=0).stop 2024-03-30T01:53:02.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.538+0000 7f174b400640 1 -- 172.21.15.133:0/4028597535 shutdown_connections 2024-03-30T01:53:02.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.538+0000 7f174b400640 1 --2- 172.21.15.133:0/4028597535 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f172006ac00 0x7f172006d0c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:02.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.538+0000 7f174b400640 1 --2- 172.21.15.133:0/4028597535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1744145d30 0x7f17440aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:02.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.538+0000 7f174b400640 1 --2- 172.21.15.133:0/4028597535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17441457b0 0x7f17440cdc30 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:02.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.538+0000 7f174b400640 1 --2- 172.21.15.133:0/4028597535 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1744070a40 0x7f174413cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:02.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.538+0000 7f174b400640 1 -- 172.21.15.133:0/4028597535 >> 172.21.15.133:0/4028597535 conn(0x7f17440b07a0 msgr2=0x7f17440b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:02.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.538+0000 7f174b400640 1 -- 172.21.15.133:0/4028597535 shutdown_connections 2024-03-30T01:53:02.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.539+0000 7f174b400640 1 -- 172.21.15.133:0/4028597535 wait complete. 2024-03-30T01:53:02.563 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T01:51:21.771393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T01:52:43.357481+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T01:52:44.221573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T01:53:02.563 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T01:53:02.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.770+0000 7fef75c00640 1 Processor -- start 2024-03-30T01:53:02.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.770+0000 7fef75c00640 1 -- start start 2024-03-30T01:53:02.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.772+0000 7fef75c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fef7006e2e0 0x7fef70070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:02.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.772+0000 7fef75c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef70070a40 0x7fef7015d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:02.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.772+0000 7fef75c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef70070e90 con 0x7fef70143220 2024-03-30T01:53:02.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.772+0000 7fef75c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef700cc5c0 con 0x7fef7006e2e0 2024-03-30T01:53:02.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.772+0000 7fef75c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef700ce400 con 0x7fef70070a40 2024-03-30T01:53:02.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.772+0000 7fef66000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fef7006e2e0 0x7fef70070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:02.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.772+0000 7fef6f400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef70070a40 0x7fef7015d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:02.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.772+0000 7fef66000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fef7006e2e0 0x7fef70070500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.133:54440/0 (socket says 172.21.15.133:54440) 2024-03-30T01:53:02.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.772+0000 7fef66000640 1 -- 172.21.15.133:0/351018990 learned_addr learned my addr 172.21.15.133:0/351018990 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:02.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.773+0000 7fef66000640 1 -- 172.21.15.133:0/351018990 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef70070a40 msgr2=0x7fef7015d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:02.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.773+0000 7fef66000640 1 --2- 172.21.15.133:0/351018990 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef70070a40 0x7fef7015d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:02.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.773+0000 7fef66000640 1 -- 172.21.15.133:0/351018990 >> v1:172.21.15.137:6789/0 conn(0x7fef70143220 legacy=0x7fef700cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:02.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.773+0000 7fef66000640 1 -- 172.21.15.133:0/351018990 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7006d0e0 con 0x7fef7006e2e0 2024-03-30T01:53:02.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.775+0000 7fef66000640 1 --2- 172.21.15.133:0/351018990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef7006e2e0 0x7fef70070500 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fef58009870 tx=0x7fef5802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a96b87dc7f9dd636 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:02.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.775+0000 7fef6e000640 1 -- 172.21.15.133:0/351018990 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef58030840 con 0x7fef7006e2e0 2024-03-30T01:53:02.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.775+0000 7fef6e000640 1 -- 172.21.15.133:0/351018990 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef580309a0 con 0x7fef7006e2e0 2024-03-30T01:53:02.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.775+0000 7fef6e000640 1 -- 172.21.15.133:0/351018990 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef58030d30 con 0x7fef7006e2e0 2024-03-30T01:53:02.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.776+0000 7fef75c00640 1 -- 172.21.15.133:0/351018990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef7006e2e0 msgr2=0x7fef70070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:02.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.776+0000 7fef75c00640 1 --2- 172.21.15.133:0/351018990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef7006e2e0 0x7fef70070500 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fef58009870 tx=0x7fef5802b980 comp rx=0 tx=0).stop 2024-03-30T01:53:02.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.776+0000 7fef75c00640 1 -- 172.21.15.133:0/351018990 shutdown_connections 2024-03-30T01:53:02.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.776+0000 7fef75c00640 1 --2- 172.21.15.133:0/351018990 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef70070a40 0x7fef7015d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:02.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.776+0000 7fef75c00640 1 --2- 172.21.15.133:0/351018990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef7006e2e0 0x7fef70070500 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:02.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.776+0000 7fef75c00640 1 -- 172.21.15.133:0/351018990 >> 172.21.15.133:0/351018990 conn(0x7fef700b07a0 msgr2=0x7fef700b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:02.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.776+0000 7fef75c00640 1 -- 172.21.15.133:0/351018990 shutdown_connections 2024-03-30T01:53:02.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.776+0000 7fef75c00640 1 -- 172.21.15.133:0/351018990 wait complete. 2024-03-30T01:53:02.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.778+0000 7fef75c00640 1 Processor -- start 2024-03-30T01:53:02.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.778+0000 7fef75c00640 1 -- start start 2024-03-30T01:53:02.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.779+0000 7fef75c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef7006e2e0 0x7fef7013a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:02.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.779+0000 7fef75c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef70070a40 0x7fef70158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:02.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.779+0000 7fef75c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef70143220 0x7fef7015aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:02.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.779+0000 7fef75c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef701428b0 con 0x7fef70143220 2024-03-30T01:53:02.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.779+0000 7fef75c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef701e3600 con 0x7fef7006e2e0 2024-03-30T01:53:02.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.779+0000 7fef75c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7013a720 con 0x7fef70070a40 2024-03-30T01:53:02.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.779+0000 7fef6f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef70143220 0x7fef7015aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:02.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.779+0000 7fef6f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef70143220 0x7fef7015aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36300/0 (socket says 172.21.15.133:36300) 2024-03-30T01:53:02.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.779+0000 7fef6f400640 1 -- 172.21.15.133:0/3128992419 learned_addr learned my addr 172.21.15.133:0/3128992419 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:02.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.779+0000 7fef6ea00640 1 --2- 172.21.15.133:0/3128992419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef7006e2e0 0x7fef7013a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:02.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.780+0000 7fef66000640 1 --2- 172.21.15.133:0/3128992419 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef70070a40 0x7fef70158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:02.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.780+0000 7fef6f400640 1 -- 172.21.15.133:0/3128992419 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef70070a40 msgr2=0x7fef70158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:02.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.780+0000 7fef6f400640 1 --2- 172.21.15.133:0/3128992419 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef70070a40 0x7fef70158ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:02.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.780+0000 7fef6f400640 1 -- 172.21.15.133:0/3128992419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef7006e2e0 msgr2=0x7fef7013a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:02.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.780+0000 7fef6f400640 1 --2- 172.21.15.133:0/3128992419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef7006e2e0 0x7fef7013a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:02.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.780+0000 7fef6f400640 1 -- 172.21.15.133:0/3128992419 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef580094d0 con 0x7fef70143220 2024-03-30T01:53:02.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.780+0000 7fef6ea00640 1 --2- 172.21.15.133:0/3128992419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef7006e2e0 0x7fef7013a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:02.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.780+0000 7fef6f400640 1 --2- 172.21.15.133:0/3128992419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef70143220 0x7fef7015aff0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fef6800efc0 tx=0x7fef6800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:02.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.780+0000 7fef67400640 1 -- 172.21.15.133:0/3128992419 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef68014480 con 0x7fef70143220 2024-03-30T01:53:02.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.780+0000 7fef67400640 1 -- 172.21.15.133:0/3128992419 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6800f040 con 0x7fef70143220 2024-03-30T01:53:02.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.780+0000 7fef75c00640 1 -- 172.21.15.133:0/3128992419 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7013a950 con 0x7fef70143220 2024-03-30T01:53:02.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.780+0000 7fef67400640 1 -- 172.21.15.133:0/3128992419 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef68014820 con 0x7fef70143220 2024-03-30T01:53:02.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.780+0000 7fef75c00640 1 -- 172.21.15.133:0/3128992419 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7013af10 con 0x7fef70143220 2024-03-30T01:53:02.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.781+0000 7fef75c00640 1 -- 172.21.15.133:0/3128992419 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef701e3790 con 0x7fef70143220 2024-03-30T01:53:02.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.782+0000 7fef67400640 1 -- 172.21.15.133:0/3128992419 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fef68014980 con 0x7fef70143220 2024-03-30T01:53:02.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.783+0000 7fef67400640 1 --2- 172.21.15.133:0/3128992419 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fef4c06ac30 0x7fef4c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:02.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.783+0000 7fef67400640 1 -- 172.21.15.133:0/3128992419 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fef68089fe0 con 0x7fef70143220 2024-03-30T01:53:02.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.784+0000 7fef6ea00640 1 --2- 172.21.15.133:0/3128992419 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fef4c06ac30 0x7fef4c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:02.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.784+0000 7fef6ea00640 1 --2- 172.21.15.133:0/3128992419 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fef4c06ac30 0x7fef4c06d0f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fef70139f90 tx=0x7fef60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:02.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.788+0000 7fef67400640 1 -- 172.21.15.133:0/3128992419 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fef701e3790 con 0x7fef70143220 2024-03-30T01:53:02.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.983+0000 7fef75c00640 1 -- 172.21.15.133:0/3128992419 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef701e3740 con 0x7fef70143220 2024-03-30T01:53:02.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.984+0000 7fef67400640 1 -- 172.21.15.133:0/3128992419 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fef680180a0 con 0x7fef70143220 2024-03-30T01:53:02.990 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-03-30T01:53:02.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.987+0000 7fef75c00640 1 -- 172.21.15.133:0/3128992419 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fef4c06ac30 msgr2=0x7fef4c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:02.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.987+0000 7fef75c00640 1 --2- 172.21.15.133:0/3128992419 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fef4c06ac30 0x7fef4c06d0f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fef70139f90 tx=0x7fef60009040 comp rx=0 tx=0).stop 2024-03-30T01:53:02.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.987+0000 7fef75c00640 1 -- 172.21.15.133:0/3128992419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef70143220 msgr2=0x7fef7015aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:02.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.987+0000 7fef75c00640 1 --2- 172.21.15.133:0/3128992419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef70143220 0x7fef7015aff0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fef6800efc0 tx=0x7fef6800c490 comp rx=0 tx=0).stop 2024-03-30T01:53:02.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.987+0000 7fef75c00640 1 -- 172.21.15.133:0/3128992419 shutdown_connections 2024-03-30T01:53:02.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.987+0000 7fef75c00640 1 --2- 172.21.15.133:0/3128992419 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fef4c06ac30 0x7fef4c06d0f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:02.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.987+0000 7fef75c00640 1 --2- 172.21.15.133:0/3128992419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef70143220 0x7fef7015aff0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:02.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.987+0000 7fef75c00640 1 --2- 172.21.15.133:0/3128992419 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef70070a40 0x7fef70158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:02.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.987+0000 7fef75c00640 1 --2- 172.21.15.133:0/3128992419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef7006e2e0 0x7fef7013a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:02.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.987+0000 7fef75c00640 1 -- 172.21.15.133:0/3128992419 >> 172.21.15.133:0/3128992419 conn(0x7fef700b07a0 msgr2=0x7fef7013d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:02.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.987+0000 7fef75c00640 1 -- 172.21.15.133:0/3128992419 shutdown_connections 2024-03-30T01:53:02.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:02.987+0000 7fef75c00640 1 -- 172.21.15.133:0/3128992419 wait complete. 2024-03-30T01:53:03.014 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T01:53:03.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.217+0000 7f9b23600640 1 Processor -- start 2024-03-30T01:53:03.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.218+0000 7f9b23600640 1 -- start start 2024-03-30T01:53:03.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.219+0000 7f9b23600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9b1c15cc50 0x7f9b1c0d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:03.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.219+0000 7f9b23600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9b1c0cfb80 0x7f9b1c0b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:03.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.219+0000 7f9b23600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1c15d030 con 0x7f9b1c0d2240 2024-03-30T01:53:03.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.219+0000 7f9b23600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1c0d1c50 con 0x7f9b1c15cc50 2024-03-30T01:53:03.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.219+0000 7f9b23600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1c0b5af0 con 0x7f9b1c0cfb80 2024-03-30T01:53:03.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.220+0000 7f9b20c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9b1c15cc50 0x7f9b1c0d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:03.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.220+0000 7f9b20c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9b1c15cc50 0x7f9b1c0d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36306/0 (socket says 172.21.15.133:36306) 2024-03-30T01:53:03.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.220+0000 7f9b20c00640 1 -- 172.21.15.133:0/2255949834 learned_addr learned my addr 172.21.15.133:0/2255949834 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:03.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.220+0000 7f9b20c00640 1 -- 172.21.15.133:0/2255949834 >> v2:172.21.15.137:3300/0 conn(0x7f9b1c0cfb80 msgr2=0x7f9b1c0b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:03.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.220+0000 7f9b20c00640 1 --2- 172.21.15.133:0/2255949834 >> v2:172.21.15.137:3300/0 conn(0x7f9b1c0cfb80 0x7f9b1c0b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:03.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.220+0000 7f9b20c00640 1 -- 172.21.15.133:0/2255949834 >> v1:172.21.15.133:6789/0 conn(0x7f9b1c0d2240 legacy=0x7f9b1c0cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:03.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.220+0000 7f9b20c00640 1 -- 172.21.15.133:0/2255949834 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c0d10d0 con 0x7f9b1c15cc50 2024-03-30T01:53:03.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.222+0000 7f9b20c00640 1 --2- 172.21.15.133:0/2255949834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c15cc50 0x7f9b1c0d0af0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c06bd10 tx=0x7f9b0c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3108d94433bd4f40 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:03.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.222+0000 7f9b1b400640 1 -- 172.21.15.133:0/2255949834 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c030860 con 0x7f9b1c15cc50 2024-03-30T01:53:03.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.222+0000 7f9b1b400640 1 -- 172.21.15.133:0/2255949834 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0c0309c0 con 0x7f9b1c15cc50 2024-03-30T01:53:03.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.222+0000 7f9b1b400640 1 -- 172.21.15.133:0/2255949834 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c030d50 con 0x7f9b1c15cc50 2024-03-30T01:53:03.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.223+0000 7f9b23600640 1 -- 172.21.15.133:0/2255949834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c15cc50 msgr2=0x7f9b1c0d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:03.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.223+0000 7f9b23600640 1 --2- 172.21.15.133:0/2255949834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c15cc50 0x7f9b1c0d0af0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c06bd10 tx=0x7f9b0c02b9a0 comp rx=0 tx=0).stop 2024-03-30T01:53:03.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.223+0000 7f9b23600640 1 -- 172.21.15.133:0/2255949834 shutdown_connections 2024-03-30T01:53:03.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.223+0000 7f9b23600640 1 --2- 172.21.15.133:0/2255949834 >> v2:172.21.15.137:3300/0 conn(0x7f9b1c0cfb80 0x7f9b1c0b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:03.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.223+0000 7f9b23600640 1 --2- 172.21.15.133:0/2255949834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c15cc50 0x7f9b1c0d0af0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:03.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.223+0000 7f9b23600640 1 -- 172.21.15.133:0/2255949834 >> 172.21.15.133:0/2255949834 conn(0x7f9b1c071a40 msgr2=0x7f9b1c06b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:03.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.223+0000 7f9b23600640 1 -- 172.21.15.133:0/2255949834 shutdown_connections 2024-03-30T01:53:03.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.223+0000 7f9b23600640 1 -- 172.21.15.133:0/2255949834 wait complete. 2024-03-30T01:53:03.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.225+0000 7f9b23600640 1 Processor -- start 2024-03-30T01:53:03.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.226+0000 7f9b23600640 1 -- start start 2024-03-30T01:53:03.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.227+0000 7f9b23600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b1c0cfb80 0x7f9b1c1f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:03.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.227+0000 7f9b23600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c0d2240 0x7f9b1c155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:03.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.227+0000 7f9b23600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c15cc50 0x7f9b1c158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:03.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.227+0000 7f9b23600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c1f5bf0 con 0x7f9b1c0d2240 2024-03-30T01:53:03.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.227+0000 7f9b23600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c153f40 con 0x7f9b1c15cc50 2024-03-30T01:53:03.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.227+0000 7f9b23600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c1541e0 con 0x7f9b1c0cfb80 2024-03-30T01:53:03.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.227+0000 7f9b1be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c0d2240 0x7f9b1c155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:03.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.227+0000 7f9b1be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c0d2240 0x7f9b1c155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36312/0 (socket says 172.21.15.133:36312) 2024-03-30T01:53:03.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.227+0000 7f9b1be00640 1 -- 172.21.15.133:0/1281891440 learned_addr learned my addr 172.21.15.133:0/1281891440 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:03.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.227+0000 7f9b21600640 1 --2- 172.21.15.133:0/1281891440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c15cc50 0x7f9b1c158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:03.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.228+0000 7f9b20c00640 1 --2- 172.21.15.133:0/1281891440 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b1c0cfb80 0x7f9b1c1f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:03.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.228+0000 7f9b1be00640 1 -- 172.21.15.133:0/1281891440 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b1c0cfb80 msgr2=0x7f9b1c1f56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:03.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.228+0000 7f9b1be00640 1 --2- 172.21.15.133:0/1281891440 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b1c0cfb80 0x7f9b1c1f56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:03.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.228+0000 7f9b1be00640 1 -- 172.21.15.133:0/1281891440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c15cc50 msgr2=0x7f9b1c158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:03.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.228+0000 7f9b1be00640 1 --2- 172.21.15.133:0/1281891440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c15cc50 0x7f9b1c158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:03.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.228+0000 7f9b1be00640 1 -- 172.21.15.133:0/1281891440 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0c0094d0 con 0x7f9b1c0d2240 2024-03-30T01:53:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.228+0000 7f9b1be00640 1 --2- 172.21.15.133:0/1281891440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c0d2240 0x7f9b1c155280 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800c4d0 tx=0x7f9b0800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.228+0000 7f9b18c00640 1 -- 172.21.15.133:0/1281891440 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b080052d0 con 0x7f9b1c0d2240 2024-03-30T01:53:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.228+0000 7f9b18c00640 1 -- 172.21.15.133:0/1281891440 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b08005430 con 0x7f9b1c0d2240 2024-03-30T01:53:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.228+0000 7f9b23600640 1 -- 172.21.15.133:0/1281891440 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1c1544c0 con 0x7f9b1c0d2240 2024-03-30T01:53:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.228+0000 7f9b18c00640 1 -- 172.21.15.133:0/1281891440 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b08012850 con 0x7f9b1c0d2240 2024-03-30T01:53:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.228+0000 7f9b23600640 1 -- 172.21.15.133:0/1281891440 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1c154a80 con 0x7f9b1c0d2240 2024-03-30T01:53:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.229+0000 7f9b23600640 1 -- 172.21.15.133:0/1281891440 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b1c0d0df0 con 0x7f9b1c0d2240 2024-03-30T01:53:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.230+0000 7f9b18c00640 1 -- 172.21.15.133:0/1281891440 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9b080129b0 con 0x7f9b1c0d2240 2024-03-30T01:53:03.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.231+0000 7f9b18c00640 1 --2- 172.21.15.133:0/1281891440 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9afc06ac00 0x7f9afc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:03.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.231+0000 7f9b18c00640 1 -- 172.21.15.133:0/1281891440 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9b08088ec0 con 0x7f9b1c0d2240 2024-03-30T01:53:03.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.232+0000 7f9b20c00640 1 --2- 172.21.15.133:0/1281891440 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9afc06ac00 0x7f9afc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:03.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.232+0000 7f9b20c00640 1 --2- 172.21.15.133:0/1281891440 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9afc06ac00 0x7f9afc06d0c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c036000 tx=0x7f9b0c03b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:03.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.236+0000 7f9b18c00640 1 -- 172.21.15.133:0/1281891440 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f9b08054030 con 0x7f9b1c0d2240 2024-03-30T01:53:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.432+0000 7f9b23600640 1 -- 172.21.15.133:0/1281891440 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9b1c066d80 con 0x7f9b1c0d2240 2024-03-30T01:53:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.433+0000 7f9b18c00640 1 -- 172.21.15.133:0/1281891440 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9b08057650 con 0x7f9b1c0d2240 2024-03-30T01:53:03.439 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-03-30T01:53:03.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.436+0000 7f9b23600640 1 -- 172.21.15.133:0/1281891440 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9afc06ac00 msgr2=0x7f9afc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:03.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.436+0000 7f9b23600640 1 --2- 172.21.15.133:0/1281891440 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9afc06ac00 0x7f9afc06d0c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c036000 tx=0x7f9b0c03b040 comp rx=0 tx=0).stop 2024-03-30T01:53:03.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.436+0000 7f9b23600640 1 -- 172.21.15.133:0/1281891440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c0d2240 msgr2=0x7f9b1c155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.436+0000 7f9b23600640 1 --2- 172.21.15.133:0/1281891440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c0d2240 0x7f9b1c155280 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800c4d0 tx=0x7f9b0800c990 comp rx=0 tx=0).stop 2024-03-30T01:53:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.436+0000 7f9b23600640 1 -- 172.21.15.133:0/1281891440 shutdown_connections 2024-03-30T01:53:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.436+0000 7f9b23600640 1 --2- 172.21.15.133:0/1281891440 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f9afc06ac00 0x7f9afc06d0c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.436+0000 7f9b23600640 1 --2- 172.21.15.133:0/1281891440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c15cc50 0x7f9b1c158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.436+0000 7f9b23600640 1 --2- 172.21.15.133:0/1281891440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c0d2240 0x7f9b1c155280 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.436+0000 7f9b23600640 1 --2- 172.21.15.133:0/1281891440 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b1c0cfb80 0x7f9b1c1f56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.436+0000 7f9b23600640 1 -- 172.21.15.133:0/1281891440 >> 172.21.15.133:0/1281891440 conn(0x7f9b1c071a40 msgr2=0x7f9b1c072ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.436+0000 7f9b23600640 1 -- 172.21.15.133:0/1281891440 shutdown_connections 2024-03-30T01:53:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.436+0000 7f9b23600640 1 -- 172.21.15.133:0/1281891440 wait complete. 2024-03-30T01:53:03.461 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T01:53:03.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.664+0000 7fd2d8600640 1 Processor -- start 2024-03-30T01:53:03.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.665+0000 7fd2d8600640 1 -- start start 2024-03-30T01:53:03.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.666+0000 7fd2d8600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2d015ae70 0x7fd2d00cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:03.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.666+0000 7fd2d8600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd2d00cf670 0x7fd2d00ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:03.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.666+0000 7fd2d8600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d00ccf00 con 0x7fd2d00ce570 2024-03-30T01:53:03.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.666+0000 7fd2d8600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d00cb920 con 0x7fd2d00cf670 2024-03-30T01:53:03.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.666+0000 7fd2d8600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d00cbc00 con 0x7fd2d015ae70 2024-03-30T01:53:03.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.667+0000 7fd2d5200640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd2d00ce570 0x7fd2d00cef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35192/0 (socket says 172.21.15.133:35192) 2024-03-30T01:53:03.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.667+0000 7fd2d5200640 1 -- 172.21.15.133:0/2804077369 learned_addr learned my addr 172.21.15.133:0/2804077369 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:03.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.667+0000 7fd2d6600640 1 --2- 172.21.15.133:0/2804077369 >> v2:172.21.15.137:3300/0 conn(0x7fd2d00cf670 0x7fd2d00ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:03.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.667+0000 7fd2d5c00640 1 --2- 172.21.15.133:0/2804077369 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2d015ae70 0x7fd2d00cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:03.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.667+0000 7fd2cfe00640 1 -- 172.21.15.133:0/2804077369 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3638208905 0 0) 0x7fd2d00ccf00 con 0x7fd2d00ce570 2024-03-30T01:53:03.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.667+0000 7fd2cfe00640 1 -- 172.21.15.133:0/2804077369 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2b4003520 con 0x7fd2d00ce570 2024-03-30T01:53:03.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.667+0000 7fd2cfe00640 1 -- 172.21.15.133:0/2804077369 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4172922183 0 0) 0x7fd2b4003520 con 0x7fd2d00ce570 2024-03-30T01:53:03.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.667+0000 7fd2cfe00640 1 -- 172.21.15.133:0/2804077369 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2d015ae70 msgr2=0x7fd2d00cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:03.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.667+0000 7fd2cfe00640 1 --2- 172.21.15.133:0/2804077369 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2d015ae70 0x7fd2d00cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:03.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.667+0000 7fd2cfe00640 1 -- 172.21.15.133:0/2804077369 >> v2:172.21.15.137:3300/0 conn(0x7fd2d00cf670 msgr2=0x7fd2d00ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:03.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.667+0000 7fd2cfe00640 1 --2- 172.21.15.133:0/2804077369 >> v2:172.21.15.137:3300/0 conn(0x7fd2d00cf670 0x7fd2d00ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:03.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.667+0000 7fd2cfe00640 1 -- 172.21.15.133:0/2804077369 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d00cbee0 con 0x7fd2d00ce570 2024-03-30T01:53:03.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.667+0000 7fd2cfe00640 1 -- 172.21.15.133:0/2804077369 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fd2bc001670 con 0x7fd2d00ce570 2024-03-30T01:53:03.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.667+0000 7fd2cfe00640 1 -- 172.21.15.133:0/2804077369 >> v1:172.21.15.133:6789/0 conn(0x7fd2d00ce570 legacy=0x7fd2d00cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:03.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.668+0000 7fd2cfe00640 1 --2- 172.21.15.133:0/2804077369 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2b4003970 0x7fd2b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:03.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.668+0000 7fd2cfe00640 1 --2- 172.21.15.133:0/2804077369 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2d015ae70 0x7fd2b40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:03.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.668+0000 7fd2cfe00640 1 --2- 172.21.15.133:0/2804077369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2b4004d00 0x7fd2b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:03.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.668+0000 7fd2cfe00640 1 -- 172.21.15.133:0/2804077369 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d00cb920 con 0x7fd2b4003970 2024-03-30T01:53:03.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.668+0000 7fd2cfe00640 1 -- 172.21.15.133:0/2804077369 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d00cbc00 con 0x7fd2b4004d00 2024-03-30T01:53:03.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.668+0000 7fd2cfe00640 1 -- 172.21.15.133:0/2804077369 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b400b980 con 0x7fd2d015ae70 2024-03-30T01:53:03.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.668+0000 7fd2d5c00640 1 --2- 172.21.15.133:0/2804077369 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2b4003970 0x7fd2b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:03.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.668+0000 7fd2d5200640 1 --2- 172.21.15.133:0/2804077369 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2d015ae70 0x7fd2b40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:03.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.668+0000 7fd2d5c00640 1 -- 172.21.15.133:0/2804077369 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2d015ae70 msgr2=0x7fd2b40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:03.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.668+0000 7fd2d5c00640 1 --2- 172.21.15.133:0/2804077369 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2d015ae70 0x7fd2b40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:03.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.668+0000 7fd2d5c00640 1 -- 172.21.15.133:0/2804077369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2b4004d00 msgr2=0x7fd2b4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:03.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.668+0000 7fd2d5c00640 1 --2- 172.21.15.133:0/2804077369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2b4004d00 0x7fd2b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:03.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.668+0000 7fd2d5c00640 1 -- 172.21.15.133:0/2804077369 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b4003520 con 0x7fd2b4003970 2024-03-30T01:53:03.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.669+0000 7fd2d5c00640 1 --2- 172.21.15.133:0/2804077369 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2b4003970 0x7fd2b4003d90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0009ac0 tx=0x7fd2b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7368ce43fe01e9d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:03.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.670+0000 7fd2cfe00640 1 -- 172.21.15.133:0/2804077369 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c002c6b0 con 0x7fd2b4003970 2024-03-30T01:53:03.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.670+0000 7fd2cfe00640 1 -- 172.21.15.133:0/2804077369 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c002c810 con 0x7fd2b4003970 2024-03-30T01:53:03.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.670+0000 7fd2cfe00640 1 -- 172.21.15.133:0/2804077369 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c002cba0 con 0x7fd2b4003970 2024-03-30T01:53:03.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.670+0000 7fd2d8600640 1 -- 172.21.15.133:0/2804077369 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2b4003970 msgr2=0x7fd2b4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:03.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.670+0000 7fd2d8600640 1 --2- 172.21.15.133:0/2804077369 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2b4003970 0x7fd2b4003d90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0009ac0 tx=0x7fd2b40057f0 comp rx=0 tx=0).stop 2024-03-30T01:53:03.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.670+0000 7fd2d6600640 1 -- 172.21.15.133:0/2804077369 reap_dead start 2024-03-30T01:53:03.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.670+0000 7fd2d8600640 1 -- 172.21.15.133:0/2804077369 shutdown_connections 2024-03-30T01:53:03.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.671+0000 7fd2d8600640 1 -- 172.21.15.133:0/2804077369 >> 172.21.15.133:0/2804077369 conn(0x7fd2d00d09a0 msgr2=0x7fd2d00d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:03.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.671+0000 7fd2d8600640 1 -- 172.21.15.133:0/2804077369 shutdown_connections 2024-03-30T01:53:03.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.671+0000 7fd2d8600640 1 -- 172.21.15.133:0/2804077369 wait complete. 2024-03-30T01:53:03.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.672+0000 7fd2d8600640 1 Processor -- start 2024-03-30T01:53:03.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.672+0000 7fd2d8600640 1 -- start start 2024-03-30T01:53:03.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.673+0000 7fd2d8600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2b4003970 0x7fd2d01534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:03.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.673+0000 7fd2d8600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2d00ca5e0 0x7fd2d0157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:03.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.673+0000 7fd2d8600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2d00b3fd0 0x7fd2d00b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:03.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.673+0000 7fd2d8600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d01584f0 con 0x7fd2b4003970 2024-03-30T01:53:03.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.673+0000 7fd2d8600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d0157b20 con 0x7fd2d00b3fd0 2024-03-30T01:53:03.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.673+0000 7fd2d8600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d00b48d0 con 0x7fd2d00ca5e0 2024-03-30T01:53:03.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.674+0000 7fd2d5c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2b4003970 0x7fd2d01534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:03.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.674+0000 7fd2d5c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2b4003970 0x7fd2d01534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36322/0 (socket says 172.21.15.133:36322) 2024-03-30T01:53:03.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.674+0000 7fd2d5c00640 1 -- 172.21.15.133:0/3283430012 learned_addr learned my addr 172.21.15.133:0/3283430012 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:03.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.674+0000 7fd2d5c00640 1 -- 172.21.15.133:0/3283430012 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2d00ca5e0 msgr2=0x7fd2d0157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:03.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.674+0000 7fd2d5c00640 1 --2- 172.21.15.133:0/3283430012 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2d00ca5e0 0x7fd2d0157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:03.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.674+0000 7fd2d5c00640 1 -- 172.21.15.133:0/3283430012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2d00b3fd0 msgr2=0x7fd2d00b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:03.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.674+0000 7fd2d5c00640 1 --2- 172.21.15.133:0/3283430012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2d00b3fd0 0x7fd2d00b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:03.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.674+0000 7fd2d5c00640 1 -- 172.21.15.133:0/3283430012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d01571f0 con 0x7fd2b4003970 2024-03-30T01:53:03.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.674+0000 7fd2d5c00640 1 --2- 172.21.15.133:0/3283430012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2b4003970 0x7fd2d01534b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0037040 tx=0x7fd2c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:03.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.675+0000 7fd2cd600640 1 -- 172.21.15.133:0/3283430012 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0003810 con 0x7fd2b4003970 2024-03-30T01:53:03.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.675+0000 7fd2cd600640 1 -- 172.21.15.133:0/3283430012 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c0003970 con 0x7fd2b4003970 2024-03-30T01:53:03.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.675+0000 7fd2cd600640 1 -- 172.21.15.133:0/3283430012 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0003d20 con 0x7fd2b4003970 2024-03-30T01:53:03.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.675+0000 7fd2d8600640 1 -- 172.21.15.133:0/3283430012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d01574d0 con 0x7fd2b4003970 2024-03-30T01:53:03.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.675+0000 7fd2d8600640 1 -- 172.21.15.133:0/3283430012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d00b4480 con 0x7fd2b4003970 2024-03-30T01:53:03.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.676+0000 7fd2d8600640 1 -- 172.21.15.133:0/3283430012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d0066d80 con 0x7fd2b4003970 2024-03-30T01:53:03.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.677+0000 7fd2cd600640 1 -- 172.21.15.133:0/3283430012 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd2c0034440 con 0x7fd2b4003970 2024-03-30T01:53:03.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.678+0000 7fd2cd600640 1 --2- 172.21.15.133:0/3283430012 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd2b006ac30 0x7fd2b006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:03.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.678+0000 7fd2cd600640 1 -- 172.21.15.133:0/3283430012 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd2c00ab1b0 con 0x7fd2b4003970 2024-03-30T01:53:03.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.679+0000 7fd2d5200640 1 --2- 172.21.15.133:0/3283430012 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd2b006ac30 0x7fd2b006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:03.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.679+0000 7fd2d5200640 1 --2- 172.21.15.133:0/3283430012 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd2b006ac30 0x7fd2b006d0f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc000f60 tx=0x7fd2bc000ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:03.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.683+0000 7fd2cd600640 1 -- 172.21.15.133:0/3283430012 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fd2c0076470 con 0x7fd2b4003970 2024-03-30T01:53:03.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.879+0000 7fd2d8600640 1 -- 172.21.15.133:0/3283430012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd2d00b6920 con 0x7fd2b4003970 2024-03-30T01:53:03.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.880+0000 7fd2cd600640 1 -- 172.21.15.133:0/3283430012 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd2c00044e0 con 0x7fd2b4003970 2024-03-30T01:53:03.887 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-03-30T01:53:03.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.883+0000 7fd2d8600640 1 -- 172.21.15.133:0/3283430012 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd2b006ac30 msgr2=0x7fd2b006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:03.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.883+0000 7fd2d8600640 1 --2- 172.21.15.133:0/3283430012 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd2b006ac30 0x7fd2b006d0f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc000f60 tx=0x7fd2bc000ed0 comp rx=0 tx=0).stop 2024-03-30T01:53:03.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.883+0000 7fd2d8600640 1 -- 172.21.15.133:0/3283430012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2b4003970 msgr2=0x7fd2d01534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:03.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.883+0000 7fd2d8600640 1 --2- 172.21.15.133:0/3283430012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2b4003970 0x7fd2d01534b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0037040 tx=0x7fd2c0004730 comp rx=0 tx=0).stop 2024-03-30T01:53:03.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.883+0000 7fd2d8600640 1 -- 172.21.15.133:0/3283430012 shutdown_connections 2024-03-30T01:53:03.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.883+0000 7fd2d8600640 1 --2- 172.21.15.133:0/3283430012 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd2b006ac30 0x7fd2b006d0f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:03.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.883+0000 7fd2d8600640 1 --2- 172.21.15.133:0/3283430012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2d00b3fd0 0x7fd2d00b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:03.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.883+0000 7fd2d8600640 1 --2- 172.21.15.133:0/3283430012 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2d00ca5e0 0x7fd2d0157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:03.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.883+0000 7fd2d8600640 1 --2- 172.21.15.133:0/3283430012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2b4003970 0x7fd2d01534b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:03.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.883+0000 7fd2d8600640 1 -- 172.21.15.133:0/3283430012 >> 172.21.15.133:0/3283430012 conn(0x7fd2d00d09a0 msgr2=0x7fd2d00c4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:03.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.883+0000 7fd2d8600640 1 -- 172.21.15.133:0/3283430012 shutdown_connections 2024-03-30T01:53:03.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:03.883+0000 7fd2d8600640 1 -- 172.21.15.133:0/3283430012 wait complete. 2024-03-30T01:53:03.907 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T01:53:04.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.106+0000 7fa58a600640 1 Processor -- start 2024-03-30T01:53:04.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.107+0000 7fa58a600640 1 -- start start 2024-03-30T01:53:04.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.108+0000 7fa58a600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5841457b0 0x7fa5840b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:04.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.108+0000 7fa58a600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa584145d30 0x7fa584070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:04.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.108+0000 7fa58a600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5840b28d0 con 0x7fa584070a40 2024-03-30T01:53:04.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.108+0000 7fa58a600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa584070ed0 con 0x7fa5841457b0 2024-03-30T01:53:04.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.108+0000 7fa58a600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa584145b90 con 0x7fa584145d30 2024-03-30T01:53:04.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.109+0000 7fa583400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5841457b0 0x7fa5840b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:04.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.109+0000 7fa583400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5841457b0 0x7fa5840b3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36330/0 (socket says 172.21.15.133:36330) 2024-03-30T01:53:04.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.109+0000 7fa583400640 1 -- 172.21.15.133:0/183065969 learned_addr learned my addr 172.21.15.133:0/183065969 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:04.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.109+0000 7fa57aa00640 1 --2- 172.21.15.133:0/183065969 >> v2:172.21.15.137:3300/0 conn(0x7fa584145d30 0x7fa584070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:04.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.109+0000 7fa583400640 1 -- 172.21.15.133:0/183065969 >> v2:172.21.15.137:3300/0 conn(0x7fa584145d30 msgr2=0x7fa584070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:04.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.109+0000 7fa583400640 1 --2- 172.21.15.133:0/183065969 >> v2:172.21.15.137:3300/0 conn(0x7fa584145d30 0x7fa584070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:04.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.109+0000 7fa583400640 1 -- 172.21.15.133:0/183065969 >> v1:172.21.15.137:6789/0 conn(0x7fa584070a40 legacy=0x7fa584160620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:04.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.109+0000 7fa583400640 1 -- 172.21.15.133:0/183065969 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58406c320 con 0x7fa5841457b0 2024-03-30T01:53:04.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.111+0000 7fa583400640 1 --2- 172.21.15.133:0/183065969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5841457b0 0x7fa5840b3850 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa5840717d0 tx=0x7fa57402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae0bc02a52be0b81 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.111+0000 7fa582a00640 1 -- 172.21.15.133:0/183065969 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574031870 con 0x7fa5841457b0 2024-03-30T01:53:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.111+0000 7fa582a00640 1 -- 172.21.15.133:0/183065969 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5740319d0 con 0x7fa5841457b0 2024-03-30T01:53:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.111+0000 7fa582a00640 1 -- 172.21.15.133:0/183065969 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574031d60 con 0x7fa5841457b0 2024-03-30T01:53:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.112+0000 7fa58a600640 1 -- 172.21.15.133:0/183065969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5841457b0 msgr2=0x7fa5840b3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.112+0000 7fa58a600640 1 --2- 172.21.15.133:0/183065969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5841457b0 0x7fa5840b3850 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa5840717d0 tx=0x7fa57402b910 comp rx=0 tx=0).stop 2024-03-30T01:53:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.112+0000 7fa58a600640 1 -- 172.21.15.133:0/183065969 shutdown_connections 2024-03-30T01:53:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.112+0000 7fa58a600640 1 --2- 172.21.15.133:0/183065969 >> v2:172.21.15.137:3300/0 conn(0x7fa584145d30 0x7fa584070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.112+0000 7fa58a600640 1 --2- 172.21.15.133:0/183065969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5841457b0 0x7fa5840b3850 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.112+0000 7fa58a600640 1 -- 172.21.15.133:0/183065969 >> 172.21.15.133:0/183065969 conn(0x7fa5840b07a0 msgr2=0x7fa5840b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.112+0000 7fa58a600640 1 -- 172.21.15.133:0/183065969 shutdown_connections 2024-03-30T01:53:04.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.112+0000 7fa58a600640 1 -- 172.21.15.133:0/183065969 wait complete. 2024-03-30T01:53:04.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.114+0000 7fa58a600640 1 Processor -- start 2024-03-30T01:53:04.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.114+0000 7fa58a600640 1 -- start start 2024-03-30T01:53:04.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.115+0000 7fa58a600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa584070a40 0x7fa58415c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:04.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.115+0000 7fa58a600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa5841457b0 0x7fa5840aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:04.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.115+0000 7fa58a600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa584145d30 0x7fa584141690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:04.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.115+0000 7fa58a600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa584141bd0 con 0x7fa584070a40 2024-03-30T01:53:04.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.115+0000 7fa58a600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5841446d0 con 0x7fa584145d30 2024-03-30T01:53:04.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.115+0000 7fa58a600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5841f3d80 con 0x7fa5841457b0 2024-03-30T01:53:04.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.115+0000 7fa583400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa584070a40 0x7fa58415c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:04.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.116+0000 7fa583400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa584070a40 0x7fa58415c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36338/0 (socket says 172.21.15.133:36338) 2024-03-30T01:53:04.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.116+0000 7fa583400640 1 -- 172.21.15.133:0/2100196755 learned_addr learned my addr 172.21.15.133:0/2100196755 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:04.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.116+0000 7fa57aa00640 1 --2- 172.21.15.133:0/2100196755 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa5841457b0 0x7fa5840aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:04.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.116+0000 7fa583400640 1 -- 172.21.15.133:0/2100196755 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa5841457b0 msgr2=0x7fa5840aef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:04.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.116+0000 7fa583400640 1 --2- 172.21.15.133:0/2100196755 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa5841457b0 0x7fa5840aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:04.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.116+0000 7fa583400640 1 -- 172.21.15.133:0/2100196755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa584145d30 msgr2=0x7fa584141690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:04.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.116+0000 7fa583400640 1 --2- 172.21.15.133:0/2100196755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa584145d30 0x7fa584141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:04.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.116+0000 7fa583400640 1 -- 172.21.15.133:0/2100196755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5740094d0 con 0x7fa584070a40 2024-03-30T01:53:04.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.116+0000 7fa583400640 1 --2- 172.21.15.133:0/2100196755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa584070a40 0x7fa58415c380 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa5740097f0 tx=0x7fa5740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:04.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.117+0000 7fa57be00640 1 -- 172.21.15.133:0/2100196755 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57403ac60 con 0x7fa584070a40 2024-03-30T01:53:04.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.117+0000 7fa57be00640 1 -- 172.21.15.133:0/2100196755 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57403adc0 con 0x7fa584070a40 2024-03-30T01:53:04.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.117+0000 7fa58a600640 1 -- 172.21.15.133:0/2100196755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5841443f0 con 0x7fa584070a40 2024-03-30T01:53:04.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.117+0000 7fa57be00640 1 -- 172.21.15.133:0/2100196755 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574044610 con 0x7fa584070a40 2024-03-30T01:53:04.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.117+0000 7fa58a600640 1 -- 172.21.15.133:0/2100196755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5841f4300 con 0x7fa584070a40 2024-03-30T01:53:04.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.118+0000 7fa58a600640 1 -- 172.21.15.133:0/2100196755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa584066d80 con 0x7fa584070a40 2024-03-30T01:53:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.119+0000 7fa57be00640 1 -- 172.21.15.133:0/2100196755 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fa57404d450 con 0x7fa584070a40 2024-03-30T01:53:04.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.120+0000 7fa57be00640 1 --2- 172.21.15.133:0/2100196755 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa56006ac50 0x7fa56006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:04.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.120+0000 7fa57be00640 1 -- 172.21.15.133:0/2100196755 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa57402d040 con 0x7fa584070a40 2024-03-30T01:53:04.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.120+0000 7fa57aa00640 1 --2- 172.21.15.133:0/2100196755 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa56006ac50 0x7fa56006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:04.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.121+0000 7fa57aa00640 1 --2- 172.21.15.133:0/2100196755 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa56006ac50 0x7fa56006d110 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa58413d840 tx=0x7fa56c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:04.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.125+0000 7fa57be00640 1 -- 172.21.15.133:0/2100196755 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fa574076bf0 con 0x7fa584070a40 2024-03-30T01:53:04.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.335+0000 7fa58a600640 1 -- 172.21.15.133:0/2100196755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa5841f44f0 con 0x7fa584070a40 2024-03-30T01:53:04.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.336+0000 7fa57be00640 1 -- 172.21.15.133:0/2100196755 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v36) v1 ==== 80+0+122 (secure 0 0 0) 0x7fa574035080 con 0x7fa584070a40 2024-03-30T01:53:04.342 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133:6836/665764657 2024-03-31T01:52:54.232727+0000 2024-03-30T01:53:04.342 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133:6834/665764657 2024-03-31T01:52:54.232727+0000 2024-03-30T01:53:04.342 INFO:teuthology.orchestra.run.smithi133.stderr:listed 2 entries 2024-03-30T01:53:04.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.339+0000 7fa58a600640 1 -- 172.21.15.133:0/2100196755 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa56006ac50 msgr2=0x7fa56006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:04.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.339+0000 7fa58a600640 1 --2- 172.21.15.133:0/2100196755 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa56006ac50 0x7fa56006d110 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa58413d840 tx=0x7fa56c008040 comp rx=0 tx=0).stop 2024-03-30T01:53:04.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.339+0000 7fa58a600640 1 -- 172.21.15.133:0/2100196755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa584070a40 msgr2=0x7fa58415c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:04.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.339+0000 7fa58a600640 1 --2- 172.21.15.133:0/2100196755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa584070a40 0x7fa58415c380 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa5740097f0 tx=0x7fa5740046c0 comp rx=0 tx=0).stop 2024-03-30T01:53:04.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.339+0000 7fa58a600640 1 -- 172.21.15.133:0/2100196755 shutdown_connections 2024-03-30T01:53:04.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.339+0000 7fa58a600640 1 --2- 172.21.15.133:0/2100196755 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa56006ac50 0x7fa56006d110 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:04.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.339+0000 7fa58a600640 1 --2- 172.21.15.133:0/2100196755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa584145d30 0x7fa584141690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:04.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.339+0000 7fa58a600640 1 --2- 172.21.15.133:0/2100196755 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa5841457b0 0x7fa5840aef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:04.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.339+0000 7fa58a600640 1 --2- 172.21.15.133:0/2100196755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa584070a40 0x7fa58415c380 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:04.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.339+0000 7fa58a600640 1 -- 172.21.15.133:0/2100196755 >> 172.21.15.133:0/2100196755 conn(0x7fa5840b07a0 msgr2=0x7fa5840b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:04.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.339+0000 7fa58a600640 1 -- 172.21.15.133:0/2100196755 shutdown_connections 2024-03-30T01:53:04.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.339+0000 7fa58a600640 1 -- 172.21.15.133:0/2100196755 wait complete. 2024-03-30T01:53:04.365 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-30T01:53:04.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:53:04.365 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-30T01:53:04.465 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2024-03-30T01:53:04.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:53:04.466 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-30T01:53:04.515 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:53:04.516 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:53:04.572 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053418,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249172k,nr_inodes=812293,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-30T01:53:04.572 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:53:04.572 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:53:04.626 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053418,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249172k,nr_inodes=812293,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-30T01:53:04.626 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:53:04.626 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:53:04.681 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053418,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249172k,nr_inodes=812293,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-30T01:53:04.681 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T01:53:04.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.893+0000 7f3f05000640 1 Processor -- start 2024-03-30T01:53:04.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.893+0000 7f3f05000640 1 -- start start 2024-03-30T01:53:04.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.894+0000 7f3f05000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3f00143790 0x7f3f000cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:04.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.894+0000 7f3f05000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3f00070500 0x7f3f00070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:04.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.894+0000 7f3f05000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f000cc530 0x7f3f000cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:04.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.895+0000 7f3f05000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f00070ed0 con 0x7f3f00070500 2024-03-30T01:53:04.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.895+0000 7f3f05000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f000a76a0 con 0x7f3f00143790 2024-03-30T01:53:04.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.895+0000 7f3f05000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f000b38e0 con 0x7f3f000cc530 2024-03-30T01:53:04.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.895+0000 7f3ef7e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3f00070500 0x7f3f00070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:04.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.895+0000 7f3ef7e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3f00070500 0x7f3f00070990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36348/0 (socket says 172.21.15.133:36348) 2024-03-30T01:53:04.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.895+0000 7f3ef7e00640 1 -- 172.21.15.133:0/1053135737 learned_addr learned my addr 172.21.15.133:0/1053135737 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:04.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.895+0000 7f3efde00640 1 --2- 172.21.15.133:0/1053135737 >> v2:172.21.15.137:3300/0 conn(0x7f3f00143790 0x7f3f000cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:04.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.895+0000 7f3efe800640 1 --2- 172.21.15.133:0/1053135737 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f000cc530 0x7f3f000cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:04.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.895+0000 7f3ef7e00640 1 -- 172.21.15.133:0/1053135737 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f000cc530 msgr2=0x7f3f000cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:04.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.895+0000 7f3ef7e00640 1 --2- 172.21.15.133:0/1053135737 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f000cc530 0x7f3f000cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:04.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.896+0000 7f3ef7e00640 1 -- 172.21.15.133:0/1053135737 >> v2:172.21.15.137:3300/0 conn(0x7f3f00143790 msgr2=0x7f3f000cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:04.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.896+0000 7f3ef7e00640 1 --2- 172.21.15.133:0/1053135737 >> v2:172.21.15.137:3300/0 conn(0x7f3f00143790 0x7f3f000cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:04.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.896+0000 7f3ef7e00640 1 -- 172.21.15.133:0/1053135737 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f000ccf00 con 0x7f3f00070500 2024-03-30T01:53:04.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.897+0000 7f3ef7e00640 1 --2- 172.21.15.133:0/1053135737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f00070500 0x7f3f00070990 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3f0006ea10 tx=0x7f3ee802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8007e8ab0e9233c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:04.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.897+0000 7f3efd400640 1 -- 172.21.15.133:0/1053135737 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8030860 con 0x7f3f00070500 2024-03-30T01:53:04.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.897+0000 7f3efd400640 1 -- 172.21.15.133:0/1053135737 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee80309c0 con 0x7f3f00070500 2024-03-30T01:53:04.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.897+0000 7f3efd400640 1 -- 172.21.15.133:0/1053135737 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8030d50 con 0x7f3f00070500 2024-03-30T01:53:04.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.898+0000 7f3f05000640 1 -- 172.21.15.133:0/1053135737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f00070500 msgr2=0x7f3f00070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:04.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.898+0000 7f3f05000640 1 --2- 172.21.15.133:0/1053135737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f00070500 0x7f3f00070990 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3f0006ea10 tx=0x7f3ee802b9a0 comp rx=0 tx=0).stop 2024-03-30T01:53:04.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.898+0000 7f3f05000640 1 -- 172.21.15.133:0/1053135737 shutdown_connections 2024-03-30T01:53:04.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.898+0000 7f3f05000640 1 --2- 172.21.15.133:0/1053135737 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f000cc530 0x7f3f000cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:04.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.898+0000 7f3f05000640 1 --2- 172.21.15.133:0/1053135737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f00070500 0x7f3f00070990 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:04.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.898+0000 7f3f05000640 1 --2- 172.21.15.133:0/1053135737 >> v2:172.21.15.137:3300/0 conn(0x7f3f00143790 0x7f3f000cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:04.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.898+0000 7f3f05000640 1 -- 172.21.15.133:0/1053135737 >> 172.21.15.133:0/1053135737 conn(0x7f3f000b07a0 msgr2=0x7f3f000b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:04.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.898+0000 7f3f05000640 1 -- 172.21.15.133:0/1053135737 shutdown_connections 2024-03-30T01:53:04.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.898+0000 7f3f05000640 1 -- 172.21.15.133:0/1053135737 wait complete. 2024-03-30T01:53:04.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.900+0000 7f3f05000640 1 Processor -- start 2024-03-30T01:53:04.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.900+0000 7f3f05000640 1 -- start start 2024-03-30T01:53:04.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.901+0000 7f3f05000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f00070500 0x7f3f001e8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:04.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.901+0000 7f3f05000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f000cc530 0x7f3f000c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:04.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.901+0000 7f3f05000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f00143790 0x7f3f000c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:04.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.901+0000 7f3f05000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0012bda0 con 0x7f3f00143790 2024-03-30T01:53:04.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.901+0000 7f3f05000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0012c320 con 0x7f3f00070500 2024-03-30T01:53:04.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.901+0000 7f3f05000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f000c4d00 con 0x7f3f000cc530 2024-03-30T01:53:04.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.901+0000 7f3efe800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f00143790 0x7f3f000c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:04.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.901+0000 7f3efe800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f00143790 0x7f3f000c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36362/0 (socket says 172.21.15.133:36362) 2024-03-30T01:53:04.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.902+0000 7f3efe800640 1 -- 172.21.15.133:0/2250819679 learned_addr learned my addr 172.21.15.133:0/2250819679 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:04.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.902+0000 7f3efde00640 1 --2- 172.21.15.133:0/2250819679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f00070500 0x7f3f001e8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:04.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.902+0000 7f3ef7e00640 1 --2- 172.21.15.133:0/2250819679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f000cc530 0x7f3f000c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:04.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.902+0000 7f3efe800640 1 -- 172.21.15.133:0/2250819679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f000cc530 msgr2=0x7f3f000c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:04.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.902+0000 7f3efe800640 1 --2- 172.21.15.133:0/2250819679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f000cc530 0x7f3f000c4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:04.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.902+0000 7f3efe800640 1 -- 172.21.15.133:0/2250819679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f00070500 msgr2=0x7f3f001e8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:04.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.902+0000 7f3efe800640 1 --2- 172.21.15.133:0/2250819679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f00070500 0x7f3f001e8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:04.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.902+0000 7f3efe800640 1 -- 172.21.15.133:0/2250819679 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee80094d0 con 0x7f3f00143790 2024-03-30T01:53:04.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.902+0000 7f3efde00640 1 --2- 172.21.15.133:0/2250819679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f00070500 0x7f3f001e8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:04.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.902+0000 7f3ef7e00640 1 --2- 172.21.15.133:0/2250819679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f000cc530 0x7f3f000c4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:04.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.902+0000 7f3efe800640 1 --2- 172.21.15.133:0/2250819679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f00143790 0x7f3f000c8a30 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8007e40 tx=0x7f3ef800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:04.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.903+0000 7f3ef6000640 1 -- 172.21.15.133:0/2250819679 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8014620 con 0x7f3f00143790 2024-03-30T01:53:04.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.903+0000 7f3ef6000640 1 -- 172.21.15.133:0/2250819679 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef800ee90 con 0x7f3f00143790 2024-03-30T01:53:04.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.903+0000 7f3f05000640 1 -- 172.21.15.133:0/2250819679 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f000c4fe0 con 0x7f3f00143790 2024-03-30T01:53:04.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.903+0000 7f3ef6000640 1 -- 172.21.15.133:0/2250819679 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef80149e0 con 0x7f3f00143790 2024-03-30T01:53:04.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.903+0000 7f3f05000640 1 -- 172.21.15.133:0/2250819679 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f001e8980 con 0x7f3f00143790 2024-03-30T01:53:04.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.904+0000 7f3f05000640 1 -- 172.21.15.133:0/2250819679 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0012c490 con 0x7f3f00143790 2024-03-30T01:53:04.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.905+0000 7f3ef6000640 1 -- 172.21.15.133:0/2250819679 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f3ef8014b40 con 0x7f3f00143790 2024-03-30T01:53:04.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.906+0000 7f3ef6000640 1 --2- 172.21.15.133:0/2250819679 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3edc06ac00 0x7f3edc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:04.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.906+0000 7f3ef6000640 1 -- 172.21.15.133:0/2250819679 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3ef8089ec0 con 0x7f3f00143790 2024-03-30T01:53:04.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.906+0000 7f3efde00640 1 --2- 172.21.15.133:0/2250819679 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3edc06ac00 0x7f3edc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:04.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.907+0000 7f3efde00640 1 --2- 172.21.15.133:0/2250819679 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3edc06ac00 0x7f3edc06d0c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0006fd0 tx=0x7f3ef0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:04.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:04.910+0000 7f3ef6000640 1 -- 172.21.15.133:0/2250819679 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f3ef8054f10 con 0x7f3f00143790 2024-03-30T01:53:05.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.144+0000 7f3f05000640 1 -- 172.21.15.133:0/2250819679 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f00066d80 con 0x7f3f00143790 2024-03-30T01:53:05.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.146+0000 7f3ef6000640 1 -- 172.21.15.133:0/2250819679 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f3ef8058530 con 0x7f3f00143790 2024-03-30T01:53:05.152 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:53:05.152 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/820901593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":820901593},{"type":"v1","addr":"172.21.15.137:6834","nonce":820901593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3524452213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3524452213},{"type":"v1","addr":"172.21.15.137:6835","nonce":3524452213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3989486478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3989486478},{"type":"v1","addr":"172.21.15.133:6837","nonce":3989486478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T01:52:55.753449+0000","modified":"2024-03-30T01:52:59.774372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.133:6836/1431848593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1431848593},{"type":"v1","addr":"172.21.15.133:6836","nonce":1431848593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":2}]} 2024-03-30T01:53:05.152 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 24 2024-03-30T01:53:05.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.148+0000 7f3f05000640 1 -- 172.21.15.133:0/2250819679 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3edc06ac00 msgr2=0x7f3edc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:05.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.148+0000 7f3f05000640 1 --2- 172.21.15.133:0/2250819679 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3edc06ac00 0x7f3edc06d0c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0006fd0 tx=0x7f3ef0008040 comp rx=0 tx=0).stop 2024-03-30T01:53:05.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.148+0000 7f3f05000640 1 -- 172.21.15.133:0/2250819679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f00143790 msgr2=0x7f3f000c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:05.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.148+0000 7f3f05000640 1 --2- 172.21.15.133:0/2250819679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f00143790 0x7f3f000c8a30 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8007e40 tx=0x7f3ef800e4b0 comp rx=0 tx=0).stop 2024-03-30T01:53:05.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.149+0000 7f3f05000640 1 -- 172.21.15.133:0/2250819679 shutdown_connections 2024-03-30T01:53:05.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.149+0000 7f3f05000640 1 --2- 172.21.15.133:0/2250819679 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3edc06ac00 0x7f3edc06d0c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:05.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.149+0000 7f3f05000640 1 --2- 172.21.15.133:0/2250819679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f00143790 0x7f3f000c8a30 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:05.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.149+0000 7f3f05000640 1 --2- 172.21.15.133:0/2250819679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f000cc530 0x7f3f000c4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:05.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.149+0000 7f3f05000640 1 --2- 172.21.15.133:0/2250819679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f00070500 0x7f3f001e8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:05.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.149+0000 7f3f05000640 1 -- 172.21.15.133:0/2250819679 >> 172.21.15.133:0/2250819679 conn(0x7f3f000b07a0 msgr2=0x7f3f000b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:05.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.149+0000 7f3f05000640 1 -- 172.21.15.133:0/2250819679 shutdown_connections 2024-03-30T01:53:05.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.149+0000 7f3f05000640 1 -- 172.21.15.133:0/2250819679 wait complete. 2024-03-30T01:53:05.175 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:53:05.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.371+0000 7fe103e00640 1 Processor -- start 2024-03-30T01:53:05.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.371+0000 7fe103e00640 1 -- start start 2024-03-30T01:53:05.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.373+0000 7fe103e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0fc070c10 0x7fe0fc164740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:05.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.373+0000 7fe103e00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0fc0ce400 con 0x7fe0fc143220 2024-03-30T01:53:05.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.373+0000 7fe103e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0fc06d0e0 con 0x7fe0fc06e2e0 2024-03-30T01:53:05.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.373+0000 7fe103e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0fc0cc5c0 con 0x7fe0fc070c10 2024-03-30T01:53:05.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.373+0000 7fe101e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0fc070c10 0x7fe0fc164740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:05.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.373+0000 7fe101400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe0fc143220 0x7fe0fc0cd990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35198/0 (socket says 172.21.15.133:35198) 2024-03-30T01:53:05.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.373+0000 7fe101400640 1 -- 172.21.15.133:0/2890134118 learned_addr learned my addr 172.21.15.133:0/2890134118 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:05.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.374+0000 7fe101e00640 1 -- 172.21.15.133:0/2890134118 >> v1:172.21.15.137:6789/0 conn(0x7fe0fc06e2e0 legacy=0x7fe0fc070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:05.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.374+0000 7fe101e00640 1 -- 172.21.15.133:0/2890134118 >> v1:172.21.15.133:6789/0 conn(0x7fe0fc143220 legacy=0x7fe0fc0cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:05.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.374+0000 7fe101e00640 1 -- 172.21.15.133:0/2890134118 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc06d3c0 con 0x7fe0fc070c10 2024-03-30T01:53:05.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.375+0000 7fe101e00640 1 --2- 172.21.15.133:0/2890134118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0fc070c10 0x7fe0fc164740 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40097a0 tx=0x7fe0f402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a35e6f068dd7f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:05.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.376+0000 7fe0fbe00640 1 -- 172.21.15.133:0/2890134118 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4031830 con 0x7fe0fc070c10 2024-03-30T01:53:05.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.376+0000 7fe0fbe00640 1 -- 172.21.15.133:0/2890134118 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f4031990 con 0x7fe0fc070c10 2024-03-30T01:53:05.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.376+0000 7fe0fbe00640 1 -- 172.21.15.133:0/2890134118 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4031d20 con 0x7fe0fc070c10 2024-03-30T01:53:05.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.376+0000 7fe103e00640 1 -- 172.21.15.133:0/2890134118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0fc070c10 msgr2=0x7fe0fc164740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:05.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.376+0000 7fe103e00640 1 --2- 172.21.15.133:0/2890134118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0fc070c10 0x7fe0fc164740 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40097a0 tx=0x7fe0f402b8d0 comp rx=0 tx=0).stop 2024-03-30T01:53:05.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.377+0000 7fe103e00640 1 -- 172.21.15.133:0/2890134118 shutdown_connections 2024-03-30T01:53:05.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.377+0000 7fe103e00640 1 --2- 172.21.15.133:0/2890134118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0fc070c10 0x7fe0fc164740 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:05.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.377+0000 7fe103e00640 1 -- 172.21.15.133:0/2890134118 >> 172.21.15.133:0/2890134118 conn(0x7fe0fc0b07a0 msgr2=0x7fe0fc0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:05.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.377+0000 7fe103e00640 1 -- 172.21.15.133:0/2890134118 shutdown_connections 2024-03-30T01:53:05.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.377+0000 7fe103e00640 1 -- 172.21.15.133:0/2890134118 wait complete. 2024-03-30T01:53:05.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.378+0000 7fe103e00640 1 Processor -- start 2024-03-30T01:53:05.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.379+0000 7fe103e00640 1 -- start start 2024-03-30T01:53:05.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.379+0000 7fe103e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0fc06e2e0 0x7fe0fc15bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:05.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.379+0000 7fe103e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0fc070c10 0x7fe0fc1f6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:05.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.379+0000 7fe103e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0fc143220 0x7fe0fc1f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:05.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.379+0000 7fe103e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0c9050 con 0x7fe0fc06e2e0 2024-03-30T01:53:05.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.380+0000 7fe103e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0c8bc0 con 0x7fe0fc070c10 2024-03-30T01:53:05.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.380+0000 7fe103e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0c7fb0 con 0x7fe0fc143220 2024-03-30T01:53:05.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.380+0000 7fe101400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0fc06e2e0 0x7fe0fc15bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:05.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.380+0000 7fe101400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0fc06e2e0 0x7fe0fc15bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36376/0 (socket says 172.21.15.133:36376) 2024-03-30T01:53:05.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.380+0000 7fe101400640 1 -- 172.21.15.133:0/2328233798 learned_addr learned my addr 172.21.15.133:0/2328233798 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:05.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.380+0000 7fe100a00640 1 --2- 172.21.15.133:0/2328233798 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0fc070c10 0x7fe0fc1f6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:05.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.380+0000 7fe101400640 1 -- 172.21.15.133:0/2328233798 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0fc143220 msgr2=0x7fe0fc1f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:05.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.380+0000 7fe101400640 1 --2- 172.21.15.133:0/2328233798 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0fc143220 0x7fe0fc1f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:05.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.380+0000 7fe101400640 1 -- 172.21.15.133:0/2328233798 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0fc070c10 msgr2=0x7fe0fc1f6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:05.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.380+0000 7fe101400640 1 --2- 172.21.15.133:0/2328233798 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0fc070c10 0x7fe0fc1f6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:05.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.380+0000 7fe101400640 1 -- 172.21.15.133:0/2328233798 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f4009400 con 0x7fe0fc06e2e0 2024-03-30T01:53:05.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.380+0000 7fe100a00640 1 --2- 172.21.15.133:0/2328233798 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0fc070c10 0x7fe0fc1f6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:05.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.381+0000 7fe101400640 1 --2- 172.21.15.133:0/2328233798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0fc06e2e0 0x7fe0fc15bbe0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000cbc0 tx=0x7fe0f000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:05.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.381+0000 7fe0f9600640 1 -- 172.21.15.133:0/2328233798 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f000aca0 con 0x7fe0fc06e2e0 2024-03-30T01:53:05.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.381+0000 7fe0f9600640 1 -- 172.21.15.133:0/2328233798 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f000ae00 con 0x7fe0fc06e2e0 2024-03-30T01:53:05.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.381+0000 7fe0f9600640 1 -- 172.21.15.133:0/2328233798 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0012600 con 0x7fe0fc06e2e0 2024-03-30T01:53:05.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.381+0000 7fe103e00640 1 -- 172.21.15.133:0/2328233798 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0fc0c8290 con 0x7fe0fc06e2e0 2024-03-30T01:53:05.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.381+0000 7fe103e00640 1 -- 172.21.15.133:0/2328233798 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0fc0c8850 con 0x7fe0fc06e2e0 2024-03-30T01:53:05.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.382+0000 7fe103e00640 1 -- 172.21.15.133:0/2328233798 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0fc066d80 con 0x7fe0fc06e2e0 2024-03-30T01:53:05.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.383+0000 7fe0f9600640 1 -- 172.21.15.133:0/2328233798 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe0f0007070 con 0x7fe0fc06e2e0 2024-03-30T01:53:05.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.384+0000 7fe0f9600640 1 --2- 172.21.15.133:0/2328233798 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe0dc06ac30 0x7fe0dc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:05.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.384+0000 7fe0f9600640 1 -- 172.21.15.133:0/2328233798 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe0f00892a0 con 0x7fe0fc06e2e0 2024-03-30T01:53:05.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.384+0000 7fe100a00640 1 --2- 172.21.15.133:0/2328233798 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe0dc06ac30 0x7fe0dc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:05.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.385+0000 7fe100a00640 1 --2- 172.21.15.133:0/2328233798 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe0dc06ac30 0x7fe0dc06d0f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc139c50 tx=0x7fe0e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:05.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.388+0000 7fe0f9600640 1 -- 172.21.15.133:0/2328233798 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fe0f0054430 con 0x7fe0fc06e2e0 2024-03-30T01:53:05.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.582+0000 7fe103e00640 1 -- 172.21.15.133:0/2328233798 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0fc15d120 con 0x7fe0fc06e2e0 2024-03-30T01:53:05.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.585+0000 7fe0f9600640 1 -- 172.21.15.133:0/2328233798 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16278 (secure 0 0 0) 0x7fe0f0057a50 con 0x7fe0fc06e2e0 2024-03-30T01:53:05.591 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:53:05.591 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":36,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:52:55.753199+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:52:43.357481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-30T01:52:44.221573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6836/665764657":"2024-03-31T01:52:54.232727+0000","172.21.15.133:6834/665764657":"2024-03-31T01:52:54.232727+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:53:05.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.588+0000 7fe103e00640 1 -- 172.21.15.133:0/2328233798 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe0dc06ac30 msgr2=0x7fe0dc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:05.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.588+0000 7fe103e00640 1 --2- 172.21.15.133:0/2328233798 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe0dc06ac30 0x7fe0dc06d0f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc139c50 tx=0x7fe0e8009040 comp rx=0 tx=0).stop 2024-03-30T01:53:05.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.588+0000 7fe103e00640 1 -- 172.21.15.133:0/2328233798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0fc06e2e0 msgr2=0x7fe0fc15bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:05.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.588+0000 7fe103e00640 1 --2- 172.21.15.133:0/2328233798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0fc06e2e0 0x7fe0fc15bbe0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000cbc0 tx=0x7fe0f000a060 comp rx=0 tx=0).stop 2024-03-30T01:53:05.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.588+0000 7fe103e00640 1 -- 172.21.15.133:0/2328233798 shutdown_connections 2024-03-30T01:53:05.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.588+0000 7fe103e00640 1 --2- 172.21.15.133:0/2328233798 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe0dc06ac30 0x7fe0dc06d0f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.588+0000 7fe103e00640 1 --2- 172.21.15.133:0/2328233798 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0fc143220 0x7fe0fc1f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.588+0000 7fe103e00640 1 --2- 172.21.15.133:0/2328233798 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0fc070c10 0x7fe0fc1f6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.588+0000 7fe103e00640 1 --2- 172.21.15.133:0/2328233798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0fc06e2e0 0x7fe0fc15bbe0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.588+0000 7fe103e00640 1 -- 172.21.15.133:0/2328233798 >> 172.21.15.133:0/2328233798 conn(0x7fe0fc0b07a0 msgr2=0x7fe0fc1416b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.588+0000 7fe103e00640 1 -- 172.21.15.133:0/2328233798 shutdown_connections 2024-03-30T01:53:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.588+0000 7fe103e00640 1 -- 172.21.15.133:0/2328233798 wait complete. 2024-03-30T01:53:05.612 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T01:51:21.771393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T01:52:43.357481+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T01:52:44.221573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T01:53:05.613 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T01:53:05.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.818+0000 7f68c4c00640 1 Processor -- start 2024-03-30T01:53:05.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.818+0000 7f68c4c00640 1 -- start start 2024-03-30T01:53:05.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.819+0000 7f68c4c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68c00b42c0 0x7f68c00cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:05.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.819+0000 7f68c4c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f68c00ccb30 0x7f68c015e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:05.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.819+0000 7f68c4c00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c013dba0 con 0x7f68c015b9c0 2024-03-30T01:53:05.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.819+0000 7f68c4c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c015bda0 con 0x7f68c00ccb30 2024-03-30T01:53:05.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.819+0000 7f68c4c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c01408b0 con 0x7f68c00b42c0 2024-03-30T01:53:05.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.820+0000 7f68bf400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f68c015b9c0 0x7f68c00b3bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35210/0 (socket says 172.21.15.133:35210) 2024-03-30T01:53:05.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.820+0000 7f68bf400640 1 -- 172.21.15.133:0/2865820785 learned_addr learned my addr 172.21.15.133:0/2865820785 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:05.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.820+0000 7f68b6a00640 1 --2- 172.21.15.133:0/2865820785 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68c00b42c0 0x7f68c00cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:05.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.820+0000 7f68bea00640 1 -- 172.21.15.133:0/2865820785 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381536805 0 0) 0x7f68c013dba0 con 0x7f68c015b9c0 2024-03-30T01:53:05.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.820+0000 7f68bea00640 1 -- 172.21.15.133:0/2865820785 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68a4003520 con 0x7f68c015b9c0 2024-03-30T01:53:05.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.820+0000 7f68bfe00640 1 --2- 172.21.15.133:0/2865820785 >> v2:172.21.15.137:3300/0 conn(0x7f68c00ccb30 0x7f68c015e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:05.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.820+0000 7f68bea00640 1 -- 172.21.15.133:0/2865820785 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 647475330 0 0) 0x7f68a4003520 con 0x7f68c015b9c0 2024-03-30T01:53:05.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.820+0000 7f68bea00640 1 -- 172.21.15.133:0/2865820785 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68c00b42c0 msgr2=0x7f68c00cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:05.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.820+0000 7f68bea00640 1 --2- 172.21.15.133:0/2865820785 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68c00b42c0 0x7f68c00cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:05.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.820+0000 7f68bea00640 1 -- 172.21.15.133:0/2865820785 >> v2:172.21.15.137:3300/0 conn(0x7f68c00ccb30 msgr2=0x7f68c015e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:05.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.820+0000 7f68bea00640 1 --2- 172.21.15.133:0/2865820785 >> v2:172.21.15.137:3300/0 conn(0x7f68c00ccb30 0x7f68c015e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:05.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.820+0000 7f68bea00640 1 -- 172.21.15.133:0/2865820785 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c015ad40 con 0x7f68c015b9c0 2024-03-30T01:53:05.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.820+0000 7f68bea00640 1 -- 172.21.15.133:0/2865820785 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f68b0001670 con 0x7f68c015b9c0 2024-03-30T01:53:05.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.821+0000 7f68bea00640 1 -- 172.21.15.133:0/2865820785 >> v1:172.21.15.133:6789/0 conn(0x7f68c015b9c0 legacy=0x7f68c00b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:05.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.821+0000 7f68bea00640 1 --2- 172.21.15.133:0/2865820785 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68c00b42c0 0x7f68a4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:05.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.821+0000 7f68bea00640 1 --2- 172.21.15.133:0/2865820785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68a4003ef0 0x7f68a40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:05.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.821+0000 7f68bea00640 1 --2- 172.21.15.133:0/2865820785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68a4004d00 0x7f68a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:05.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.821+0000 7f68bea00640 1 -- 172.21.15.133:0/2865820785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c015bda0 con 0x7f68a4003ef0 2024-03-30T01:53:05.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.821+0000 7f68bea00640 1 -- 172.21.15.133:0/2865820785 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c01408b0 con 0x7f68a4004d00 2024-03-30T01:53:05.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.821+0000 7f68bea00640 1 -- 172.21.15.133:0/2865820785 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a400b9d0 con 0x7f68c00b42c0 2024-03-30T01:53:05.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.821+0000 7f68b6a00640 1 --2- 172.21.15.133:0/2865820785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68a4003ef0 0x7f68a40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:05.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.821+0000 7f68bf400640 1 --2- 172.21.15.133:0/2865820785 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68c00b42c0 0x7f68a4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:05.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.821+0000 7f68bfe00640 1 --2- 172.21.15.133:0/2865820785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68a4004d00 0x7f68a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:05.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.821+0000 7f68b6a00640 1 -- 172.21.15.133:0/2865820785 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68c00b42c0 msgr2=0x7f68a4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:05.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.821+0000 7f68b6a00640 1 --2- 172.21.15.133:0/2865820785 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68c00b42c0 0x7f68a4003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:05.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.821+0000 7f68b6a00640 1 -- 172.21.15.133:0/2865820785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68a4004d00 msgr2=0x7f68a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:05.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.821+0000 7f68b6a00640 1 --2- 172.21.15.133:0/2865820785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68a4004d00 0x7f68a4005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:05.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.821+0000 7f68b6a00640 1 -- 172.21.15.133:0/2865820785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a4003520 con 0x7f68a4003ef0 2024-03-30T01:53:05.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.823+0000 7f68b6a00640 1 --2- 172.21.15.133:0/2865820785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68a4003ef0 0x7f68a40047c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009ac0 tx=0x7f68a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e5fc36708e3519 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:05.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.824+0000 7f68bea00640 1 -- 172.21.15.133:0/2865820785 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a802c6b0 con 0x7f68a4003ef0 2024-03-30T01:53:05.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.824+0000 7f68bea00640 1 -- 172.21.15.133:0/2865820785 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a802c810 con 0x7f68a4003ef0 2024-03-30T01:53:05.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.824+0000 7f68bea00640 1 -- 172.21.15.133:0/2865820785 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a802cba0 con 0x7f68a4003ef0 2024-03-30T01:53:05.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.824+0000 7f68c4c00640 1 -- 172.21.15.133:0/2865820785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68a4003ef0 msgr2=0x7f68a40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:05.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.824+0000 7f68c4c00640 1 --2- 172.21.15.133:0/2865820785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68a4003ef0 0x7f68a40047c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009ac0 tx=0x7f68a40057f0 comp rx=0 tx=0).stop 2024-03-30T01:53:05.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.824+0000 7f68bfe00640 1 -- 172.21.15.133:0/2865820785 reap_dead start 2024-03-30T01:53:05.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.824+0000 7f68c4c00640 1 -- 172.21.15.133:0/2865820785 shutdown_connections 2024-03-30T01:53:05.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.824+0000 7f68c4c00640 1 -- 172.21.15.133:0/2865820785 >> 172.21.15.133:0/2865820785 conn(0x7f68c00b05a0 msgr2=0x7f68c00b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:05.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.824+0000 7f68c4c00640 1 -- 172.21.15.133:0/2865820785 shutdown_connections 2024-03-30T01:53:05.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.825+0000 7f68c4c00640 1 -- 172.21.15.133:0/2865820785 wait complete. 2024-03-30T01:53:05.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.826+0000 7f68c4c00640 1 Processor -- start 2024-03-30T01:53:05.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.826+0000 7f68c4c00640 1 -- start start 2024-03-30T01:53:05.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.827+0000 7f68c4c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68a4003ef0 0x7f68c0138200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:05.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.827+0000 7f68c4c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68c0138740 0x7f68c00a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:05.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.827+0000 7f68c4c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68c0139130 0x7f68c00a8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:05.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.827+0000 7f68c4c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c00b1830 con 0x7f68c0139130 2024-03-30T01:53:05.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.827+0000 7f68c4c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c00a7aa0 con 0x7f68c0138740 2024-03-30T01:53:05.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.827+0000 7f68c4c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c00a7d80 con 0x7f68a4003ef0 2024-03-30T01:53:05.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.828+0000 7f68bfe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68c0139130 0x7f68c00a8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:05.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.828+0000 7f68bfe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68c0139130 0x7f68c00a8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36394/0 (socket says 172.21.15.133:36394) 2024-03-30T01:53:05.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.828+0000 7f68bfe00640 1 -- 172.21.15.133:0/2890987035 learned_addr learned my addr 172.21.15.133:0/2890987035 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:05.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.828+0000 7f68b6a00640 1 --2- 172.21.15.133:0/2890987035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68c0138740 0x7f68c00a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:05.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.828+0000 7f68bf400640 1 --2- 172.21.15.133:0/2890987035 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68a4003ef0 0x7f68c0138200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:05.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.828+0000 7f68bfe00640 1 -- 172.21.15.133:0/2890987035 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68a4003ef0 msgr2=0x7f68c0138200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:05.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.828+0000 7f68bfe00640 1 --2- 172.21.15.133:0/2890987035 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68a4003ef0 0x7f68c0138200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:05.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.828+0000 7f68bfe00640 1 -- 172.21.15.133:0/2890987035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68c0138740 msgr2=0x7f68c00a85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:05.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.828+0000 7f68bfe00640 1 --2- 172.21.15.133:0/2890987035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68c0138740 0x7f68c00a85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:05.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.828+0000 7f68bfe00640 1 -- 172.21.15.133:0/2890987035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c00a8060 con 0x7f68c0139130 2024-03-30T01:53:05.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.828+0000 7f68bfe00640 1 --2- 172.21.15.133:0/2890987035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68c0139130 0x7f68c00a8ae0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f68c00b15e0 tx=0x7f68b8009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:05.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.829+0000 7f68b7e00640 1 -- 172.21.15.133:0/2890987035 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b8007cf0 con 0x7f68c0139130 2024-03-30T01:53:05.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.829+0000 7f68b7e00640 1 -- 172.21.15.133:0/2890987035 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b8007e70 con 0x7f68c0139130 2024-03-30T01:53:05.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.829+0000 7f68b7e00640 1 -- 172.21.15.133:0/2890987035 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b8014620 con 0x7f68c0139130 2024-03-30T01:53:05.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.829+0000 7f68c4c00640 1 -- 172.21.15.133:0/2890987035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c00a8340 con 0x7f68c0139130 2024-03-30T01:53:05.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.829+0000 7f68c4c00640 1 -- 172.21.15.133:0/2890987035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c00a7810 con 0x7f68c0139130 2024-03-30T01:53:05.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.830+0000 7f68c4c00640 1 -- 172.21.15.133:0/2890987035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c00b1970 con 0x7f68c0139130 2024-03-30T01:53:05.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.831+0000 7f68b7e00640 1 -- 172.21.15.133:0/2890987035 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f68b801d3b0 con 0x7f68c0139130 2024-03-30T01:53:05.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.832+0000 7f68b7e00640 1 --2- 172.21.15.133:0/2890987035 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f689c06ac00 0x7f689c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:05.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.832+0000 7f68b7e00640 1 -- 172.21.15.133:0/2890987035 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f68b8089190 con 0x7f68c0139130 2024-03-30T01:53:05.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.832+0000 7f68bf400640 1 --2- 172.21.15.133:0/2890987035 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f689c06ac00 0x7f689c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:05.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.833+0000 7f68bf400640 1 --2- 172.21.15.133:0/2890987035 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f689c06ac00 0x7f689c06d0c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f68b0001820 tx=0x7f68b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:05.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:05.836+0000 7f68b7e00640 1 -- 172.21.15.133:0/2890987035 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f68b8054300 con 0x7f68c0139130 2024-03-30T01:53:06.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.033+0000 7f68c4c00640 1 -- 172.21.15.133:0/2890987035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f68c0073750 con 0x7f68c0139130 2024-03-30T01:53:06.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.034+0000 7f68b7e00640 1 -- 172.21.15.133:0/2890987035 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f68b8057920 con 0x7f68c0139130 2024-03-30T01:53:06.041 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-03-30T01:53:06.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.037+0000 7f68c4c00640 1 -- 172.21.15.133:0/2890987035 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f689c06ac00 msgr2=0x7f689c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:06.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.037+0000 7f68c4c00640 1 --2- 172.21.15.133:0/2890987035 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f689c06ac00 0x7f689c06d0c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f68b0001820 tx=0x7f68b0009040 comp rx=0 tx=0).stop 2024-03-30T01:53:06.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.037+0000 7f68c4c00640 1 -- 172.21.15.133:0/2890987035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68c0139130 msgr2=0x7f68c00a8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:06.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.037+0000 7f68c4c00640 1 --2- 172.21.15.133:0/2890987035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68c0139130 0x7f68c00a8ae0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f68c00b15e0 tx=0x7f68b8009d40 comp rx=0 tx=0).stop 2024-03-30T01:53:06.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.037+0000 7f68c4c00640 1 -- 172.21.15.133:0/2890987035 shutdown_connections 2024-03-30T01:53:06.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.037+0000 7f68c4c00640 1 --2- 172.21.15.133:0/2890987035 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f689c06ac00 0x7f689c06d0c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.037+0000 7f68c4c00640 1 --2- 172.21.15.133:0/2890987035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68c0139130 0x7f68c00a8ae0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.037+0000 7f68c4c00640 1 --2- 172.21.15.133:0/2890987035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68c0138740 0x7f68c00a85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.037+0000 7f68c4c00640 1 --2- 172.21.15.133:0/2890987035 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68a4003ef0 0x7f68c0138200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.037+0000 7f68c4c00640 1 -- 172.21.15.133:0/2890987035 >> 172.21.15.133:0/2890987035 conn(0x7f68c00b05a0 msgr2=0x7f68c0151630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:06.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.037+0000 7f68c4c00640 1 -- 172.21.15.133:0/2890987035 shutdown_connections 2024-03-30T01:53:06.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.037+0000 7f68c4c00640 1 -- 172.21.15.133:0/2890987035 wait complete. 2024-03-30T01:53:06.062 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T01:53:06.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.269+0000 7f96ef200640 1 Processor -- start 2024-03-30T01:53:06.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.269+0000 7f96ef200640 1 -- start start 2024-03-30T01:53:06.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.271+0000 7f96ef200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96e8143790 0x7f96e80cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:06.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.271+0000 7f96ef200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f96e8070500 0x7f96e8070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:06.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.271+0000 7f96ef200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f96e80cc530 0x7f96e80cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:06.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.271+0000 7f96ef200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e80a76a0 con 0x7f96e80cc530 2024-03-30T01:53:06.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.271+0000 7f96ef200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e8070ea0 con 0x7f96e8070500 2024-03-30T01:53:06.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.271+0000 7f96ef200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80b38e0 con 0x7f96e8143790 2024-03-30T01:53:06.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.271+0000 7f96ed200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f96e80cc530 0x7f96e80cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:06.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.271+0000 7f96ed200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f96e80cc530 0x7f96e80cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54472/0 (socket says 172.21.15.133:54472) 2024-03-30T01:53:06.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.271+0000 7f96ed200640 1 -- 172.21.15.133:0/696716155 learned_addr learned my addr 172.21.15.133:0/696716155 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:06.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.271+0000 7f96e7e00640 1 --2- 172.21.15.133:0/696716155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96e8143790 0x7f96e80cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:06.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.271+0000 7f96e7400640 1 --2- 172.21.15.133:0/696716155 >> v2:172.21.15.137:3300/0 conn(0x7f96e8070500 0x7f96e8070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:06.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.272+0000 7f96ed200640 1 -- 172.21.15.133:0/696716155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96e8143790 msgr2=0x7f96e80cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:06.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.272+0000 7f96ed200640 1 --2- 172.21.15.133:0/696716155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96e8143790 0x7f96e80cbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.272+0000 7f96ed200640 1 -- 172.21.15.133:0/696716155 >> v2:172.21.15.137:3300/0 conn(0x7f96e8070500 msgr2=0x7f96e8070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:06.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.272+0000 7f96ed200640 1 --2- 172.21.15.133:0/696716155 >> v2:172.21.15.137:3300/0 conn(0x7f96e8070500 0x7f96e8070960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.272+0000 7f96ed200640 1 -- 172.21.15.133:0/696716155 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e80ccf00 con 0x7f96e80cc530 2024-03-30T01:53:06.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.273+0000 7f96ed200640 1 --2- 172.21.15.133:0/696716155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96e80cc530 0x7f96e80cc9c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f96e806e5b0 tx=0x7f96e002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ad1634ea66eada server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:06.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.273+0000 7f96e6a00640 1 -- 172.21.15.133:0/696716155 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e002cb00 con 0x7f96e80cc530 2024-03-30T01:53:06.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.273+0000 7f96e6a00640 1 -- 172.21.15.133:0/696716155 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e002cc60 con 0x7f96e80cc530 2024-03-30T01:53:06.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.273+0000 7f96e6a00640 1 -- 172.21.15.133:0/696716155 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00343f0 con 0x7f96e80cc530 2024-03-30T01:53:06.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.274+0000 7f96ef200640 1 -- 172.21.15.133:0/696716155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96e80cc530 msgr2=0x7f96e80cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:06.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.274+0000 7f96ef200640 1 --2- 172.21.15.133:0/696716155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96e80cc530 0x7f96e80cc9c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f96e806e5b0 tx=0x7f96e002bf60 comp rx=0 tx=0).stop 2024-03-30T01:53:06.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.274+0000 7f96ef200640 1 -- 172.21.15.133:0/696716155 shutdown_connections 2024-03-30T01:53:06.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.274+0000 7f96ef200640 1 --2- 172.21.15.133:0/696716155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96e80cc530 0x7f96e80cc9c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.274+0000 7f96ef200640 1 --2- 172.21.15.133:0/696716155 >> v2:172.21.15.137:3300/0 conn(0x7f96e8070500 0x7f96e8070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.274+0000 7f96ef200640 1 --2- 172.21.15.133:0/696716155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96e8143790 0x7f96e80cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.274+0000 7f96ef200640 1 -- 172.21.15.133:0/696716155 >> 172.21.15.133:0/696716155 conn(0x7f96e80b07a0 msgr2=0x7f96e80b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:06.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.274+0000 7f96ef200640 1 -- 172.21.15.133:0/696716155 shutdown_connections 2024-03-30T01:53:06.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.274+0000 7f96ef200640 1 -- 172.21.15.133:0/696716155 wait complete. 2024-03-30T01:53:06.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.276+0000 7f96ef200640 1 Processor -- start 2024-03-30T01:53:06.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.276+0000 7f96ef200640 1 -- start start 2024-03-30T01:53:06.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.277+0000 7f96ef200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96e8070500 0x7f96e8142810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:06.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.277+0000 7f96ef200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96e80cc530 0x7f96e815ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:06.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.278+0000 7f96ef200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96e8143790 0x7f96e815d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:06.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.278+0000 7f96ef200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e815b170 con 0x7f96e8143790 2024-03-30T01:53:06.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.278+0000 7f96ef200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e815a7a0 con 0x7f96e80cc530 2024-03-30T01:53:06.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.278+0000 7f96ef200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80ad7e0 con 0x7f96e8070500 2024-03-30T01:53:06.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.278+0000 7f96ed200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96e8143790 0x7f96e815d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:06.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.278+0000 7f96ed200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96e8143790 0x7f96e815d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54474/0 (socket says 172.21.15.133:54474) 2024-03-30T01:53:06.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.278+0000 7f96ed200640 1 -- 172.21.15.133:0/3099205188 learned_addr learned my addr 172.21.15.133:0/3099205188 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:06.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.278+0000 7f96e7e00640 1 --2- 172.21.15.133:0/3099205188 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96e8070500 0x7f96e8142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:06.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.278+0000 7f96ed200640 1 -- 172.21.15.133:0/3099205188 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96e8070500 msgr2=0x7f96e8142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:06.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.278+0000 7f96ed200640 1 --2- 172.21.15.133:0/3099205188 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96e8070500 0x7f96e8142810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.278+0000 7f96e7400640 1 --2- 172.21.15.133:0/3099205188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96e80cc530 0x7f96e815ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:06.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.278+0000 7f96ed200640 1 -- 172.21.15.133:0/3099205188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96e80cc530 msgr2=0x7f96e815ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:06.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.278+0000 7f96ed200640 1 --2- 172.21.15.133:0/3099205188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96e80cc530 0x7f96e815ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.278+0000 7f96ed200640 1 -- 172.21.15.133:0/3099205188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e0009b30 con 0x7f96e8143790 2024-03-30T01:53:06.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.278+0000 7f96e7400640 1 --2- 172.21.15.133:0/3099205188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96e80cc530 0x7f96e815ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:06.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.279+0000 7f96ed200640 1 --2- 172.21.15.133:0/3099205188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96e8143790 0x7f96e815d970 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009f40 tx=0x7f96e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:06.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.279+0000 7f96dfe00640 1 -- 172.21.15.133:0/3099205188 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e003e450 con 0x7f96e8143790 2024-03-30T01:53:06.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.279+0000 7f96dfe00640 1 -- 172.21.15.133:0/3099205188 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e003e5d0 con 0x7f96e8143790 2024-03-30T01:53:06.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.279+0000 7f96dfe00640 1 -- 172.21.15.133:0/3099205188 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e003e980 con 0x7f96e8143790 2024-03-30T01:53:06.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.279+0000 7f96ef200640 1 -- 172.21.15.133:0/3099205188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e8159e70 con 0x7f96e8143790 2024-03-30T01:53:06.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.279+0000 7f96ef200640 1 -- 172.21.15.133:0/3099205188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e815a430 con 0x7f96e8143790 2024-03-30T01:53:06.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.280+0000 7f96ef200640 1 -- 172.21.15.133:0/3099205188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e815a950 con 0x7f96e8143790 2024-03-30T01:53:06.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.281+0000 7f96dfe00640 1 -- 172.21.15.133:0/3099205188 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f96e003eae0 con 0x7f96e8143790 2024-03-30T01:53:06.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.282+0000 7f96dfe00640 1 --2- 172.21.15.133:0/3099205188 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f96c806ac00 0x7f96c806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:06.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.282+0000 7f96dfe00640 1 -- 172.21.15.133:0/3099205188 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f96e00ac2e0 con 0x7f96e8143790 2024-03-30T01:53:06.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.282+0000 7f96e7e00640 1 --2- 172.21.15.133:0/3099205188 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f96c806ac00 0x7f96c806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:06.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.283+0000 7f96e7e00640 1 --2- 172.21.15.133:0/3099205188 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f96c806ac00 0x7f96c806d0c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f96d800b740 tx=0x7f96d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:06.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.287+0000 7f96dfe00640 1 -- 172.21.15.133:0/3099205188 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f96e815a950 con 0x7f96e8143790 2024-03-30T01:53:06.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.481+0000 7f96ef200640 1 -- 172.21.15.133:0/3099205188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f96e815a950 con 0x7f96e8143790 2024-03-30T01:53:06.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.482+0000 7f96dfe00640 1 -- 172.21.15.133:0/3099205188 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f96e815a950 con 0x7f96e8143790 2024-03-30T01:53:06.488 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-03-30T01:53:06.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.484+0000 7f96ef200640 1 -- 172.21.15.133:0/3099205188 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f96c806ac00 msgr2=0x7f96c806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:06.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.484+0000 7f96ef200640 1 --2- 172.21.15.133:0/3099205188 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f96c806ac00 0x7f96c806d0c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f96d800b740 tx=0x7f96d8008040 comp rx=0 tx=0).stop 2024-03-30T01:53:06.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.484+0000 7f96ef200640 1 -- 172.21.15.133:0/3099205188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96e8143790 msgr2=0x7f96e815d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:06.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.484+0000 7f96ef200640 1 --2- 172.21.15.133:0/3099205188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96e8143790 0x7f96e815d970 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009f40 tx=0x7f96e0004a40 comp rx=0 tx=0).stop 2024-03-30T01:53:06.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.485+0000 7f96ef200640 1 -- 172.21.15.133:0/3099205188 shutdown_connections 2024-03-30T01:53:06.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.485+0000 7f96ef200640 1 --2- 172.21.15.133:0/3099205188 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f96c806ac00 0x7f96c806d0c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.485+0000 7f96ef200640 1 --2- 172.21.15.133:0/3099205188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96e8143790 0x7f96e815d970 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.485+0000 7f96ef200640 1 --2- 172.21.15.133:0/3099205188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96e80cc530 0x7f96e815ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.485+0000 7f96ef200640 1 --2- 172.21.15.133:0/3099205188 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96e8070500 0x7f96e8142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.485+0000 7f96ef200640 1 -- 172.21.15.133:0/3099205188 >> 172.21.15.133:0/3099205188 conn(0x7f96e80b07a0 msgr2=0x7f96e80ae510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:06.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.485+0000 7f96ef200640 1 -- 172.21.15.133:0/3099205188 shutdown_connections 2024-03-30T01:53:06.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.485+0000 7f96ef200640 1 -- 172.21.15.133:0/3099205188 wait complete. 2024-03-30T01:53:06.509 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T01:53:06.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.715+0000 7f8ca6800640 1 Processor -- start 2024-03-30T01:53:06.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.715+0000 7f8ca6800640 1 -- start start 2024-03-30T01:53:06.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.717+0000 7f8ca6800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ca015cc50 0x7f8ca00d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:06.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.717+0000 7f8ca6800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8ca00cfb80 0x7f8ca00b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:06.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.717+0000 7f8ca6800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca015d030 con 0x7f8ca00d2240 2024-03-30T01:53:06.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.717+0000 7f8ca6800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca00d1c50 con 0x7f8ca00cfb80 2024-03-30T01:53:06.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.717+0000 7f8ca6800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca00b5af0 con 0x7f8ca015cc50 2024-03-30T01:53:06.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.717+0000 7f8c96a00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8ca00d2240 0x7f8ca00cf470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57664/0 (socket says 172.21.15.133:57664) 2024-03-30T01:53:06.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.717+0000 7f8c96a00640 1 -- 172.21.15.133:0/1069892408 learned_addr learned my addr 172.21.15.133:0/1069892408 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:06.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.718+0000 7f8c9f400640 1 --2- 172.21.15.133:0/1069892408 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ca015cc50 0x7f8ca00d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:06.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.718+0000 7f8c9fe00640 1 --2- 172.21.15.133:0/1069892408 >> v2:172.21.15.137:3300/0 conn(0x7f8ca00cfb80 0x7f8ca00b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:06.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.718+0000 7f8c9ea00640 1 -- 172.21.15.133:0/1069892408 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198320802 0 0) 0x7f8ca015d030 con 0x7f8ca00d2240 2024-03-30T01:53:06.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.718+0000 7f8c9ea00640 1 -- 172.21.15.133:0/1069892408 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c84003520 con 0x7f8ca00d2240 2024-03-30T01:53:06.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.718+0000 7f8c9ea00640 1 -- 172.21.15.133:0/1069892408 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 647231666 0 0) 0x7f8c84003520 con 0x7f8ca00d2240 2024-03-30T01:53:06.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.718+0000 7f8c9ea00640 1 -- 172.21.15.133:0/1069892408 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ca015cc50 msgr2=0x7f8ca00d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:06.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.718+0000 7f8c9ea00640 1 --2- 172.21.15.133:0/1069892408 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ca015cc50 0x7f8ca00d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.718+0000 7f8c9ea00640 1 -- 172.21.15.133:0/1069892408 >> v2:172.21.15.137:3300/0 conn(0x7f8ca00cfb80 msgr2=0x7f8ca00b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:06.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.718+0000 7f8c9ea00640 1 --2- 172.21.15.133:0/1069892408 >> v2:172.21.15.137:3300/0 conn(0x7f8ca00cfb80 0x7f8ca00b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.718+0000 7f8c9ea00640 1 -- 172.21.15.133:0/1069892408 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca00d10d0 con 0x7f8ca00d2240 2024-03-30T01:53:06.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.718+0000 7f8c9ea00640 1 -- 172.21.15.133:0/1069892408 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f8c88001670 con 0x7f8ca00d2240 2024-03-30T01:53:06.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.718+0000 7f8c9ea00640 1 -- 172.21.15.133:0/1069892408 >> v1:172.21.15.133:6789/0 conn(0x7f8ca00d2240 legacy=0x7f8ca00cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:06.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.718+0000 7f8c9ea00640 1 --2- 172.21.15.133:0/1069892408 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ca015cc50 0x7f8c84003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:06.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.718+0000 7f8c9ea00640 1 --2- 172.21.15.133:0/1069892408 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c84003ef0 0x7f8c840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:06.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.718+0000 7f8c9ea00640 1 --2- 172.21.15.133:0/1069892408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c84004d00 0x7f8c84005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:06.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.719+0000 7f8c9ea00640 1 -- 172.21.15.133:0/1069892408 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca00d1c50 con 0x7f8c84004d00 2024-03-30T01:53:06.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.719+0000 7f8c9ea00640 1 -- 172.21.15.133:0/1069892408 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca00b5af0 con 0x7f8c84003ef0 2024-03-30T01:53:06.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.719+0000 7f8c9ea00640 1 -- 172.21.15.133:0/1069892408 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8400b980 con 0x7f8ca015cc50 2024-03-30T01:53:06.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.719+0000 7f8c9fe00640 1 --2- 172.21.15.133:0/1069892408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c84004d00 0x7f8c84005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:06.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.719+0000 7f8c96a00640 1 --2- 172.21.15.133:0/1069892408 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c84003ef0 0x7f8c840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:06.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.719+0000 7f8c9f400640 1 --2- 172.21.15.133:0/1069892408 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ca015cc50 0x7f8c84003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:06.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.719+0000 7f8c9fe00640 1 -- 172.21.15.133:0/1069892408 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ca015cc50 msgr2=0x7f8c84003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:06.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.719+0000 7f8c9fe00640 1 --2- 172.21.15.133:0/1069892408 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ca015cc50 0x7f8c84003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.719+0000 7f8c9fe00640 1 -- 172.21.15.133:0/1069892408 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c84003ef0 msgr2=0x7f8c840047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:06.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.719+0000 7f8c9fe00640 1 --2- 172.21.15.133:0/1069892408 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c84003ef0 0x7f8c840047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.719+0000 7f8c9fe00640 1 -- 172.21.15.133:0/1069892408 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c84003520 con 0x7f8c84004d00 2024-03-30T01:53:06.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.719+0000 7f8c9f400640 1 --2- 172.21.15.133:0/1069892408 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ca015cc50 0x7f8c84003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:06.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.720+0000 7f8c9fe00640 1 --2- 172.21.15.133:0/1069892408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c84004d00 0x7f8c84005180 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009fc0 tx=0x7f8c840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e186ce032f1cfe server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:06.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.720+0000 7f8c9ea00640 1 -- 172.21.15.133:0/1069892408 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9802cc40 con 0x7f8c84004d00 2024-03-30T01:53:06.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.721+0000 7f8c9ea00640 1 -- 172.21.15.133:0/1069892408 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9800f040 con 0x7f8c84004d00 2024-03-30T01:53:06.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.721+0000 7f8c9ea00640 1 -- 172.21.15.133:0/1069892408 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c98034440 con 0x7f8c84004d00 2024-03-30T01:53:06.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.721+0000 7f8ca6800640 1 -- 172.21.15.133:0/1069892408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c84004d00 msgr2=0x7f8c84005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:06.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.721+0000 7f8ca6800640 1 --2- 172.21.15.133:0/1069892408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c84004d00 0x7f8c84005180 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009fc0 tx=0x7f8c840057f0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.721+0000 7f8c9fe00640 1 -- 172.21.15.133:0/1069892408 reap_dead start 2024-03-30T01:53:06.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.721+0000 7f8ca6800640 1 -- 172.21.15.133:0/1069892408 shutdown_connections 2024-03-30T01:53:06.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.721+0000 7f8ca6800640 1 -- 172.21.15.133:0/1069892408 >> 172.21.15.133:0/1069892408 conn(0x7f8ca0071a40 msgr2=0x7f8ca006b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:06.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.721+0000 7f8ca6800640 1 -- 172.21.15.133:0/1069892408 shutdown_connections 2024-03-30T01:53:06.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.721+0000 7f8ca6800640 1 -- 172.21.15.133:0/1069892408 wait complete. 2024-03-30T01:53:06.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.723+0000 7f8ca6800640 1 Processor -- start 2024-03-30T01:53:06.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.723+0000 7f8ca6800640 1 -- start start 2024-03-30T01:53:06.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.724+0000 7f8ca6800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c84004d00 0x7f8ca015d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:06.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.724+0000 7f8ca6800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ca0152ad0 0x7f8ca01f5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:06.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.724+0000 7f8ca6800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ca01f5a50 0x7f8ca00b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:06.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.724+0000 7f8ca6800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca01f5ed0 con 0x7f8ca0152ad0 2024-03-30T01:53:06.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.724+0000 7f8ca6800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca00c8ea0 con 0x7f8c84004d00 2024-03-30T01:53:06.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.724+0000 7f8ca6800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca0158f20 con 0x7f8ca01f5a50 2024-03-30T01:53:06.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.724+0000 7f8c96a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ca0152ad0 0x7f8ca01f5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:06.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.724+0000 7f8c96a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ca0152ad0 0x7f8ca01f5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54488/0 (socket says 172.21.15.133:54488) 2024-03-30T01:53:06.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.724+0000 7f8c96a00640 1 -- 172.21.15.133:0/1015499807 learned_addr learned my addr 172.21.15.133:0/1015499807 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:06.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.725+0000 7f8c96a00640 1 -- 172.21.15.133:0/1015499807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ca01f5a50 msgr2=0x7f8ca00b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:06.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.725+0000 7f8c9f400640 1 --2- 172.21.15.133:0/1015499807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c84004d00 0x7f8ca015d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:06.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.725+0000 7f8c9fe00640 1 --2- 172.21.15.133:0/1015499807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ca01f5a50 0x7f8ca00b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:06.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.725+0000 7f8c96a00640 1 --2- 172.21.15.133:0/1015499807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ca01f5a50 0x7f8ca00b4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.725+0000 7f8c96a00640 1 -- 172.21.15.133:0/1015499807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c84004d00 msgr2=0x7f8ca015d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:06.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.725+0000 7f8c96a00640 1 --2- 172.21.15.133:0/1015499807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c84004d00 0x7f8ca015d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.725+0000 7f8c96a00640 1 -- 172.21.15.133:0/1015499807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca0156ad0 con 0x7f8ca0152ad0 2024-03-30T01:53:06.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.725+0000 7f8c96a00640 1 --2- 172.21.15.133:0/1015499807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ca0152ad0 0x7f8ca01f5510 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800d910 tx=0x7f8c8800ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:06.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.725+0000 7f8c97e00640 1 -- 172.21.15.133:0/1015499807 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88007560 con 0x7f8ca0152ad0 2024-03-30T01:53:06.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.725+0000 7f8c97e00640 1 -- 172.21.15.133:0/1015499807 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c880047e0 con 0x7f8ca0152ad0 2024-03-30T01:53:06.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.725+0000 7f8c97e00640 1 -- 172.21.15.133:0/1015499807 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88004bb0 con 0x7f8ca0152ad0 2024-03-30T01:53:06.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.725+0000 7f8ca6800640 1 -- 172.21.15.133:0/1015499807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca015e340 con 0x7f8ca0152ad0 2024-03-30T01:53:06.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.726+0000 7f8ca6800640 1 -- 172.21.15.133:0/1015499807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca0156760 con 0x7f8ca0152ad0 2024-03-30T01:53:06.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.727+0000 7f8ca6800640 1 -- 172.21.15.133:0/1015499807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca0156c60 con 0x7f8ca0152ad0 2024-03-30T01:53:06.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.728+0000 7f8c97e00640 1 -- 172.21.15.133:0/1015499807 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f8c88004d10 con 0x7f8ca0152ad0 2024-03-30T01:53:06.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.729+0000 7f8c97e00640 1 --2- 172.21.15.133:0/1015499807 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f8c7c06ac30 0x7f8c7c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:06.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.729+0000 7f8c97e00640 1 -- 172.21.15.133:0/1015499807 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8c88088dd0 con 0x7f8ca0152ad0 2024-03-30T01:53:06.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.729+0000 7f8c9f400640 1 --2- 172.21.15.133:0/1015499807 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f8c7c06ac30 0x7f8c7c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:06.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.730+0000 7f8c9f400640 1 --2- 172.21.15.133:0/1015499807 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f8c7c06ac30 0x7f8c7c06d0f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8c900099c0 tx=0x7f8c90008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:06.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.734+0000 7f8c97e00640 1 -- 172.21.15.133:0/1015499807 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f8c88053f40 con 0x7f8ca0152ad0 2024-03-30T01:53:06.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.929+0000 7f8ca6800640 1 -- 172.21.15.133:0/1015499807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8ca0066d80 con 0x7f8ca0152ad0 2024-03-30T01:53:06.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.930+0000 7f8c97e00640 1 -- 172.21.15.133:0/1015499807 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c88019020 con 0x7f8ca0152ad0 2024-03-30T01:53:06.937 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-03-30T01:53:06.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.933+0000 7f8ca6800640 1 -- 172.21.15.133:0/1015499807 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f8c7c06ac30 msgr2=0x7f8c7c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:06.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.933+0000 7f8ca6800640 1 --2- 172.21.15.133:0/1015499807 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f8c7c06ac30 0x7f8c7c06d0f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8c900099c0 tx=0x7f8c90008040 comp rx=0 tx=0).stop 2024-03-30T01:53:06.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.933+0000 7f8ca6800640 1 -- 172.21.15.133:0/1015499807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ca0152ad0 msgr2=0x7f8ca01f5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:06.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.933+0000 7f8ca6800640 1 --2- 172.21.15.133:0/1015499807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ca0152ad0 0x7f8ca01f5510 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800d910 tx=0x7f8c8800ddd0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.933+0000 7f8ca6800640 1 -- 172.21.15.133:0/1015499807 shutdown_connections 2024-03-30T01:53:06.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.933+0000 7f8ca6800640 1 --2- 172.21.15.133:0/1015499807 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f8c7c06ac30 0x7f8c7c06d0f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.933+0000 7f8ca6800640 1 --2- 172.21.15.133:0/1015499807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ca01f5a50 0x7f8ca00b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.933+0000 7f8ca6800640 1 --2- 172.21.15.133:0/1015499807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ca0152ad0 0x7f8ca01f5510 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.933+0000 7f8ca6800640 1 --2- 172.21.15.133:0/1015499807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c84004d00 0x7f8ca015d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:06.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.933+0000 7f8ca6800640 1 -- 172.21.15.133:0/1015499807 >> 172.21.15.133:0/1015499807 conn(0x7f8ca0071a40 msgr2=0x7f8ca00c9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:06.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.933+0000 7f8ca6800640 1 -- 172.21.15.133:0/1015499807 shutdown_connections 2024-03-30T01:53:06.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:06.934+0000 7f8ca6800640 1 -- 172.21.15.133:0/1015499807 wait complete. 2024-03-30T01:53:06.960 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T01:53:07.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.163+0000 7f23caa00640 1 Processor -- start 2024-03-30T01:53:07.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.163+0000 7f23caa00640 1 -- start start 2024-03-30T01:53:07.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.165+0000 7f23caa00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f23c40ce2c0 0x7f23c40cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:07.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.165+0000 7f23caa00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c40b2200 con 0x7f23c406e170 2024-03-30T01:53:07.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.165+0000 7f23caa00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c40b1940 con 0x7f23c4159680 2024-03-30T01:53:07.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.165+0000 7f23caa00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c40b47e0 con 0x7f23c40ce2c0 2024-03-30T01:53:07.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.165+0000 7f23c8c00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f23c406e170 0x7f23c415d180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57676/0 (socket says 172.21.15.133:57676) 2024-03-30T01:53:07.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.165+0000 7f23c8c00640 1 -- 172.21.15.133:0/4014594783 learned_addr learned my addr 172.21.15.133:0/4014594783 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:07.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.165+0000 7f23ca000640 1 --2- 172.21.15.133:0/4014594783 >> v2:172.21.15.133:3300/0 conn(0x7f23c40ce2c0 0x7f23c40cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:07.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.165+0000 7f23ca000640 1 -- 172.21.15.133:0/4014594783 >> v1:172.21.15.137:6789/0 conn(0x7f23c4159680 legacy=0x7f23c406da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:07.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.165+0000 7f23ca000640 1 -- 172.21.15.133:0/4014594783 >> v1:172.21.15.133:6789/0 conn(0x7f23c406e170 legacy=0x7f23c415d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:07.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.165+0000 7f23ca000640 1 -- 172.21.15.133:0/4014594783 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c40b1bb0 con 0x7f23c40ce2c0 2024-03-30T01:53:07.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.165+0000 7f23c3e00640 1 -- 172.21.15.133:0/4014594783 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063235032 0 0) 0x7f23c40b2200 con 0x7f23c406e170 2024-03-30T01:53:07.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.167+0000 7f23ca000640 1 --2- 172.21.15.133:0/4014594783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c40ce2c0 0x7f23c40cbae0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f23bc009d90 tx=0x7f23bc02bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a72c55ea02e704f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:07.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.167+0000 7f23c3e00640 1 -- 172.21.15.133:0/4014594783 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc02cb40 con 0x7f23c40ce2c0 2024-03-30T01:53:07.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.167+0000 7f23c3e00640 1 -- 172.21.15.133:0/4014594783 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23bc02cca0 con 0x7f23c40ce2c0 2024-03-30T01:53:07.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.167+0000 7f23c3e00640 1 -- 172.21.15.133:0/4014594783 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc034660 con 0x7f23c40ce2c0 2024-03-30T01:53:07.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.167+0000 7f23caa00640 1 -- 172.21.15.133:0/4014594783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c40ce2c0 msgr2=0x7f23c40cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:07.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.167+0000 7f23caa00640 1 --2- 172.21.15.133:0/4014594783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c40ce2c0 0x7f23c40cbae0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f23bc009d90 tx=0x7f23bc02bd90 comp rx=0 tx=0).stop 2024-03-30T01:53:07.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.167+0000 7f23caa00640 1 -- 172.21.15.133:0/4014594783 shutdown_connections 2024-03-30T01:53:07.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.167+0000 7f23caa00640 1 --2- 172.21.15.133:0/4014594783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c40ce2c0 0x7f23c40cbae0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:07.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.167+0000 7f23caa00640 1 -- 172.21.15.133:0/4014594783 >> 172.21.15.133:0/4014594783 conn(0x7f23c40b05a0 msgr2=0x7f23c40b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:07.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.168+0000 7f23caa00640 1 -- 172.21.15.133:0/4014594783 shutdown_connections 2024-03-30T01:53:07.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.168+0000 7f23caa00640 1 -- 172.21.15.133:0/4014594783 wait complete. 2024-03-30T01:53:07.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.169+0000 7f23caa00640 1 Processor -- start 2024-03-30T01:53:07.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.169+0000 7f23caa00640 1 -- start start 2024-03-30T01:53:07.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.170+0000 7f23caa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23c406e170 0x7f23c4140130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:07.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.170+0000 7f23caa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c40ce2c0 0x7f23c413ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:07.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.170+0000 7f23caa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23c4159680 0x7f23c4153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:07.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.170+0000 7f23caa00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c413d6e0 con 0x7f23c40ce2c0 2024-03-30T01:53:07.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.170+0000 7f23caa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c413dca0 con 0x7f23c406e170 2024-03-30T01:53:07.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.170+0000 7f23caa00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c4140670 con 0x7f23c4159680 2024-03-30T01:53:07.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.171+0000 7f23c8c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c40ce2c0 0x7f23c413ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:07.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.171+0000 7f23c8c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c40ce2c0 0x7f23c413ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54504/0 (socket says 172.21.15.133:54504) 2024-03-30T01:53:07.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.171+0000 7f23c8c00640 1 -- 172.21.15.133:0/3106060071 learned_addr learned my addr 172.21.15.133:0/3106060071 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:07.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.171+0000 7f23c8c00640 1 -- 172.21.15.133:0/3106060071 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23c4159680 msgr2=0x7f23c4153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:07.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.171+0000 7f23c8c00640 1 --2- 172.21.15.133:0/3106060071 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23c4159680 0x7f23c4153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:07.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.171+0000 7f23c9600640 1 --2- 172.21.15.133:0/3106060071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23c406e170 0x7f23c4140130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:07.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.171+0000 7f23c8c00640 1 -- 172.21.15.133:0/3106060071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23c406e170 msgr2=0x7f23c4140130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:07.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.171+0000 7f23c8c00640 1 --2- 172.21.15.133:0/3106060071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23c406e170 0x7f23c4140130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:07.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.171+0000 7f23c8c00640 1 -- 172.21.15.133:0/3106060071 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23bc009a70 con 0x7f23c40ce2c0 2024-03-30T01:53:07.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.171+0000 7f23c8c00640 1 --2- 172.21.15.133:0/3106060071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c40ce2c0 0x7f23c413ce00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f23b400c430 tx=0x7f23b400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:07.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.172+0000 7f23c1600640 1 -- 172.21.15.133:0/3106060071 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b40074e0 con 0x7f23c40ce2c0 2024-03-30T01:53:07.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.172+0000 7f23c1600640 1 -- 172.21.15.133:0/3106060071 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b4007660 con 0x7f23c40ce2c0 2024-03-30T01:53:07.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.172+0000 7f23c1600640 1 -- 172.21.15.133:0/3106060071 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b4004a20 con 0x7f23c40ce2c0 2024-03-30T01:53:07.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.172+0000 7f23caa00640 1 -- 172.21.15.133:0/3106060071 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c40b2810 con 0x7f23c40ce2c0 2024-03-30T01:53:07.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.172+0000 7f23caa00640 1 -- 172.21.15.133:0/3106060071 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c414f1f0 con 0x7f23c40ce2c0 2024-03-30T01:53:07.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.173+0000 7f23caa00640 1 -- 172.21.15.133:0/3106060071 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c413de10 con 0x7f23c40ce2c0 2024-03-30T01:53:07.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.174+0000 7f23c1600640 1 -- 172.21.15.133:0/3106060071 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f23b4004b80 con 0x7f23c40ce2c0 2024-03-30T01:53:07.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.175+0000 7f23c1600640 1 --2- 172.21.15.133:0/3106060071 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f23a806ac00 0x7f23a806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:07.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.175+0000 7f23c1600640 1 -- 172.21.15.133:0/3106060071 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f23b40892f0 con 0x7f23c40ce2c0 2024-03-30T01:53:07.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.175+0000 7f23c9600640 1 --2- 172.21.15.133:0/3106060071 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f23a806ac00 0x7f23a806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:07.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.176+0000 7f23c9600640 1 --2- 172.21.15.133:0/3106060071 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f23a806ac00 0x7f23a806d0c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f23b8003d90 tx=0x7f23b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:07.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.179+0000 7f23c1600640 1 -- 172.21.15.133:0/3106060071 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f23b40543d0 con 0x7f23c40ce2c0 2024-03-30T01:53:07.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.411+0000 7f23caa00640 1 -- 172.21.15.133:0/3106060071 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23c40b2670 con 0x7f23c40ce2c0 2024-03-30T01:53:07.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.412+0000 7f23c1600640 1 -- 172.21.15.133:0/3106060071 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f23c40b2670 con 0x7f23c40ce2c0 2024-03-30T01:53:07.418 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:53:07.418 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/820901593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":820901593},{"type":"v1","addr":"172.21.15.137:6834","nonce":820901593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3524452213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3524452213},{"type":"v1","addr":"172.21.15.137:6835","nonce":3524452213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3989486478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3989486478},{"type":"v1","addr":"172.21.15.133:6837","nonce":3989486478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T01:52:55.753449+0000","modified":"2024-03-30T01:52:59.774372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.133:6836/1431848593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1431848593},{"type":"v1","addr":"172.21.15.133:6836","nonce":1431848593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":2}]} 2024-03-30T01:53:07.419 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 24 2024-03-30T01:53:07.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.415+0000 7f23caa00640 1 -- 172.21.15.133:0/3106060071 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f23a806ac00 msgr2=0x7f23a806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:07.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.415+0000 7f23caa00640 1 --2- 172.21.15.133:0/3106060071 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f23a806ac00 0x7f23a806d0c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f23b8003d90 tx=0x7f23b8009040 comp rx=0 tx=0).stop 2024-03-30T01:53:07.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.415+0000 7f23caa00640 1 -- 172.21.15.133:0/3106060071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c40ce2c0 msgr2=0x7f23c413ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:07.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.415+0000 7f23caa00640 1 --2- 172.21.15.133:0/3106060071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c40ce2c0 0x7f23c413ce00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f23b400c430 tx=0x7f23b400c8f0 comp rx=0 tx=0).stop 2024-03-30T01:53:07.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.415+0000 7f23caa00640 1 -- 172.21.15.133:0/3106060071 shutdown_connections 2024-03-30T01:53:07.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.415+0000 7f23caa00640 1 --2- 172.21.15.133:0/3106060071 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f23a806ac00 0x7f23a806d0c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:07.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.415+0000 7f23caa00640 1 --2- 172.21.15.133:0/3106060071 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23c4159680 0x7f23c4153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:07.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.415+0000 7f23caa00640 1 --2- 172.21.15.133:0/3106060071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c40ce2c0 0x7f23c413ce00 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:07.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.415+0000 7f23caa00640 1 --2- 172.21.15.133:0/3106060071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23c406e170 0x7f23c4140130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:07.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.415+0000 7f23caa00640 1 -- 172.21.15.133:0/3106060071 >> 172.21.15.133:0/3106060071 conn(0x7f23c40b05a0 msgr2=0x7f23c40702b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:07.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.415+0000 7f23caa00640 1 -- 172.21.15.133:0/3106060071 shutdown_connections 2024-03-30T01:53:07.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.415+0000 7f23caa00640 1 -- 172.21.15.133:0/3106060071 wait complete. 2024-03-30T01:53:07.440 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:53:07.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.637+0000 7f2329a00640 1 Processor -- start 2024-03-30T01:53:07.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.637+0000 7f2329a00640 1 -- start start 2024-03-30T01:53:07.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.638+0000 7f2329a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f232415ea60 0x7f2324070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:07.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.639+0000 7f2329a00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23240b3db0 con 0x7f23240b38b0 2024-03-30T01:53:07.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.639+0000 7f2329a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f232415ee40 con 0x7f2324070a40 2024-03-30T01:53:07.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.639+0000 7f2329a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2324070eb0 con 0x7f232415ea60 2024-03-30T01:53:07.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.639+0000 7f2323400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f23240b38b0 0x7f23240b18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57684/0 (socket says 172.21.15.133:57684) 2024-03-30T01:53:07.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.639+0000 7f2323400640 1 -- 172.21.15.133:0/2135929804 learned_addr learned my addr 172.21.15.133:0/2135929804 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:07.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.639+0000 7f2322a00640 1 --2- 172.21.15.133:0/2135929804 >> v2:172.21.15.137:3300/0 conn(0x7f232415ea60 0x7f2324070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:07.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.639+0000 7f2322000640 1 -- 172.21.15.133:0/2135929804 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307689885 0 0) 0x7f23240b3db0 con 0x7f23240b38b0 2024-03-30T01:53:07.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.639+0000 7f2322000640 1 -- 172.21.15.133:0/2135929804 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2308003520 con 0x7f23240b38b0 2024-03-30T01:53:07.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.640+0000 7f2322000640 1 -- 172.21.15.133:0/2135929804 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 604572026 0 0) 0x7f2308003520 con 0x7f23240b38b0 2024-03-30T01:53:07.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.640+0000 7f2322000640 1 -- 172.21.15.133:0/2135929804 >> v2:172.21.15.137:3300/0 conn(0x7f232415ea60 msgr2=0x7f2324070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:07.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.640+0000 7f2322000640 1 --2- 172.21.15.133:0/2135929804 >> v2:172.21.15.137:3300/0 conn(0x7f232415ea60 0x7f2324070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:07.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.640+0000 7f2322000640 1 -- 172.21.15.133:0/2135929804 >> v1:172.21.15.137:6789/0 conn(0x7f2324070a40 legacy=0x7f23240b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:07.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.640+0000 7f2322000640 1 -- 172.21.15.133:0/2135929804 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2324161510 con 0x7f23240b38b0 2024-03-30T01:53:07.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.640+0000 7f2322000640 1 -- 172.21.15.133:0/2135929804 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f231c0019f0 con 0x7f23240b38b0 2024-03-30T01:53:07.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.640+0000 7f2322000640 1 -- 172.21.15.133:0/2135929804 >> v1:172.21.15.133:6789/0 conn(0x7f23240b38b0 legacy=0x7f23240b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:07.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.640+0000 7f2322000640 1 --2- 172.21.15.133:0/2135929804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23080039c0 0x7f2308003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:07.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.640+0000 7f2322000640 1 --2- 172.21.15.133:0/2135929804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23080047c0 0x7f2308004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:07.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.640+0000 7f2322000640 1 --2- 172.21.15.133:0/2135929804 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23080051d0 0x7f230800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:07.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.640+0000 7f2322000640 1 -- 172.21.15.133:0/2135929804 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2324070eb0 con 0x7f23080047c0 2024-03-30T01:53:07.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.640+0000 7f2322000640 1 -- 172.21.15.133:0/2135929804 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230800c120 con 0x7f23080039c0 2024-03-30T01:53:07.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.640+0000 7f2322000640 1 -- 172.21.15.133:0/2135929804 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230800c2e0 con 0x7f23080051d0 2024-03-30T01:53:07.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.640+0000 7f231a000640 1 --2- 172.21.15.133:0/2135929804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23080047c0 0x7f2308004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:07.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.641+0000 7f2322a00640 1 --2- 172.21.15.133:0/2135929804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23080039c0 0x7f2308003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:07.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.641+0000 7f231a000640 1 -- 172.21.15.133:0/2135929804 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23080051d0 msgr2=0x7f230800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:07.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.641+0000 7f2323400640 1 --2- 172.21.15.133:0/2135929804 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23080051d0 0x7f230800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:07.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.641+0000 7f231a000640 1 --2- 172.21.15.133:0/2135929804 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23080051d0 0x7f230800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:07.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.641+0000 7f231a000640 1 -- 172.21.15.133:0/2135929804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23080039c0 msgr2=0x7f2308003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:07.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.641+0000 7f231a000640 1 --2- 172.21.15.133:0/2135929804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23080039c0 0x7f2308003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:07.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.641+0000 7f231a000640 1 -- 172.21.15.133:0/2135929804 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2308003520 con 0x7f23080047c0 2024-03-30T01:53:07.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.641+0000 7f2322a00640 1 --2- 172.21.15.133:0/2135929804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23080039c0 0x7f2308003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:07.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.641+0000 7f2323400640 1 -- 172.21.15.133:0/2135929804 reap_dead start 2024-03-30T01:53:07.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.642+0000 7f231a000640 1 --2- 172.21.15.133:0/2135929804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23080047c0 0x7f2308004c40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f230c001720 tx=0x7f23080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e5c09823f9cbe7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:07.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.642+0000 7f2322000640 1 -- 172.21.15.133:0/2135929804 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c0052d0 con 0x7f23080047c0 2024-03-30T01:53:07.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.642+0000 7f2322000640 1 -- 172.21.15.133:0/2135929804 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c02e050 con 0x7f23080047c0 2024-03-30T01:53:07.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.642+0000 7f2322000640 1 -- 172.21.15.133:0/2135929804 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c003830 con 0x7f23080047c0 2024-03-30T01:53:07.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.643+0000 7f2329a00640 1 -- 172.21.15.133:0/2135929804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23080047c0 msgr2=0x7f2308004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:07.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.643+0000 7f2329a00640 1 --2- 172.21.15.133:0/2135929804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23080047c0 0x7f2308004c40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f230c001720 tx=0x7f23080057f0 comp rx=0 tx=0).stop 2024-03-30T01:53:07.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.643+0000 7f2329a00640 1 -- 172.21.15.133:0/2135929804 shutdown_connections 2024-03-30T01:53:07.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.643+0000 7f2329a00640 1 --2- 172.21.15.133:0/2135929804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23080047c0 0x7f2308004c40 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:07.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.643+0000 7f2329a00640 1 -- 172.21.15.133:0/2135929804 >> 172.21.15.133:0/2135929804 conn(0x7f23240b07a0 msgr2=0x7f23240b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:07.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.643+0000 7f2329a00640 1 -- 172.21.15.133:0/2135929804 shutdown_connections 2024-03-30T01:53:07.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.643+0000 7f2329a00640 1 -- 172.21.15.133:0/2135929804 wait complete. 2024-03-30T01:53:07.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.644+0000 7f2329a00640 1 Processor -- start 2024-03-30T01:53:07.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.645+0000 7f2329a00640 1 -- start start 2024-03-30T01:53:07.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.646+0000 7f2329a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23080047c0 0x7f23240ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:07.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.646+0000 7f2329a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23241585e0 0x7f23241559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:07.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.646+0000 7f2329a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2324140fc0 0x7f2324141440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:07.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.646+0000 7f2329a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23240aeb30 con 0x7f2324140fc0 2024-03-30T01:53:07.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.646+0000 7f2329a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23240aee10 con 0x7f23080047c0 2024-03-30T01:53:07.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.646+0000 7f2329a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23240af0f0 con 0x7f23241585e0 2024-03-30T01:53:07.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.646+0000 7f2323400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2324140fc0 0x7f2324141440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:07.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.646+0000 7f2323400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2324140fc0 0x7f2324141440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54524/0 (socket says 172.21.15.133:54524) 2024-03-30T01:53:07.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.646+0000 7f2323400640 1 -- 172.21.15.133:0/866110946 learned_addr learned my addr 172.21.15.133:0/866110946 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:07.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.646+0000 7f2322a00640 1 --2- 172.21.15.133:0/866110946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23080047c0 0x7f23240ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:07.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.646+0000 7f231a000640 1 --2- 172.21.15.133:0/866110946 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23241585e0 0x7f23241559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:07.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.646+0000 7f2323400640 1 -- 172.21.15.133:0/866110946 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23241585e0 msgr2=0x7f23241559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:07.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.646+0000 7f2323400640 1 --2- 172.21.15.133:0/866110946 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23241585e0 0x7f23241559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:07.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.646+0000 7f2323400640 1 -- 172.21.15.133:0/866110946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23080047c0 msgr2=0x7f23240ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:07.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.646+0000 7f2323400640 1 --2- 172.21.15.133:0/866110946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23080047c0 0x7f23240ae430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:07.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.646+0000 7f2323400640 1 -- 172.21.15.133:0/866110946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23240af3d0 con 0x7f2324140fc0 2024-03-30T01:53:07.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.647+0000 7f2323400640 1 --2- 172.21.15.133:0/866110946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2324140fc0 0x7f2324141440 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f232406d940 tx=0x7f231c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:07.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.647+0000 7f231b400640 1 -- 172.21.15.133:0/866110946 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c004d60 con 0x7f2324140fc0 2024-03-30T01:53:07.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.647+0000 7f231b400640 1 -- 172.21.15.133:0/866110946 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231c00bb80 con 0x7f2324140fc0 2024-03-30T01:53:07.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.647+0000 7f231b400640 1 -- 172.21.15.133:0/866110946 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c007070 con 0x7f2324140fc0 2024-03-30T01:53:07.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.647+0000 7f2329a00640 1 -- 172.21.15.133:0/866110946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23240af6b0 con 0x7f2324140fc0 2024-03-30T01:53:07.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.647+0000 7f2329a00640 1 -- 172.21.15.133:0/866110946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23240afbd0 con 0x7f2324140fc0 2024-03-30T01:53:07.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.648+0000 7f2329a00640 1 -- 172.21.15.133:0/866110946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23240af8a0 con 0x7f2324140fc0 2024-03-30T01:53:07.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.649+0000 7f231b400640 1 -- 172.21.15.133:0/866110946 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f231c0071d0 con 0x7f2324140fc0 2024-03-30T01:53:07.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.650+0000 7f231b400640 1 --2- 172.21.15.133:0/866110946 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f230006ac30 0x7f230006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:07.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.650+0000 7f231b400640 1 -- 172.21.15.133:0/866110946 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f231c089880 con 0x7f2324140fc0 2024-03-30T01:53:07.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.650+0000 7f2322a00640 1 --2- 172.21.15.133:0/866110946 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f230006ac30 0x7f230006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:07.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.651+0000 7f2322a00640 1 --2- 172.21.15.133:0/866110946 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f230006ac30 0x7f230006d0f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2324072b00 tx=0x7f2314008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:07.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.655+0000 7f231b400640 1 -- 172.21.15.133:0/866110946 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f231c0548d0 con 0x7f2324140fc0 2024-03-30T01:53:07.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.852+0000 7f2329a00640 1 -- 172.21.15.133:0/866110946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2324066d80 con 0x7f2324140fc0 2024-03-30T01:53:07.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.855+0000 7f231b400640 1 -- 172.21.15.133:0/866110946 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16278 (secure 0 0 0) 0x7f231c057ef0 con 0x7f2324140fc0 2024-03-30T01:53:07.862 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:53:07.863 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":36,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:52:55.753199+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:52:43.357481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-30T01:52:44.221573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6836/665764657":"2024-03-31T01:52:54.232727+0000","172.21.15.133:6834/665764657":"2024-03-31T01:52:54.232727+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:53:07.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.858+0000 7f2329a00640 1 -- 172.21.15.133:0/866110946 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f230006ac30 msgr2=0x7f230006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:07.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.858+0000 7f2329a00640 1 --2- 172.21.15.133:0/866110946 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f230006ac30 0x7f230006d0f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2324072b00 tx=0x7f2314008040 comp rx=0 tx=0).stop 2024-03-30T01:53:07.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.858+0000 7f2329a00640 1 -- 172.21.15.133:0/866110946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2324140fc0 msgr2=0x7f2324141440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:07.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.858+0000 7f2329a00640 1 --2- 172.21.15.133:0/866110946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2324140fc0 0x7f2324141440 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f232406d940 tx=0x7f231c00b4a0 comp rx=0 tx=0).stop 2024-03-30T01:53:07.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.858+0000 7f2329a00640 1 -- 172.21.15.133:0/866110946 shutdown_connections 2024-03-30T01:53:07.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.858+0000 7f2329a00640 1 --2- 172.21.15.133:0/866110946 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f230006ac30 0x7f230006d0f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:07.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.858+0000 7f2329a00640 1 --2- 172.21.15.133:0/866110946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2324140fc0 0x7f2324141440 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:07.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.858+0000 7f2329a00640 1 --2- 172.21.15.133:0/866110946 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23241585e0 0x7f23241559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:07.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.858+0000 7f2329a00640 1 --2- 172.21.15.133:0/866110946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23080047c0 0x7f23240ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:07.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.858+0000 7f2329a00640 1 -- 172.21.15.133:0/866110946 >> 172.21.15.133:0/866110946 conn(0x7f23240b07a0 msgr2=0x7f23240cd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:07.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.859+0000 7f2329a00640 1 -- 172.21.15.133:0/866110946 shutdown_connections 2024-03-30T01:53:07.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:07.859+0000 7f2329a00640 1 -- 172.21.15.133:0/866110946 wait complete. 2024-03-30T01:53:07.884 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-30T01:53:07.885 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T01:53:08.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.087+0000 7fe82be00640 1 Processor -- start 2024-03-30T01:53:08.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.087+0000 7fe82be00640 1 -- start start 2024-03-30T01:53:08.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.088+0000 7fe82be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe82c15b9c0 0x7fe82c0b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:08.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.089+0000 7fe82be00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe82c0ccd00 0x7fe82c15e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:08.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.089+0000 7fe82be00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe82c0b4550 con 0x7fe82c0b40f0 2024-03-30T01:53:08.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.089+0000 7fe82be00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe82c15bda0 con 0x7fe82c0ccd00 2024-03-30T01:53:08.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.089+0000 7fe82be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0cd170 con 0x7fe82c15b9c0 2024-03-30T01:53:08.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.089+0000 7fe82b400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe82c0ccd00 0x7fe82c15e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:08.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.089+0000 7fe82b400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe82c0ccd00 0x7fe82c15e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54528/0 (socket says 172.21.15.133:54528) 2024-03-30T01:53:08.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.089+0000 7fe82b400640 1 -- 172.21.15.133:0/48602467 learned_addr learned my addr 172.21.15.133:0/48602467 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:08.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.089+0000 7fe82aa00640 1 --2- 172.21.15.133:0/48602467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe82c15b9c0 0x7fe82c0b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:08.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.089+0000 7fe82b400640 1 -- 172.21.15.133:0/48602467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe82c15b9c0 msgr2=0x7fe82c0b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:08.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.089+0000 7fe82b400640 1 --2- 172.21.15.133:0/48602467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe82c15b9c0 0x7fe82c0b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:08.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.089+0000 7fe82b400640 1 -- 172.21.15.133:0/48602467 >> v1:172.21.15.137:6789/0 conn(0x7fe82c0b40f0 legacy=0x7fe82c0cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:08.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.090+0000 7fe82b400640 1 -- 172.21.15.133:0/48602467 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c13dba0 con 0x7fe82c0ccd00 2024-03-30T01:53:08.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.090+0000 7fe82aa00640 1 --2- 172.21.15.133:0/48602467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe82c15b9c0 0x7fe82c0b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:08.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.091+0000 7fe82b400640 1 --2- 172.21.15.133:0/48602467 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe82c0ccd00 0x7fe82c15e330 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe824009e50 tx=0x7fe82402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f27b7c85491e05 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:08.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.091+0000 7fe829600640 1 -- 172.21.15.133:0/48602467 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82402cb00 con 0x7fe82c0ccd00 2024-03-30T01:53:08.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.091+0000 7fe829600640 1 -- 172.21.15.133:0/48602467 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82402cc60 con 0x7fe82c0ccd00 2024-03-30T01:53:08.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.091+0000 7fe829600640 1 -- 172.21.15.133:0/48602467 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8240343f0 con 0x7fe82c0ccd00 2024-03-30T01:53:08.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.092+0000 7fe82be00640 1 -- 172.21.15.133:0/48602467 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe82c0ccd00 msgr2=0x7fe82c15e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:08.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.092+0000 7fe82be00640 1 --2- 172.21.15.133:0/48602467 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe82c0ccd00 0x7fe82c15e330 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe824009e50 tx=0x7fe82402bf60 comp rx=0 tx=0).stop 2024-03-30T01:53:08.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.092+0000 7fe82be00640 1 -- 172.21.15.133:0/48602467 shutdown_connections 2024-03-30T01:53:08.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.092+0000 7fe82be00640 1 --2- 172.21.15.133:0/48602467 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe82c0ccd00 0x7fe82c15e330 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:08.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.092+0000 7fe82be00640 1 --2- 172.21.15.133:0/48602467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe82c15b9c0 0x7fe82c0b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:08.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.092+0000 7fe82be00640 1 -- 172.21.15.133:0/48602467 >> 172.21.15.133:0/48602467 conn(0x7fe82c0b05a0 msgr2=0x7fe82c0b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:08.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.092+0000 7fe82be00640 1 -- 172.21.15.133:0/48602467 shutdown_connections 2024-03-30T01:53:08.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.092+0000 7fe82be00640 1 -- 172.21.15.133:0/48602467 wait complete. 2024-03-30T01:53:08.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.094+0000 7fe82be00640 1 Processor -- start 2024-03-30T01:53:08.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.094+0000 7fe82be00640 1 -- start start 2024-03-30T01:53:08.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.095+0000 7fe82be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe82c0b40f0 0x7fe82c13c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:08.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.095+0000 7fe82be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe82c0ccd00 0x7fe82c153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:08.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.095+0000 7fe82be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe82c15b9c0 0x7fe82c0b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:08.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.095+0000 7fe82be00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c153b30 con 0x7fe82c0b40f0 2024-03-30T01:53:08.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.095+0000 7fe82be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c153e10 con 0x7fe82c0ccd00 2024-03-30T01:53:08.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.095+0000 7fe82be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c1540f0 con 0x7fe82c15b9c0 2024-03-30T01:53:08.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.095+0000 7fe82aa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe82c0b40f0 0x7fe82c13c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:08.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.095+0000 7fe82aa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe82c0b40f0 0x7fe82c13c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54538/0 (socket says 172.21.15.133:54538) 2024-03-30T01:53:08.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.095+0000 7fe82aa00640 1 -- 172.21.15.133:0/3752370651 learned_addr learned my addr 172.21.15.133:0/3752370651 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:08.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.095+0000 7fe82b400640 1 --2- 172.21.15.133:0/3752370651 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe82c15b9c0 0x7fe82c0b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:08.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.095+0000 7fe82a000640 1 --2- 172.21.15.133:0/3752370651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe82c0ccd00 0x7fe82c153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:08.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.096+0000 7fe82aa00640 1 -- 172.21.15.133:0/3752370651 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe82c15b9c0 msgr2=0x7fe82c0b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:08.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.096+0000 7fe82aa00640 1 --2- 172.21.15.133:0/3752370651 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe82c15b9c0 0x7fe82c0b2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:08.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.096+0000 7fe82aa00640 1 -- 172.21.15.133:0/3752370651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe82c0ccd00 msgr2=0x7fe82c153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:08.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.096+0000 7fe82aa00640 1 --2- 172.21.15.133:0/3752370651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe82c0ccd00 0x7fe82c153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:08.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.096+0000 7fe82aa00640 1 -- 172.21.15.133:0/3752370651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe824009b30 con 0x7fe82c0b40f0 2024-03-30T01:53:08.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.096+0000 7fe82aa00640 1 --2- 172.21.15.133:0/3752370651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe82c0b40f0 0x7fe82c13c920 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00c7f0 tx=0x7fe81c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:08.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.096+0000 7fe822a00640 1 -- 172.21.15.133:0/3752370651 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c007820 con 0x7fe82c0b40f0 2024-03-30T01:53:08.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.096+0000 7fe822a00640 1 -- 172.21.15.133:0/3752370651 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81c007980 con 0x7fe82c0b40f0 2024-03-30T01:53:08.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.096+0000 7fe822a00640 1 -- 172.21.15.133:0/3752370651 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c007cf0 con 0x7fe82c0b40f0 2024-03-30T01:53:08.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.096+0000 7fe82be00640 1 -- 172.21.15.133:0/3752370651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82c1543d0 con 0x7fe82c0b40f0 2024-03-30T01:53:08.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.096+0000 7fe82be00640 1 -- 172.21.15.133:0/3752370651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82c1537d0 con 0x7fe82c0b40f0 2024-03-30T01:53:08.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.098+0000 7fe82be00640 1 -- 172.21.15.133:0/3752370651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe82c073750 con 0x7fe82c0b40f0 2024-03-30T01:53:08.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.098+0000 7fe822a00640 1 -- 172.21.15.133:0/3752370651 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe81c0113f0 con 0x7fe82c0b40f0 2024-03-30T01:53:08.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.099+0000 7fe822a00640 1 --2- 172.21.15.133:0/3752370651 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe80c06ac00 0x7fe80c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:08.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.099+0000 7fe822a00640 1 -- 172.21.15.133:0/3752370651 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe81c0896e0 con 0x7fe82c0b40f0 2024-03-30T01:53:08.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.099+0000 7fe82a000640 1 --2- 172.21.15.133:0/3752370651 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe80c06ac00 0x7fe80c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:08.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.100+0000 7fe82a000640 1 --2- 172.21.15.133:0/3752370651 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe80c06ac00 0x7fe80c06d0c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0cc2a0 tx=0x7fe818009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:08.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.103+0000 7fe822a00640 1 -- 172.21.15.133:0/3752370651 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fe81c054850 con 0x7fe82c0b40f0 2024-03-30T01:53:08.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.336+0000 7fe82be00640 1 -- 172.21.15.133:0/3752370651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe82c13f250 con 0x7fe82c0b40f0 2024-03-30T01:53:08.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.338+0000 7fe822a00640 1 -- 172.21.15.133:0/3752370651 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4743 (secure 0 0 0) 0x7fe81c057e70 con 0x7fe82c0b40f0 2024-03-30T01:53:08.344 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:53:08.344 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/820901593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":820901593},{"type":"v1","addr":"172.21.15.137:6834","nonce":820901593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3524452213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3524452213},{"type":"v1","addr":"172.21.15.137:6835","nonce":3524452213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3989486478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3989486478},{"type":"v1","addr":"172.21.15.133:6837","nonce":3989486478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T01:52:55.753449+0000","modified":"2024-03-30T01:52:59.774372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.133:6836/1431848593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1431848593},{"type":"v1","addr":"172.21.15.133:6836","nonce":1431848593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":2}]} 2024-03-30T01:53:08.344 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 24 2024-03-30T01:53:08.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.340+0000 7fe82be00640 1 -- 172.21.15.133:0/3752370651 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe80c06ac00 msgr2=0x7fe80c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:08.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.340+0000 7fe82be00640 1 --2- 172.21.15.133:0/3752370651 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe80c06ac00 0x7fe80c06d0c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0cc2a0 tx=0x7fe818009040 comp rx=0 tx=0).stop 2024-03-30T01:53:08.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.341+0000 7fe82be00640 1 -- 172.21.15.133:0/3752370651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe82c0b40f0 msgr2=0x7fe82c13c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:08.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.341+0000 7fe82be00640 1 --2- 172.21.15.133:0/3752370651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe82c0b40f0 0x7fe82c13c920 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00c7f0 tx=0x7fe81c00ccb0 comp rx=0 tx=0).stop 2024-03-30T01:53:08.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.341+0000 7fe82be00640 1 -- 172.21.15.133:0/3752370651 shutdown_connections 2024-03-30T01:53:08.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.341+0000 7fe82be00640 1 --2- 172.21.15.133:0/3752370651 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe80c06ac00 0x7fe80c06d0c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:08.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.341+0000 7fe82be00640 1 --2- 172.21.15.133:0/3752370651 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe82c15b9c0 0x7fe82c0b2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:08.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.341+0000 7fe82be00640 1 --2- 172.21.15.133:0/3752370651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe82c0ccd00 0x7fe82c153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:08.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.341+0000 7fe82be00640 1 --2- 172.21.15.133:0/3752370651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe82c0b40f0 0x7fe82c13c920 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:08.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.341+0000 7fe82be00640 1 -- 172.21.15.133:0/3752370651 >> 172.21.15.133:0/3752370651 conn(0x7fe82c0b05a0 msgr2=0x7fe82c0ae510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:08.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.341+0000 7fe82be00640 1 -- 172.21.15.133:0/3752370651 shutdown_connections 2024-03-30T01:53:08.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.341+0000 7fe82be00640 1 -- 172.21.15.133:0/3752370651 wait complete. 2024-03-30T01:53:08.364 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T01:53:08.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.565+0000 7f3701200640 1 Processor -- start 2024-03-30T01:53:08.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.565+0000 7f3701200640 1 -- start start 2024-03-30T01:53:08.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.567+0000 7f3701200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f36fc15cc50 0x7f36fc0d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:08.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.567+0000 7f3701200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36fc0d2240 0x7f36fc0cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:08.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.567+0000 7f3701200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36fc15d030 con 0x7f36fc0cf9b0 2024-03-30T01:53:08.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.567+0000 7f3701200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36fc0d1c50 con 0x7f36fc15cc50 2024-03-30T01:53:08.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.567+0000 7f3701200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc0cfe40 con 0x7f36fc0d2240 2024-03-30T01:53:08.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.568+0000 7f36f9e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f36fc15cc50 0x7f36fc0d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:08.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.568+0000 7f36f9400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36fc0d2240 0x7f36fc0cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:08.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.568+0000 7f36f9e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f36fc15cc50 0x7f36fc0d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.133:56168/0 (socket says 172.21.15.133:56168) 2024-03-30T01:53:08.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.568+0000 7f36f9e00640 1 -- 172.21.15.133:0/873581972 learned_addr learned my addr 172.21.15.133:0/873581972 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:08.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.568+0000 7f36f9e00640 1 -- 172.21.15.133:0/873581972 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36fc0d2240 msgr2=0x7f36fc0cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:08.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.569+0000 7f36f9e00640 1 --2- 172.21.15.133:0/873581972 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36fc0d2240 0x7f36fc0cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:08.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.569+0000 7f36f9e00640 1 -- 172.21.15.133:0/873581972 >> v1:172.21.15.137:6789/0 conn(0x7f36fc0cf9b0 legacy=0x7f36fc0b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:08.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.569+0000 7f36f9e00640 1 -- 172.21.15.133:0/873581972 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc0b5af0 con 0x7f36fc15cc50 2024-03-30T01:53:08.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.570+0000 7f36f9e00640 1 --2- 172.21.15.133:0/873581972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36fc15cc50 0x7f36fc0d0af0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009870 tx=0x7f36ec02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0be642204491a50 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:08.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.570+0000 7f36f8a00640 1 -- 172.21.15.133:0/873581972 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec030840 con 0x7f36fc15cc50 2024-03-30T01:53:08.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.571+0000 7f36f8a00640 1 -- 172.21.15.133:0/873581972 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec0309a0 con 0x7f36fc15cc50 2024-03-30T01:53:08.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.571+0000 7f36f8a00640 1 -- 172.21.15.133:0/873581972 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec030d30 con 0x7f36fc15cc50 2024-03-30T01:53:08.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.571+0000 7f3701200640 1 -- 172.21.15.133:0/873581972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36fc15cc50 msgr2=0x7f36fc0d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:08.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.571+0000 7f3701200640 1 --2- 172.21.15.133:0/873581972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36fc15cc50 0x7f36fc0d0af0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009870 tx=0x7f36ec02b980 comp rx=0 tx=0).stop 2024-03-30T01:53:08.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.571+0000 7f3701200640 1 -- 172.21.15.133:0/873581972 shutdown_connections 2024-03-30T01:53:08.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.571+0000 7f3701200640 1 --2- 172.21.15.133:0/873581972 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36fc0d2240 0x7f36fc0cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:08.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.571+0000 7f3701200640 1 --2- 172.21.15.133:0/873581972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36fc15cc50 0x7f36fc0d0af0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:08.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.571+0000 7f3701200640 1 -- 172.21.15.133:0/873581972 >> 172.21.15.133:0/873581972 conn(0x7f36fc071a40 msgr2=0x7f36fc06b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:08.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.572+0000 7f3701200640 1 -- 172.21.15.133:0/873581972 shutdown_connections 2024-03-30T01:53:08.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.572+0000 7f3701200640 1 -- 172.21.15.133:0/873581972 wait complete. 2024-03-30T01:53:08.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.573+0000 7f3701200640 1 Processor -- start 2024-03-30T01:53:08.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.574+0000 7f3701200640 1 -- start start 2024-03-30T01:53:08.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.574+0000 7f3701200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36fc0cf9b0 0x7f36fc0ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:08.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.574+0000 7f3701200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36fc0d2240 0x7f36fc0cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:08.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.574+0000 7f3701200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36fc15cc50 0x7f36fc157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:08.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.574+0000 7f3701200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc156820 con 0x7f36fc0cf9b0 2024-03-30T01:53:08.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.575+0000 7f3701200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc153410 con 0x7f36fc0d2240 2024-03-30T01:53:08.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.575+0000 7f3701200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc0cae20 con 0x7f36fc15cc50 2024-03-30T01:53:08.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.575+0000 7f36f9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36fc0cf9b0 0x7f36fc0ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:08.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.575+0000 7f36f9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36fc0cf9b0 0x7f36fc0ca540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54552/0 (socket says 172.21.15.133:54552) 2024-03-30T01:53:08.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.575+0000 7f36f9e00640 1 -- 172.21.15.133:0/1800360073 learned_addr learned my addr 172.21.15.133:0/1800360073 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:08.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.575+0000 7f36fa800640 1 --2- 172.21.15.133:0/1800360073 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36fc15cc50 0x7f36fc157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:08.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.575+0000 7f36f9400640 1 --2- 172.21.15.133:0/1800360073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36fc0d2240 0x7f36fc0cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:08.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.575+0000 7f36f9e00640 1 -- 172.21.15.133:0/1800360073 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36fc15cc50 msgr2=0x7f36fc157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:08.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.575+0000 7f36f9e00640 1 --2- 172.21.15.133:0/1800360073 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36fc15cc50 0x7f36fc157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:08.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.575+0000 7f36f9e00640 1 -- 172.21.15.133:0/1800360073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36fc0d2240 msgr2=0x7f36fc0cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:08.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.575+0000 7f36f9e00640 1 --2- 172.21.15.133:0/1800360073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36fc0d2240 0x7f36fc0cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:08.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.575+0000 7f36f9e00640 1 -- 172.21.15.133:0/1800360073 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ec0094d0 con 0x7f36fc0cf9b0 2024-03-30T01:53:08.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.575+0000 7f36fa800640 1 --2- 172.21.15.133:0/1800360073 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36fc15cc50 0x7f36fc157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:08.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.576+0000 7f36f9e00640 1 --2- 172.21.15.133:0/1800360073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36fc0cf9b0 0x7f36fc0ca540 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f36ec000c00 tx=0x7f36ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:08.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.576+0000 7f36f2000640 1 -- 172.21.15.133:0/1800360073 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec039a90 con 0x7f36fc0cf9b0 2024-03-30T01:53:08.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.576+0000 7f36f2000640 1 -- 172.21.15.133:0/1800360073 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec039bf0 con 0x7f36fc0cf9b0 2024-03-30T01:53:08.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.576+0000 7f36f2000640 1 -- 172.21.15.133:0/1800360073 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec043410 con 0x7f36fc0cf9b0 2024-03-30T01:53:08.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.576+0000 7f3701200640 1 -- 172.21.15.133:0/1800360073 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36fc152ae0 con 0x7f36fc0cf9b0 2024-03-30T01:53:08.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.576+0000 7f3701200640 1 -- 172.21.15.133:0/1800360073 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36fc0caa80 con 0x7f36fc0cf9b0 2024-03-30T01:53:08.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.577+0000 7f3701200640 1 -- 172.21.15.133:0/1800360073 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36fc066d80 con 0x7f36fc0cf9b0 2024-03-30T01:53:08.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.578+0000 7f36f2000640 1 -- 172.21.15.133:0/1800360073 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f36ec02f390 con 0x7f36fc0cf9b0 2024-03-30T01:53:08.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.580+0000 7f36f2000640 1 --2- 172.21.15.133:0/1800360073 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f36dc06ac00 0x7f36dc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:08.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.580+0000 7f36f2000640 1 -- 172.21.15.133:0/1800360073 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f36ec0ab8c0 con 0x7f36fc0cf9b0 2024-03-30T01:53:08.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.580+0000 7f36f9400640 1 --2- 172.21.15.133:0/1800360073 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f36dc06ac00 0x7f36dc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:08.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.581+0000 7f36f9400640 1 --2- 172.21.15.133:0/1800360073 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f36dc06ac00 0x7f36dc06d0c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f36fc0b5530 tx=0x7f36e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:08.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.584+0000 7f36f2000640 1 -- 172.21.15.133:0/1800360073 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f36ec076b50 con 0x7f36fc0cf9b0 2024-03-30T01:53:08.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.819+0000 7f3701200640 1 -- 172.21.15.133:0/1800360073 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36fc15c1a0 con 0x7f36fc0cf9b0 2024-03-30T01:53:08.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.821+0000 7f36f2000640 1 -- 172.21.15.133:0/1800360073 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f36ec034090 con 0x7f36fc0cf9b0 2024-03-30T01:53:08.827 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:53:08.827 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/820901593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":820901593},{"type":"v1","addr":"172.21.15.137:6834","nonce":820901593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3524452213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3524452213},{"type":"v1","addr":"172.21.15.137:6835","nonce":3524452213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3989486478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3989486478},{"type":"v1","addr":"172.21.15.133:6837","nonce":3989486478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T01:52:55.753449+0000","modified":"2024-03-30T01:52:59.774372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.133:6836/1431848593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1431848593},{"type":"v1","addr":"172.21.15.133:6836","nonce":1431848593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":2}]} 2024-03-30T01:53:08.827 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 24 2024-03-30T01:53:08.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.824+0000 7f3701200640 1 -- 172.21.15.133:0/1800360073 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f36dc06ac00 msgr2=0x7f36dc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:08.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.824+0000 7f3701200640 1 --2- 172.21.15.133:0/1800360073 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f36dc06ac00 0x7f36dc06d0c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f36fc0b5530 tx=0x7f36e8008040 comp rx=0 tx=0).stop 2024-03-30T01:53:08.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.824+0000 7f3701200640 1 -- 172.21.15.133:0/1800360073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36fc0cf9b0 msgr2=0x7f36fc0ca540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:08.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.824+0000 7f3701200640 1 --2- 172.21.15.133:0/1800360073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36fc0cf9b0 0x7f36fc0ca540 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f36ec000c00 tx=0x7f36ec004730 comp rx=0 tx=0).stop 2024-03-30T01:53:08.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.824+0000 7f3701200640 1 -- 172.21.15.133:0/1800360073 shutdown_connections 2024-03-30T01:53:08.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.824+0000 7f3701200640 1 --2- 172.21.15.133:0/1800360073 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f36dc06ac00 0x7f36dc06d0c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:08.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.824+0000 7f3701200640 1 --2- 172.21.15.133:0/1800360073 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36fc15cc50 0x7f36fc157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:08.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.824+0000 7f3701200640 1 --2- 172.21.15.133:0/1800360073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36fc0d2240 0x7f36fc0cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:08.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.824+0000 7f3701200640 1 --2- 172.21.15.133:0/1800360073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36fc0cf9b0 0x7f36fc0ca540 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:08.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.824+0000 7f3701200640 1 -- 172.21.15.133:0/1800360073 >> 172.21.15.133:0/1800360073 conn(0x7f36fc071a40 msgr2=0x7f36fc15f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:08.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.824+0000 7f3701200640 1 -- 172.21.15.133:0/1800360073 shutdown_connections 2024-03-30T01:53:08.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:08.824+0000 7f3701200640 1 -- 172.21.15.133:0/1800360073 wait complete. 2024-03-30T01:53:08.848 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:53:09.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.045+0000 7ff3f1a00640 1 Processor -- start 2024-03-30T01:53:09.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.045+0000 7ff3f1a00640 1 -- start start 2024-03-30T01:53:09.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.046+0000 7ff3f1a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3ec143790 0x7ff3ec0cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:09.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.046+0000 7ff3f1a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff3ec070500 0x7ff3ec070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:09.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.047+0000 7ff3f1a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3ec0a76a0 con 0x7ff3ec0cc530 2024-03-30T01:53:09.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.047+0000 7ff3f1a00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3ec0b38e0 con 0x7ff3ec070500 2024-03-30T01:53:09.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.047+0000 7ff3f1a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec0cd180 con 0x7ff3ec143790 2024-03-30T01:53:09.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.047+0000 7ff3e2000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff3ec070500 0x7ff3ec070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:09.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.047+0000 7ff3e2000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff3ec070500 0x7ff3ec070960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54558/0 (socket says 172.21.15.133:54558) 2024-03-30T01:53:09.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.047+0000 7ff3e2000640 1 -- 172.21.15.133:0/1808723896 learned_addr learned my addr 172.21.15.133:0/1808723896 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:09.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.047+0000 7ff3e2000640 1 -- 172.21.15.133:0/1808723896 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3ec143790 msgr2=0x7ff3ec0cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:09.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.047+0000 7ff3e2000640 1 --2- 172.21.15.133:0/1808723896 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3ec143790 0x7ff3ec0cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.047+0000 7ff3e2000640 1 -- 172.21.15.133:0/1808723896 >> v1:172.21.15.137:6789/0 conn(0x7ff3ec0cc530 legacy=0x7ff3ec0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:09.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.047+0000 7ff3e2000640 1 -- 172.21.15.133:0/1808723896 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ec070ea0 con 0x7ff3ec070500 2024-03-30T01:53:09.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.048+0000 7ff3e2000640 1 --2- 172.21.15.133:0/1808723896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3ec070500 0x7ff3ec070960 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009870 tx=0x7ff3d402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567526fcf0d21b6a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:09.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.049+0000 7ff3ea000640 1 -- 172.21.15.133:0/1808723896 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4030840 con 0x7ff3ec070500 2024-03-30T01:53:09.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.049+0000 7ff3ea000640 1 -- 172.21.15.133:0/1808723896 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d40309a0 con 0x7ff3ec070500 2024-03-30T01:53:09.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.049+0000 7ff3ea000640 1 -- 172.21.15.133:0/1808723896 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4030d30 con 0x7ff3ec070500 2024-03-30T01:53:09.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.049+0000 7ff3f1a00640 1 -- 172.21.15.133:0/1808723896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3ec070500 msgr2=0x7ff3ec070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:09.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.049+0000 7ff3f1a00640 1 --2- 172.21.15.133:0/1808723896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3ec070500 0x7ff3ec070960 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009870 tx=0x7ff3d402b980 comp rx=0 tx=0).stop 2024-03-30T01:53:09.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.050+0000 7ff3f1a00640 1 -- 172.21.15.133:0/1808723896 shutdown_connections 2024-03-30T01:53:09.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.050+0000 7ff3f1a00640 1 --2- 172.21.15.133:0/1808723896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3ec070500 0x7ff3ec070960 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.050+0000 7ff3f1a00640 1 --2- 172.21.15.133:0/1808723896 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3ec143790 0x7ff3ec0cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.050+0000 7ff3f1a00640 1 -- 172.21.15.133:0/1808723896 >> 172.21.15.133:0/1808723896 conn(0x7ff3ec0b07a0 msgr2=0x7ff3ec0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:09.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.050+0000 7ff3f1a00640 1 -- 172.21.15.133:0/1808723896 shutdown_connections 2024-03-30T01:53:09.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.050+0000 7ff3f1a00640 1 -- 172.21.15.133:0/1808723896 wait complete. 2024-03-30T01:53:09.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.051+0000 7ff3f1a00640 1 Processor -- start 2024-03-30T01:53:09.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.052+0000 7ff3f1a00640 1 -- start start 2024-03-30T01:53:09.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.052+0000 7ff3f1a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3ec070500 0x7ff3ec138d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:09.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.052+0000 7ff3f1a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3ec0cc530 0x7ff3ec15d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:09.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.052+0000 7ff3f1a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3ec143790 0x7ff3ec1f1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:09.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.052+0000 7ff3f1a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec139340 con 0x7ff3ec143790 2024-03-30T01:53:09.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.052+0000 7ff3f1a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec139620 con 0x7ff3ec070500 2024-03-30T01:53:09.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.052+0000 7ff3f1a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec139900 con 0x7ff3ec0cc530 2024-03-30T01:53:09.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.053+0000 7ff3eb400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3ec143790 0x7ff3ec1f1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:09.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.053+0000 7ff3eb400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3ec143790 0x7ff3ec1f1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54574/0 (socket says 172.21.15.133:54574) 2024-03-30T01:53:09.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.053+0000 7ff3eb400640 1 -- 172.21.15.133:0/1476878477 learned_addr learned my addr 172.21.15.133:0/1476878477 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:09.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.053+0000 7ff3eb400640 1 -- 172.21.15.133:0/1476878477 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3ec0cc530 msgr2=0x7ff3ec15d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:09.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.053+0000 7ff3eb400640 1 --2- 172.21.15.133:0/1476878477 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3ec0cc530 0x7ff3ec15d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.053+0000 7ff3eb400640 1 -- 172.21.15.133:0/1476878477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3ec070500 msgr2=0x7ff3ec138d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:09.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.053+0000 7ff3eaa00640 1 --2- 172.21.15.133:0/1476878477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3ec070500 0x7ff3ec138d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:09.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.053+0000 7ff3eb400640 1 --2- 172.21.15.133:0/1476878477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3ec070500 0x7ff3ec138d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.053+0000 7ff3eb400640 1 -- 172.21.15.133:0/1476878477 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d40094d0 con 0x7ff3ec143790 2024-03-30T01:53:09.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.054+0000 7ff3eb400640 1 --2- 172.21.15.133:0/1476878477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3ec143790 0x7ff3ec1f1350 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400c780 tx=0x7ff3e400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:09.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.054+0000 7ff3e3400640 1 -- 172.21.15.133:0/1476878477 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e4003d80 con 0x7ff3ec143790 2024-03-30T01:53:09.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.054+0000 7ff3e3400640 1 -- 172.21.15.133:0/1476878477 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e400ce90 con 0x7ff3ec143790 2024-03-30T01:53:09.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.054+0000 7ff3f1a00640 1 -- 172.21.15.133:0/1476878477 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3ec139be0 con 0x7ff3ec143790 2024-03-30T01:53:09.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.054+0000 7ff3e3400640 1 -- 172.21.15.133:0/1476878477 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e40052b0 con 0x7ff3ec143790 2024-03-30T01:53:09.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.054+0000 7ff3f1a00640 1 -- 172.21.15.133:0/1476878477 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3ec15c3a0 con 0x7ff3ec143790 2024-03-30T01:53:09.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.055+0000 7ff3f1a00640 1 -- 172.21.15.133:0/1476878477 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3ec13a100 con 0x7ff3ec143790 2024-03-30T01:53:09.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.056+0000 7ff3e3400640 1 -- 172.21.15.133:0/1476878477 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ff3e4005410 con 0x7ff3ec143790 2024-03-30T01:53:09.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.057+0000 7ff3e3400640 1 --2- 172.21.15.133:0/1476878477 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff3c806ac00 0x7ff3c806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:09.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.057+0000 7ff3e3400640 1 -- 172.21.15.133:0/1476878477 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff3e40888d0 con 0x7ff3ec143790 2024-03-30T01:53:09.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.057+0000 7ff3eaa00640 1 --2- 172.21.15.133:0/1476878477 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff3c806ac00 0x7ff3c806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:09.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.058+0000 7ff3eaa00640 1 --2- 172.21.15.133:0/1476878477 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff3c806ac00 0x7ff3c806d0c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec0adf00 tx=0x7ff3dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:09.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.062+0000 7ff3e3400640 1 -- 172.21.15.133:0/1476878477 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7ff3ec13a100 con 0x7ff3ec143790 2024-03-30T01:53:09.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.261+0000 7ff3f1a00640 1 -- 172.21.15.133:0/1476878477 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3ec13a100 con 0x7ff3ec143790 2024-03-30T01:53:09.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.263+0000 7ff3e3400640 1 -- 172.21.15.133:0/1476878477 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16278 (secure 0 0 0) 0x7ff3ec13a100 con 0x7ff3ec143790 2024-03-30T01:53:09.269 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:53:09.269 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":36,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:52:55.753199+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-30T01:52:43.357481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-30T01:52:44.221573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6836/665764657":"2024-03-31T01:52:54.232727+0000","172.21.15.133:6834/665764657":"2024-03-31T01:52:54.232727+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:53:09.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.266+0000 7ff3f1a00640 1 -- 172.21.15.133:0/1476878477 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff3c806ac00 msgr2=0x7ff3c806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:09.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.266+0000 7ff3f1a00640 1 --2- 172.21.15.133:0/1476878477 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff3c806ac00 0x7ff3c806d0c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec0adf00 tx=0x7ff3dc008040 comp rx=0 tx=0).stop 2024-03-30T01:53:09.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.266+0000 7ff3f1a00640 1 -- 172.21.15.133:0/1476878477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3ec143790 msgr2=0x7ff3ec1f1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:09.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.266+0000 7ff3f1a00640 1 --2- 172.21.15.133:0/1476878477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3ec143790 0x7ff3ec1f1350 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400c780 tx=0x7ff3e400cc40 comp rx=0 tx=0).stop 2024-03-30T01:53:09.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.266+0000 7ff3f1a00640 1 -- 172.21.15.133:0/1476878477 shutdown_connections 2024-03-30T01:53:09.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.266+0000 7ff3f1a00640 1 --2- 172.21.15.133:0/1476878477 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff3c806ac00 0x7ff3c806d0c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.266+0000 7ff3f1a00640 1 --2- 172.21.15.133:0/1476878477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3ec143790 0x7ff3ec1f1350 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.266+0000 7ff3f1a00640 1 --2- 172.21.15.133:0/1476878477 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3ec0cc530 0x7ff3ec15d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.266+0000 7ff3f1a00640 1 --2- 172.21.15.133:0/1476878477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3ec070500 0x7ff3ec138d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.266+0000 7ff3f1a00640 1 -- 172.21.15.133:0/1476878477 >> 172.21.15.133:0/1476878477 conn(0x7ff3ec0b07a0 msgr2=0x7ff3ec0cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:09.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.266+0000 7ff3f1a00640 1 -- 172.21.15.133:0/1476878477 shutdown_connections 2024-03-30T01:53:09.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.266+0000 7ff3f1a00640 1 -- 172.21.15.133:0/1476878477 wait complete. 2024-03-30T01:53:09.291 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-30T01:53:09.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.493+0000 7f5407200640 1 Processor -- start 2024-03-30T01:53:09.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.493+0000 7f5407200640 1 -- start start 2024-03-30T01:53:09.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.495+0000 7f5407200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f540815b9c0 0x7f54080b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:09.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.495+0000 7f5407200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540813dba0 con 0x7f54080ccd00 2024-03-30T01:53:09.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.495+0000 7f5407200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54081408b0 con 0x7f54080b40f0 2024-03-30T01:53:09.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.495+0000 7f5407200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540815bda0 con 0x7f540815b9c0 2024-03-30T01:53:09.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.495+0000 7f5405e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f540815b9c0 0x7f54080b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:09.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.495+0000 7f5406800640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f54080ccd00 0x7f540815e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57700/0 (socket says 172.21.15.133:57700) 2024-03-30T01:53:09.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.495+0000 7f5406800640 1 -- 172.21.15.133:0/1889506821 learned_addr learned my addr 172.21.15.133:0/1889506821 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:09.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.496+0000 7f5405e00640 1 -- 172.21.15.133:0/1889506821 >> v1:172.21.15.137:6789/0 conn(0x7f54080b40f0 legacy=0x7f54080cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:09.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.496+0000 7f5405e00640 1 -- 172.21.15.133:0/1889506821 >> v1:172.21.15.133:6789/0 conn(0x7f54080ccd00 legacy=0x7f540815e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:09.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.496+0000 7f5405e00640 1 -- 172.21.15.133:0/1889506821 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540815ad40 con 0x7f540815b9c0 2024-03-30T01:53:09.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.496+0000 7f5404a00640 1 -- 172.21.15.133:0/1889506821 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818441917 0 0) 0x7f540813dba0 con 0x7f54080ccd00 2024-03-30T01:53:09.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.497+0000 7f5405e00640 1 --2- 172.21.15.133:0/1889506821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f540815b9c0 0x7f54080b3bb0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f53f80097a0 tx=0x7f53f802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a746d103977550f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:09.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.497+0000 7f5404a00640 1 -- 172.21.15.133:0/1889506821 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f8031830 con 0x7f540815b9c0 2024-03-30T01:53:09.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.497+0000 7f5404a00640 1 -- 172.21.15.133:0/1889506821 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f8031990 con 0x7f540815b9c0 2024-03-30T01:53:09.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.497+0000 7f5404a00640 1 -- 172.21.15.133:0/1889506821 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f8031d20 con 0x7f540815b9c0 2024-03-30T01:53:09.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.497+0000 7f5407200640 1 -- 172.21.15.133:0/1889506821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f540815b9c0 msgr2=0x7f54080b3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:09.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.497+0000 7f5407200640 1 --2- 172.21.15.133:0/1889506821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f540815b9c0 0x7f54080b3bb0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f53f80097a0 tx=0x7f53f802b8d0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.498+0000 7f5407200640 1 -- 172.21.15.133:0/1889506821 shutdown_connections 2024-03-30T01:53:09.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.498+0000 7f5407200640 1 --2- 172.21.15.133:0/1889506821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f540815b9c0 0x7f54080b3bb0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.498+0000 7f5407200640 1 -- 172.21.15.133:0/1889506821 >> 172.21.15.133:0/1889506821 conn(0x7f54080b05a0 msgr2=0x7f54080b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:09.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.498+0000 7f5407200640 1 -- 172.21.15.133:0/1889506821 shutdown_connections 2024-03-30T01:53:09.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.498+0000 7f5407200640 1 -- 172.21.15.133:0/1889506821 wait complete. 2024-03-30T01:53:09.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.499+0000 7f5407200640 1 Processor -- start 2024-03-30T01:53:09.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.500+0000 7f5407200640 1 -- start start 2024-03-30T01:53:09.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.500+0000 7f5407200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54080b40f0 0x7f5408137060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:09.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.501+0000 7f5407200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54080ccd00 0x7f5408138240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:09.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.501+0000 7f5407200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f540815b9c0 0x7f54081f0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:09.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.501+0000 7f5407200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54081f0370 con 0x7f54080b40f0 2024-03-30T01:53:09.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.501+0000 7f5407200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5408137940 con 0x7f540815b9c0 2024-03-30T01:53:09.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.501+0000 7f5407200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5408137be0 con 0x7f54080ccd00 2024-03-30T01:53:09.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.501+0000 7f5405e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54080b40f0 0x7f5408137060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:09.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.501+0000 7f5405e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54080b40f0 0x7f5408137060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54594/0 (socket says 172.21.15.133:54594) 2024-03-30T01:53:09.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.501+0000 7f5405e00640 1 -- 172.21.15.133:0/4160401991 learned_addr learned my addr 172.21.15.133:0/4160401991 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:09.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.501+0000 7f5405400640 1 --2- 172.21.15.133:0/4160401991 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54080ccd00 0x7f5408138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:09.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.501+0000 7f5405e00640 1 -- 172.21.15.133:0/4160401991 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54080ccd00 msgr2=0x7f5408138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:09.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.501+0000 7f5405e00640 1 --2- 172.21.15.133:0/4160401991 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54080ccd00 0x7f5408138240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.501+0000 7f5406800640 1 --2- 172.21.15.133:0/4160401991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f540815b9c0 0x7f54081f0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:09.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.501+0000 7f5405e00640 1 -- 172.21.15.133:0/4160401991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f540815b9c0 msgr2=0x7f54081f0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:09.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.501+0000 7f5405e00640 1 --2- 172.21.15.133:0/4160401991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f540815b9c0 0x7f54081f0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.501+0000 7f5405e00640 1 -- 172.21.15.133:0/4160401991 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f8009400 con 0x7f54080b40f0 2024-03-30T01:53:09.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.502+0000 7f5405e00640 1 --2- 172.21.15.133:0/4160401991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54080b40f0 0x7f5408137060 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f53f80097a0 tx=0x7f53f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:09.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.502+0000 7f53fe000640 1 -- 172.21.15.133:0/4160401991 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f803aa60 con 0x7f54080b40f0 2024-03-30T01:53:09.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.502+0000 7f53fe000640 1 -- 172.21.15.133:0/4160401991 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f803abc0 con 0x7f54080b40f0 2024-03-30T01:53:09.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.502+0000 7f53fe000640 1 -- 172.21.15.133:0/4160401991 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f80443f0 con 0x7f54080b40f0 2024-03-30T01:53:09.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.502+0000 7f5407200640 1 -- 172.21.15.133:0/4160401991 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5408137ec0 con 0x7f54080b40f0 2024-03-30T01:53:09.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.502+0000 7f5407200640 1 -- 172.21.15.133:0/4160401991 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54081eff50 con 0x7f54080b40f0 2024-03-30T01:53:09.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.503+0000 7f5407200640 1 -- 172.21.15.133:0/4160401991 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5408073750 con 0x7f54080b40f0 2024-03-30T01:53:09.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.504+0000 7f53fe000640 1 -- 172.21.15.133:0/4160401991 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f53f804d450 con 0x7f54080b40f0 2024-03-30T01:53:09.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.505+0000 7f53fe000640 1 --2- 172.21.15.133:0/4160401991 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f53e806ac00 0x7f53e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:09.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.505+0000 7f53fe000640 1 -- 172.21.15.133:0/4160401991 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f53f80ab6d0 con 0x7f54080b40f0 2024-03-30T01:53:09.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.505+0000 7f5405400640 1 --2- 172.21.15.133:0/4160401991 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f53e806ac00 0x7f53e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:09.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.506+0000 7f5405400640 1 --2- 172.21.15.133:0/4160401991 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f53e806ac00 0x7f53e806d0c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f54081f34e0 tx=0x7f53f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:09.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.509+0000 7f53fe000640 1 -- 172.21.15.133:0/4160401991 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f53f80767b0 con 0x7f54080b40f0 2024-03-30T01:53:09.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.744+0000 7f5407200640 1 -- 172.21.15.133:0/4160401991 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f540806d540 con 0x7f54080b40f0 2024-03-30T01:53:09.751 INFO:tasks.ceph.mon.a.smithi133.stderr:2024-03-30T01:53:09.745+0000 7fa124c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-30T01:53:09.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.762+0000 7f53fe000640 1 -- 172.21.15.133:0/4160401991 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7f53f8079dd0 con 0x7f54080b40f0 2024-03-30T01:53:09.768 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-30T01:53:09.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.764+0000 7f5407200640 1 -- 172.21.15.133:0/4160401991 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f53e806ac00 msgr2=0x7f53e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:09.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.764+0000 7f5407200640 1 --2- 172.21.15.133:0/4160401991 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f53e806ac00 0x7f53e806d0c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f54081f34e0 tx=0x7f53f4009040 comp rx=0 tx=0).stop 2024-03-30T01:53:09.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.764+0000 7f5407200640 1 -- 172.21.15.133:0/4160401991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54080b40f0 msgr2=0x7f5408137060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:09.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.764+0000 7f5407200640 1 --2- 172.21.15.133:0/4160401991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54080b40f0 0x7f5408137060 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f53f80097a0 tx=0x7f53f80046c0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.765+0000 7f5407200640 1 -- 172.21.15.133:0/4160401991 shutdown_connections 2024-03-30T01:53:09.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.765+0000 7f5407200640 1 --2- 172.21.15.133:0/4160401991 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f53e806ac00 0x7f53e806d0c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.765+0000 7f5407200640 1 --2- 172.21.15.133:0/4160401991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f540815b9c0 0x7f54081f0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.765+0000 7f5407200640 1 --2- 172.21.15.133:0/4160401991 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54080ccd00 0x7f5408138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.765+0000 7f5407200640 1 --2- 172.21.15.133:0/4160401991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54080b40f0 0x7f5408137060 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.765+0000 7f5407200640 1 -- 172.21.15.133:0/4160401991 >> 172.21.15.133:0/4160401991 conn(0x7f54080b05a0 msgr2=0x7f540813dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:09.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.765+0000 7f5407200640 1 -- 172.21.15.133:0/4160401991 shutdown_connections 2024-03-30T01:53:09.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.765+0000 7f5407200640 1 -- 172.21.15.133:0/4160401991 wait complete. 2024-03-30T01:53:09.776 INFO:tasks.ceph.mds.a.smithi133.stderr: -709> 2024-03-30T01:53:00.263+0000 7f925da00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-30T01:53:09.790 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-30T01:53:09.834 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2024-03-30T01:53:09.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.974+0000 7fe4d3200640 1 Processor -- start 2024-03-30T01:53:09.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.974+0000 7fe4d3200640 1 -- start start 2024-03-30T01:53:09.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.975+0000 7fe4d3200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe4d415b9c0 0x7fe4d40b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:09.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.976+0000 7fe4d3200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4d40ccd00 0x7fe4d415e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:09.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.976+0000 7fe4d3200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d413dba0 con 0x7fe4d40b40f0 2024-03-30T01:53:09.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.976+0000 7fe4d3200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4d415bda0 con 0x7fe4d415b9c0 2024-03-30T01:53:09.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.976+0000 7fe4d3200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d40cd170 con 0x7fe4d40ccd00 2024-03-30T01:53:09.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.976+0000 7fe4d1400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe4d40b40f0 0x7fe4d40cc5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57712/0 (socket says 172.21.15.133:57712) 2024-03-30T01:53:09.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.976+0000 7fe4d1400640 1 -- 172.21.15.133:0/3407594062 learned_addr learned my addr 172.21.15.133:0/3407594062 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:09.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.976+0000 7fe4d1e00640 1 --2- 172.21.15.133:0/3407594062 >> v2:172.21.15.137:3300/0 conn(0x7fe4d415b9c0 0x7fe4d40b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:09.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.976+0000 7fe4d2800640 1 --2- 172.21.15.133:0/3407594062 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4d40ccd00 0x7fe4d415e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:09.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.976+0000 7fe4d0a00640 1 -- 172.21.15.133:0/3407594062 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916236317 0 0) 0x7fe4d413dba0 con 0x7fe4d40b40f0 2024-03-30T01:53:09.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.977+0000 7fe4d0a00640 1 -- 172.21.15.133:0/3407594062 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4b8003520 con 0x7fe4d40b40f0 2024-03-30T01:53:09.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.977+0000 7fe4d0a00640 1 -- 172.21.15.133:0/3407594062 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1918521771 0 0) 0x7fe4b8003520 con 0x7fe4d40b40f0 2024-03-30T01:53:09.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.977+0000 7fe4d0a00640 1 -- 172.21.15.133:0/3407594062 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4d40ccd00 msgr2=0x7fe4d415e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:09.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.977+0000 7fe4d0a00640 1 --2- 172.21.15.133:0/3407594062 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4d40ccd00 0x7fe4d415e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.977+0000 7fe4d0a00640 1 -- 172.21.15.133:0/3407594062 >> v2:172.21.15.137:3300/0 conn(0x7fe4d415b9c0 msgr2=0x7fe4d40b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:09.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.977+0000 7fe4d0a00640 1 --2- 172.21.15.133:0/3407594062 >> v2:172.21.15.137:3300/0 conn(0x7fe4d415b9c0 0x7fe4d40b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.977+0000 7fe4d0a00640 1 -- 172.21.15.133:0/3407594062 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d41408b0 con 0x7fe4d40b40f0 2024-03-30T01:53:09.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.977+0000 7fe4d0a00640 1 -- 172.21.15.133:0/3407594062 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fe4c0001670 con 0x7fe4d40b40f0 2024-03-30T01:53:09.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.977+0000 7fe4d0a00640 1 -- 172.21.15.133:0/3407594062 >> v1:172.21.15.133:6789/0 conn(0x7fe4d40b40f0 legacy=0x7fe4d40cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:09.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.977+0000 7fe4d0a00640 1 --2- 172.21.15.133:0/3407594062 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4d40ccd00 0x7fe4b8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:09.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.977+0000 7fe4d0a00640 1 --2- 172.21.15.133:0/3407594062 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4b8003ef0 0x7fe4b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:09.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.977+0000 7fe4d0a00640 1 --2- 172.21.15.133:0/3407594062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4b8004d00 0x7fe4b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:09.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.977+0000 7fe4d0a00640 1 -- 172.21.15.133:0/3407594062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d415bda0 con 0x7fe4b8004d00 2024-03-30T01:53:09.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.977+0000 7fe4d0a00640 1 -- 172.21.15.133:0/3407594062 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b800b980 con 0x7fe4b8003ef0 2024-03-30T01:53:09.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.977+0000 7fe4d0a00640 1 -- 172.21.15.133:0/3407594062 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b800bac0 con 0x7fe4d40ccd00 2024-03-30T01:53:09.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.978+0000 7fe4d2800640 1 --2- 172.21.15.133:0/3407594062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4b8004d00 0x7fe4b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:09.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.978+0000 7fe4d1e00640 1 --2- 172.21.15.133:0/3407594062 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4d40ccd00 0x7fe4b8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:09.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.978+0000 7fe4d1400640 1 --2- 172.21.15.133:0/3407594062 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4b8003ef0 0x7fe4b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:09.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.978+0000 7fe4d2800640 1 -- 172.21.15.133:0/3407594062 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4d40ccd00 msgr2=0x7fe4b8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:09.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.978+0000 7fe4d2800640 1 --2- 172.21.15.133:0/3407594062 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4d40ccd00 0x7fe4b8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.978+0000 7fe4d2800640 1 -- 172.21.15.133:0/3407594062 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4b8003ef0 msgr2=0x7fe4b80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:09.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.978+0000 7fe4d2800640 1 --2- 172.21.15.133:0/3407594062 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4b8003ef0 0x7fe4b80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.978+0000 7fe4d2800640 1 -- 172.21.15.133:0/3407594062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b8003520 con 0x7fe4b8004d00 2024-03-30T01:53:09.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.979+0000 7fe4d2800640 1 --2- 172.21.15.133:0/3407594062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4b8004d00 0x7fe4b8005180 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc009fc0 tx=0x7fe4b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0b4ef5a4ae7c98 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:09.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.979+0000 7fe4d0a00640 1 -- 172.21.15.133:0/3407594062 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc02cc00 con 0x7fe4b8004d00 2024-03-30T01:53:09.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.979+0000 7fe4d0a00640 1 -- 172.21.15.133:0/3407594062 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4cc00f040 con 0x7fe4b8004d00 2024-03-30T01:53:09.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.979+0000 7fe4d0a00640 1 -- 172.21.15.133:0/3407594062 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc034440 con 0x7fe4b8004d00 2024-03-30T01:53:09.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.980+0000 7fe4d3200640 1 -- 172.21.15.133:0/3407594062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4b8004d00 msgr2=0x7fe4b8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:09.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.980+0000 7fe4d3200640 1 --2- 172.21.15.133:0/3407594062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4b8004d00 0x7fe4b8005180 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc009fc0 tx=0x7fe4b80057f0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.980+0000 7fe4d2800640 1 -- 172.21.15.133:0/3407594062 reap_dead start 2024-03-30T01:53:09.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.980+0000 7fe4d3200640 1 -- 172.21.15.133:0/3407594062 shutdown_connections 2024-03-30T01:53:09.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.980+0000 7fe4d3200640 1 -- 172.21.15.133:0/3407594062 >> 172.21.15.133:0/3407594062 conn(0x7fe4d40b05a0 msgr2=0x7fe4d40b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:09.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.980+0000 7fe4d3200640 1 -- 172.21.15.133:0/3407594062 shutdown_connections 2024-03-30T01:53:09.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.980+0000 7fe4d3200640 1 -- 172.21.15.133:0/3407594062 wait complete. 2024-03-30T01:53:09.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.982+0000 7fe4d3200640 1 Processor -- start 2024-03-30T01:53:09.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.982+0000 7fe4d3200640 1 -- start start 2024-03-30T01:53:09.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.983+0000 7fe4d3200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4b8004d00 0x7fe4d413a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:09.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.983+0000 7fe4d3200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4d41f3400 0x7fe4d41efe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:09.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.983+0000 7fe4d3200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4d41564c0 0x7fe4d4156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:09.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.983+0000 7fe4d3200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d41f03a0 con 0x7fe4d41564c0 2024-03-30T01:53:09.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.983+0000 7fe4d3200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d4156e80 con 0x7fe4b8004d00 2024-03-30T01:53:09.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.983+0000 7fe4d3200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d41f0590 con 0x7fe4d41f3400 2024-03-30T01:53:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.983+0000 7fe4d2800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4d41564c0 0x7fe4d4156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.983+0000 7fe4d2800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4d41564c0 0x7fe4d4156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54632/0 (socket says 172.21.15.133:54632) 2024-03-30T01:53:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.983+0000 7fe4d2800640 1 -- 172.21.15.133:0/4089842714 learned_addr learned my addr 172.21.15.133:0/4089842714 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.983+0000 7fe4d1e00640 1 --2- 172.21.15.133:0/4089842714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4b8004d00 0x7fe4d413a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.983+0000 7fe4d2800640 1 -- 172.21.15.133:0/4089842714 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4d41f3400 msgr2=0x7fe4d41efe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.983+0000 7fe4d2800640 1 --2- 172.21.15.133:0/4089842714 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4d41f3400 0x7fe4d41efe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.984+0000 7fe4d2800640 1 -- 172.21.15.133:0/4089842714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4b8004d00 msgr2=0x7fe4d413a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.984+0000 7fe4d2800640 1 --2- 172.21.15.133:0/4089842714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4b8004d00 0x7fe4d413a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.984+0000 7fe4d2800640 1 -- 172.21.15.133:0/4089842714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d41f0870 con 0x7fe4d41564c0 2024-03-30T01:53:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.984+0000 7fe4d2800640 1 --2- 172.21.15.133:0/4089842714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4d41564c0 0x7fe4d4156940 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc002230 tx=0x7fe4cc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.984+0000 7fe4ca000640 1 -- 172.21.15.133:0/4089842714 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc043070 con 0x7fe4d41564c0 2024-03-30T01:53:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.984+0000 7fe4ca000640 1 -- 172.21.15.133:0/4089842714 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4cc0349c0 con 0x7fe4d41564c0 2024-03-30T01:53:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.984+0000 7fe4ca000640 1 -- 172.21.15.133:0/4089842714 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc034d70 con 0x7fe4d41564c0 2024-03-30T01:53:09.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.984+0000 7fe4d3200640 1 -- 172.21.15.133:0/4089842714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d41f0b50 con 0x7fe4d41564c0 2024-03-30T01:53:09.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.984+0000 7fe4d3200640 1 -- 172.21.15.133:0/4089842714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d4154c10 con 0x7fe4d41564c0 2024-03-30T01:53:09.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.985+0000 7fe4d3200640 1 -- 172.21.15.133:0/4089842714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d41f1070 con 0x7fe4d41564c0 2024-03-30T01:53:09.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.986+0000 7fe4ca000640 1 -- 172.21.15.133:0/4089842714 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe4cc03e440 con 0x7fe4d41564c0 2024-03-30T01:53:09.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.987+0000 7fe4ca000640 1 --2- 172.21.15.133:0/4089842714 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe4b406ac30 0x7fe4b406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:09.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.987+0000 7fe4ca000640 1 -- 172.21.15.133:0/4089842714 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fe4cc0ab090 con 0x7fe4d41564c0 2024-03-30T01:53:09.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.987+0000 7fe4d1e00640 1 --2- 172.21.15.133:0/4089842714 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe4b406ac30 0x7fe4b406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:09.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.988+0000 7fe4d1e00640 1 --2- 172.21.15.133:0/4089842714 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe4b406ac30 0x7fe4b406d0f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe4c40099d0 tx=0x7fe4c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:09.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:09.992+0000 7fe4ca000640 1 -- 172.21.15.133:0/4089842714 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fe4cc0761b0 con 0x7fe4d41564c0 2024-03-30T01:53:10.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:10.221+0000 7fe4d3200640 1 -- 172.21.15.133:0/4089842714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe4d4073750 con 0x7fe4d41564c0 2024-03-30T01:53:10.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:10.766+0000 7fe4ca000640 1 -- 172.21.15.133:0/4089842714 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe4cc0797d0 con 0x7fe4d41564c0 2024-03-30T01:53:10.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:10.769+0000 7fe4d3200640 1 -- 172.21.15.133:0/4089842714 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe4b406ac30 msgr2=0x7fe4b406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:10.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:10.769+0000 7fe4d3200640 1 --2- 172.21.15.133:0/4089842714 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe4b406ac30 0x7fe4b406d0f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe4c40099d0 tx=0x7fe4c4008040 comp rx=0 tx=0).stop 2024-03-30T01:53:10.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:10.769+0000 7fe4d3200640 1 -- 172.21.15.133:0/4089842714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4d41564c0 msgr2=0x7fe4d4156940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:10.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:10.769+0000 7fe4d3200640 1 --2- 172.21.15.133:0/4089842714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4d41564c0 0x7fe4d4156940 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc002230 tx=0x7fe4cc009750 comp rx=0 tx=0).stop 2024-03-30T01:53:10.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:10.770+0000 7fe4d3200640 1 -- 172.21.15.133:0/4089842714 shutdown_connections 2024-03-30T01:53:10.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:10.770+0000 7fe4d3200640 1 --2- 172.21.15.133:0/4089842714 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fe4b406ac30 0x7fe4b406d0f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:10.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:10.770+0000 7fe4d3200640 1 --2- 172.21.15.133:0/4089842714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4d41564c0 0x7fe4d4156940 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:10.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:10.770+0000 7fe4d3200640 1 --2- 172.21.15.133:0/4089842714 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4d41f3400 0x7fe4d41efe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:10.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:10.770+0000 7fe4d3200640 1 --2- 172.21.15.133:0/4089842714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4b8004d00 0x7fe4d413a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:10.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:10.770+0000 7fe4d3200640 1 -- 172.21.15.133:0/4089842714 >> 172.21.15.133:0/4089842714 conn(0x7fe4d40b05a0 msgr2=0x7fe4d413dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:10.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:10.770+0000 7fe4d3200640 1 -- 172.21.15.133:0/4089842714 shutdown_connections 2024-03-30T01:53:10.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:10.770+0000 7fe4d3200640 1 -- 172.21.15.133:0/4089842714 wait complete. 2024-03-30T01:53:10.797 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-30T01:53:11.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.047+0000 7f0a3e800640 1 Processor -- start 2024-03-30T01:53:11.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.047+0000 7f0a3e800640 1 -- start start 2024-03-30T01:53:11.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.049+0000 7f0a3e800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0a3815df30 0x7f0a380cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:11.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.049+0000 7f0a3e800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0a3806bac0 0x7f0a380d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:11.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.049+0000 7f0a3e800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3815e310 con 0x7f0a380b1750 2024-03-30T01:53:11.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.049+0000 7f0a3e800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a380ce240 con 0x7f0a3815df30 2024-03-30T01:53:11.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.049+0000 7f0a3e800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a380d34c0 con 0x7f0a3806bac0 2024-03-30T01:53:11.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.049+0000 7f0a3d400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0a3815df30 0x7f0a380cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:11.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.049+0000 7f0a3d400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0a3815df30 0x7f0a380cdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54636/0 (socket says 172.21.15.133:54636) 2024-03-30T01:53:11.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.049+0000 7f0a3d400640 1 -- 172.21.15.133:0/1021486501 learned_addr learned my addr 172.21.15.133:0/1021486501 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:11.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.049+0000 7f0a3de00640 1 --2- 172.21.15.133:0/1021486501 >> v2:172.21.15.137:3300/0 conn(0x7f0a3806bac0 0x7f0a380d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:11.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.050+0000 7f0a3d400640 1 -- 172.21.15.133:0/1021486501 >> v2:172.21.15.137:3300/0 conn(0x7f0a3806bac0 msgr2=0x7f0a380d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:11.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.050+0000 7f0a3d400640 1 --2- 172.21.15.133:0/1021486501 >> v2:172.21.15.137:3300/0 conn(0x7f0a3806bac0 0x7f0a380d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:11.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.050+0000 7f0a3d400640 1 -- 172.21.15.133:0/1021486501 >> v1:172.21.15.137:6789/0 conn(0x7f0a380b1750 legacy=0x7f0a3806b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:11.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.050+0000 7f0a3d400640 1 -- 172.21.15.133:0/1021486501 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a380d37a0 con 0x7f0a3815df30 2024-03-30T01:53:11.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.051+0000 7f0a3d400640 1 --2- 172.21.15.133:0/1021486501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a3815df30 0x7f0a380cdd00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0a38161a00 tx=0x7f0a2c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b2a98240662dc9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:11.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.052+0000 7f0a37e00640 1 -- 172.21.15.133:0/1021486501 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c031870 con 0x7f0a3815df30 2024-03-30T01:53:11.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.052+0000 7f0a37e00640 1 -- 172.21.15.133:0/1021486501 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c0319d0 con 0x7f0a3815df30 2024-03-30T01:53:11.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.052+0000 7f0a37e00640 1 -- 172.21.15.133:0/1021486501 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c031d60 con 0x7f0a3815df30 2024-03-30T01:53:11.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.052+0000 7f0a3e800640 1 -- 172.21.15.133:0/1021486501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a3815df30 msgr2=0x7f0a380cdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:11.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.052+0000 7f0a3e800640 1 --2- 172.21.15.133:0/1021486501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a3815df30 0x7f0a380cdd00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0a38161a00 tx=0x7f0a2c02b910 comp rx=0 tx=0).stop 2024-03-30T01:53:11.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.052+0000 7f0a3e800640 1 -- 172.21.15.133:0/1021486501 shutdown_connections 2024-03-30T01:53:11.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.052+0000 7f0a3e800640 1 --2- 172.21.15.133:0/1021486501 >> v2:172.21.15.137:3300/0 conn(0x7f0a3806bac0 0x7f0a380d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:11.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.052+0000 7f0a3e800640 1 --2- 172.21.15.133:0/1021486501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a3815df30 0x7f0a380cdd00 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:11.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.052+0000 7f0a3e800640 1 -- 172.21.15.133:0/1021486501 >> 172.21.15.133:0/1021486501 conn(0x7f0a380b4a20 msgr2=0x7f0a380d28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:11.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.053+0000 7f0a3e800640 1 -- 172.21.15.133:0/1021486501 shutdown_connections 2024-03-30T01:53:11.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.053+0000 7f0a3e800640 1 -- 172.21.15.133:0/1021486501 wait complete. 2024-03-30T01:53:11.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.054+0000 7f0a3e800640 1 Processor -- start 2024-03-30T01:53:11.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.054+0000 7f0a3e800640 1 -- start start 2024-03-30T01:53:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.055+0000 7f0a3e800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a3806bac0 0x7f0a381f2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.055+0000 7f0a3e800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a380b1750 0x7f0a380c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.055+0000 7f0a3e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3815df30 0x7f0a3815f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.055+0000 7f0a3e800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3815fae0 con 0x7f0a3806bac0 2024-03-30T01:53:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.055+0000 7f0a3e800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3815fd10 con 0x7f0a3815df30 2024-03-30T01:53:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.055+0000 7f0a3e800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3815fff0 con 0x7f0a380b1750 2024-03-30T01:53:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.056+0000 7f0a3d400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a3806bac0 0x7f0a381f2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.056+0000 7f0a3d400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a3806bac0 0x7f0a381f2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54650/0 (socket says 172.21.15.133:54650) 2024-03-30T01:53:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.056+0000 7f0a3d400640 1 -- 172.21.15.133:0/273820535 learned_addr learned my addr 172.21.15.133:0/273820535 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.056+0000 7f0a3ca00640 1 --2- 172.21.15.133:0/273820535 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a380b1750 0x7f0a380c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.056+0000 7f0a3de00640 1 --2- 172.21.15.133:0/273820535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3815df30 0x7f0a3815f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.056+0000 7f0a3d400640 1 -- 172.21.15.133:0/273820535 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a380b1750 msgr2=0x7f0a380c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:11.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.056+0000 7f0a3d400640 1 --2- 172.21.15.133:0/273820535 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a380b1750 0x7f0a380c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:11.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.056+0000 7f0a3d400640 1 -- 172.21.15.133:0/273820535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3815df30 msgr2=0x7f0a3815f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:11.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.056+0000 7f0a3d400640 1 --2- 172.21.15.133:0/273820535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3815df30 0x7f0a3815f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:11.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.056+0000 7f0a3d400640 1 -- 172.21.15.133:0/273820535 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2c0094d0 con 0x7f0a3806bac0 2024-03-30T01:53:11.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.056+0000 7f0a3de00640 1 --2- 172.21.15.133:0/273820535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3815df30 0x7f0a3815f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:11.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.056+0000 7f0a3d400640 1 --2- 172.21.15.133:0/273820535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a3806bac0 0x7f0a381f2dc0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c000c00 tx=0x7f0a2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:11.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.057+0000 7f0a35600640 1 -- 172.21.15.133:0/273820535 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c03abe0 con 0x7f0a3806bac0 2024-03-30T01:53:11.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.057+0000 7f0a35600640 1 -- 172.21.15.133:0/273820535 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c03ad40 con 0x7f0a3806bac0 2024-03-30T01:53:11.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.057+0000 7f0a35600640 1 -- 172.21.15.133:0/273820535 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c044610 con 0x7f0a3806bac0 2024-03-30T01:53:11.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.057+0000 7f0a3e800640 1 -- 172.21.15.133:0/273820535 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a381602d0 con 0x7f0a3806bac0 2024-03-30T01:53:11.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.057+0000 7f0a3e800640 1 -- 172.21.15.133:0/273820535 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a380cac20 con 0x7f0a3806bac0 2024-03-30T01:53:11.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.058+0000 7f0a3e800640 1 -- 172.21.15.133:0/273820535 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a380cb1e0 con 0x7f0a3806bac0 2024-03-30T01:53:11.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.059+0000 7f0a35600640 1 -- 172.21.15.133:0/273820535 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0a2c04d450 con 0x7f0a3806bac0 2024-03-30T01:53:11.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.060+0000 7f0a35600640 1 --2- 172.21.15.133:0/273820535 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0a1806ac00 0x7f0a1806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:11.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.060+0000 7f0a35600640 1 -- 172.21.15.133:0/273820535 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f0a2c02d040 con 0x7f0a3806bac0 2024-03-30T01:53:11.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.060+0000 7f0a3ca00640 1 --2- 172.21.15.133:0/273820535 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0a1806ac00 0x7f0a1806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:11.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.061+0000 7f0a3ca00640 1 --2- 172.21.15.133:0/273820535 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0a1806ac00 0x7f0a1806d0c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0a380c90f0 tx=0x7f0a24009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:11.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.064+0000 7f0a35600640 1 -- 172.21.15.133:0/273820535 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f0a380cb1e0 con 0x7f0a3806bac0 2024-03-30T01:53:11.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.255+0000 7f0a3e800640 1 -- 172.21.15.133:0/273820535 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0a380cb5c0 con 0x7f0a3806bac0 2024-03-30T01:53:11.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.865+0000 7f0a35600640 1 -- 172.21.15.133:0/273820535 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0a380cb5c0 con 0x7f0a3806bac0 2024-03-30T01:53:11.871 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2024-03-30T01:53:11.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.869+0000 7f0a3e800640 1 -- 172.21.15.133:0/273820535 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0a1806ac00 msgr2=0x7f0a1806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:11.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.869+0000 7f0a3e800640 1 --2- 172.21.15.133:0/273820535 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0a1806ac00 0x7f0a1806d0c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0a380c90f0 tx=0x7f0a24009040 comp rx=0 tx=0).stop 2024-03-30T01:53:11.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.869+0000 7f0a3e800640 1 -- 172.21.15.133:0/273820535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a3806bac0 msgr2=0x7f0a381f2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:11.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.869+0000 7f0a3e800640 1 --2- 172.21.15.133:0/273820535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a3806bac0 0x7f0a381f2dc0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c000c00 tx=0x7f0a2c0046c0 comp rx=0 tx=0).stop 2024-03-30T01:53:11.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.869+0000 7f0a3e800640 1 -- 172.21.15.133:0/273820535 shutdown_connections 2024-03-30T01:53:11.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.869+0000 7f0a3e800640 1 --2- 172.21.15.133:0/273820535 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f0a1806ac00 0x7f0a1806d0c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:11.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.869+0000 7f0a3e800640 1 --2- 172.21.15.133:0/273820535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3815df30 0x7f0a3815f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:11.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.869+0000 7f0a3e800640 1 --2- 172.21.15.133:0/273820535 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a380b1750 0x7f0a380c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:11.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.869+0000 7f0a3e800640 1 --2- 172.21.15.133:0/273820535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a3806bac0 0x7f0a381f2dc0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:11.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.869+0000 7f0a3e800640 1 -- 172.21.15.133:0/273820535 >> 172.21.15.133:0/273820535 conn(0x7f0a380b4a20 msgr2=0x7f0a380b70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:11.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.869+0000 7f0a3e800640 1 -- 172.21.15.133:0/273820535 shutdown_connections 2024-03-30T01:53:11.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:11.870+0000 7f0a3e800640 1 -- 172.21.15.133:0/273820535 wait complete. 2024-03-30T01:53:11.897 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-30T01:53:12.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.102+0000 7f56b6400640 1 Processor -- start 2024-03-30T01:53:12.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.102+0000 7f56b6400640 1 -- start start 2024-03-30T01:53:12.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.103+0000 7f56b6400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56b00b2b40 0x7f56b00b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:12.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.103+0000 7f56b6400640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b00b34d0 con 0x7f56b0143340 2024-03-30T01:53:12.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.103+0000 7f56b6400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b0143720 con 0x7f56b00cb970 2024-03-30T01:53:12.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.103+0000 7f56b6400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b00cbf50 con 0x7f56b00b2b40 2024-03-30T01:53:12.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.104+0000 7f56af400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f56b0143340 0x7f56b006e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57728/0 (socket says 172.21.15.133:57728) 2024-03-30T01:53:12.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.104+0000 7f56af400640 1 -- 172.21.15.133:0/469410787 learned_addr learned my addr 172.21.15.133:0/469410787 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:12.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.104+0000 7f56afe00640 1 --2- 172.21.15.133:0/469410787 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56b00b2b40 0x7f56b00b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:12.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.104+0000 7f56aea00640 1 -- 172.21.15.133:0/469410787 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749644836 0 0) 0x7f56a0001110 con 0x7f56b0143340 2024-03-30T01:53:12.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.104+0000 7f56aea00640 1 -- 172.21.15.133:0/469410787 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5694003520 con 0x7f56b0143340 2024-03-30T01:53:12.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.104+0000 7f56aea00640 1 -- 172.21.15.133:0/469410787 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2626554792 0 0) 0x7f5694003520 con 0x7f56b0143340 2024-03-30T01:53:12.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.104+0000 7f56aea00640 1 -- 172.21.15.133:0/469410787 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56b00b2b40 msgr2=0x7f56b00b2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:12.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.104+0000 7f56aea00640 1 --2- 172.21.15.133:0/469410787 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56b00b2b40 0x7f56b00b2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:12.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.104+0000 7f56aea00640 1 -- 172.21.15.133:0/469410787 >> v1:172.21.15.137:6789/0 conn(0x7f56b00cb970 legacy=0x7f56b006d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:12.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.104+0000 7f56aea00640 1 -- 172.21.15.133:0/469410787 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b00cc230 con 0x7f56b0143340 2024-03-30T01:53:12.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.104+0000 7f56aea00640 1 -- 172.21.15.133:0/469410787 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f56a0001800 con 0x7f56b0143340 2024-03-30T01:53:12.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.104+0000 7f56aea00640 1 -- 172.21.15.133:0/469410787 >> v1:172.21.15.133:6789/0 conn(0x7f56b0143340 legacy=0x7f56b006e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:12.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.105+0000 7f56aea00640 1 --2- 172.21.15.133:0/469410787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56940039a0 0x7f5694003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:12.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.105+0000 7f56aea00640 1 --2- 172.21.15.133:0/469410787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56940047c0 0x7f5694004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:12.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.105+0000 7f56aea00640 1 --2- 172.21.15.133:0/469410787 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56b00b2b40 0x7f5694005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:12.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.105+0000 7f56aea00640 1 -- 172.21.15.133:0/469410787 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b00cbf50 con 0x7f56940047c0 2024-03-30T01:53:12.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.105+0000 7f56aea00640 1 -- 172.21.15.133:0/469410787 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569400dc70 con 0x7f56940039a0 2024-03-30T01:53:12.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.105+0000 7f56aea00640 1 -- 172.21.15.133:0/469410787 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569400de30 con 0x7f56b00b2b40 2024-03-30T01:53:12.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.105+0000 7f56a6a00640 1 --2- 172.21.15.133:0/469410787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56940047c0 0x7f5694004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:12.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.105+0000 7f56af400640 1 --2- 172.21.15.133:0/469410787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56940039a0 0x7f5694003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:12.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.105+0000 7f56afe00640 1 --2- 172.21.15.133:0/469410787 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56b00b2b40 0x7f5694005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:12.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.105+0000 7f56a6a00640 1 -- 172.21.15.133:0/469410787 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56b00b2b40 msgr2=0x7f5694005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:12.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.105+0000 7f56a6a00640 1 --2- 172.21.15.133:0/469410787 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56b00b2b40 0x7f5694005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:12.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.105+0000 7f56a6a00640 1 -- 172.21.15.133:0/469410787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56940039a0 msgr2=0x7f5694003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:12.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.105+0000 7f56a6a00640 1 --2- 172.21.15.133:0/469410787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56940039a0 0x7f5694003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:12.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.105+0000 7f56a6a00640 1 -- 172.21.15.133:0/469410787 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5694003520 con 0x7f56940047c0 2024-03-30T01:53:12.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.105+0000 7f56afe00640 1 --2- 172.21.15.133:0/469410787 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56b00b2b40 0x7f5694005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:12.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.106+0000 7f56a6a00640 1 --2- 172.21.15.133:0/469410787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56940047c0 0x7f5694004c40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5698001e20 tx=0x7f56940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2a025c0d5c8168 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:12.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.107+0000 7f56aea00640 1 -- 172.21.15.133:0/469410787 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5698003b70 con 0x7f56940047c0 2024-03-30T01:53:12.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.107+0000 7f56aea00640 1 -- 172.21.15.133:0/469410787 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5698003cd0 con 0x7f56940047c0 2024-03-30T01:53:12.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.107+0000 7f56aea00640 1 -- 172.21.15.133:0/469410787 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5698005310 con 0x7f56940047c0 2024-03-30T01:53:12.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.107+0000 7f56b6400640 1 -- 172.21.15.133:0/469410787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56940047c0 msgr2=0x7f5694004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:12.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.107+0000 7f56b6400640 1 --2- 172.21.15.133:0/469410787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56940047c0 0x7f5694004c40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5698001e20 tx=0x7f56940057f0 comp rx=0 tx=0).stop 2024-03-30T01:53:12.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.107+0000 7f56afe00640 1 -- 172.21.15.133:0/469410787 reap_dead start 2024-03-30T01:53:12.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.107+0000 7f56b6400640 1 -- 172.21.15.133:0/469410787 shutdown_connections 2024-03-30T01:53:12.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.107+0000 7f56b6400640 1 -- 172.21.15.133:0/469410787 >> 172.21.15.133:0/469410787 conn(0x7f56b00b0810 msgr2=0x7f56b00b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:12.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.107+0000 7f56b6400640 1 -- 172.21.15.133:0/469410787 shutdown_connections 2024-03-30T01:53:12.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.107+0000 7f56b6400640 1 -- 172.21.15.133:0/469410787 wait complete. 2024-03-30T01:53:12.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.109+0000 7f56b6400640 1 Processor -- start 2024-03-30T01:53:12.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.109+0000 7f56b6400640 1 -- start start 2024-03-30T01:53:12.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.110+0000 7f56b6400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56940047c0 0x7f56b00a8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:12.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.110+0000 7f56b6400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56b0134490 0x7f56b01590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:12.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.110+0000 7f56b6400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56b00aeb50 0x7f56b00aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:12.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.110+0000 7f56b6400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b00af510 con 0x7f56b0134490 2024-03-30T01:53:12.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.110+0000 7f56b6400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b00a8140 con 0x7f56940047c0 2024-03-30T01:53:12.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.110+0000 7f56b6400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b00a8b70 con 0x7f56b00aeb50 2024-03-30T01:53:12.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.111+0000 7f56a6a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56b0134490 0x7f56b01590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:12.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.111+0000 7f56a6a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56b0134490 0x7f56b01590e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54674/0 (socket says 172.21.15.133:54674) 2024-03-30T01:53:12.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.111+0000 7f56a6a00640 1 -- 172.21.15.133:0/852348923 learned_addr learned my addr 172.21.15.133:0/852348923 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:12.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.111+0000 7f56afe00640 1 --2- 172.21.15.133:0/852348923 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56b00aeb50 0x7f56b00aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:12.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.111+0000 7f56af400640 1 --2- 172.21.15.133:0/852348923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56940047c0 0x7f56b00a8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:12.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.111+0000 7f56a6a00640 1 -- 172.21.15.133:0/852348923 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56b00aeb50 msgr2=0x7f56b00aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:12.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.111+0000 7f56a6a00640 1 --2- 172.21.15.133:0/852348923 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56b00aeb50 0x7f56b00aefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:12.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.111+0000 7f56a6a00640 1 -- 172.21.15.133:0/852348923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56940047c0 msgr2=0x7f56b00a8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:12.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.111+0000 7f56a6a00640 1 --2- 172.21.15.133:0/852348923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56940047c0 0x7f56b00a8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:12.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.111+0000 7f56a6a00640 1 -- 172.21.15.133:0/852348923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b00a7530 con 0x7f56b0134490 2024-03-30T01:53:12.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.111+0000 7f56afe00640 1 --2- 172.21.15.133:0/852348923 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56b00aeb50 0x7f56b00aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:12.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.111+0000 7f56a6a00640 1 --2- 172.21.15.133:0/852348923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56b0134490 0x7f56b01590e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5698001f40 tx=0x7f56980014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:12.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.112+0000 7f56a7e00640 1 -- 172.21.15.133:0/852348923 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569803e070 con 0x7f56b0134490 2024-03-30T01:53:12.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.112+0000 7f56a7e00640 1 -- 172.21.15.133:0/852348923 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5698006b50 con 0x7f56b0134490 2024-03-30T01:53:12.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.112+0000 7f56a7e00640 1 -- 172.21.15.133:0/852348923 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5698007030 con 0x7f56b0134490 2024-03-30T01:53:12.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.112+0000 7f56b6400640 1 -- 172.21.15.133:0/852348923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b00a7810 con 0x7f56b0134490 2024-03-30T01:53:12.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.112+0000 7f56b6400640 1 -- 172.21.15.133:0/852348923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b00a7dd0 con 0x7f56b0134490 2024-03-30T01:53:12.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.113+0000 7f56b6400640 1 -- 172.21.15.133:0/852348923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b00a82f0 con 0x7f56b0134490 2024-03-30T01:53:12.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.114+0000 7f56a7e00640 1 -- 172.21.15.133:0/852348923 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f5698007190 con 0x7f56b0134490 2024-03-30T01:53:12.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.115+0000 7f56a7e00640 1 --2- 172.21.15.133:0/852348923 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f568c06ac30 0x7f568c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:12.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.115+0000 7f56a7e00640 1 -- 172.21.15.133:0/852348923 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5443+0+0 (secure 0 0 0) 0x7f56980aadb0 con 0x7f56b0134490 2024-03-30T01:53:12.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.115+0000 7f56af400640 1 --2- 172.21.15.133:0/852348923 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f568c06ac30 0x7f568c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:12.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.116+0000 7f56af400640 1 --2- 172.21.15.133:0/852348923 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f568c06ac30 0x7f568c06d0f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f56a0001390 tx=0x7f56a0000f50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:12.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.119+0000 7f56a7e00640 1 -- 172.21.15.133:0/852348923 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f56b00a82f0 con 0x7f56b0134490 2024-03-30T01:53:12.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.311+0000 7f56b6400640 1 -- 172.21.15.133:0/852348923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f56b00a82f0 con 0x7f56b0134490 2024-03-30T01:53:12.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.868+0000 7f56a7e00640 1 -- 172.21.15.133:0/852348923 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 169+0+0 (secure 0 0 0) 0x7f56b00a82f0 con 0x7f56b0134490 2024-03-30T01:53:12.875 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2024-03-30T01:53:12.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.874+0000 7f56b6400640 1 -- 172.21.15.133:0/852348923 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f568c06ac30 msgr2=0x7f568c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:12.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.874+0000 7f56b6400640 1 --2- 172.21.15.133:0/852348923 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f568c06ac30 0x7f568c06d0f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f56a0001390 tx=0x7f56a0000f50 comp rx=0 tx=0).stop 2024-03-30T01:53:12.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.874+0000 7f56b6400640 1 -- 172.21.15.133:0/852348923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56b0134490 msgr2=0x7f56b01590e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:12.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.874+0000 7f56b6400640 1 --2- 172.21.15.133:0/852348923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56b0134490 0x7f56b01590e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5698001f40 tx=0x7f56980014a0 comp rx=0 tx=0).stop 2024-03-30T01:53:12.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.876+0000 7f56b6400640 1 -- 172.21.15.133:0/852348923 shutdown_connections 2024-03-30T01:53:12.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.876+0000 7f56b6400640 1 --2- 172.21.15.133:0/852348923 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f568c06ac30 0x7f568c06d0f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:12.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.876+0000 7f56b6400640 1 --2- 172.21.15.133:0/852348923 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56b00aeb50 0x7f56b00aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:12.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.876+0000 7f56b6400640 1 --2- 172.21.15.133:0/852348923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56b0134490 0x7f56b01590e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:12.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.876+0000 7f56b6400640 1 --2- 172.21.15.133:0/852348923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56940047c0 0x7f56b00a8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:12.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.876+0000 7f56b6400640 1 -- 172.21.15.133:0/852348923 >> 172.21.15.133:0/852348923 conn(0x7f56b00b0810 msgr2=0x7f56b00b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:12.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.877+0000 7f56b6400640 1 -- 172.21.15.133:0/852348923 shutdown_connections 2024-03-30T01:53:12.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:12.877+0000 7f56b6400640 1 -- 172.21.15.133:0/852348923 wait complete. 2024-03-30T01:53:12.908 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-30T01:53:13.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.096+0000 7f171f200640 1 Processor -- start 2024-03-30T01:53:13.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.096+0000 7f171f200640 1 -- start start 2024-03-30T01:53:13.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.098+0000 7f171f200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f17200b42c0 0x7f17200cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:13.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.098+0000 7f171f200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f17200ccb30 0x7f172015e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:13.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.098+0000 7f171f200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f172013dba0 con 0x7f172015b9c0 2024-03-30T01:53:13.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.098+0000 7f171f200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f172015bda0 con 0x7f17200b42c0 2024-03-30T01:53:13.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.098+0000 7f171f200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17201408b0 con 0x7f17200ccb30 2024-03-30T01:53:13.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.098+0000 7f171d400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f17200b42c0 0x7f17200cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:13.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.098+0000 7f171d400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f17200b42c0 0x7f17200cc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54680/0 (socket says 172.21.15.133:54680) 2024-03-30T01:53:13.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.098+0000 7f171d400640 1 -- 172.21.15.133:0/256664318 learned_addr learned my addr 172.21.15.133:0/256664318 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:13.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.099+0000 7f171e800640 1 --2- 172.21.15.133:0/256664318 >> v2:172.21.15.137:3300/0 conn(0x7f17200ccb30 0x7f172015e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:13.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.099+0000 7f171d400640 1 -- 172.21.15.133:0/256664318 >> v2:172.21.15.137:3300/0 conn(0x7f17200ccb30 msgr2=0x7f172015e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:13.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.099+0000 7f171d400640 1 --2- 172.21.15.133:0/256664318 >> v2:172.21.15.137:3300/0 conn(0x7f17200ccb30 0x7f172015e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:13.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.099+0000 7f171d400640 1 -- 172.21.15.133:0/256664318 >> v1:172.21.15.137:6789/0 conn(0x7f172015b9c0 legacy=0x7f17200b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:13.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.099+0000 7f171d400640 1 -- 172.21.15.133:0/256664318 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172015ad40 con 0x7f17200b42c0 2024-03-30T01:53:13.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.100+0000 7f171d400640 1 --2- 172.21.15.133:0/256664318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17200b42c0 0x7f17200cc5f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f17200cc2d0 tx=0x7f170802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494b9b76e06dbe5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:13.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.100+0000 7f171ca00640 1 -- 172.21.15.133:0/256664318 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1708031870 con 0x7f17200b42c0 2024-03-30T01:53:13.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.100+0000 7f171ca00640 1 -- 172.21.15.133:0/256664318 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17080319d0 con 0x7f17200b42c0 2024-03-30T01:53:13.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.100+0000 7f171ca00640 1 -- 172.21.15.133:0/256664318 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1708031d60 con 0x7f17200b42c0 2024-03-30T01:53:13.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.101+0000 7f171f200640 1 -- 172.21.15.133:0/256664318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17200b42c0 msgr2=0x7f17200cc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:13.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.101+0000 7f171f200640 1 --2- 172.21.15.133:0/256664318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17200b42c0 0x7f17200cc5f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f17200cc2d0 tx=0x7f170802b910 comp rx=0 tx=0).stop 2024-03-30T01:53:13.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.101+0000 7f171f200640 1 -- 172.21.15.133:0/256664318 shutdown_connections 2024-03-30T01:53:13.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.101+0000 7f171f200640 1 --2- 172.21.15.133:0/256664318 >> v2:172.21.15.137:3300/0 conn(0x7f17200ccb30 0x7f172015e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:13.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.101+0000 7f171f200640 1 --2- 172.21.15.133:0/256664318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17200b42c0 0x7f17200cc5f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:13.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.101+0000 7f171f200640 1 -- 172.21.15.133:0/256664318 >> 172.21.15.133:0/256664318 conn(0x7f17200b05a0 msgr2=0x7f17200b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:13.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.101+0000 7f171f200640 1 -- 172.21.15.133:0/256664318 shutdown_connections 2024-03-30T01:53:13.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.101+0000 7f171f200640 1 -- 172.21.15.133:0/256664318 wait complete. 2024-03-30T01:53:13.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.103+0000 7f171f200640 1 Processor -- start 2024-03-30T01:53:13.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.103+0000 7f171f200640 1 -- start start 2024-03-30T01:53:13.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.104+0000 7f171f200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17200b42c0 0x7f17200a8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:13.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.104+0000 7f171f200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f17200ccb30 0x7f17201534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:13.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.104+0000 7f171f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f172015b9c0 0x7f17200b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:13.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.104+0000 7f171f200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17200a7ab0 con 0x7f17200b42c0 2024-03-30T01:53:13.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.104+0000 7f171f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17201539e0 con 0x7f172015b9c0 2024-03-30T01:53:13.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.104+0000 7f171f200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1720154210 con 0x7f17200ccb30 2024-03-30T01:53:13.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.104+0000 7f171de00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17200b42c0 0x7f17200a8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:13.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.104+0000 7f171de00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17200b42c0 0x7f17200a8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54692/0 (socket says 172.21.15.133:54692) 2024-03-30T01:53:13.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.104+0000 7f171de00640 1 -- 172.21.15.133:0/2453081839 learned_addr learned my addr 172.21.15.133:0/2453081839 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:13.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.105+0000 7f171de00640 1 -- 172.21.15.133:0/2453081839 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f17200ccb30 msgr2=0x7f17201534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:13.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.105+0000 7f171de00640 1 --2- 172.21.15.133:0/2453081839 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f17200ccb30 0x7f17201534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:13.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.105+0000 7f171de00640 1 -- 172.21.15.133:0/2453081839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f172015b9c0 msgr2=0x7f17200b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:13.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.105+0000 7f171de00640 1 --2- 172.21.15.133:0/2453081839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f172015b9c0 0x7f17200b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:13.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.105+0000 7f171de00640 1 -- 172.21.15.133:0/2453081839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17080094d0 con 0x7f17200b42c0 2024-03-30T01:53:13.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.105+0000 7f171de00640 1 --2- 172.21.15.133:0/2453081839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17200b42c0 0x7f17200a8900 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f171000b3f0 tx=0x7f171000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:13.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.105+0000 7f1716000640 1 -- 172.21.15.133:0/2453081839 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1710011830 con 0x7f17200b42c0 2024-03-30T01:53:13.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.105+0000 7f1716000640 1 -- 172.21.15.133:0/2453081839 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1710011990 con 0x7f17200b42c0 2024-03-30T01:53:13.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.105+0000 7f1716000640 1 -- 172.21.15.133:0/2453081839 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1710011d40 con 0x7f17200b42c0 2024-03-30T01:53:13.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.105+0000 7f171f200640 1 -- 172.21.15.133:0/2453081839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17201544f0 con 0x7f17200b42c0 2024-03-30T01:53:13.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.105+0000 7f171f200640 1 -- 172.21.15.133:0/2453081839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1720154ab0 con 0x7f17200b42c0 2024-03-30T01:53:13.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.106+0000 7f171f200640 1 -- 172.21.15.133:0/2453081839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1720070d00 con 0x7f17200b42c0 2024-03-30T01:53:13.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.107+0000 7f1716000640 1 -- 172.21.15.133:0/2453081839 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f171001a400 con 0x7f17200b42c0 2024-03-30T01:53:13.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.108+0000 7f1716000640 1 --2- 172.21.15.133:0/2453081839 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f16fc06ac00 0x7f16fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:13.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.108+0000 7f1716000640 1 -- 172.21.15.133:0/2453081839 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f1710088f10 con 0x7f17200b42c0 2024-03-30T01:53:13.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.109+0000 7f171d400640 1 --2- 172.21.15.133:0/2453081839 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f16fc06ac00 0x7f16fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:13.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.109+0000 7f171d400640 1 --2- 172.21.15.133:0/2453081839 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f16fc06ac00 0x7f16fc06d0c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1708036000 tx=0x7f1708030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:13.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.113+0000 7f1716000640 1 -- 172.21.15.133:0/2453081839 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f1710054380 con 0x7f17200b42c0 2024-03-30T01:53:13.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.306+0000 7f171f200640 1 -- 172.21.15.133:0/2453081839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f17200adea0 con 0x7f17200b42c0 2024-03-30T01:53:13.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.311+0000 7f1716000640 1 -- 172.21.15.133:0/2453081839 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f17100579a0 con 0x7f17200b42c0 2024-03-30T01:53:13.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.314+0000 7f171f200640 1 -- 172.21.15.133:0/2453081839 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f16fc06ac00 msgr2=0x7f16fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:13.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.314+0000 7f171f200640 1 --2- 172.21.15.133:0/2453081839 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f16fc06ac00 0x7f16fc06d0c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1708036000 tx=0x7f1708030000 comp rx=0 tx=0).stop 2024-03-30T01:53:13.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.314+0000 7f171f200640 1 -- 172.21.15.133:0/2453081839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17200b42c0 msgr2=0x7f17200a8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:13.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.314+0000 7f171f200640 1 --2- 172.21.15.133:0/2453081839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17200b42c0 0x7f17200a8900 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f171000b3f0 tx=0x7f171000b8b0 comp rx=0 tx=0).stop 2024-03-30T01:53:13.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.314+0000 7f171f200640 1 -- 172.21.15.133:0/2453081839 shutdown_connections 2024-03-30T01:53:13.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.314+0000 7f171f200640 1 --2- 172.21.15.133:0/2453081839 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f16fc06ac00 0x7f16fc06d0c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:13.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.314+0000 7f171f200640 1 --2- 172.21.15.133:0/2453081839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f172015b9c0 0x7f17200b2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:13.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.314+0000 7f171f200640 1 --2- 172.21.15.133:0/2453081839 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f17200ccb30 0x7f17201534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:13.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.314+0000 7f171f200640 1 --2- 172.21.15.133:0/2453081839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17200b42c0 0x7f17200a8900 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:13.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.314+0000 7f171f200640 1 -- 172.21.15.133:0/2453081839 >> 172.21.15.133:0/2453081839 conn(0x7f17200b05a0 msgr2=0x7f1720159810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:13.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.315+0000 7f171f200640 1 -- 172.21.15.133:0/2453081839 shutdown_connections 2024-03-30T01:53:13.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.315+0000 7f171f200640 1 -- 172.21.15.133:0/2453081839 wait complete. 2024-03-30T01:53:13.339 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal' 2024-03-30T01:53:13.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.535+0000 7f3ae2000640 1 Processor -- start 2024-03-30T01:53:13.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.536+0000 7f3ae2000640 1 -- start start 2024-03-30T01:53:13.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.537+0000 7f3ae2000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3adc0d0af0 0x7f3adc0cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:13.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.537+0000 7f3ae2000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3adc0cf9b0 0x7f3adc0b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:13.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.537+0000 7f3ae2000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3adc15d030 con 0x7f3adc15cc50 2024-03-30T01:53:13.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.537+0000 7f3ae2000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3adc0d1c50 con 0x7f3adc0d0af0 2024-03-30T01:53:13.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.537+0000 7f3ae2000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc0cfe40 con 0x7f3adc0cf9b0 2024-03-30T01:53:13.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.537+0000 7f3adaa00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3adc0d0af0 0x7f3adc0cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:13.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.537+0000 7f3adaa00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3adc0d0af0 0x7f3adc0cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54700/0 (socket says 172.21.15.133:54700) 2024-03-30T01:53:13.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.537+0000 7f3adaa00640 1 -- 172.21.15.133:0/3370792645 learned_addr learned my addr 172.21.15.133:0/3370792645 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:13.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.538+0000 7f3adbe00640 1 --2- 172.21.15.133:0/3370792645 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3adc0cf9b0 0x7f3adc0b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:13.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.538+0000 7f3adaa00640 1 -- 172.21.15.133:0/3370792645 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3adc0cf9b0 msgr2=0x7f3adc0b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:13.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.538+0000 7f3adaa00640 1 --2- 172.21.15.133:0/3370792645 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3adc0cf9b0 0x7f3adc0b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:13.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.538+0000 7f3adaa00640 1 -- 172.21.15.133:0/3370792645 >> v1:172.21.15.137:6789/0 conn(0x7f3adc15cc50 legacy=0x7f3adc0d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:13.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.538+0000 7f3adaa00640 1 -- 172.21.15.133:0/3370792645 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3adc0b5af0 con 0x7f3adc0d0af0 2024-03-30T01:53:13.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.539+0000 7f3adaa00640 1 --2- 172.21.15.133:0/3370792645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc0d0af0 0x7f3adc0cf470 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8009870 tx=0x7f3ac802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a0b3543c3adb6c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:13.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.539+0000 7f3ada000640 1 -- 172.21.15.133:0/3370792645 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8031640 con 0x7f3adc0d0af0 2024-03-30T01:53:13.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.539+0000 7f3ada000640 1 -- 172.21.15.133:0/3370792645 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac80317a0 con 0x7f3adc0d0af0 2024-03-30T01:53:13.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.539+0000 7f3ada000640 1 -- 172.21.15.133:0/3370792645 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8031b30 con 0x7f3adc0d0af0 2024-03-30T01:53:13.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.540+0000 7f3ae2000640 1 -- 172.21.15.133:0/3370792645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc0d0af0 msgr2=0x7f3adc0cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:13.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.540+0000 7f3ae2000640 1 --2- 172.21.15.133:0/3370792645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc0d0af0 0x7f3adc0cf470 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8009870 tx=0x7f3ac802b8f0 comp rx=0 tx=0).stop 2024-03-30T01:53:13.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.540+0000 7f3ae2000640 1 -- 172.21.15.133:0/3370792645 shutdown_connections 2024-03-30T01:53:13.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.540+0000 7f3ae2000640 1 --2- 172.21.15.133:0/3370792645 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3adc0cf9b0 0x7f3adc0b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:13.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.540+0000 7f3ae2000640 1 --2- 172.21.15.133:0/3370792645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc0d0af0 0x7f3adc0cf470 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:13.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.540+0000 7f3ae2000640 1 -- 172.21.15.133:0/3370792645 >> 172.21.15.133:0/3370792645 conn(0x7f3adc071a40 msgr2=0x7f3adc06b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:13.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.540+0000 7f3ae2000640 1 -- 172.21.15.133:0/3370792645 shutdown_connections 2024-03-30T01:53:13.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.540+0000 7f3ae2000640 1 -- 172.21.15.133:0/3370792645 wait complete. 2024-03-30T01:53:13.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.542+0000 7f3ae2000640 1 Processor -- start 2024-03-30T01:53:13.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.542+0000 7f3ae2000640 1 -- start start 2024-03-30T01:53:13.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.543+0000 7f3ae2000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc0cf9b0 0x7f3adc0ab040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:13.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.543+0000 7f3ae2000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3adc0d0af0 0x7f3adc0a9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:13.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.544+0000 7f3ae2000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3adc15cc50 0x7f3adc0a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:13.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.544+0000 7f3ae2000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc1564f0 con 0x7f3adc0cf9b0 2024-03-30T01:53:13.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.544+0000 7f3ae2000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc0a9fa0 con 0x7f3adc0d0af0 2024-03-30T01:53:13.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.544+0000 7f3ae2000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc0aa280 con 0x7f3adc15cc50 2024-03-30T01:53:13.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.544+0000 7f3adb400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc0cf9b0 0x7f3adc0ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:13.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.544+0000 7f3adb400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc0cf9b0 0x7f3adc0ab040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54706/0 (socket says 172.21.15.133:54706) 2024-03-30T01:53:13.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.544+0000 7f3adb400640 1 -- 172.21.15.133:0/2815474108 learned_addr learned my addr 172.21.15.133:0/2815474108 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:13.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.544+0000 7f3adaa00640 1 --2- 172.21.15.133:0/2815474108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3adc0d0af0 0x7f3adc0a9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:13.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.544+0000 7f3adb400640 1 -- 172.21.15.133:0/2815474108 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3adc15cc50 msgr2=0x7f3adc0a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:13.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.544+0000 7f3adb400640 1 --2- 172.21.15.133:0/2815474108 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3adc15cc50 0x7f3adc0a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:13.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.544+0000 7f3adb400640 1 -- 172.21.15.133:0/2815474108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3adc0d0af0 msgr2=0x7f3adc0a9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:13.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.544+0000 7f3adb400640 1 --2- 172.21.15.133:0/2815474108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3adc0d0af0 0x7f3adc0a9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:13.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.544+0000 7f3adb400640 1 -- 172.21.15.133:0/2815474108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac80094d0 con 0x7f3adc0cf9b0 2024-03-30T01:53:13.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.544+0000 7f3adaa00640 1 --2- 172.21.15.133:0/2815474108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3adc0d0af0 0x7f3adc0a9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:13.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.545+0000 7f3adb400640 1 --2- 172.21.15.133:0/2815474108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc0cf9b0 0x7f3adc0ab040 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3acc00b3f0 tx=0x7f3acc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:13.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.545+0000 7f3ad3400640 1 -- 172.21.15.133:0/2815474108 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc011830 con 0x7f3adc0cf9b0 2024-03-30T01:53:13.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.545+0000 7f3ad3400640 1 -- 172.21.15.133:0/2815474108 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3acc011990 con 0x7f3adc0cf9b0 2024-03-30T01:53:13.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.545+0000 7f3ad3400640 1 -- 172.21.15.133:0/2815474108 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc011d40 con 0x7f3adc0cf9b0 2024-03-30T01:53:13.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.545+0000 7f3ae2000640 1 -- 172.21.15.133:0/2815474108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3adc0aa560 con 0x7f3adc0cf9b0 2024-03-30T01:53:13.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.545+0000 7f3ae2000640 1 -- 172.21.15.133:0/2815474108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3adc0aab20 con 0x7f3adc0cf9b0 2024-03-30T01:53:13.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.546+0000 7f3ae2000640 1 -- 172.21.15.133:0/2815474108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3adc0aad10 con 0x7f3adc0cf9b0 2024-03-30T01:53:13.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.547+0000 7f3ad3400640 1 -- 172.21.15.133:0/2815474108 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f3acc01a400 con 0x7f3adc0cf9b0 2024-03-30T01:53:13.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.548+0000 7f3ad3400640 1 --2- 172.21.15.133:0/2815474108 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3abc06ac00 0x7f3abc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:13.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.549+0000 7f3ad3400640 1 -- 172.21.15.133:0/2815474108 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3acc088f60 con 0x7f3adc0cf9b0 2024-03-30T01:53:13.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.549+0000 7f3adaa00640 1 --2- 172.21.15.133:0/2815474108 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3abc06ac00 0x7f3abc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:13.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.549+0000 7f3adaa00640 1 --2- 172.21.15.133:0/2815474108 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3abc06ac00 0x7f3abc06d0c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8036000 tx=0x7f3ac803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:13.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.553+0000 7f3ad3400640 1 -- 172.21.15.133:0/2815474108 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f3acc0543d0 con 0x7f3adc0cf9b0 2024-03-30T01:53:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.818+0000 7f3ae2000640 1 -- 172.21.15.133:0/2815474108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal"]} v 0) v1 -- 0x7f3adc066d80 con 0x7f3adc0cf9b0 2024-03-30T01:53:13.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.886+0000 7f3ad3400640 1 -- 172.21.15.133:0/2815474108 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal"]}]=0 v118) v1 ==== 159+0+0 (secure 0 0 0) 0x7f3acc0579f0 con 0x7f3adc0cf9b0 2024-03-30T01:53:13.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.889+0000 7f3ae2000640 1 -- 172.21.15.133:0/2815474108 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3abc06ac00 msgr2=0x7f3abc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:13.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.889+0000 7f3ae2000640 1 --2- 172.21.15.133:0/2815474108 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3abc06ac00 0x7f3abc06d0c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8036000 tx=0x7f3ac803c040 comp rx=0 tx=0).stop 2024-03-30T01:53:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.889+0000 7f3ae2000640 1 -- 172.21.15.133:0/2815474108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc0cf9b0 msgr2=0x7f3adc0ab040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.889+0000 7f3ae2000640 1 --2- 172.21.15.133:0/2815474108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc0cf9b0 0x7f3adc0ab040 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3acc00b3f0 tx=0x7f3acc00b8b0 comp rx=0 tx=0).stop 2024-03-30T01:53:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.889+0000 7f3ae2000640 1 -- 172.21.15.133:0/2815474108 shutdown_connections 2024-03-30T01:53:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.889+0000 7f3ae2000640 1 --2- 172.21.15.133:0/2815474108 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f3abc06ac00 0x7f3abc06d0c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.889+0000 7f3ae2000640 1 --2- 172.21.15.133:0/2815474108 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3adc15cc50 0x7f3adc0a99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.889+0000 7f3ae2000640 1 --2- 172.21.15.133:0/2815474108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3adc0d0af0 0x7f3adc0a9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.889+0000 7f3ae2000640 1 --2- 172.21.15.133:0/2815474108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc0cf9b0 0x7f3adc0ab040 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.889+0000 7f3ae2000640 1 -- 172.21.15.133:0/2815474108 >> 172.21.15.133:0/2815474108 conn(0x7f3adc071a40 msgr2=0x7f3adc0cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.889+0000 7f3ae2000640 1 -- 172.21.15.133:0/2815474108 shutdown_connections 2024-03-30T01:53:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:13.889+0000 7f3ae2000640 1 -- 172.21.15.133:0/2815474108 wait complete. 2024-03-30T01:53:13.914 INFO:tasks.cephfs_test_runner:test_recover_fs_after_fsmap_removal (tasks.cephfs.test_recovery_fs.TestFSRecovery) ... ok 2024-03-30T01:53:13.914 INFO:tasks.cephfs_test_runner: 2024-03-30T01:53:13.915 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-30T01:53:13.915 INFO:tasks.cephfs_test_runner:Ran 1 test in 58.952s 2024-03-30T01:53:13.915 INFO:tasks.cephfs_test_runner: 2024-03-30T01:53:13.915 INFO:tasks.cephfs_test_runner:OK 2024-03-30T01:53:13.915 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-03-30T01:53:13.924 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-03-30T01:53:13.932 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-30T01:53:13.932 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:53:13.932 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:53:13.987 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053418,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249172k,nr_inodes=812293,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-30T01:53:13.987 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-03-30T01:53:13.987 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:53:14.037 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053418,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249172k,nr_inodes=812293,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-30T01:53:14.038 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:53:14.038 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:53:14.095 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053418,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249172k,nr_inodes=812293,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-30T01:53:14.095 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-30T01:53:14.095 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T01:53:14.150 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053418,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249172k,nr_inodes=812293,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-30T01:53:14.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:53:14.150 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-03-30T01:53:14.205 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-30T01:53:14.205 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-30T01:53:14.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:53:14.206 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T01:53:14.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:53:14.301 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T01:53:14.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:53:14.384 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2024-03-30T01:53:14.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:53:14.534 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-03-30T01:53:14.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:53:14.580 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2024-03-30T01:53:14.717 INFO:teuthology.orchestra.run.smithi133.stderr:Cannot find device "ceph-brx" 2024-03-30T01:53:14.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T01:53:14.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:53:14.721 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-03-30T01:53:14.778 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-30T01:53:14.778 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-03-30T01:53:14.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:53:14.779 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T01:53:14.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:53:14.864 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-30T01:53:14.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:53:14.963 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-03-30T01:53:15.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:53:15.101 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-03-30T01:53:15.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T01:53:15.143 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-03-30T01:53:15.279 INFO:teuthology.orchestra.run.smithi137.stderr:Cannot find device "ceph-brx" 2024-03-30T01:53:15.282 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T01:53:15.282 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-30T01:53:15.291 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-30T01:53:15.292 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T01:53:15.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.503+0000 7f9069e00640 1 Processor -- start 2024-03-30T01:53:15.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.503+0000 7f9069e00640 1 -- start start 2024-03-30T01:53:15.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.505+0000 7f9069e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f906413fc10 0x7f906415d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:15.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.505+0000 7f9069e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f90640caab0 0x7f906413f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:15.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.505+0000 7f9069e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f90640cd7d0 0x7f90640cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:15.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.505+0000 7f9069e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90640cb290 con 0x7f90640caab0 2024-03-30T01:53:15.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.505+0000 7f9069e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90640cb570 con 0x7f90640cd7d0 2024-03-30T01:53:15.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.505+0000 7f9069e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90640cb850 con 0x7f906413fc10 2024-03-30T01:53:15.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.505+0000 7f9063400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f90640cd7d0 0x7f90640cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:15.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.505+0000 7f9062a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f906413fc10 0x7f906415d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:15.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.506+0000 7f9062a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f906413fc10 0x7f906415d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.133:51416/0 (socket says 172.21.15.133:51416) 2024-03-30T01:53:15.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.506+0000 7f9062a00640 1 -- 172.21.15.133:0/114832839 learned_addr learned my addr 172.21.15.133:0/114832839 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:15.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.505+0000 7f9062000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f90640caab0 0x7f906413f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:15.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.506+0000 7f9062a00640 1 -- 172.21.15.133:0/114832839 >> v2:172.21.15.137:3300/0 conn(0x7f90640cd7d0 msgr2=0x7f90640cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:15.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.506+0000 7f9062a00640 1 --2- 172.21.15.133:0/114832839 >> v2:172.21.15.137:3300/0 conn(0x7f90640cd7d0 0x7f90640cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:15.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.506+0000 7f9062a00640 1 -- 172.21.15.133:0/114832839 >> v2:172.21.15.133:3300/0 conn(0x7f90640caab0 msgr2=0x7f906413f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:15.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.506+0000 7f9062a00640 1 --2- 172.21.15.133:0/114832839 >> v2:172.21.15.133:3300/0 conn(0x7f90640caab0 0x7f906413f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:15.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.506+0000 7f9062a00640 1 -- 172.21.15.133:0/114832839 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90640cbb30 con 0x7f906413fc10 2024-03-30T01:53:15.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.508+0000 7f9062a00640 1 --2- 172.21.15.133:0/114832839 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f906413fc10 0x7f906415d670 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f90640ae220 tx=0x7f905402b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6eb906512fb9003b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:15.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.508+0000 7f9061600640 1 -- 172.21.15.133:0/114832839 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9054031870 con 0x7f906413fc10 2024-03-30T01:53:15.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.508+0000 7f9061600640 1 -- 172.21.15.133:0/114832839 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90540319d0 con 0x7f906413fc10 2024-03-30T01:53:15.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.508+0000 7f9061600640 1 -- 172.21.15.133:0/114832839 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9054031d60 con 0x7f906413fc10 2024-03-30T01:53:15.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.509+0000 7f9069e00640 1 -- 172.21.15.133:0/114832839 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f906413fc10 msgr2=0x7f906415d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:15.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.509+0000 7f9069e00640 1 --2- 172.21.15.133:0/114832839 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f906413fc10 0x7f906415d670 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f90640ae220 tx=0x7f905402b910 comp rx=0 tx=0).stop 2024-03-30T01:53:15.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.509+0000 7f9069e00640 1 -- 172.21.15.133:0/114832839 shutdown_connections 2024-03-30T01:53:15.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.509+0000 7f9069e00640 1 --2- 172.21.15.133:0/114832839 >> v2:172.21.15.137:3300/0 conn(0x7f90640cd7d0 0x7f90640cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:15.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.509+0000 7f9069e00640 1 --2- 172.21.15.133:0/114832839 >> v2:172.21.15.133:3300/0 conn(0x7f90640caab0 0x7f906413f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:15.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.509+0000 7f9069e00640 1 --2- 172.21.15.133:0/114832839 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f906413fc10 0x7f906415d670 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:15.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.509+0000 7f9069e00640 1 -- 172.21.15.133:0/114832839 >> 172.21.15.133:0/114832839 conn(0x7f90640b07a0 msgr2=0x7f90640b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:15.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.509+0000 7f9069e00640 1 -- 172.21.15.133:0/114832839 shutdown_connections 2024-03-30T01:53:15.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.509+0000 7f9069e00640 1 -- 172.21.15.133:0/114832839 wait complete. 2024-03-30T01:53:15.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.511+0000 7f9069e00640 1 Processor -- start 2024-03-30T01:53:15.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.511+0000 7f9069e00640 1 -- start start 2024-03-30T01:53:15.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.512+0000 7f9069e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90640caab0 0x7f90641e3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:15.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.512+0000 7f9069e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90640cd7d0 0x7f9064139c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:15.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.512+0000 7f9069e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f906413a1a0 0x7f9064159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:15.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.512+0000 7f9069e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906406de60 con 0x7f906413a1a0 2024-03-30T01:53:15.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.512+0000 7f9069e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906406db80 con 0x7f90640cd7d0 2024-03-30T01:53:15.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.512+0000 7f9069e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90641e34d0 con 0x7f90640caab0 2024-03-30T01:53:15.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.512+0000 7f9063400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f906413a1a0 0x7f9064159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:15.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.512+0000 7f9063400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f906413a1a0 0x7f9064159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54724/0 (socket says 172.21.15.133:54724) 2024-03-30T01:53:15.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.512+0000 7f9063400640 1 -- 172.21.15.133:0/2091350729 learned_addr learned my addr 172.21.15.133:0/2091350729 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:15.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.512+0000 7f9062a00640 1 --2- 172.21.15.133:0/2091350729 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90640caab0 0x7f90641e3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:15.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.512+0000 7f9063400640 1 -- 172.21.15.133:0/2091350729 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90640caab0 msgr2=0x7f90641e3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:15.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.512+0000 7f9063400640 1 --2- 172.21.15.133:0/2091350729 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90640caab0 0x7f90641e3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:15.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.512+0000 7f9063400640 1 -- 172.21.15.133:0/2091350729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90640cd7d0 msgr2=0x7f9064139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:15.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.513+0000 7f9063400640 1 --2- 172.21.15.133:0/2091350729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90640cd7d0 0x7f9064139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:15.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.513+0000 7f9063400640 1 -- 172.21.15.133:0/2091350729 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90540094d0 con 0x7f906413a1a0 2024-03-30T01:53:15.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.513+0000 7f9062a00640 1 --2- 172.21.15.133:0/2091350729 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90640caab0 0x7f90641e3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:15.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.513+0000 7f9063400640 1 --2- 172.21.15.133:0/2091350729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f906413a1a0 0x7f9064159620 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f905c00efc0 tx=0x7f905c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:15.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.513+0000 7f905b400640 1 -- 172.21.15.133:0/2091350729 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c009ba0 con 0x7f906413a1a0 2024-03-30T01:53:15.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.513+0000 7f905b400640 1 -- 172.21.15.133:0/2091350729 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905c00f040 con 0x7f906413a1a0 2024-03-30T01:53:15.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.513+0000 7f9069e00640 1 -- 172.21.15.133:0/2091350729 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90641e37b0 con 0x7f906413a1a0 2024-03-30T01:53:15.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.513+0000 7f905b400640 1 -- 172.21.15.133:0/2091350729 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c0146c0 con 0x7f906413a1a0 2024-03-30T01:53:15.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.513+0000 7f9069e00640 1 -- 172.21.15.133:0/2091350729 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9064158530 con 0x7f906413a1a0 2024-03-30T01:53:15.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.514+0000 7f9069e00640 1 -- 172.21.15.133:0/2091350729 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90641e3cd0 con 0x7f906413a1a0 2024-03-30T01:53:15.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.515+0000 7f905b400640 1 -- 172.21.15.133:0/2091350729 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f905c014820 con 0x7f906413a1a0 2024-03-30T01:53:15.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.517+0000 7f905b400640 1 --2- 172.21.15.133:0/2091350729 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f904406ac00 0x7f904406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:15.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.517+0000 7f905b400640 1 -- 172.21.15.133:0/2091350729 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f905c089b70 con 0x7f906413a1a0 2024-03-30T01:53:15.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.517+0000 7f9062a00640 1 --2- 172.21.15.133:0/2091350729 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f904406ac00 0x7f904406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:15.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.518+0000 7f9062a00640 1 --2- 172.21.15.133:0/2091350729 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f904406ac00 0x7f904406d0c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9054036000 tx=0x7f905403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:15.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.521+0000 7f905b400640 1 -- 172.21.15.133:0/2091350729 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f90641e3cd0 con 0x7f906413a1a0 2024-03-30T01:53:15.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.713+0000 7f9069e00640 1 -- 172.21.15.133:0/2091350729 --> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9064158750 con 0x7f904406ac00 2024-03-30T01:53:15.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.716+0000 7f905b400640 1 -- 172.21.15.133:0/2091350729 <== mgr.4105 v2:172.21.15.133:6832/37234 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48099 (secure 0 0 0) 0x7f9064158750 con 0x7f904406ac00 2024-03-30T01:53:15.722 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:53:15.723 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-03-30T01:53:15.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.718+0000 7f9069e00640 1 -- 172.21.15.133:0/2091350729 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f904406ac00 msgr2=0x7f904406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:15.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.718+0000 7f9069e00640 1 --2- 172.21.15.133:0/2091350729 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f904406ac00 0x7f904406d0c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9054036000 tx=0x7f905403c040 comp rx=0 tx=0).stop 2024-03-30T01:53:15.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.718+0000 7f9069e00640 1 -- 172.21.15.133:0/2091350729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f906413a1a0 msgr2=0x7f9064159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:15.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.718+0000 7f9069e00640 1 --2- 172.21.15.133:0/2091350729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f906413a1a0 0x7f9064159620 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f905c00efc0 tx=0x7f905c00c490 comp rx=0 tx=0).stop 2024-03-30T01:53:15.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.719+0000 7f9069e00640 1 -- 172.21.15.133:0/2091350729 shutdown_connections 2024-03-30T01:53:15.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.719+0000 7f9069e00640 1 --2- 172.21.15.133:0/2091350729 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f904406ac00 0x7f904406d0c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:15.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.719+0000 7f9069e00640 1 --2- 172.21.15.133:0/2091350729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f906413a1a0 0x7f9064159620 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:15.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.719+0000 7f9069e00640 1 --2- 172.21.15.133:0/2091350729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90640cd7d0 0x7f9064139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:15.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.719+0000 7f9069e00640 1 --2- 172.21.15.133:0/2091350729 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90640caab0 0x7f90641e3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:15.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.719+0000 7f9069e00640 1 -- 172.21.15.133:0/2091350729 >> 172.21.15.133:0/2091350729 conn(0x7f90640b07a0 msgr2=0x7f9064141a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:15.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.719+0000 7f9069e00640 1 -- 172.21.15.133:0/2091350729 shutdown_connections 2024-03-30T01:53:15.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.719+0000 7f9069e00640 1 -- 172.21.15.133:0/2091350729 wait complete. 2024-03-30T01:53:15.743 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-03-30T01:53:13.727095+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220696,"kb_used_data":4536,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754024,"statfs":{"total":773094113280,"available":772868120576,"internally_reserved":0,"allocated":4644864,"data_stored":2567970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9154,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-81,"num_read_kb":-88,"num_write":-55,"num_write_kb":-27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002050"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":179,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-03-30T01:52:56.741565+0000","last_change":"2024-03-30T01:51:23.358245+0000","last_active":"2024-03-30T01:52:56.741565+0000","last_peered":"2024-03-30T01:52:56.741565+0000","last_clean":"2024-03-30T01:52:56.741565+0000","last_became_active":"2024-03-30T01:51:23.355914+0000","last_became_peered":"2024-03-30T01:51:23.355914+0000","last_unstale":"2024-03-30T01:52:56.741565+0000","last_undegraded":"2024-03-30T01:52:56.741565+0000","last_fullsized":"2024-03-30T01:52:56.741565+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_clean_scrub_stamp":"2024-03-30T01:51:21.990253+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:21:19.291194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":761399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.369},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.3280000000000001}]},{"osd":1,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":1.494},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.0509999999999999}]},{"osd":2,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.90700000000000003}]},{"osd":3,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.1899999999999999}]},{"osd":4,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":1.264}]},{"osd":5,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.129,"5min":2.129,"15min":2.129},"last":1.2170000000000001}]},{"osd":6,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.639}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":171556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.204},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.1759999999999999}]},{"osd":1,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.84799999999999998}]},{"osd":2,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.399},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.1120000000000001}]},{"osd":3,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":1.3140000000000001}]},{"osd":4,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.0780000000000001}]},{"osd":5,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.528,"5min":2.528,"15min":2.528},"last":1.234}]},{"osd":7,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.4350000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":1.329}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":171612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":13.811999999999999,"5min":13.811999999999999,"15min":13.811999999999999},"last":1.163},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.5030000000000001,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.90300000000000002}]},{"osd":1,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":9.9900000000000002,"5min":9.9900000000000002,"15min":9.9900000000000002},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":6.024,"5min":6.024,"15min":6.024},"last":1.5680000000000001}]},{"osd":2,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":6.109,"5min":6.109,"15min":6.109},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.222}]},{"osd":3,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":6.6950000000000003,"5min":6.6950000000000003,"15min":6.6950000000000003},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.956,"5min":1.956,"15min":1.956},"min":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"max":{"1min":9.9489999999999998,"5min":9.9489999999999998,"15min":9.9489999999999998},"last":1.367}]},{"osd":4,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":6.1520000000000001,"5min":6.1520000000000001,"15min":6.1520000000000001},"last":1.633},{"interface":"front","average":{"1min":1.819,"5min":1.819,"15min":1.819},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":6.6100000000000003,"5min":6.6100000000000003,"15min":6.6100000000000003},"last":1.347}]},{"osd":6,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":2.052,"5min":2.052,"15min":2.052},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":9.8160000000000007,"5min":9.8160000000000007,"15min":9.8160000000000007},"last":1.5109999999999999},{"interface":"front","average":{"1min":2,"5min":2,"15min":2},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":6.0679999999999996,"5min":6.0679999999999996,"15min":6.0679999999999996},"last":1.6950000000000001}]},{"osd":7,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":1.831,"15min":1.831},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":1.4319999999999999},{"interface":"front","average":{"1min":2.214,"5min":2.214,"15min":2.214},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":9.8650000000000002,"5min":9.8650000000000002,"15min":9.8650000000000002},"last":1.605}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":171044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":1.2110000000000001}]},{"osd":1,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.399},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":0.70899999999999996}]},{"osd":2,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.4550000000000001}]},{"osd":3,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":4.9969999999999999,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":1.673},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"min":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":4.6680000000000001,"5min":4.6680000000000001,"15min":4.6680000000000001},"last":1.3120000000000001}]},{"osd":5,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.9729999999999999,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":1.03},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":3.4790000000000001,"5min":3.4790000000000001,"15min":3.4790000000000001},"last":1.544}]},{"osd":6,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.107},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.496}]},{"osd":7,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.871},{"interface":"front","average":{"1min":1.625,"5min":1.625,"15min":1.625},"min":{"1min":1.113,"5min":1.113,"15min":1.113},"max":{"1min":2.4409999999999998,"5min":2.4409999999999998,"15min":2.4409999999999998},"last":1.599}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":450560,"data_stored":181040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":9.298,"5min":9.298,"15min":9.298},"last":1.054},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.806,"5min":3.806,"15min":3.806},"last":0.97899999999999998}]},{"osd":1,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":3.1070000000000002,"5min":3.1070000000000002,"15min":3.1070000000000002},"last":1.181},{"interface":"front","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":9.3659999999999997,"5min":9.3659999999999997,"15min":9.3659999999999997},"last":1.23}]},{"osd":2,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":5.7949999999999999,"5min":5.7949999999999999,"15min":5.7949999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":6.7240000000000002,"5min":6.7240000000000002,"15min":6.7240000000000002},"last":1.323}]},{"osd":4,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":6.1280000000000001,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":1.266},{"interface":"front","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":1.4930000000000001}]},{"osd":5,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.383},{"interface":"front","average":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":18.904,"5min":18.904,"15min":18.904},"last":1.4159999999999999}]},{"osd":6,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":3.9209999999999998,"5min":3.9209999999999998,"15min":3.9209999999999998},"last":1.147},{"interface":"front","average":{"1min":1.738,"5min":1.738,"15min":1.738},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":5.0919999999999996,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":1.4370000000000001}]},{"osd":7,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.903,"5min":1.903,"15min":1.903},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":6.8600000000000003,"5min":6.8600000000000003,"15min":6.8600000000000003},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":4.4669999999999996,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":1.353}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":169991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.877}]},{"osd":1,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.83899999999999997}]},{"osd":3,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":4.742,"5min":4.742,"15min":4.742},"last":1.169},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":0.96899999999999997}]},{"osd":4,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.5609999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":1.008},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.0860000000000001}]},{"osd":5,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":3.012,"5min":3.012,"15min":3.012},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":8.125,"5min":8.125,"15min":8.125},"last":1.226}]},{"osd":6,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":5.6449999999999996,"5min":5.6449999999999996,"15min":5.6449999999999996},"last":1.587},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.6279999999999999}]},{"osd":7,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.8120000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":181039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2,"5min":2,"15min":2},"last":0.91500000000000004}]},{"osd":2,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.7549999999999999,"5min":4.7549999999999999,"15min":4.7549999999999999},"last":1.119}]},{"osd":3,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":3.0619999999999998,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":6.04,"5min":6.04,"15min":6.04},"last":0.95699999999999996}]},{"osd":4,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.629,"5min":2.629,"15min":2.629},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":3.7669999999999999,"5min":3.7669999999999999,"15min":3.7669999999999999},"last":1.3049999999999999}]},{"osd":5,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.532,"5min":1.532,"15min":1.532},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":4.2480000000000002,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":1.389},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":3.9359999999999999,"5min":3.9359999999999999,"15min":3.9359999999999999},"last":1.26}]},{"osd":6,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.4209999999999998,"5min":2.4209999999999998,"15min":2.4209999999999998},"last":1.012},{"interface":"front","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":3.2559999999999998,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":1.3140000000000001}]},{"osd":7,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.6869999999999998,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":1.214},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.877}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":760289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.6190000000000002,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":1.1679999999999999}]},{"osd":2,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.006},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.97899999999999998}]},{"osd":3,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.21},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":5.2679999999999998,"5min":5.2679999999999998,"15min":5.2679999999999998},"last":1.143}]},{"osd":4,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.345},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":3.3540000000000001,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":1.2669999999999999}]},{"osd":5,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":1.528},{"interface":"front","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.3859999999999999}]},{"osd":6,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.9279999999999999,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.8690000000000002,"5min":2.8690000000000002,"15min":2.8690000000000002},"last":1.6200000000000001}]},{"osd":7,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.8010000000000002,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.417},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":4.923,"5min":4.923,"15min":4.923},"last":1.45}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T01:53:15.744 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T01:53:15.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.947+0000 7f285ee00640 1 Processor -- start 2024-03-30T01:53:15.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.947+0000 7f285ee00640 1 -- start start 2024-03-30T01:53:15.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.948+0000 7f285ee00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2858143790 0x7f28580cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:15.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.948+0000 7f285ee00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28580a76a0 con 0x7f28580ccc40 2024-03-30T01:53:15.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.949+0000 7f285ee00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28580b38e0 con 0x7f2858070500 2024-03-30T01:53:15.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.949+0000 7f285ee00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28580cd180 con 0x7f2858143790 2024-03-30T01:53:15.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.949+0000 7f2857e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2858143790 0x7f28580cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:15.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.949+0000 7f285ce00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f28580ccc40 0x7f285815ae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49474/0 (socket says 172.21.15.133:49474) 2024-03-30T01:53:15.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.949+0000 7f285ce00640 1 -- 172.21.15.133:0/2678333527 learned_addr learned my addr 172.21.15.133:0/2678333527 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:15.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.949+0000 7f2857e00640 1 -- 172.21.15.133:0/2678333527 >> v1:172.21.15.137:6789/0 conn(0x7f2858070500 legacy=0x7f28580cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:15.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.949+0000 7f2857e00640 1 -- 172.21.15.133:0/2678333527 >> v1:172.21.15.133:6789/0 conn(0x7f28580ccc40 legacy=0x7f285815ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:15.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.949+0000 7f2857e00640 1 -- 172.21.15.133:0/2678333527 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28580cd460 con 0x7f2858143790 2024-03-30T01:53:15.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.950+0000 7f2857e00640 1 --2- 172.21.15.133:0/2678333527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2858143790 0x7f28580cbb10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f28480097a0 tx=0x7f284802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b1c22627bced6e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:15.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.951+0000 7f2857400640 1 -- 172.21.15.133:0/2678333527 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848030610 con 0x7f2858143790 2024-03-30T01:53:15.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.951+0000 7f2857400640 1 -- 172.21.15.133:0/2678333527 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2848030770 con 0x7f2858143790 2024-03-30T01:53:15.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.951+0000 7f2857400640 1 -- 172.21.15.133:0/2678333527 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848030b00 con 0x7f2858143790 2024-03-30T01:53:15.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.951+0000 7f285ee00640 1 -- 172.21.15.133:0/2678333527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2858143790 msgr2=0x7f28580cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:15.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.951+0000 7f285ee00640 1 --2- 172.21.15.133:0/2678333527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2858143790 0x7f28580cbb10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f28480097a0 tx=0x7f284802b960 comp rx=0 tx=0).stop 2024-03-30T01:53:15.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.951+0000 7f285ee00640 1 -- 172.21.15.133:0/2678333527 shutdown_connections 2024-03-30T01:53:15.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.951+0000 7f285ee00640 1 --2- 172.21.15.133:0/2678333527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2858143790 0x7f28580cbb10 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:15.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.951+0000 7f285ee00640 1 -- 172.21.15.133:0/2678333527 >> 172.21.15.133:0/2678333527 conn(0x7f28580b07a0 msgr2=0x7f28580b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.951+0000 7f285ee00640 1 -- 172.21.15.133:0/2678333527 shutdown_connections 2024-03-30T01:53:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.951+0000 7f285ee00640 1 -- 172.21.15.133:0/2678333527 wait complete. 2024-03-30T01:53:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.953+0000 7f285ee00640 1 Processor -- start 2024-03-30T01:53:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.953+0000 7f285ee00640 1 -- start start 2024-03-30T01:53:15.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.954+0000 7f285ee00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2858070500 0x7f28581e29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:15.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.954+0000 7f285ee00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28580ccc40 0x7f2858159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:15.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.954+0000 7f285ee00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2858143790 0x7f28580af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:15.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.954+0000 7f285ee00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285813a170 con 0x7f2858143790 2024-03-30T01:53:15.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.954+0000 7f285ee00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285815a500 con 0x7f2858070500 2024-03-30T01:53:15.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.954+0000 7f285ee00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2858139720 con 0x7f28580ccc40 2024-03-30T01:53:15.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.954+0000 7f285ce00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2858143790 0x7f28580af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:15.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.954+0000 7f285ce00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2858143790 0x7f28580af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35890/0 (socket says 172.21.15.133:35890) 2024-03-30T01:53:15.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.954+0000 7f285ce00640 1 -- 172.21.15.133:0/173866281 learned_addr learned my addr 172.21.15.133:0/173866281 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:15.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.955+0000 7f2857e00640 1 --2- 172.21.15.133:0/173866281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2858070500 0x7f28581e29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:15.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.955+0000 7f284f400640 1 --2- 172.21.15.133:0/173866281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28580ccc40 0x7f2858159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:15.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.955+0000 7f285ce00640 1 -- 172.21.15.133:0/173866281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28580ccc40 msgr2=0x7f2858159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:15.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.955+0000 7f285ce00640 1 --2- 172.21.15.133:0/173866281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28580ccc40 0x7f2858159fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:15.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.955+0000 7f285ce00640 1 -- 172.21.15.133:0/173866281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2858070500 msgr2=0x7f28581e29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:15.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.955+0000 7f285ce00640 1 --2- 172.21.15.133:0/173866281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2858070500 0x7f28581e29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:15.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.955+0000 7f285ce00640 1 -- 172.21.15.133:0/173866281 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2848009400 con 0x7f2858143790 2024-03-30T01:53:15.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.955+0000 7f2857e00640 1 --2- 172.21.15.133:0/173866281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2858070500 0x7f28581e29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:15.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.955+0000 7f285ce00640 1 --2- 172.21.15.133:0/173866281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2858143790 0x7f28580af580 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f285000caf0 tx=0x7f285000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:15.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.955+0000 7f2854c00640 1 -- 172.21.15.133:0/173866281 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285000aca0 con 0x7f2858143790 2024-03-30T01:53:15.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.955+0000 7f2854c00640 1 -- 172.21.15.133:0/173866281 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285000ae00 con 0x7f2858143790 2024-03-30T01:53:15.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.955+0000 7f2854c00640 1 -- 172.21.15.133:0/173866281 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2850012600 con 0x7f2858143790 2024-03-30T01:53:15.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.955+0000 7f285ee00640 1 -- 172.21.15.133:0/173866281 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285813a3c0 con 0x7f2858143790 2024-03-30T01:53:15.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.956+0000 7f285ee00640 1 -- 172.21.15.133:0/173866281 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285813a980 con 0x7f2858143790 2024-03-30T01:53:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.957+0000 7f285ee00640 1 -- 172.21.15.133:0/173866281 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2858066d80 con 0x7f2858143790 2024-03-30T01:53:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.958+0000 7f2854c00640 1 -- 172.21.15.133:0/173866281 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f2850007070 con 0x7f2858143790 2024-03-30T01:53:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.959+0000 7f2854c00640 1 --2- 172.21.15.133:0/173866281 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f283406ac00 0x7f283406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:15.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.959+0000 7f2854c00640 1 -- 172.21.15.133:0/173866281 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f2850088f10 con 0x7f2858143790 2024-03-30T01:53:15.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.959+0000 7f2857e00640 1 --2- 172.21.15.133:0/173866281 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f283406ac00 0x7f283406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:15.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.959+0000 7f2857e00640 1 --2- 172.21.15.133:0/173866281 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f283406ac00 0x7f283406d0c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2848036000 tx=0x7f284803b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:15.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:15.963+0000 7f2854c00640 1 -- 172.21.15.133:0/173866281 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f2850054430 con 0x7f2858143790 2024-03-30T01:53:16.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.156+0000 7f285ee00640 1 -- 172.21.15.133:0/173866281 --> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f28580cb5f0 con 0x7f283406ac00 2024-03-30T01:53:16.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.162+0000 7f2854c00640 1 -- 172.21.15.133:0/173866281 <== mgr.4105 v2:172.21.15.133:6832/37234 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48099 (secure 0 0 0) 0x7f2848030b00 con 0x7f283406ac00 2024-03-30T01:53:16.169 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:53:16.170 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-03-30T01:53:16.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.165+0000 7f285ee00640 1 -- 172.21.15.133:0/173866281 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f283406ac00 msgr2=0x7f283406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:16.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.165+0000 7f285ee00640 1 --2- 172.21.15.133:0/173866281 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f283406ac00 0x7f283406d0c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2848036000 tx=0x7f284803b040 comp rx=0 tx=0).stop 2024-03-30T01:53:16.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.165+0000 7f285ee00640 1 -- 172.21.15.133:0/173866281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2858143790 msgr2=0x7f28580af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:16.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.165+0000 7f285ee00640 1 --2- 172.21.15.133:0/173866281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2858143790 0x7f28580af580 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f285000caf0 tx=0x7f285000a060 comp rx=0 tx=0).stop 2024-03-30T01:53:16.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.166+0000 7f285ee00640 1 -- 172.21.15.133:0/173866281 shutdown_connections 2024-03-30T01:53:16.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.166+0000 7f285ee00640 1 --2- 172.21.15.133:0/173866281 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f283406ac00 0x7f283406d0c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:16.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.166+0000 7f285ee00640 1 --2- 172.21.15.133:0/173866281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2858143790 0x7f28580af580 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:16.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.166+0000 7f285ee00640 1 --2- 172.21.15.133:0/173866281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28580ccc40 0x7f2858159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:16.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.166+0000 7f285ee00640 1 --2- 172.21.15.133:0/173866281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2858070500 0x7f28581e29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.166+0000 7f285ee00640 1 -- 172.21.15.133:0/173866281 >> 172.21.15.133:0/173866281 conn(0x7f28580b07a0 msgr2=0x7f285806a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.166+0000 7f285ee00640 1 -- 172.21.15.133:0/173866281 shutdown_connections 2024-03-30T01:53:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.166+0000 7f285ee00640 1 -- 172.21.15.133:0/173866281 wait complete. 2024-03-30T01:53:16.191 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-03-30T01:53:15.727701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220696,"kb_used_data":4536,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754024,"statfs":{"total":773094113280,"available":772868120576,"internally_reserved":0,"allocated":4644864,"data_stored":2567970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9154,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-81,"num_read_kb":-88,"num_write":-55,"num_write_kb":-27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001780"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":179,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-03-30T01:52:56.741565+0000","last_change":"2024-03-30T01:51:23.358245+0000","last_active":"2024-03-30T01:52:56.741565+0000","last_peered":"2024-03-30T01:52:56.741565+0000","last_clean":"2024-03-30T01:52:56.741565+0000","last_became_active":"2024-03-30T01:51:23.355914+0000","last_became_peered":"2024-03-30T01:51:23.355914+0000","last_unstale":"2024-03-30T01:52:56.741565+0000","last_undegraded":"2024-03-30T01:52:56.741565+0000","last_fullsized":"2024-03-30T01:52:56.741565+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_clean_scrub_stamp":"2024-03-30T01:51:21.990253+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:21:19.291194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":761399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.369},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.3280000000000001}]},{"osd":1,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":1.494},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.0509999999999999}]},{"osd":2,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.90700000000000003}]},{"osd":3,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.1899999999999999}]},{"osd":4,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":1.264}]},{"osd":5,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.129,"5min":2.129,"15min":2.129},"last":1.2170000000000001}]},{"osd":6,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.639}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":171556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.204},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.1759999999999999}]},{"osd":1,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.84799999999999998}]},{"osd":2,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.399},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.1120000000000001}]},{"osd":3,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":1.3140000000000001}]},{"osd":4,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.0780000000000001}]},{"osd":5,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.528,"5min":2.528,"15min":2.528},"last":1.234}]},{"osd":7,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.4350000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":1.329}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":171612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":13.811999999999999,"5min":13.811999999999999,"15min":13.811999999999999},"last":1.163},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.5030000000000001,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.90300000000000002}]},{"osd":1,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":9.9900000000000002,"5min":9.9900000000000002,"15min":9.9900000000000002},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":6.024,"5min":6.024,"15min":6.024},"last":1.5680000000000001}]},{"osd":2,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":6.109,"5min":6.109,"15min":6.109},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.222}]},{"osd":3,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":6.6950000000000003,"5min":6.6950000000000003,"15min":6.6950000000000003},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.956,"5min":1.956,"15min":1.956},"min":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"max":{"1min":9.9489999999999998,"5min":9.9489999999999998,"15min":9.9489999999999998},"last":1.367}]},{"osd":4,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":6.1520000000000001,"5min":6.1520000000000001,"15min":6.1520000000000001},"last":1.633},{"interface":"front","average":{"1min":1.819,"5min":1.819,"15min":1.819},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":6.6100000000000003,"5min":6.6100000000000003,"15min":6.6100000000000003},"last":1.347}]},{"osd":6,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":2.052,"5min":2.052,"15min":2.052},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":9.8160000000000007,"5min":9.8160000000000007,"15min":9.8160000000000007},"last":1.5109999999999999},{"interface":"front","average":{"1min":2,"5min":2,"15min":2},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":6.0679999999999996,"5min":6.0679999999999996,"15min":6.0679999999999996},"last":1.6950000000000001}]},{"osd":7,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":1.831,"15min":1.831},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":1.4319999999999999},{"interface":"front","average":{"1min":2.214,"5min":2.214,"15min":2.214},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":9.8650000000000002,"5min":9.8650000000000002,"15min":9.8650000000000002},"last":1.605}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":171044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":1.2110000000000001}]},{"osd":1,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.399},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":0.70899999999999996}]},{"osd":2,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.4550000000000001}]},{"osd":3,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":4.9969999999999999,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":1.673},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"min":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":4.6680000000000001,"5min":4.6680000000000001,"15min":4.6680000000000001},"last":1.3120000000000001}]},{"osd":5,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.9729999999999999,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":1.03},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":3.4790000000000001,"5min":3.4790000000000001,"15min":3.4790000000000001},"last":1.544}]},{"osd":6,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.107},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.496}]},{"osd":7,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.871},{"interface":"front","average":{"1min":1.625,"5min":1.625,"15min":1.625},"min":{"1min":1.113,"5min":1.113,"15min":1.113},"max":{"1min":2.4409999999999998,"5min":2.4409999999999998,"15min":2.4409999999999998},"last":1.599}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":450560,"data_stored":181040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":9.298,"5min":9.298,"15min":9.298},"last":1.054},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.806,"5min":3.806,"15min":3.806},"last":0.97899999999999998}]},{"osd":1,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":3.1070000000000002,"5min":3.1070000000000002,"15min":3.1070000000000002},"last":1.181},{"interface":"front","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":9.3659999999999997,"5min":9.3659999999999997,"15min":9.3659999999999997},"last":1.23}]},{"osd":2,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":5.7949999999999999,"5min":5.7949999999999999,"15min":5.7949999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":6.7240000000000002,"5min":6.7240000000000002,"15min":6.7240000000000002},"last":1.323}]},{"osd":4,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":6.1280000000000001,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":1.266},{"interface":"front","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":1.4930000000000001}]},{"osd":5,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.383},{"interface":"front","average":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":18.904,"5min":18.904,"15min":18.904},"last":1.4159999999999999}]},{"osd":6,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":3.9209999999999998,"5min":3.9209999999999998,"15min":3.9209999999999998},"last":1.147},{"interface":"front","average":{"1min":1.738,"5min":1.738,"15min":1.738},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":5.0919999999999996,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":1.4370000000000001}]},{"osd":7,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.903,"5min":1.903,"15min":1.903},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":6.8600000000000003,"5min":6.8600000000000003,"15min":6.8600000000000003},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":4.4669999999999996,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":1.353}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":169991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.877}]},{"osd":1,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.83899999999999997}]},{"osd":3,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":4.742,"5min":4.742,"15min":4.742},"last":1.169},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":0.96899999999999997}]},{"osd":4,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.5609999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":1.008},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.0860000000000001}]},{"osd":5,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":3.012,"5min":3.012,"15min":3.012},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":8.125,"5min":8.125,"15min":8.125},"last":1.226}]},{"osd":6,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":5.6449999999999996,"5min":5.6449999999999996,"15min":5.6449999999999996},"last":1.587},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.6279999999999999}]},{"osd":7,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.8120000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":181039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2,"5min":2,"15min":2},"last":0.91500000000000004}]},{"osd":2,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.7549999999999999,"5min":4.7549999999999999,"15min":4.7549999999999999},"last":1.119}]},{"osd":3,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":3.0619999999999998,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":6.04,"5min":6.04,"15min":6.04},"last":0.95699999999999996}]},{"osd":4,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.629,"5min":2.629,"15min":2.629},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":3.7669999999999999,"5min":3.7669999999999999,"15min":3.7669999999999999},"last":1.3049999999999999}]},{"osd":5,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.532,"5min":1.532,"15min":1.532},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":4.2480000000000002,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":1.389},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":3.9359999999999999,"5min":3.9359999999999999,"15min":3.9359999999999999},"last":1.26}]},{"osd":6,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.4209999999999998,"5min":2.4209999999999998,"15min":2.4209999999999998},"last":1.012},{"interface":"front","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":3.2559999999999998,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":1.3140000000000001}]},{"osd":7,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.6869999999999998,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":1.214},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.877}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":760289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.6190000000000002,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":1.1679999999999999}]},{"osd":2,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.006},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.97899999999999998}]},{"osd":3,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.21},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":5.2679999999999998,"5min":5.2679999999999998,"15min":5.2679999999999998},"last":1.143}]},{"osd":4,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.345},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":3.3540000000000001,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":1.2669999999999999}]},{"osd":5,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":1.528},{"interface":"front","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.3859999999999999}]},{"osd":6,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.9279999999999999,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.8690000000000002,"5min":2.8690000000000002,"15min":2.8690000000000002},"last":1.6200000000000001}]},{"osd":7,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.8010000000000002,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.417},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":4.923,"5min":4.923,"15min":4.923},"last":1.45}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T01:53:16.193 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-30T01:53:16.193 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T01:53:16.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.395+0000 7f130fe00640 1 Processor -- start 2024-03-30T01:53:16.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.395+0000 7f130fe00640 1 -- start start 2024-03-30T01:53:16.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.396+0000 7f130fe00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f130813f100 0x7f130815d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:16.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.396+0000 7f130fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f130813f4e0 0x7f13080caab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:16.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.396+0000 7f130fe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f130813fc10 0x7f1308070d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:16.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.396+0000 7f130fe00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13080caff0 con 0x7f130813f100 2024-03-30T01:53:16.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.396+0000 7f130fe00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13080cb290 con 0x7f130813fc10 2024-03-30T01:53:16.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.396+0000 7f130fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13080cb570 con 0x7f130813f4e0 2024-03-30T01:53:16.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.397+0000 7f130d400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f130813f100 0x7f130815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:16.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.397+0000 7f130d400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f130813f100 0x7f130815d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35896/0 (socket says 172.21.15.133:35896) 2024-03-30T01:53:16.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.397+0000 7f130d400640 1 -- 172.21.15.133:0/3248805273 learned_addr learned my addr 172.21.15.133:0/3248805273 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:16.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.397+0000 7f130ca00640 1 --2- 172.21.15.133:0/3248805273 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f130813f4e0 0x7f13080caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:16.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.397+0000 7f130de00640 1 --2- 172.21.15.133:0/3248805273 >> v2:172.21.15.137:3300/0 conn(0x7f130813fc10 0x7f1308070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:16.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.397+0000 7f130d400640 1 -- 172.21.15.133:0/3248805273 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f130813f4e0 msgr2=0x7f13080caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:16.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.397+0000 7f130d400640 1 --2- 172.21.15.133:0/3248805273 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f130813f4e0 0x7f13080caab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:16.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.397+0000 7f130d400640 1 -- 172.21.15.133:0/3248805273 >> v2:172.21.15.137:3300/0 conn(0x7f130813fc10 msgr2=0x7f1308070d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:16.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.397+0000 7f130d400640 1 --2- 172.21.15.133:0/3248805273 >> v2:172.21.15.137:3300/0 conn(0x7f130813fc10 0x7f1308070d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:16.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.397+0000 7f130d400640 1 -- 172.21.15.133:0/3248805273 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13080cb850 con 0x7f130813f100 2024-03-30T01:53:16.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.398+0000 7f130d400640 1 --2- 172.21.15.133:0/3248805273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f130813f100 0x7f130815d670 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f130815dbb0 tx=0x7f12fc02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed471a4df9319a1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:16.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.398+0000 7f1307e00640 1 -- 172.21.15.133:0/3248805273 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc031860 con 0x7f130813f100 2024-03-30T01:53:16.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.399+0000 7f1307e00640 1 -- 172.21.15.133:0/3248805273 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc0319c0 con 0x7f130813f100 2024-03-30T01:53:16.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.399+0000 7f1307e00640 1 -- 172.21.15.133:0/3248805273 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc031d50 con 0x7f130813f100 2024-03-30T01:53:16.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.399+0000 7f130fe00640 1 -- 172.21.15.133:0/3248805273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f130813f100 msgr2=0x7f130815d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:16.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.399+0000 7f130fe00640 1 --2- 172.21.15.133:0/3248805273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f130813f100 0x7f130815d670 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f130815dbb0 tx=0x7f12fc02b900 comp rx=0 tx=0).stop 2024-03-30T01:53:16.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.399+0000 7f130fe00640 1 -- 172.21.15.133:0/3248805273 shutdown_connections 2024-03-30T01:53:16.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.399+0000 7f130fe00640 1 --2- 172.21.15.133:0/3248805273 >> v2:172.21.15.137:3300/0 conn(0x7f130813fc10 0x7f1308070d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:16.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.399+0000 7f130fe00640 1 --2- 172.21.15.133:0/3248805273 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f130813f4e0 0x7f13080caab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:16.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.399+0000 7f130fe00640 1 --2- 172.21.15.133:0/3248805273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f130813f100 0x7f130815d670 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:16.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.399+0000 7f130fe00640 1 -- 172.21.15.133:0/3248805273 >> 172.21.15.133:0/3248805273 conn(0x7f13080b07a0 msgr2=0x7f13080b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:16.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.399+0000 7f130fe00640 1 -- 172.21.15.133:0/3248805273 shutdown_connections 2024-03-30T01:53:16.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.399+0000 7f130fe00640 1 -- 172.21.15.133:0/3248805273 wait complete. 2024-03-30T01:53:16.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.401+0000 7f130fe00640 1 Processor -- start 2024-03-30T01:53:16.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.401+0000 7f130fe00640 1 -- start start 2024-03-30T01:53:16.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.402+0000 7f130fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f130813f100 0x7f13081582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:16.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.402+0000 7f130fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f130813f4e0 0x7f130815a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:16.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.402+0000 7f130fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f130813fc10 0x7f13081f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:16.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.402+0000 7f130fe00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130815a350 con 0x7f130813fc10 2024-03-30T01:53:16.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.402+0000 7f130fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13081596d0 con 0x7f130813f4e0 2024-03-30T01:53:16.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.402+0000 7f130fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13081599b0 con 0x7f130813f100 2024-03-30T01:53:16.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.402+0000 7f130de00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f130813fc10 0x7f13081f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:16.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.402+0000 7f130de00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f130813fc10 0x7f13081f26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35910/0 (socket says 172.21.15.133:35910) 2024-03-30T01:53:16.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.402+0000 7f130de00640 1 -- 172.21.15.133:0/1262712937 learned_addr learned my addr 172.21.15.133:0/1262712937 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:16.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.403+0000 7f130ca00640 1 --2- 172.21.15.133:0/1262712937 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f130813f4e0 0x7f130815a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:16.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.403+0000 7f130de00640 1 -- 172.21.15.133:0/1262712937 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f130813f100 msgr2=0x7f13081582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:16.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.403+0000 7f130de00640 1 --2- 172.21.15.133:0/1262712937 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f130813f100 0x7f13081582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:16.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.403+0000 7f130de00640 1 -- 172.21.15.133:0/1262712937 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f130813f4e0 msgr2=0x7f130815a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:16.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.403+0000 7f130de00640 1 --2- 172.21.15.133:0/1262712937 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f130813f4e0 0x7f130815a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:16.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.403+0000 7f130de00640 1 -- 172.21.15.133:0/1262712937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc0094d0 con 0x7f130813fc10 2024-03-30T01:53:16.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.403+0000 7f130ca00640 1 --2- 172.21.15.133:0/1262712937 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f130813f4e0 0x7f130815a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:16.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.403+0000 7f130de00640 1 --2- 172.21.15.133:0/1262712937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f130813fc10 0x7f13081f26d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f130000cc30 tx=0x7f130000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:16.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.403+0000 7f1305600640 1 -- 172.21.15.133:0/1262712937 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130000ce40 con 0x7f130813fc10 2024-03-30T01:53:16.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.403+0000 7f1305600640 1 -- 172.21.15.133:0/1262712937 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1300003990 con 0x7f130813fc10 2024-03-30T01:53:16.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.404+0000 7f1305600640 1 -- 172.21.15.133:0/1262712937 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1300003d20 con 0x7f130813fc10 2024-03-30T01:53:16.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.404+0000 7f130fe00640 1 -- 172.21.15.133:0/1262712937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1308159c90 con 0x7f130813fc10 2024-03-30T01:53:16.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.404+0000 7f130fe00640 1 -- 172.21.15.133:0/1262712937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13081587e0 con 0x7f130813fc10 2024-03-30T01:53:16.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.405+0000 7f130fe00640 1 -- 172.21.15.133:0/1262712937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1308066d80 con 0x7f130813fc10 2024-03-30T01:53:16.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.406+0000 7f1305600640 1 -- 172.21.15.133:0/1262712937 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1300003e80 con 0x7f130813fc10 2024-03-30T01:53:16.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.407+0000 7f1305600640 1 --2- 172.21.15.133:0/1262712937 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f12e806ac30 0x7f12e806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:16.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.407+0000 7f1305600640 1 -- 172.21.15.133:0/1262712937 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f1300089390 con 0x7f130813fc10 2024-03-30T01:53:16.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.407+0000 7f130d400640 1 --2- 172.21.15.133:0/1262712937 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f12e806ac30 0x7f12e806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:16.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.408+0000 7f130d400640 1 --2- 172.21.15.133:0/1262712937 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f12e806ac30 0x7f12e806d0f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f12fc036000 tx=0x7f12fc030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:16.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.412+0000 7f1305600640 1 -- 172.21.15.133:0/1262712937 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f1300054800 con 0x7f130813fc10 2024-03-30T01:53:16.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.602+0000 7f130fe00640 1 -- 172.21.15.133:0/1262712937 --> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13080cd2b0 con 0x7f12e806ac30 2024-03-30T01:53:16.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.607+0000 7f1305600640 1 -- 172.21.15.133:0/1262712937 <== mgr.4105 v2:172.21.15.133:6832/37234 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48099 (secure 0 0 0) 0x7f12fc03a420 con 0x7f12e806ac30 2024-03-30T01:53:16.613 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:53:16.614 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-03-30T01:53:16.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.610+0000 7f130fe00640 1 -- 172.21.15.133:0/1262712937 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f12e806ac30 msgr2=0x7f12e806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:16.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.610+0000 7f130fe00640 1 --2- 172.21.15.133:0/1262712937 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f12e806ac30 0x7f12e806d0f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f12fc036000 tx=0x7f12fc030000 comp rx=0 tx=0).stop 2024-03-30T01:53:16.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.610+0000 7f130fe00640 1 -- 172.21.15.133:0/1262712937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f130813fc10 msgr2=0x7f13081f26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:16.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.610+0000 7f130fe00640 1 --2- 172.21.15.133:0/1262712937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f130813fc10 0x7f13081f26d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f130000cc30 tx=0x7f130000a5c0 comp rx=0 tx=0).stop 2024-03-30T01:53:16.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.610+0000 7f130fe00640 1 -- 172.21.15.133:0/1262712937 shutdown_connections 2024-03-30T01:53:16.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.610+0000 7f130fe00640 1 --2- 172.21.15.133:0/1262712937 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f12e806ac30 0x7f12e806d0f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:16.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.610+0000 7f130fe00640 1 --2- 172.21.15.133:0/1262712937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f130813fc10 0x7f13081f26d0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:16.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.610+0000 7f130fe00640 1 --2- 172.21.15.133:0/1262712937 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f130813f4e0 0x7f130815a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:16.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.610+0000 7f130fe00640 1 --2- 172.21.15.133:0/1262712937 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f130813f100 0x7f13081582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:16.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.610+0000 7f130fe00640 1 -- 172.21.15.133:0/1262712937 >> 172.21.15.133:0/1262712937 conn(0x7f13080b07a0 msgr2=0x7f130815d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:16.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.610+0000 7f130fe00640 1 -- 172.21.15.133:0/1262712937 shutdown_connections 2024-03-30T01:53:16.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.610+0000 7f130fe00640 1 -- 172.21.15.133:0/1262712937 wait complete. 2024-03-30T01:53:16.634 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-03-30T01:53:15.727701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220696,"kb_used_data":4536,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754024,"statfs":{"total":773094113280,"available":772868120576,"internally_reserved":0,"allocated":4644864,"data_stored":2567970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9154,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-81,"num_read_kb":-88,"num_write":-55,"num_write_kb":-27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001780"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":179,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-03-30T01:52:56.741565+0000","last_change":"2024-03-30T01:51:23.358245+0000","last_active":"2024-03-30T01:52:56.741565+0000","last_peered":"2024-03-30T01:52:56.741565+0000","last_clean":"2024-03-30T01:52:56.741565+0000","last_became_active":"2024-03-30T01:51:23.355914+0000","last_became_peered":"2024-03-30T01:51:23.355914+0000","last_unstale":"2024-03-30T01:52:56.741565+0000","last_undegraded":"2024-03-30T01:52:56.741565+0000","last_fullsized":"2024-03-30T01:52:56.741565+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_clean_scrub_stamp":"2024-03-30T01:51:21.990253+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:21:19.291194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":761399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.369},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.3280000000000001}]},{"osd":1,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":1.494},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.0509999999999999}]},{"osd":2,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.90700000000000003}]},{"osd":3,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.1899999999999999}]},{"osd":4,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":1.264}]},{"osd":5,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.129,"5min":2.129,"15min":2.129},"last":1.2170000000000001}]},{"osd":6,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.639}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":171556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.204},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.1759999999999999}]},{"osd":1,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.84799999999999998}]},{"osd":2,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.399},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.1120000000000001}]},{"osd":3,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":1.3140000000000001}]},{"osd":4,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.0780000000000001}]},{"osd":5,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.528,"5min":2.528,"15min":2.528},"last":1.234}]},{"osd":7,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.4350000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":1.329}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":171612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":13.811999999999999,"5min":13.811999999999999,"15min":13.811999999999999},"last":1.163},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.5030000000000001,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.90300000000000002}]},{"osd":1,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":9.9900000000000002,"5min":9.9900000000000002,"15min":9.9900000000000002},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":6.024,"5min":6.024,"15min":6.024},"last":1.5680000000000001}]},{"osd":2,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":6.109,"5min":6.109,"15min":6.109},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.222}]},{"osd":3,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":6.6950000000000003,"5min":6.6950000000000003,"15min":6.6950000000000003},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.956,"5min":1.956,"15min":1.956},"min":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"max":{"1min":9.9489999999999998,"5min":9.9489999999999998,"15min":9.9489999999999998},"last":1.367}]},{"osd":4,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":6.1520000000000001,"5min":6.1520000000000001,"15min":6.1520000000000001},"last":1.633},{"interface":"front","average":{"1min":1.819,"5min":1.819,"15min":1.819},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":6.6100000000000003,"5min":6.6100000000000003,"15min":6.6100000000000003},"last":1.347}]},{"osd":6,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":2.052,"5min":2.052,"15min":2.052},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":9.8160000000000007,"5min":9.8160000000000007,"15min":9.8160000000000007},"last":1.5109999999999999},{"interface":"front","average":{"1min":2,"5min":2,"15min":2},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":6.0679999999999996,"5min":6.0679999999999996,"15min":6.0679999999999996},"last":1.6950000000000001}]},{"osd":7,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":1.831,"15min":1.831},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":1.4319999999999999},{"interface":"front","average":{"1min":2.214,"5min":2.214,"15min":2.214},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":9.8650000000000002,"5min":9.8650000000000002,"15min":9.8650000000000002},"last":1.605}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":171044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":1.2110000000000001}]},{"osd":1,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.399},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":0.70899999999999996}]},{"osd":2,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.4550000000000001}]},{"osd":3,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":4.9969999999999999,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":1.673},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"min":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":4.6680000000000001,"5min":4.6680000000000001,"15min":4.6680000000000001},"last":1.3120000000000001}]},{"osd":5,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.9729999999999999,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":1.03},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":3.4790000000000001,"5min":3.4790000000000001,"15min":3.4790000000000001},"last":1.544}]},{"osd":6,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.107},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.496}]},{"osd":7,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.871},{"interface":"front","average":{"1min":1.625,"5min":1.625,"15min":1.625},"min":{"1min":1.113,"5min":1.113,"15min":1.113},"max":{"1min":2.4409999999999998,"5min":2.4409999999999998,"15min":2.4409999999999998},"last":1.599}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":450560,"data_stored":181040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":9.298,"5min":9.298,"15min":9.298},"last":1.054},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.806,"5min":3.806,"15min":3.806},"last":0.97899999999999998}]},{"osd":1,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":3.1070000000000002,"5min":3.1070000000000002,"15min":3.1070000000000002},"last":1.181},{"interface":"front","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":9.3659999999999997,"5min":9.3659999999999997,"15min":9.3659999999999997},"last":1.23}]},{"osd":2,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":5.7949999999999999,"5min":5.7949999999999999,"15min":5.7949999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":6.7240000000000002,"5min":6.7240000000000002,"15min":6.7240000000000002},"last":1.323}]},{"osd":4,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":6.1280000000000001,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":1.266},{"interface":"front","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":1.4930000000000001}]},{"osd":5,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.383},{"interface":"front","average":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":18.904,"5min":18.904,"15min":18.904},"last":1.4159999999999999}]},{"osd":6,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":3.9209999999999998,"5min":3.9209999999999998,"15min":3.9209999999999998},"last":1.147},{"interface":"front","average":{"1min":1.738,"5min":1.738,"15min":1.738},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":5.0919999999999996,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":1.4370000000000001}]},{"osd":7,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.903,"5min":1.903,"15min":1.903},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":6.8600000000000003,"5min":6.8600000000000003,"15min":6.8600000000000003},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":4.4669999999999996,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":1.353}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":169991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.877}]},{"osd":1,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.83899999999999997}]},{"osd":3,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":4.742,"5min":4.742,"15min":4.742},"last":1.169},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":0.96899999999999997}]},{"osd":4,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.5609999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":1.008},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.0860000000000001}]},{"osd":5,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":3.012,"5min":3.012,"15min":3.012},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":8.125,"5min":8.125,"15min":8.125},"last":1.226}]},{"osd":6,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":5.6449999999999996,"5min":5.6449999999999996,"15min":5.6449999999999996},"last":1.587},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.6279999999999999}]},{"osd":7,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.8120000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":181039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2,"5min":2,"15min":2},"last":0.91500000000000004}]},{"osd":2,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.7549999999999999,"5min":4.7549999999999999,"15min":4.7549999999999999},"last":1.119}]},{"osd":3,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":3.0619999999999998,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":6.04,"5min":6.04,"15min":6.04},"last":0.95699999999999996}]},{"osd":4,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.629,"5min":2.629,"15min":2.629},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":3.7669999999999999,"5min":3.7669999999999999,"15min":3.7669999999999999},"last":1.3049999999999999}]},{"osd":5,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.532,"5min":1.532,"15min":1.532},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":4.2480000000000002,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":1.389},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":3.9359999999999999,"5min":3.9359999999999999,"15min":3.9359999999999999},"last":1.26}]},{"osd":6,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.4209999999999998,"5min":2.4209999999999998,"15min":2.4209999999999998},"last":1.012},{"interface":"front","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":3.2559999999999998,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":1.3140000000000001}]},{"osd":7,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.6869999999999998,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":1.214},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.877}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":760289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.6190000000000002,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":1.1679999999999999}]},{"osd":2,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.006},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.97899999999999998}]},{"osd":3,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.21},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":5.2679999999999998,"5min":5.2679999999999998,"15min":5.2679999999999998},"last":1.143}]},{"osd":4,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.345},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":3.3540000000000001,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":1.2669999999999999}]},{"osd":5,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":1.528},{"interface":"front","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.3859999999999999}]},{"osd":6,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.9279999999999999,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.8690000000000002,"5min":2.8690000000000002,"15min":2.8690000000000002},"last":1.6200000000000001}]},{"osd":7,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.8010000000000002,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.417},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":4.923,"5min":4.923,"15min":4.923},"last":1.45}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T01:53:16.635 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T01:53:16.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.831+0000 7fb26e800640 1 Processor -- start 2024-03-30T01:53:16.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.832+0000 7fb26e800640 1 -- start start 2024-03-30T01:53:16.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.833+0000 7fb26e800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb268070500 0x7fb268070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.833+0000 7fb26e800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb2680cc530 0x7fb2680cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.833+0000 7fb26e800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2680a76a0 con 0x7fb268143790 2024-03-30T01:53:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.833+0000 7fb26e800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb268070ed0 con 0x7fb2680cc530 2024-03-30T01:53:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.833+0000 7fb26e800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2680b38e0 con 0x7fb268070500 2024-03-30T01:53:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.833+0000 7fb267e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb2680cc530 0x7fb2680cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.833+0000 7fb267e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb2680cc530 0x7fb2680cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35912/0 (socket says 172.21.15.133:35912) 2024-03-30T01:53:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.833+0000 7fb267e00640 1 -- 172.21.15.133:0/413661993 learned_addr learned my addr 172.21.15.133:0/413661993 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.833+0000 7fb25ea00640 1 --2- 172.21.15.133:0/413661993 >> v2:172.21.15.137:3300/0 conn(0x7fb268070500 0x7fb268070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.834+0000 7fb267e00640 1 -- 172.21.15.133:0/413661993 >> v2:172.21.15.137:3300/0 conn(0x7fb268070500 msgr2=0x7fb268070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.834+0000 7fb267e00640 1 --2- 172.21.15.133:0/413661993 >> v2:172.21.15.137:3300/0 conn(0x7fb268070500 0x7fb268070990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.834+0000 7fb267e00640 1 -- 172.21.15.133:0/413661993 >> v1:172.21.15.137:6789/0 conn(0x7fb268143790 legacy=0x7fb2680cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.834+0000 7fb267e00640 1 -- 172.21.15.133:0/413661993 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2680ccee0 con 0x7fb2680cc530 2024-03-30T01:53:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.835+0000 7fb267e00640 1 --2- 172.21.15.133:0/413661993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2680cc530 0x7fb2680cc9a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb26806e6a0 tx=0x7fb26002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa66ac4cec121d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.835+0000 7fb266a00640 1 -- 172.21.15.133:0/413661993 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26002cb20 con 0x7fb2680cc530 2024-03-30T01:53:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.835+0000 7fb266a00640 1 -- 172.21.15.133:0/413661993 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26002cc80 con 0x7fb2680cc530 2024-03-30T01:53:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.835+0000 7fb266a00640 1 -- 172.21.15.133:0/413661993 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2600343f0 con 0x7fb2680cc530 2024-03-30T01:53:16.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.836+0000 7fb26e800640 1 -- 172.21.15.133:0/413661993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2680cc530 msgr2=0x7fb2680cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:16.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.836+0000 7fb26e800640 1 --2- 172.21.15.133:0/413661993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2680cc530 0x7fb2680cc9a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb26806e6a0 tx=0x7fb26002bf80 comp rx=0 tx=0).stop 2024-03-30T01:53:16.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.836+0000 7fb26e800640 1 -- 172.21.15.133:0/413661993 shutdown_connections 2024-03-30T01:53:16.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.836+0000 7fb26e800640 1 --2- 172.21.15.133:0/413661993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2680cc530 0x7fb2680cc9a0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:16.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.836+0000 7fb26e800640 1 --2- 172.21.15.133:0/413661993 >> v2:172.21.15.137:3300/0 conn(0x7fb268070500 0x7fb268070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:16.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.836+0000 7fb26e800640 1 -- 172.21.15.133:0/413661993 >> 172.21.15.133:0/413661993 conn(0x7fb2680b07a0 msgr2=0x7fb2680b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:16.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.836+0000 7fb26e800640 1 -- 172.21.15.133:0/413661993 shutdown_connections 2024-03-30T01:53:16.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.836+0000 7fb26e800640 1 -- 172.21.15.133:0/413661993 wait complete. 2024-03-30T01:53:16.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.838+0000 7fb26e800640 1 Processor -- start 2024-03-30T01:53:16.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.838+0000 7fb26e800640 1 -- start start 2024-03-30T01:53:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.838+0000 7fb26e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb268070500 0x7fb2680c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.839+0000 7fb26e800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2680cc530 0x7fb26815a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.839+0000 7fb26e800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb268143790 0x7fb2681f04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.839+0000 7fb26e800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2681f0030 con 0x7fb268143790 2024-03-30T01:53:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.839+0000 7fb26e800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2680c55b0 con 0x7fb268070500 2024-03-30T01:53:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.839+0000 7fb26e800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2680c4a30 con 0x7fb2680cc530 2024-03-30T01:53:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.839+0000 7fb267e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb268143790 0x7fb2681f04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.839+0000 7fb267e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb268143790 0x7fb2681f04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35918/0 (socket says 172.21.15.133:35918) 2024-03-30T01:53:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.839+0000 7fb267e00640 1 -- 172.21.15.133:0/3747357385 learned_addr learned my addr 172.21.15.133:0/3747357385 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.839+0000 7fb25ea00640 1 --2- 172.21.15.133:0/3747357385 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2680cc530 0x7fb26815a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.839+0000 7fb267400640 1 --2- 172.21.15.133:0/3747357385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb268070500 0x7fb2680c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.839+0000 7fb267e00640 1 -- 172.21.15.133:0/3747357385 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2680cc530 msgr2=0x7fb26815a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.839+0000 7fb267e00640 1 --2- 172.21.15.133:0/3747357385 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2680cc530 0x7fb26815a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.839+0000 7fb267e00640 1 -- 172.21.15.133:0/3747357385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb268070500 msgr2=0x7fb2680c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.839+0000 7fb267e00640 1 --2- 172.21.15.133:0/3747357385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb268070500 0x7fb2680c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.839+0000 7fb267e00640 1 -- 172.21.15.133:0/3747357385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb260009b30 con 0x7fb268143790 2024-03-30T01:53:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.840+0000 7fb267e00640 1 --2- 172.21.15.133:0/3747357385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb268143790 0x7fb2681f04d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb260036040 tx=0x7fb260004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.840+0000 7fb25fe00640 1 -- 172.21.15.133:0/3747357385 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb260007e70 con 0x7fb268143790 2024-03-30T01:53:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.840+0000 7fb25fe00640 1 -- 172.21.15.133:0/3747357385 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb260009510 con 0x7fb268143790 2024-03-30T01:53:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.840+0000 7fb25fe00640 1 -- 172.21.15.133:0/3747357385 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26003e690 con 0x7fb268143790 2024-03-30T01:53:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.840+0000 7fb26e800640 1 -- 172.21.15.133:0/3747357385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2680c4d10 con 0x7fb268143790 2024-03-30T01:53:16.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.840+0000 7fb26e800640 1 -- 172.21.15.133:0/3747357385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2680c52d0 con 0x7fb268143790 2024-03-30T01:53:16.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.841+0000 7fb26e800640 1 -- 172.21.15.133:0/3747357385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb268066d80 con 0x7fb268143790 2024-03-30T01:53:16.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.842+0000 7fb25fe00640 1 -- 172.21.15.133:0/3747357385 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb26003e7f0 con 0x7fb268143790 2024-03-30T01:53:16.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.844+0000 7fb25fe00640 1 --2- 172.21.15.133:0/3747357385 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb24406ac00 0x7fb24406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:16.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.844+0000 7fb25fe00640 1 -- 172.21.15.133:0/3747357385 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb2600ac070 con 0x7fb268143790 2024-03-30T01:53:16.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.844+0000 7fb267400640 1 --2- 172.21.15.133:0/3747357385 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb24406ac00 0x7fb24406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:16.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.845+0000 7fb267400640 1 --2- 172.21.15.133:0/3747357385 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb24406ac00 0x7fb24406d0c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb258006fd0 tx=0x7fb258008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:16.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:16.848+0000 7fb25fe00640 1 -- 172.21.15.133:0/3747357385 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fb260077580 con 0x7fb268143790 2024-03-30T01:53:17.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:17.043+0000 7fb26e800640 1 -- 172.21.15.133:0/3747357385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2680c4720 con 0x7fb268143790 2024-03-30T01:53:17.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:17.045+0000 7fb25fe00640 1 -- 172.21.15.133:0/3747357385 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+12698 (secure 0 0 0) 0x7fb26007aba0 con 0x7fb268143790 2024-03-30T01:53:17.051 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:53:17.051 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":39,"fsid":"10e5f47a-7547-42f1-8bb3-a8ac3aae8cad","created":"2024-03-30T01:51:08.645701+0000","modified":"2024-03-30T01:53:12.860793+0000","last_up_change":"2024-03-30T01:51:20.914567+0000","last_in_change":"2024-03-30T01:51:12.191363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T01:51:21.771393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e78f3a78-50d1-4116-bc15-f2e32e628206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":37492},{"type":"v1","addr":"172.21.15.133:6818","nonce":37492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":37492},{"type":"v1","addr":"172.21.15.133:6822","nonce":37492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":37492},{"type":"v1","addr":"172.21.15.133:6828","nonce":37492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6823","nonce":37492},{"type":"v1","addr":"172.21.15.133:6825","nonce":37492}]},"public_addr":"172.21.15.133:6818/37492","cluster_addr":"172.21.15.133:6822/37492","heartbeat_back_addr":"172.21.15.133:6828/37492","heartbeat_front_addr":"172.21.15.133:6825/37492","state":["exists","up"]},{"osd":1,"uuid":"e3e02062-ba40-442a-b2e4-21f26017ff2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":37491},{"type":"v1","addr":"172.21.15.133:6819","nonce":37491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":37491},{"type":"v1","addr":"172.21.15.133:6824","nonce":37491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":37491},{"type":"v1","addr":"172.21.15.133:6831","nonce":37491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6827","nonce":37491},{"type":"v1","addr":"172.21.15.133:6829","nonce":37491}]},"public_addr":"172.21.15.133:6819/37491","cluster_addr":"172.21.15.133:6824/37491","heartbeat_back_addr":"172.21.15.133:6831/37491","heartbeat_front_addr":"172.21.15.133:6829/37491","state":["exists","up"]},{"osd":2,"uuid":"5a7cd297-9e6b-4677-afa4-193f4b3d736f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":37488},{"type":"v1","addr":"172.21.15.133:6809","nonce":37488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":37488},{"type":"v1","addr":"172.21.15.133:6811","nonce":37488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":37488},{"type":"v1","addr":"172.21.15.133:6815","nonce":37488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":37488},{"type":"v1","addr":"172.21.15.133:6813","nonce":37488}]},"public_addr":"172.21.15.133:6809/37488","cluster_addr":"172.21.15.133:6811/37488","heartbeat_back_addr":"172.21.15.133:6815/37488","heartbeat_front_addr":"172.21.15.133:6813/37488","state":["exists","up"]},{"osd":3,"uuid":"a0f82433-f2da-46c6-a3a9-4f85d761cb2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":37490},{"type":"v1","addr":"172.21.15.133:6801","nonce":37490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":37490},{"type":"v1","addr":"172.21.15.133:6803","nonce":37490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":37490},{"type":"v1","addr":"172.21.15.133:6807","nonce":37490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":37490},{"type":"v1","addr":"172.21.15.133:6805","nonce":37490}]},"public_addr":"172.21.15.133:6801/37490","cluster_addr":"172.21.15.133:6803/37490","heartbeat_back_addr":"172.21.15.133:6807/37490","heartbeat_front_addr":"172.21.15.133:6805/37490","state":["exists","up"]},{"osd":4,"uuid":"bccc5e1d-60ec-4a9f-9742-3a0fbbae2f87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":37248},{"type":"v1","addr":"172.21.15.137:6807","nonce":37248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":37248},{"type":"v1","addr":"172.21.15.137:6811","nonce":37248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":37248},{"type":"v1","addr":"172.21.15.137:6815","nonce":37248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":37248},{"type":"v1","addr":"172.21.15.137:6813","nonce":37248}]},"public_addr":"172.21.15.137:6807/37248","cluster_addr":"172.21.15.137:6811/37248","heartbeat_back_addr":"172.21.15.137:6815/37248","heartbeat_front_addr":"172.21.15.137:6813/37248","state":["exists","up"]},{"osd":5,"uuid":"3f1644b8-2f85-4eef-a63d-1c601164035d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":37249},{"type":"v1","addr":"172.21.15.137:6801","nonce":37249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":37249},{"type":"v1","addr":"172.21.15.137:6803","nonce":37249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":37249},{"type":"v1","addr":"172.21.15.137:6810","nonce":37249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":37249},{"type":"v1","addr":"172.21.15.137:6806","nonce":37249}]},"public_addr":"172.21.15.137:6801/37249","cluster_addr":"172.21.15.137:6803/37249","heartbeat_back_addr":"172.21.15.137:6810/37249","heartbeat_front_addr":"172.21.15.137:6806/37249","state":["exists","up"]},{"osd":6,"uuid":"593d11b1-b9a9-47f8-a924-71c490ed34f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":37271},{"type":"v1","addr":"172.21.15.137:6825","nonce":37271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":37271},{"type":"v1","addr":"172.21.15.137:6827","nonce":37271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":37271},{"type":"v1","addr":"172.21.15.137:6831","nonce":37271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":37271},{"type":"v1","addr":"172.21.15.137:6829","nonce":37271}]},"public_addr":"172.21.15.137:6825/37271","cluster_addr":"172.21.15.137:6827/37271","heartbeat_back_addr":"172.21.15.137:6831/37271","heartbeat_front_addr":"172.21.15.137:6829/37271","state":["exists","up"]},{"osd":7,"uuid":"deea6cf8-0323-4aec-b27e-340cada83562","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":37250},{"type":"v1","addr":"172.21.15.137:6817","nonce":37250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":37250},{"type":"v1","addr":"172.21.15.137:6819","nonce":37250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":37250},{"type":"v1","addr":"172.21.15.137:6823","nonce":37250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":37250},{"type":"v1","addr":"172.21.15.137:6821","nonce":37250}]},"public_addr":"172.21.15.137:6817/37250","cluster_addr":"172.21.15.137:6819/37250","heartbeat_back_addr":"172.21.15.137:6823/37250","heartbeat_front_addr":"172.21.15.137:6821/37250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.542456+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.502664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.476050+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.515307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.536350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.478002+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.534619+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T01:51:17.530462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6836/1431848593":"2024-03-31T01:53:09.746252+0000","172.21.15.133:6834/1431848593":"2024-03-31T01:53:09.746252+0000","172.21.15.133:6836/665764657":"2024-03-31T01:52:54.232727+0000","172.21.15.133:6834/665764657":"2024-03-31T01:52:54.232727+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T01:53:17.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:17.047+0000 7fb26e800640 1 -- 172.21.15.133:0/3747357385 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb24406ac00 msgr2=0x7fb24406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:17.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:17.047+0000 7fb26e800640 1 --2- 172.21.15.133:0/3747357385 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb24406ac00 0x7fb24406d0c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb258006fd0 tx=0x7fb258008040 comp rx=0 tx=0).stop 2024-03-30T01:53:17.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:17.047+0000 7fb26e800640 1 -- 172.21.15.133:0/3747357385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb268143790 msgr2=0x7fb2681f04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:17.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:17.047+0000 7fb26e800640 1 --2- 172.21.15.133:0/3747357385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb268143790 0x7fb2681f04d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb260036040 tx=0x7fb260004a40 comp rx=0 tx=0).stop 2024-03-30T01:53:17.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:17.047+0000 7fb26e800640 1 -- 172.21.15.133:0/3747357385 shutdown_connections 2024-03-30T01:53:17.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:17.047+0000 7fb26e800640 1 --2- 172.21.15.133:0/3747357385 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fb24406ac00 0x7fb24406d0c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:17.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:17.047+0000 7fb26e800640 1 --2- 172.21.15.133:0/3747357385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb268143790 0x7fb2681f04d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:17.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:17.047+0000 7fb26e800640 1 --2- 172.21.15.133:0/3747357385 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2680cc530 0x7fb26815a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:17.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:17.047+0000 7fb26e800640 1 --2- 172.21.15.133:0/3747357385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb268070500 0x7fb2680c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:17.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:17.047+0000 7fb26e800640 1 -- 172.21.15.133:0/3747357385 >> 172.21.15.133:0/3747357385 conn(0x7fb2680b07a0 msgr2=0x7fb268140cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:17.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:17.048+0000 7fb26e800640 1 -- 172.21.15.133:0/3747357385 shutdown_connections 2024-03-30T01:53:17.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:17.048+0000 7fb26e800640 1 -- 172.21.15.133:0/3747357385 wait complete. 2024-03-30T01:53:18.073 INFO:tasks.ceph:Scrubbing osd.0 2024-03-30T01:53:18.073 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-30T01:53:18.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.286+0000 7f6d8f800640 1 Processor -- start 2024-03-30T01:53:18.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.287+0000 7f6d8f800640 1 -- start start 2024-03-30T01:53:18.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.288+0000 7f6d8f800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d880cc5a0 0x7f6d880705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:18.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.288+0000 7f6d8f800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6d88070af0 0x7f6d8815b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:18.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.288+0000 7f6d8f800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d880cd700 con 0x7f6d88144450 2024-03-30T01:53:18.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.288+0000 7f6d8f800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d8815ae10 con 0x7f6d88070af0 2024-03-30T01:53:18.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.288+0000 7f6d8f800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d88070f40 con 0x7f6d880cc5a0 2024-03-30T01:53:18.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.289+0000 7f6d8d800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6d88070af0 0x7f6d8815b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:18.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.289+0000 7f6d8d800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6d88070af0 0x7f6d8815b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35930/0 (socket says 172.21.15.133:35930) 2024-03-30T01:53:18.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.289+0000 7f6d8d800640 1 -- 172.21.15.133:0/2958687505 learned_addr learned my addr 172.21.15.133:0/2958687505 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:18.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.289+0000 7f6d87e00640 1 --2- 172.21.15.133:0/2958687505 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d880cc5a0 0x7f6d880705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:18.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.289+0000 7f6d8d800640 1 -- 172.21.15.133:0/2958687505 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d880cc5a0 msgr2=0x7f6d880705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:18.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.289+0000 7f6d8d800640 1 --2- 172.21.15.133:0/2958687505 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d880cc5a0 0x7f6d880705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:18.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.289+0000 7f6d8d800640 1 -- 172.21.15.133:0/2958687505 >> v1:172.21.15.137:6789/0 conn(0x7f6d88144450 legacy=0x7f6d880b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:18.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.289+0000 7f6d8d800640 1 -- 172.21.15.133:0/2958687505 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d880ccb80 con 0x7f6d88070af0 2024-03-30T01:53:18.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.289+0000 7f6d87e00640 1 --2- 172.21.15.133:0/2958687505 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d880cc5a0 0x7f6d880705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:18.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.291+0000 7f6d8d800640 1 --2- 172.21.15.133:0/2958687505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d88070af0 0x7f6d8815b260 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009870 tx=0x7f6d8002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2292a65e0986d7ef server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:18.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.291+0000 7f6d87400640 1 -- 172.21.15.133:0/2958687505 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80031640 con 0x7f6d88070af0 2024-03-30T01:53:18.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.291+0000 7f6d87400640 1 -- 172.21.15.133:0/2958687505 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d800317a0 con 0x7f6d88070af0 2024-03-30T01:53:18.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.291+0000 7f6d87400640 1 -- 172.21.15.133:0/2958687505 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80031b30 con 0x7f6d88070af0 2024-03-30T01:53:18.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.292+0000 7f6d8f800640 1 -- 172.21.15.133:0/2958687505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d88070af0 msgr2=0x7f6d8815b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:18.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.292+0000 7f6d8f800640 1 --2- 172.21.15.133:0/2958687505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d88070af0 0x7f6d8815b260 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009870 tx=0x7f6d8002b8f0 comp rx=0 tx=0).stop 2024-03-30T01:53:18.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.292+0000 7f6d8f800640 1 -- 172.21.15.133:0/2958687505 shutdown_connections 2024-03-30T01:53:18.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.292+0000 7f6d8f800640 1 --2- 172.21.15.133:0/2958687505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d88070af0 0x7f6d8815b260 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:18.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.292+0000 7f6d8f800640 1 --2- 172.21.15.133:0/2958687505 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d880cc5a0 0x7f6d880705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:18.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.292+0000 7f6d8f800640 1 -- 172.21.15.133:0/2958687505 >> 172.21.15.133:0/2958687505 conn(0x7f6d880b0810 msgr2=0x7f6d880b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:18.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.292+0000 7f6d8f800640 1 -- 172.21.15.133:0/2958687505 shutdown_connections 2024-03-30T01:53:18.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.292+0000 7f6d8f800640 1 -- 172.21.15.133:0/2958687505 wait complete. 2024-03-30T01:53:18.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.294+0000 7f6d8f800640 1 Processor -- start 2024-03-30T01:53:18.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.295+0000 7f6d8f800640 1 -- start start 2024-03-30T01:53:18.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.296+0000 7f6d8f800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d88070af0 0x7f6d880c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:18.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.296+0000 7f6d8f800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d880cc5a0 0x7f6d880c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:18.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.296+0000 7f6d8f800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d88144450 0x7f6d881f1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:18.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.296+0000 7f6d8f800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d880cad90 con 0x7f6d88070af0 2024-03-30T01:53:18.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.296+0000 7f6d8f800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d880ca210 con 0x7f6d88144450 2024-03-30T01:53:18.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.296+0000 7f6d8f800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d880ca4f0 con 0x7f6d880cc5a0 2024-03-30T01:53:18.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.296+0000 7f6d8ce00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d88070af0 0x7f6d880c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:18.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.296+0000 7f6d8ce00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d88070af0 0x7f6d880c7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35946/0 (socket says 172.21.15.133:35946) 2024-03-30T01:53:18.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.296+0000 7f6d8ce00640 1 -- 172.21.15.133:0/2482199361 learned_addr learned my addr 172.21.15.133:0/2482199361 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:18.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.296+0000 7f6d8ce00640 1 -- 172.21.15.133:0/2482199361 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d880cc5a0 msgr2=0x7f6d880c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:18.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.296+0000 7f6d8ce00640 1 --2- 172.21.15.133:0/2482199361 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d880cc5a0 0x7f6d880c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:18.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.296+0000 7f6d8ce00640 1 -- 172.21.15.133:0/2482199361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d88144450 msgr2=0x7f6d881f1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:18.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.296+0000 7f6d8ce00640 1 --2- 172.21.15.133:0/2482199361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d88144450 0x7f6d881f1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:18.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.296+0000 7f6d8ce00640 1 -- 172.21.15.133:0/2482199361 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d800094d0 con 0x7f6d88070af0 2024-03-30T01:53:18.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.297+0000 7f6d8ce00640 1 --2- 172.21.15.133:0/2482199361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d88070af0 0x7f6d880c7650 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6d7800ba50 tx=0x7f6d7800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:18.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.297+0000 7f6d84c00640 1 -- 172.21.15.133:0/2482199361 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7800cbe0 con 0x7f6d88070af0 2024-03-30T01:53:18.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.297+0000 7f6d84c00640 1 -- 172.21.15.133:0/2482199361 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7800cd80 con 0x7f6d88070af0 2024-03-30T01:53:18.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.297+0000 7f6d84c00640 1 -- 172.21.15.133:0/2482199361 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78014680 con 0x7f6d88070af0 2024-03-30T01:53:18.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.297+0000 7f6d8f800640 1 -- 172.21.15.133:0/2482199361 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d880ca7d0 con 0x7f6d88070af0 2024-03-30T01:53:18.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.297+0000 7f6d8f800640 1 -- 172.21.15.133:0/2482199361 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d880c9f20 con 0x7f6d88070af0 2024-03-30T01:53:18.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.298+0000 7f6d8f800640 1 -- 172.21.15.133:0/2482199361 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6d880cd420 con 0x7f6d88070af0 2024-03-30T01:53:18.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.299+0000 7f6d84c00640 1 -- 172.21.15.133:0/2482199361 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f6d780147e0 con 0x7f6d88070af0 2024-03-30T01:53:18.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.300+0000 7f6d84c00640 1 --2- 172.21.15.133:0/2482199361 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6d6806ac00 0x7f6d6806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:18.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.300+0000 7f6d84c00640 1 -- 172.21.15.133:0/2482199361 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f6d78089060 con 0x7f6d88070af0 2024-03-30T01:53:18.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.300+0000 7f6d84c00640 1 --2- 172.21.15.133:0/2482199361 >> [v2:172.21.15.133:6816/37492,v1:172.21.15.133:6818/37492] conn(0x7f6d68070b00 0x7f6d68072f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:18.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.300+0000 7f6d84c00640 1 -- 172.21.15.133:0/2482199361 --> [v2:172.21.15.133:6816/37492,v1:172.21.15.133:6818/37492] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d680735d0 con 0x7f6d68070b00 2024-03-30T01:53:18.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.300+0000 7f6d84c00640 1 -- 172.21.15.133:0/2482199361 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d7808b5e0 con 0x7f6d88070af0 2024-03-30T01:53:18.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.301+0000 7f6d87e00640 1 --2- 172.21.15.133:0/2482199361 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6d6806ac00 0x7f6d6806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:18.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.301+0000 7f6d8d800640 1 --2- 172.21.15.133:0/2482199361 >> [v2:172.21.15.133:6816/37492,v1:172.21.15.133:6818/37492] conn(0x7f6d68070b00 0x7f6d68072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:18.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.301+0000 7f6d87e00640 1 --2- 172.21.15.133:0/2482199361 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6d6806ac00 0x7f6d6806d0c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6d74006fd0 tx=0x7f6d74008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:18.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.301+0000 7f6d8d800640 1 --2- 172.21.15.133:0/2482199361 >> [v2:172.21.15.133:6816/37492,v1:172.21.15.133:6818/37492] conn(0x7f6d68070b00 0x7f6d68072f20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:18.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.302+0000 7f6d84c00640 1 -- 172.21.15.133:0/2482199361 <== osd.0 v2:172.21.15.133:6816/37492 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f6d680735d0 con 0x7f6d68070b00 2024-03-30T01:53:18.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.316+0000 7f6d8f800640 1 -- 172.21.15.133:0/2482199361 --> [v2:172.21.15.133:6816/37492,v1:172.21.15.133:6818/37492] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6d880cd140 con 0x7f6d68070b00 2024-03-30T01:53:18.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.317+0000 7f6d84c00640 1 -- 172.21.15.133:0/2482199361 <== osd.0 v2:172.21.15.133:6816/37492 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6d80031910 con 0x7f6d68070b00 2024-03-30T01:53:18.323 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-03-30T01:53:18.323 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T01:53:18.324 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-03-30T01:53:18.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.317+0000 7f6d8f800640 1 -- 172.21.15.133:0/2482199361 >> [v2:172.21.15.133:6816/37492,v1:172.21.15.133:6818/37492] conn(0x7f6d68070b00 msgr2=0x7f6d68072f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:18.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.317+0000 7f6d8f800640 1 --2- 172.21.15.133:0/2482199361 >> [v2:172.21.15.133:6816/37492,v1:172.21.15.133:6818/37492] conn(0x7f6d68070b00 0x7f6d68072f20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:18.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.317+0000 7f6d8f800640 1 -- 172.21.15.133:0/2482199361 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6d6806ac00 msgr2=0x7f6d6806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:18.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.317+0000 7f6d8f800640 1 --2- 172.21.15.133:0/2482199361 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6d6806ac00 0x7f6d6806d0c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6d74006fd0 tx=0x7f6d74008040 comp rx=0 tx=0).stop 2024-03-30T01:53:18.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.317+0000 7f6d8f800640 1 -- 172.21.15.133:0/2482199361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d88070af0 msgr2=0x7f6d880c7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:18.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.317+0000 7f6d8f800640 1 --2- 172.21.15.133:0/2482199361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d88070af0 0x7f6d880c7650 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6d7800ba50 tx=0x7f6d7800bf10 comp rx=0 tx=0).stop 2024-03-30T01:53:18.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.317+0000 7f6d8d800640 1 -- 172.21.15.133:0/2482199361 reap_dead start 2024-03-30T01:53:18.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.317+0000 7f6d8f800640 1 -- 172.21.15.133:0/2482199361 shutdown_connections 2024-03-30T01:53:18.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.317+0000 7f6d8f800640 1 -- 172.21.15.133:0/2482199361 >> 172.21.15.133:0/2482199361 conn(0x7f6d880b0810 msgr2=0x7f6d880b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:18.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.318+0000 7f6d8f800640 1 -- 172.21.15.133:0/2482199361 shutdown_connections 2024-03-30T01:53:18.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.318+0000 7f6d8f800640 1 -- 172.21.15.133:0/2482199361 wait complete. 2024-03-30T01:53:18.341 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-30T01:53:18.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.543+0000 7fabef800640 1 Processor -- start 2024-03-30T01:53:18.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.544+0000 7fabef800640 1 -- start start 2024-03-30T01:53:18.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.545+0000 7fabef800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fabe80cdc50 0x7fabe80d1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:18.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.545+0000 7fabef800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fabe80b5ac0 0x7fabe80b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:18.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.545+0000 7fabef800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe80d1c90 con 0x7fabe815cbd0 2024-03-30T01:53:18.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.545+0000 7fabef800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe815cfb0 con 0x7fabe80b5ac0 2024-03-30T01:53:18.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.545+0000 7fabef800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80d1ef0 con 0x7fabe80cdc50 2024-03-30T01:53:18.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.545+0000 7fabece00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fabe815cbd0 0x7fabe80d2f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49486/0 (socket says 172.21.15.133:49486) 2024-03-30T01:53:18.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.545+0000 7fabece00640 1 -- 172.21.15.133:0/1816312270 learned_addr learned my addr 172.21.15.133:0/1816312270 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:18.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.546+0000 7fabe7400640 1 -- 172.21.15.133:0/1816312270 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2908738341 0 0) 0x7fabe80d1c90 con 0x7fabe815cbd0 2024-03-30T01:53:18.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.546+0000 7fabe7400640 1 -- 172.21.15.133:0/1816312270 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabc8003520 con 0x7fabe815cbd0 2024-03-30T01:53:18.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.546+0000 7fabed800640 1 --2- 172.21.15.133:0/1816312270 >> v2:172.21.15.137:3300/0 conn(0x7fabe80b5ac0 0x7fabe80b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:18.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.546+0000 7fabe7e00640 1 --2- 172.21.15.133:0/1816312270 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fabe80cdc50 0x7fabe80d1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:18.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.546+0000 7fabe7400640 1 -- 172.21.15.133:0/1816312270 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2610069766 0 0) 0x7fabc8003520 con 0x7fabe815cbd0 2024-03-30T01:53:18.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.546+0000 7fabe7400640 1 -- 172.21.15.133:0/1816312270 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fabe80cdc50 msgr2=0x7fabe80d1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:18.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.546+0000 7fabe7400640 1 --2- 172.21.15.133:0/1816312270 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fabe80cdc50 0x7fabe80d1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:18.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.546+0000 7fabe7400640 1 -- 172.21.15.133:0/1816312270 >> v2:172.21.15.137:3300/0 conn(0x7fabe80b5ac0 msgr2=0x7fabe80b5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:18.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.546+0000 7fabe7400640 1 --2- 172.21.15.133:0/1816312270 >> v2:172.21.15.137:3300/0 conn(0x7fabe80b5ac0 0x7fabe80b5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:18.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.546+0000 7fabe7400640 1 -- 172.21.15.133:0/1816312270 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe80d21d0 con 0x7fabe815cbd0 2024-03-30T01:53:18.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.546+0000 7fabe7400640 1 -- 172.21.15.133:0/1816312270 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fabd8001670 con 0x7fabe815cbd0 2024-03-30T01:53:18.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.546+0000 7fabe7400640 1 -- 172.21.15.133:0/1816312270 >> v1:172.21.15.133:6789/0 conn(0x7fabe815cbd0 legacy=0x7fabe80d2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:18.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.546+0000 7fabe7400640 1 --2- 172.21.15.133:0/1816312270 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fabe80cdc50 0x7fabc8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:18.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.546+0000 7fabe7400640 1 --2- 172.21.15.133:0/1816312270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabc8003ff0 0x7fabc80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:18.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.546+0000 7fabe7400640 1 --2- 172.21.15.133:0/1816312270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabc8004d00 0x7fabc8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:18.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.546+0000 7fabe7400640 1 -- 172.21.15.133:0/1816312270 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe815cfb0 con 0x7fabc8003ff0 2024-03-30T01:53:18.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.546+0000 7fabe7400640 1 -- 172.21.15.133:0/1816312270 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80d1ef0 con 0x7fabc8004d00 2024-03-30T01:53:18.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.546+0000 7fabe7400640 1 -- 172.21.15.133:0/1816312270 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc800bb70 con 0x7fabe80cdc50 2024-03-30T01:53:18.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.546+0000 7fabed800640 1 --2- 172.21.15.133:0/1816312270 >> v2:172.21.15.137:3300/0 conn(0x7fabe80b5ac0 0x7fabe80b5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T01:53:18.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.546+0000 7fabe7e00640 1 --2- 172.21.15.133:0/1816312270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabc8003ff0 0x7fabc80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:18.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.547+0000 7fabe7e00640 1 -- 172.21.15.133:0/1816312270 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fabe80cdc50 msgr2=0x7fabc8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:18.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.547+0000 7fabece00640 1 --2- 172.21.15.133:0/1816312270 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fabe80cdc50 0x7fabc8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:18.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.547+0000 7fabe7e00640 1 --2- 172.21.15.133:0/1816312270 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fabe80cdc50 0x7fabc8003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:18.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.547+0000 7fabe7e00640 1 -- 172.21.15.133:0/1816312270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabc8004d00 msgr2=0x7fabc8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:18.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.547+0000 7fabe7e00640 1 --2- 172.21.15.133:0/1816312270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabc8004d00 0x7fabc8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:18.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.547+0000 7fabe7e00640 1 -- 172.21.15.133:0/1816312270 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc8003520 con 0x7fabc8003ff0 2024-03-30T01:53:18.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.548+0000 7fabe7e00640 1 --2- 172.21.15.133:0/1816312270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabc8003ff0 0x7fabc80047c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fabd0007360 tx=0x7fabc80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24bcf099cdbcc1da server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:18.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.548+0000 7fabe7400640 1 -- 172.21.15.133:0/1816312270 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd002ccd0 con 0x7fabc8003ff0 2024-03-30T01:53:18.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.548+0000 7fabe7400640 1 -- 172.21.15.133:0/1816312270 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd002ce30 con 0x7fabc8003ff0 2024-03-30T01:53:18.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.548+0000 7fabe7400640 1 -- 172.21.15.133:0/1816312270 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0034660 con 0x7fabc8003ff0 2024-03-30T01:53:18.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.549+0000 7fabef800640 1 -- 172.21.15.133:0/1816312270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabc8003ff0 msgr2=0x7fabc80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:18.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.549+0000 7fabef800640 1 --2- 172.21.15.133:0/1816312270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabc8003ff0 0x7fabc80047c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fabd0007360 tx=0x7fabc80057f0 comp rx=0 tx=0).stop 2024-03-30T01:53:18.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.549+0000 7fabed800640 1 -- 172.21.15.133:0/1816312270 reap_dead start 2024-03-30T01:53:18.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.549+0000 7fabef800640 1 -- 172.21.15.133:0/1816312270 shutdown_connections 2024-03-30T01:53:18.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.549+0000 7fabef800640 1 -- 172.21.15.133:0/1816312270 >> 172.21.15.133:0/1816312270 conn(0x7fabe8071830 msgr2=0x7fabe8071c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:18.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.549+0000 7fabef800640 1 -- 172.21.15.133:0/1816312270 shutdown_connections 2024-03-30T01:53:18.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.549+0000 7fabef800640 1 -- 172.21.15.133:0/1816312270 wait complete. 2024-03-30T01:53:18.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.551+0000 7fabef800640 1 Processor -- start 2024-03-30T01:53:18.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.551+0000 7fabef800640 1 -- start start 2024-03-30T01:53:18.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.552+0000 7fabef800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fabc8003ff0 0x7fabe80ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:18.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.552+0000 7fabef800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabe8150630 0x7fabe80d03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:18.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.552+0000 7fabef800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabe80d0930 0x7fabe81f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:18.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.552+0000 7fabef800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80d0db0 con 0x7fabe80d0930 2024-03-30T01:53:18.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.552+0000 7fabef800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80cb8f0 con 0x7fabe8150630 2024-03-30T01:53:18.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.552+0000 7fabef800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe81f3670 con 0x7fabc8003ff0 2024-03-30T01:53:18.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.552+0000 7fabed800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabe80d0930 0x7fabe81f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:18.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.552+0000 7fabed800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabe80d0930 0x7fabe81f26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35950/0 (socket says 172.21.15.133:35950) 2024-03-30T01:53:18.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.552+0000 7fabed800640 1 -- 172.21.15.133:0/1225828484 learned_addr learned my addr 172.21.15.133:0/1225828484 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:18.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.552+0000 7fabece00640 1 --2- 172.21.15.133:0/1225828484 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fabc8003ff0 0x7fabe80ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:18.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.552+0000 7fabe7e00640 1 --2- 172.21.15.133:0/1225828484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabe8150630 0x7fabe80d03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:18.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.552+0000 7fabed800640 1 -- 172.21.15.133:0/1225828484 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fabc8003ff0 msgr2=0x7fabe80ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:18.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.553+0000 7fabed800640 1 --2- 172.21.15.133:0/1225828484 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fabc8003ff0 0x7fabe80ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:18.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.553+0000 7fabed800640 1 -- 172.21.15.133:0/1225828484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabe8150630 msgr2=0x7fabe80d03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:18.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.553+0000 7fabed800640 1 --2- 172.21.15.133:0/1225828484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabe8150630 0x7fabe80d03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:18.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.553+0000 7fabed800640 1 -- 172.21.15.133:0/1225828484 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe81f3390 con 0x7fabe80d0930 2024-03-30T01:53:18.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.553+0000 7fabe7e00640 1 --2- 172.21.15.133:0/1225828484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabe8150630 0x7fabe80d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:18.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.553+0000 7fabed800640 1 --2- 172.21.15.133:0/1225828484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabe80d0930 0x7fabe81f26d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fabe0006fd0 tx=0x7fabe000e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:18.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.553+0000 7fabe4c00640 1 -- 172.21.15.133:0/1225828484 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe000c070 con 0x7fabe80d0930 2024-03-30T01:53:18.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.553+0000 7fabe4c00640 1 -- 172.21.15.133:0/1225828484 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe0004230 con 0x7fabe80d0930 2024-03-30T01:53:18.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.553+0000 7fabef800640 1 -- 172.21.15.133:0/1225828484 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe80c9c50 con 0x7fabe80d0930 2024-03-30T01:53:18.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.553+0000 7fabe4c00640 1 -- 172.21.15.133:0/1225828484 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe0003610 con 0x7fabe80d0930 2024-03-30T01:53:18.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.553+0000 7fabef800640 1 -- 172.21.15.133:0/1225828484 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe80ca210 con 0x7fabe80d0930 2024-03-30T01:53:18.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.554+0000 7fabef800640 1 -- 172.21.15.133:0/1225828484 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe80c6340 con 0x7fabe80d0930 2024-03-30T01:53:18.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.555+0000 7fabe4c00640 1 -- 172.21.15.133:0/1225828484 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fabe0003770 con 0x7fabe80d0930 2024-03-30T01:53:18.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.556+0000 7fabe4c00640 1 --2- 172.21.15.133:0/1225828484 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fabc406ac00 0x7fabc406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:18.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.556+0000 7fabe4c00640 1 -- 172.21.15.133:0/1225828484 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fabe0088730 con 0x7fabe80d0930 2024-03-30T01:53:18.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.556+0000 7fabece00640 1 --2- 172.21.15.133:0/1225828484 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fabc406ac00 0x7fabc406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:18.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.557+0000 7fabece00640 1 --2- 172.21.15.133:0/1225828484 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fabc406ac00 0x7fabc406d0c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fabe80ccb20 tx=0x7fabd8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:18.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.561+0000 7fabe4c00640 1 -- 172.21.15.133:0/1225828484 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fabe0053ba0 con 0x7fabe80d0930 2024-03-30T01:53:18.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.754+0000 7fabef800640 1 -- 172.21.15.133:0/1225828484 --> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fabe80d2a70 con 0x7fabc406ac00 2024-03-30T01:53:18.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.755+0000 7fabe4c00640 1 -- 172.21.15.133:0/1225828484 <== mgr.4105 v2:172.21.15.133:6832/37234 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fabd800d040 con 0x7fabc406ac00 2024-03-30T01:53:18.761 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 0 to deep-scrub 2024-03-30T01:53:18.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.758+0000 7fabef800640 1 -- 172.21.15.133:0/1225828484 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fabc406ac00 msgr2=0x7fabc406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:18.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.758+0000 7fabef800640 1 --2- 172.21.15.133:0/1225828484 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fabc406ac00 0x7fabc406d0c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fabe80ccb20 tx=0x7fabd8009040 comp rx=0 tx=0).stop 2024-03-30T01:53:18.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.758+0000 7fabef800640 1 -- 172.21.15.133:0/1225828484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabe80d0930 msgr2=0x7fabe81f26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:18.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.758+0000 7fabef800640 1 --2- 172.21.15.133:0/1225828484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabe80d0930 0x7fabe81f26d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fabe0006fd0 tx=0x7fabe000e8a0 comp rx=0 tx=0).stop 2024-03-30T01:53:18.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.758+0000 7fabef800640 1 -- 172.21.15.133:0/1225828484 shutdown_connections 2024-03-30T01:53:18.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.758+0000 7fabef800640 1 --2- 172.21.15.133:0/1225828484 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fabc406ac00 0x7fabc406d0c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:18.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.758+0000 7fabef800640 1 --2- 172.21.15.133:0/1225828484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabe80d0930 0x7fabe81f26d0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:18.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.758+0000 7fabef800640 1 --2- 172.21.15.133:0/1225828484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabe8150630 0x7fabe80d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:18.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.758+0000 7fabef800640 1 --2- 172.21.15.133:0/1225828484 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fabc8003ff0 0x7fabe80ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:18.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.758+0000 7fabef800640 1 -- 172.21.15.133:0/1225828484 >> 172.21.15.133:0/1225828484 conn(0x7fabe8071830 msgr2=0x7fabe80b8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:18.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.758+0000 7fabef800640 1 -- 172.21.15.133:0/1225828484 shutdown_connections 2024-03-30T01:53:18.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.758+0000 7fabef800640 1 -- 172.21.15.133:0/1225828484 wait complete. 2024-03-30T01:53:18.783 INFO:tasks.ceph:Scrubbing osd.1 2024-03-30T01:53:18.783 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-30T01:53:18.790 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T01:53:18.833 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T01:53:18.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.987+0000 7fa1fb000640 1 Processor -- start 2024-03-30T01:53:18.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.988+0000 7fa1fb000640 1 -- start start 2024-03-30T01:53:18.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.989+0000 7fa1fb000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa1f40b86a0 0x7fa1f40b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:18.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.989+0000 7fa1fb000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa1f40b44e0 0x7fa1f40b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:18.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.989+0000 7fa1fb000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f40b4e50 con 0x7fa1f40cfff0 2024-03-30T01:53:18.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.989+0000 7fa1fb000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f40cda30 con 0x7fa1f40b86a0 2024-03-30T01:53:18.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.989+0000 7fa1fb000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f40d04a0 con 0x7fa1f40b44e0 2024-03-30T01:53:18.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.990+0000 7fa1f3e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa1f40b86a0 0x7fa1f40b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:18.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.990+0000 7fa1f3e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa1f40b86a0 0x7fa1f40b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35952/0 (socket says 172.21.15.133:35952) 2024-03-30T01:53:18.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.990+0000 7fa1f3e00640 1 -- 172.21.15.133:0/1876244732 learned_addr learned my addr 172.21.15.133:0/1876244732 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:18.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.990+0000 7fa1f9000640 1 --2- 172.21.15.133:0/1876244732 >> v2:172.21.15.137:3300/0 conn(0x7fa1f40b44e0 0x7fa1f40b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:18.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.990+0000 7fa1f3e00640 1 -- 172.21.15.133:0/1876244732 >> v2:172.21.15.137:3300/0 conn(0x7fa1f40b44e0 msgr2=0x7fa1f40b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:18.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.990+0000 7fa1f3e00640 1 --2- 172.21.15.133:0/1876244732 >> v2:172.21.15.137:3300/0 conn(0x7fa1f40b44e0 0x7fa1f40b4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:18.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.990+0000 7fa1f3e00640 1 -- 172.21.15.133:0/1876244732 >> v1:172.21.15.137:6789/0 conn(0x7fa1f40cfff0 legacy=0x7fa1f40d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:18.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.990+0000 7fa1f3e00640 1 -- 172.21.15.133:0/1876244732 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f40cdc40 con 0x7fa1f40b86a0 2024-03-30T01:53:18.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.991+0000 7fa1f3e00640 1 --2- 172.21.15.133:0/1876244732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1f40b86a0 0x7fa1f40b1870 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40b59d0 tx=0x7fa1e402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da33d6e59a00ff7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:18.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.991+0000 7fa1f3400640 1 -- 172.21.15.133:0/1876244732 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4031870 con 0x7fa1f40b86a0 2024-03-30T01:53:18.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.991+0000 7fa1f3400640 1 -- 172.21.15.133:0/1876244732 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e40319d0 con 0x7fa1f40b86a0 2024-03-30T01:53:18.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.991+0000 7fa1f3400640 1 -- 172.21.15.133:0/1876244732 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4031d60 con 0x7fa1f40b86a0 2024-03-30T01:53:18.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.992+0000 7fa1fb000640 1 -- 172.21.15.133:0/1876244732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1f40b86a0 msgr2=0x7fa1f40b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:18.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.992+0000 7fa1fb000640 1 --2- 172.21.15.133:0/1876244732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1f40b86a0 0x7fa1f40b1870 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40b59d0 tx=0x7fa1e402b910 comp rx=0 tx=0).stop 2024-03-30T01:53:18.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.992+0000 7fa1fb000640 1 -- 172.21.15.133:0/1876244732 shutdown_connections 2024-03-30T01:53:18.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.992+0000 7fa1fb000640 1 --2- 172.21.15.133:0/1876244732 >> v2:172.21.15.137:3300/0 conn(0x7fa1f40b44e0 0x7fa1f40b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:18.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.992+0000 7fa1fb000640 1 --2- 172.21.15.133:0/1876244732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1f40b86a0 0x7fa1f40b1870 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:18.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.992+0000 7fa1fb000640 1 -- 172.21.15.133:0/1876244732 >> 172.21.15.133:0/1876244732 conn(0x7fa1f406b870 msgr2=0x7fa1f406bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:18.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.992+0000 7fa1fb000640 1 -- 172.21.15.133:0/1876244732 shutdown_connections 2024-03-30T01:53:18.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.992+0000 7fa1fb000640 1 -- 172.21.15.133:0/1876244732 wait complete. 2024-03-30T01:53:19.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.994+0000 7fa1fb000640 1 Processor -- start 2024-03-30T01:53:19.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.994+0000 7fa1fb000640 1 -- start start 2024-03-30T01:53:19.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.995+0000 7fa1fb000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1f40b44e0 0x7fa1f40aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.995+0000 7fa1fb000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1f40b86a0 0x7fa1f40a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.995+0000 7fa1fb000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1f40cfff0 0x7fa1f4159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.995+0000 7fa1fb000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f41f52c0 con 0x7fa1f40b86a0 2024-03-30T01:53:19.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.995+0000 7fa1fb000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f41f4680 con 0x7fa1f40cfff0 2024-03-30T01:53:19.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.995+0000 7fa1fb000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f41f4920 con 0x7fa1f40b44e0 2024-03-30T01:53:19.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.995+0000 7fa1ebe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1f40b86a0 0x7fa1f40a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.996+0000 7fa1ebe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1f40b86a0 0x7fa1f40a94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35954/0 (socket says 172.21.15.133:35954) 2024-03-30T01:53:19.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.996+0000 7fa1ebe00640 1 -- 172.21.15.133:0/2678560972 learned_addr learned my addr 172.21.15.133:0/2678560972 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:19.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.996+0000 7fa1f9000640 1 --2- 172.21.15.133:0/2678560972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1f40cfff0 0x7fa1f4159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.996+0000 7fa1f3e00640 1 --2- 172.21.15.133:0/2678560972 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1f40b44e0 0x7fa1f40aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.996+0000 7fa1ebe00640 1 -- 172.21.15.133:0/2678560972 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1f40b44e0 msgr2=0x7fa1f40aa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:19.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.996+0000 7fa1ebe00640 1 --2- 172.21.15.133:0/2678560972 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1f40b44e0 0x7fa1f40aa0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.996+0000 7fa1ebe00640 1 -- 172.21.15.133:0/2678560972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1f40cfff0 msgr2=0x7fa1f4159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:19.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.996+0000 7fa1ebe00640 1 --2- 172.21.15.133:0/2678560972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1f40cfff0 0x7fa1f4159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.996+0000 7fa1ebe00640 1 -- 172.21.15.133:0/2678560972 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e40094d0 con 0x7fa1f40b86a0 2024-03-30T01:53:19.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.996+0000 7fa1f9000640 1 --2- 172.21.15.133:0/2678560972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1f40cfff0 0x7fa1f4159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:19.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.996+0000 7fa1f3e00640 1 --2- 172.21.15.133:0/2678560972 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1f40b44e0 0x7fa1f40aa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:19.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.996+0000 7fa1ebe00640 1 --2- 172.21.15.133:0/2678560972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1f40b86a0 0x7fa1f40a94c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00b3e0 tx=0x7fa1dc00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:19.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.997+0000 7fa1f0c00640 1 -- 172.21.15.133:0/2678560972 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc011830 con 0x7fa1f40b86a0 2024-03-30T01:53:19.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.997+0000 7fa1f0c00640 1 -- 172.21.15.133:0/2678560972 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1dc0119b0 con 0x7fa1f40b86a0 2024-03-30T01:53:19.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.997+0000 7fa1f0c00640 1 -- 172.21.15.133:0/2678560972 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc011d60 con 0x7fa1f40b86a0 2024-03-30T01:53:19.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.997+0000 7fa1fb000640 1 -- 172.21.15.133:0/2678560972 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f41f4c00 con 0x7fa1f40b86a0 2024-03-30T01:53:19.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.997+0000 7fa1fb000640 1 -- 172.21.15.133:0/2678560972 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f40a9a00 con 0x7fa1f40b86a0 2024-03-30T01:53:19.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.998+0000 7fa1fb000640 1 -- 172.21.15.133:0/2678560972 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa1f40ce200 con 0x7fa1f40b86a0 2024-03-30T01:53:19.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:18.999+0000 7fa1f0c00640 1 -- 172.21.15.133:0/2678560972 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fa1dc01a400 con 0x7fa1f40b86a0 2024-03-30T01:53:19.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.000+0000 7fa1f0c00640 1 --2- 172.21.15.133:0/2678560972 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa1d006ac00 0x7fa1d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.000+0000 7fa1f0c00640 1 -- 172.21.15.133:0/2678560972 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa1dc089200 con 0x7fa1f40b86a0 2024-03-30T01:53:19.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.000+0000 7fa1f3e00640 1 --2- 172.21.15.133:0/2678560972 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa1d006ac00 0x7fa1d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.000+0000 7fa1f0c00640 1 --2- 172.21.15.133:0/2678560972 >> [v2:172.21.15.133:6817/37491,v1:172.21.15.133:6819/37491] conn(0x7fa1d0070b00 0x7fa1d0072f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.000+0000 7fa1f0c00640 1 -- 172.21.15.133:0/2678560972 --> [v2:172.21.15.133:6817/37491,v1:172.21.15.133:6819/37491] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa1d00735d0 con 0x7fa1d0070b00 2024-03-30T01:53:19.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.000+0000 7fa1f0c00640 1 -- 172.21.15.133:0/2678560972 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1dc08b7e0 con 0x7fa1f40b86a0 2024-03-30T01:53:19.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.000+0000 7fa1f9000640 1 --2- 172.21.15.133:0/2678560972 >> [v2:172.21.15.133:6817/37491,v1:172.21.15.133:6819/37491] conn(0x7fa1d0070b00 0x7fa1d0072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.001+0000 7fa1f3e00640 1 --2- 172.21.15.133:0/2678560972 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa1d006ac00 0x7fa1d006d0c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4036000 tx=0x7fa1e403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:19.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.001+0000 7fa1f9000640 1 --2- 172.21.15.133:0/2678560972 >> [v2:172.21.15.133:6817/37491,v1:172.21.15.133:6819/37491] conn(0x7fa1d0070b00 0x7fa1d0072f20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:19.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.002+0000 7fa1f0c00640 1 -- 172.21.15.133:0/2678560972 <== osd.1 v2:172.21.15.133:6817/37491 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fa1d00735d0 con 0x7fa1d0070b00 2024-03-30T01:53:19.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.015+0000 7fa1fb000640 1 -- 172.21.15.133:0/2678560972 --> [v2:172.21.15.133:6817/37491,v1:172.21.15.133:6819/37491] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa1f40b8a80 con 0x7fa1d0070b00 2024-03-30T01:53:19.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.016+0000 7fa1f0c00640 1 -- 172.21.15.133:0/2678560972 <== osd.1 v2:172.21.15.133:6817/37491 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa1ec00e3f0 con 0x7fa1d0070b00 2024-03-30T01:53:19.022 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-03-30T01:53:19.022 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T01:53:19.022 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-03-30T01:53:19.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.016+0000 7fa1fb000640 1 -- 172.21.15.133:0/2678560972 >> [v2:172.21.15.133:6817/37491,v1:172.21.15.133:6819/37491] conn(0x7fa1d0070b00 msgr2=0x7fa1d0072f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:19.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.016+0000 7fa1fb000640 1 --2- 172.21.15.133:0/2678560972 >> [v2:172.21.15.133:6817/37491,v1:172.21.15.133:6819/37491] conn(0x7fa1d0070b00 0x7fa1d0072f20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.017+0000 7fa1fb000640 1 -- 172.21.15.133:0/2678560972 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa1d006ac00 msgr2=0x7fa1d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:19.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.017+0000 7fa1fb000640 1 --2- 172.21.15.133:0/2678560972 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fa1d006ac00 0x7fa1d006d0c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4036000 tx=0x7fa1e403c040 comp rx=0 tx=0).stop 2024-03-30T01:53:19.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.017+0000 7fa1fb000640 1 -- 172.21.15.133:0/2678560972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1f40b86a0 msgr2=0x7fa1f40a94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:19.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.017+0000 7fa1fb000640 1 --2- 172.21.15.133:0/2678560972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1f40b86a0 0x7fa1f40a94c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00b3e0 tx=0x7fa1dc00b8a0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.017+0000 7fa1f9000640 1 -- 172.21.15.133:0/2678560972 reap_dead start 2024-03-30T01:53:19.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.017+0000 7fa1fb000640 1 -- 172.21.15.133:0/2678560972 shutdown_connections 2024-03-30T01:53:19.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.017+0000 7fa1fb000640 1 -- 172.21.15.133:0/2678560972 >> 172.21.15.133:0/2678560972 conn(0x7fa1f406b870 msgr2=0x7fa1f40b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:19.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.017+0000 7fa1fb000640 1 -- 172.21.15.133:0/2678560972 shutdown_connections 2024-03-30T01:53:19.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.017+0000 7fa1fb000640 1 -- 172.21.15.133:0/2678560972 wait complete. 2024-03-30T01:53:19.039 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-30T01:53:19.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.228+0000 7efd95e00640 1 Processor -- start 2024-03-30T01:53:19.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.228+0000 7efd95e00640 1 -- start start 2024-03-30T01:53:19.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.230+0000 7efd95e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd90143220 0x7efd900cd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.230+0000 7efd95e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efd90070c10 0x7efd9015d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.230+0000 7efd95e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd900ce400 con 0x7efd9006e2e0 2024-03-30T01:53:19.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.230+0000 7efd95e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd900cc5c0 con 0x7efd90070c10 2024-03-30T01:53:19.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.230+0000 7efd95e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9006d0e0 con 0x7efd90143220 2024-03-30T01:53:19.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.230+0000 7efd8f400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efd90070c10 0x7efd9015d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.230+0000 7efd8f400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efd90070c10 0x7efd9015d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35966/0 (socket says 172.21.15.133:35966) 2024-03-30T01:53:19.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.230+0000 7efd8f400640 1 -- 172.21.15.133:0/1908829943 learned_addr learned my addr 172.21.15.133:0/1908829943 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:19.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.230+0000 7efd8ea00640 1 --2- 172.21.15.133:0/1908829943 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd90143220 0x7efd900cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.230+0000 7efd8f400640 1 -- 172.21.15.133:0/1908829943 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd90143220 msgr2=0x7efd900cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:19.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.230+0000 7efd8f400640 1 --2- 172.21.15.133:0/1908829943 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd90143220 0x7efd900cd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.230+0000 7efd8f400640 1 -- 172.21.15.133:0/1908829943 >> v1:172.21.15.137:6789/0 conn(0x7efd9006e2e0 legacy=0x7efd90070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:19.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.230+0000 7efd8f400640 1 -- 172.21.15.133:0/1908829943 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9006d3c0 con 0x7efd90070c10 2024-03-30T01:53:19.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.231+0000 7efd8f400640 1 --2- 172.21.15.133:0/1908829943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd90070c10 0x7efd9015d3b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7efd88009e50 tx=0x7efd8802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6043be9e7e215d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:19.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.232+0000 7efd8d600640 1 -- 172.21.15.133:0/1908829943 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8802ca70 con 0x7efd90070c10 2024-03-30T01:53:19.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.232+0000 7efd8d600640 1 -- 172.21.15.133:0/1908829943 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8802cbd0 con 0x7efd90070c10 2024-03-30T01:53:19.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.232+0000 7efd8d600640 1 -- 172.21.15.133:0/1908829943 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd880343f0 con 0x7efd90070c10 2024-03-30T01:53:19.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.232+0000 7efd95e00640 1 -- 172.21.15.133:0/1908829943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd90070c10 msgr2=0x7efd9015d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:19.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.232+0000 7efd95e00640 1 --2- 172.21.15.133:0/1908829943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd90070c10 0x7efd9015d3b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7efd88009e50 tx=0x7efd8802bed0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.233+0000 7efd95e00640 1 -- 172.21.15.133:0/1908829943 shutdown_connections 2024-03-30T01:53:19.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.233+0000 7efd95e00640 1 --2- 172.21.15.133:0/1908829943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd90070c10 0x7efd9015d3b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.233+0000 7efd95e00640 1 --2- 172.21.15.133:0/1908829943 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd90143220 0x7efd900cd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.233+0000 7efd95e00640 1 -- 172.21.15.133:0/1908829943 >> 172.21.15.133:0/1908829943 conn(0x7efd900b07a0 msgr2=0x7efd900b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:19.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.233+0000 7efd95e00640 1 -- 172.21.15.133:0/1908829943 shutdown_connections 2024-03-30T01:53:19.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.233+0000 7efd95e00640 1 -- 172.21.15.133:0/1908829943 wait complete. 2024-03-30T01:53:19.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.234+0000 7efd95e00640 1 Processor -- start 2024-03-30T01:53:19.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.234+0000 7efd95e00640 1 -- start start 2024-03-30T01:53:19.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.235+0000 7efd95e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9006e2e0 0x7efd90159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.235+0000 7efd95e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd90070c10 0x7efd900b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.235+0000 7efd95e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd90143220 0x7efd900b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.235+0000 7efd95e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd900b29c0 con 0x7efd90070c10 2024-03-30T01:53:19.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.235+0000 7efd95e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd900b1db0 con 0x7efd90143220 2024-03-30T01:53:19.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.235+0000 7efd95e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd900b2090 con 0x7efd9006e2e0 2024-03-30T01:53:19.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.236+0000 7efd8e000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd90070c10 0x7efd900b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.236+0000 7efd8e000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd90070c10 0x7efd900b2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35972/0 (socket says 172.21.15.133:35972) 2024-03-30T01:53:19.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.236+0000 7efd8e000640 1 -- 172.21.15.133:0/3831934114 learned_addr learned my addr 172.21.15.133:0/3831934114 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:19.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.236+0000 7efd8ea00640 1 --2- 172.21.15.133:0/3831934114 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9006e2e0 0x7efd90159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.236+0000 7efd8f400640 1 --2- 172.21.15.133:0/3831934114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd90143220 0x7efd900b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.236+0000 7efd8e000640 1 -- 172.21.15.133:0/3831934114 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9006e2e0 msgr2=0x7efd90159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:19.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.236+0000 7efd8e000640 1 --2- 172.21.15.133:0/3831934114 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9006e2e0 0x7efd90159650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.236+0000 7efd8e000640 1 -- 172.21.15.133:0/3831934114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd90143220 msgr2=0x7efd900b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:19.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.236+0000 7efd8e000640 1 --2- 172.21.15.133:0/3831934114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd90143220 0x7efd900b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.236+0000 7efd8e000640 1 -- 172.21.15.133:0/3831934114 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd88009b30 con 0x7efd90070c10 2024-03-30T01:53:19.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.236+0000 7efd8f400640 1 --2- 172.21.15.133:0/3831934114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd90143220 0x7efd900b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:19.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.236+0000 7efd8e000640 1 --2- 172.21.15.133:0/3831934114 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd90070c10 0x7efd900b2e50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00c400 tx=0x7efd7c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:19.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.237+0000 7efd87400640 1 -- 172.21.15.133:0/3831934114 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c011790 con 0x7efd90070c10 2024-03-30T01:53:19.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.237+0000 7efd87400640 1 -- 172.21.15.133:0/3831934114 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7c011930 con 0x7efd90070c10 2024-03-30T01:53:19.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.237+0000 7efd87400640 1 -- 172.21.15.133:0/3831934114 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c011ce0 con 0x7efd90070c10 2024-03-30T01:53:19.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.237+0000 7efd95e00640 1 -- 172.21.15.133:0/3831934114 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd900b2370 con 0x7efd90070c10 2024-03-30T01:53:19.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.237+0000 7efd95e00640 1 -- 172.21.15.133:0/3831934114 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9015c7a0 con 0x7efd90070c10 2024-03-30T01:53:19.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.238+0000 7efd95e00640 1 -- 172.21.15.133:0/3831934114 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd900b2b70 con 0x7efd90070c10 2024-03-30T01:53:19.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.239+0000 7efd87400640 1 -- 172.21.15.133:0/3831934114 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7efd7c01c460 con 0x7efd90070c10 2024-03-30T01:53:19.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.240+0000 7efd87400640 1 --2- 172.21.15.133:0/3831934114 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efd7006ac30 0x7efd7006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.240+0000 7efd87400640 1 -- 172.21.15.133:0/3831934114 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7efd7c089050 con 0x7efd90070c10 2024-03-30T01:53:19.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.240+0000 7efd8ea00640 1 --2- 172.21.15.133:0/3831934114 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efd7006ac30 0x7efd7006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.241+0000 7efd8ea00640 1 --2- 172.21.15.133:0/3831934114 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efd7006ac30 0x7efd7006d0f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efd80006fd0 tx=0x7efd80008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:19.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.244+0000 7efd87400640 1 -- 172.21.15.133:0/3831934114 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7efd900b2b70 con 0x7efd90070c10 2024-03-30T01:53:19.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.439+0000 7efd95e00640 1 -- 172.21.15.133:0/3831934114 --> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7efd90143600 con 0x7efd7006ac30 2024-03-30T01:53:19.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.440+0000 7efd87400640 1 -- 172.21.15.133:0/3831934114 <== mgr.4105 v2:172.21.15.133:6832/37234 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efd8000e4b0 con 0x7efd7006ac30 2024-03-30T01:53:19.446 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 1 to deep-scrub 2024-03-30T01:53:19.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.442+0000 7efd95e00640 1 -- 172.21.15.133:0/3831934114 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efd7006ac30 msgr2=0x7efd7006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:19.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.442+0000 7efd95e00640 1 --2- 172.21.15.133:0/3831934114 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efd7006ac30 0x7efd7006d0f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efd80006fd0 tx=0x7efd80008040 comp rx=0 tx=0).stop 2024-03-30T01:53:19.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.442+0000 7efd95e00640 1 -- 172.21.15.133:0/3831934114 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd90070c10 msgr2=0x7efd900b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:19.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.442+0000 7efd95e00640 1 --2- 172.21.15.133:0/3831934114 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd90070c10 0x7efd900b2e50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00c400 tx=0x7efd7c00c8c0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.442+0000 7efd95e00640 1 -- 172.21.15.133:0/3831934114 shutdown_connections 2024-03-30T01:53:19.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.442+0000 7efd95e00640 1 --2- 172.21.15.133:0/3831934114 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efd7006ac30 0x7efd7006d0f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.442+0000 7efd95e00640 1 --2- 172.21.15.133:0/3831934114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd90143220 0x7efd900b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.442+0000 7efd95e00640 1 --2- 172.21.15.133:0/3831934114 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd90070c10 0x7efd900b2e50 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.442+0000 7efd95e00640 1 --2- 172.21.15.133:0/3831934114 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9006e2e0 0x7efd90159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.442+0000 7efd95e00640 1 -- 172.21.15.133:0/3831934114 >> 172.21.15.133:0/3831934114 conn(0x7efd900b07a0 msgr2=0x7efd9013daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:19.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.443+0000 7efd95e00640 1 -- 172.21.15.133:0/3831934114 shutdown_connections 2024-03-30T01:53:19.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.443+0000 7efd95e00640 1 -- 172.21.15.133:0/3831934114 wait complete. 2024-03-30T01:53:19.466 INFO:tasks.ceph:Scrubbing osd.2 2024-03-30T01:53:19.466 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-30T01:53:19.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.673+0000 7fc7dca00640 1 Processor -- start 2024-03-30T01:53:19.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.673+0000 7fc7dca00640 1 -- start start 2024-03-30T01:53:19.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.674+0000 7fc7dca00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc7d8143fe0 0x7fc7d806c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.674+0000 7fc7dca00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc7d806c830 0x7fc7d80b0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.674+0000 7fc7dca00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d806cdb0 con 0x7fc7d80b0c60 2024-03-30T01:53:19.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.675+0000 7fc7dca00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d815aef0 con 0x7fc7d8143fe0 2024-03-30T01:53:19.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.675+0000 7fc7dca00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d80b10d0 con 0x7fc7d806c830 2024-03-30T01:53:19.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.675+0000 7fc7d6800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc7d8143fe0 0x7fc7d806c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.675+0000 7fc7d6800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc7d8143fe0 0x7fc7d806c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35984/0 (socket says 172.21.15.133:35984) 2024-03-30T01:53:19.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.675+0000 7fc7d6800640 1 -- 172.21.15.133:0/590052440 learned_addr learned my addr 172.21.15.133:0/590052440 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:19.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.675+0000 7fc7cfe00640 1 --2- 172.21.15.133:0/590052440 >> v2:172.21.15.137:3300/0 conn(0x7fc7d806c830 0x7fc7d80b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.675+0000 7fc7d6800640 1 -- 172.21.15.133:0/590052440 >> v2:172.21.15.137:3300/0 conn(0x7fc7d806c830 msgr2=0x7fc7d80b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:19.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.675+0000 7fc7d6800640 1 --2- 172.21.15.133:0/590052440 >> v2:172.21.15.137:3300/0 conn(0x7fc7d806c830 0x7fc7d80b0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.675+0000 7fc7d6800640 1 -- 172.21.15.133:0/590052440 >> v1:172.21.15.137:6789/0 conn(0x7fc7d80b0c60 legacy=0x7fc7d815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:19.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.675+0000 7fc7d6800640 1 -- 172.21.15.133:0/590052440 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d806d090 con 0x7fc7d8143fe0 2024-03-30T01:53:19.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.676+0000 7fc7d6800640 1 --2- 172.21.15.133:0/590052440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7d8143fe0 0x7fc7d806c2f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc7d80b1330 tx=0x7fc7c802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c478a06184f39ab4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:19.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.677+0000 7fc7d5e00640 1 -- 172.21.15.133:0/590052440 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8031870 con 0x7fc7d8143fe0 2024-03-30T01:53:19.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.677+0000 7fc7d5e00640 1 -- 172.21.15.133:0/590052440 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c80319d0 con 0x7fc7d8143fe0 2024-03-30T01:53:19.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.677+0000 7fc7d5e00640 1 -- 172.21.15.133:0/590052440 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8031d60 con 0x7fc7d8143fe0 2024-03-30T01:53:19.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.677+0000 7fc7dca00640 1 -- 172.21.15.133:0/590052440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7d8143fe0 msgr2=0x7fc7d806c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:19.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.677+0000 7fc7dca00640 1 --2- 172.21.15.133:0/590052440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7d8143fe0 0x7fc7d806c2f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc7d80b1330 tx=0x7fc7c802b910 comp rx=0 tx=0).stop 2024-03-30T01:53:19.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.677+0000 7fc7dca00640 1 -- 172.21.15.133:0/590052440 shutdown_connections 2024-03-30T01:53:19.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.677+0000 7fc7dca00640 1 --2- 172.21.15.133:0/590052440 >> v2:172.21.15.137:3300/0 conn(0x7fc7d806c830 0x7fc7d80b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.677+0000 7fc7dca00640 1 --2- 172.21.15.133:0/590052440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7d8143fe0 0x7fc7d806c2f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.677+0000 7fc7dca00640 1 -- 172.21.15.133:0/590052440 >> 172.21.15.133:0/590052440 conn(0x7fc7d8066100 msgr2=0x7fc7d8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:19.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.678+0000 7fc7dca00640 1 -- 172.21.15.133:0/590052440 shutdown_connections 2024-03-30T01:53:19.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.678+0000 7fc7dca00640 1 -- 172.21.15.133:0/590052440 wait complete. 2024-03-30T01:53:19.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.679+0000 7fc7dca00640 1 Processor -- start 2024-03-30T01:53:19.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.679+0000 7fc7dca00640 1 -- start start 2024-03-30T01:53:19.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.680+0000 7fc7dca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7d806c830 0x7fc7d8143040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.680+0000 7fc7dca00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7d80b0c60 0x7fc7d80ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.680+0000 7fc7dca00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7d8143fe0 0x7fc7d81e1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.680+0000 7fc7dca00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d80a9c90 con 0x7fc7d8143fe0 2024-03-30T01:53:19.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.680+0000 7fc7dca00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d81f2840 con 0x7fc7d806c830 2024-03-30T01:53:19.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.680+0000 7fc7dca00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d81f2b20 con 0x7fc7d80b0c60 2024-03-30T01:53:19.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.681+0000 7fc7d7200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7d8143fe0 0x7fc7d81e1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.681+0000 7fc7d7200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7d8143fe0 0x7fc7d81e1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35994/0 (socket says 172.21.15.133:35994) 2024-03-30T01:53:19.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.681+0000 7fc7d7200640 1 -- 172.21.15.133:0/3182811908 learned_addr learned my addr 172.21.15.133:0/3182811908 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:19.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.681+0000 7fc7cfe00640 1 --2- 172.21.15.133:0/3182811908 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7d80b0c60 0x7fc7d80ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.681+0000 7fc7d6800640 1 --2- 172.21.15.133:0/3182811908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7d806c830 0x7fc7d8143040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.681+0000 7fc7d7200640 1 -- 172.21.15.133:0/3182811908 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7d80b0c60 msgr2=0x7fc7d80ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:19.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.681+0000 7fc7d7200640 1 --2- 172.21.15.133:0/3182811908 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7d80b0c60 0x7fc7d80ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.681+0000 7fc7d7200640 1 -- 172.21.15.133:0/3182811908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7d806c830 msgr2=0x7fc7d8143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:19.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.681+0000 7fc7d7200640 1 --2- 172.21.15.133:0/3182811908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7d806c830 0x7fc7d8143040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.681+0000 7fc7d7200640 1 -- 172.21.15.133:0/3182811908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c80094d0 con 0x7fc7d8143fe0 2024-03-30T01:53:19.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.682+0000 7fc7d7200640 1 --2- 172.21.15.133:0/3182811908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7d8143fe0 0x7fc7d81e1360 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000c780 tx=0x7fc7d000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:19.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.682+0000 7fc7cea00640 1 -- 172.21.15.133:0/3182811908 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0003d80 con 0x7fc7d8143fe0 2024-03-30T01:53:19.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.682+0000 7fc7cea00640 1 -- 172.21.15.133:0/3182811908 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d000ce90 con 0x7fc7d8143fe0 2024-03-30T01:53:19.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.682+0000 7fc7dca00640 1 -- 172.21.15.133:0/3182811908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d81f2e00 con 0x7fc7d8143fe0 2024-03-30T01:53:19.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.682+0000 7fc7cea00640 1 -- 172.21.15.133:0/3182811908 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d00052b0 con 0x7fc7d8143fe0 2024-03-30T01:53:19.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.682+0000 7fc7dca00640 1 -- 172.21.15.133:0/3182811908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d8143580 con 0x7fc7d8143fe0 2024-03-30T01:53:19.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.683+0000 7fc7dca00640 1 -- 172.21.15.133:0/3182811908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc7d80cc670 con 0x7fc7d8143fe0 2024-03-30T01:53:19.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.684+0000 7fc7cea00640 1 -- 172.21.15.133:0/3182811908 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fc7d0005410 con 0x7fc7d8143fe0 2024-03-30T01:53:19.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.685+0000 7fc7cea00640 1 --2- 172.21.15.133:0/3182811908 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc7b406ac00 0x7fc7b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.685+0000 7fc7cea00640 1 -- 172.21.15.133:0/3182811908 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc7d00885d0 con 0x7fc7d8143fe0 2024-03-30T01:53:19.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.685+0000 7fc7cea00640 1 --2- 172.21.15.133:0/3182811908 >> [v2:172.21.15.133:6808/37488,v1:172.21.15.133:6809/37488] conn(0x7fc7b4070b00 0x7fc7b4072f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.685+0000 7fc7d6800640 1 --2- 172.21.15.133:0/3182811908 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc7b406ac00 0x7fc7b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.685+0000 7fc7cea00640 1 -- 172.21.15.133:0/3182811908 --> [v2:172.21.15.133:6808/37488,v1:172.21.15.133:6809/37488] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc7b40735d0 con 0x7fc7b4070b00 2024-03-30T01:53:19.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.685+0000 7fc7cea00640 1 -- 172.21.15.133:0/3182811908 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7d008abb0 con 0x7fc7d8143fe0 2024-03-30T01:53:19.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.686+0000 7fc7cfe00640 1 --2- 172.21.15.133:0/3182811908 >> [v2:172.21.15.133:6808/37488,v1:172.21.15.133:6809/37488] conn(0x7fc7b4070b00 0x7fc7b4072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.686+0000 7fc7d6800640 1 --2- 172.21.15.133:0/3182811908 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc7b406ac00 0x7fc7b406d0c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8036000 tx=0x7fc7c803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:19.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.686+0000 7fc7cfe00640 1 --2- 172.21.15.133:0/3182811908 >> [v2:172.21.15.133:6808/37488,v1:172.21.15.133:6809/37488] conn(0x7fc7b4070b00 0x7fc7b4072f20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:19.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.687+0000 7fc7cea00640 1 -- 172.21.15.133:0/3182811908 <== osd.2 v2:172.21.15.133:6808/37488 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fc7b40735d0 con 0x7fc7b4070b00 2024-03-30T01:53:19.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.701+0000 7fc7dca00640 1 -- 172.21.15.133:0/3182811908 --> [v2:172.21.15.133:6808/37488,v1:172.21.15.133:6809/37488] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc7d806d650 con 0x7fc7b4070b00 2024-03-30T01:53:19.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.701+0000 7fc7cea00640 1 -- 172.21.15.133:0/3182811908 <== osd.2 v2:172.21.15.133:6808/37488 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc7c000c040 con 0x7fc7b4070b00 2024-03-30T01:53:19.707 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-03-30T01:53:19.707 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T01:53:19.707 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-03-30T01:53:19.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.702+0000 7fc7dca00640 1 -- 172.21.15.133:0/3182811908 >> [v2:172.21.15.133:6808/37488,v1:172.21.15.133:6809/37488] conn(0x7fc7b4070b00 msgr2=0x7fc7b4072f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:19.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.702+0000 7fc7dca00640 1 --2- 172.21.15.133:0/3182811908 >> [v2:172.21.15.133:6808/37488,v1:172.21.15.133:6809/37488] conn(0x7fc7b4070b00 0x7fc7b4072f20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.702+0000 7fc7dca00640 1 -- 172.21.15.133:0/3182811908 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc7b406ac00 msgr2=0x7fc7b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:19.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.702+0000 7fc7dca00640 1 --2- 172.21.15.133:0/3182811908 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fc7b406ac00 0x7fc7b406d0c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8036000 tx=0x7fc7c803c040 comp rx=0 tx=0).stop 2024-03-30T01:53:19.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.702+0000 7fc7dca00640 1 -- 172.21.15.133:0/3182811908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7d8143fe0 msgr2=0x7fc7d81e1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:19.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.702+0000 7fc7dca00640 1 --2- 172.21.15.133:0/3182811908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7d8143fe0 0x7fc7d81e1360 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000c780 tx=0x7fc7d000cc40 comp rx=0 tx=0).stop 2024-03-30T01:53:19.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.702+0000 7fc7d7200640 1 -- 172.21.15.133:0/3182811908 reap_dead start 2024-03-30T01:53:19.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.702+0000 7fc7dca00640 1 -- 172.21.15.133:0/3182811908 shutdown_connections 2024-03-30T01:53:19.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.702+0000 7fc7dca00640 1 -- 172.21.15.133:0/3182811908 >> 172.21.15.133:0/3182811908 conn(0x7fc7d8066100 msgr2=0x7fc7d80ad5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:19.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.702+0000 7fc7dca00640 1 -- 172.21.15.133:0/3182811908 shutdown_connections 2024-03-30T01:53:19.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.702+0000 7fc7dca00640 1 -- 172.21.15.133:0/3182811908 wait complete. 2024-03-30T01:53:19.725 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-30T01:53:19.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.923+0000 7f15a7200640 1 Processor -- start 2024-03-30T01:53:19.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.924+0000 7f15a7200640 1 -- start start 2024-03-30T01:53:19.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.925+0000 7f15a7200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15a015cc50 0x7f15a00d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.925+0000 7f15a7200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f15a00cfb80 0x7f15a00b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.925+0000 7f15a7200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a015d030 con 0x7f15a00d2240 2024-03-30T01:53:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.925+0000 7f15a7200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a00d1c50 con 0x7f15a00cfb80 2024-03-30T01:53:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.925+0000 7f15a7200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a00b5af0 con 0x7f15a015cc50 2024-03-30T01:53:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.925+0000 7f15a5200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f15a00cfb80 0x7f15a00b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.925+0000 7f15a5200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f15a00cfb80 0x7f15a00b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36008/0 (socket says 172.21.15.133:36008) 2024-03-30T01:53:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.925+0000 7f15a5200640 1 -- 172.21.15.133:0/2550446961 learned_addr learned my addr 172.21.15.133:0/2550446961 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.926+0000 7f159fe00640 1 --2- 172.21.15.133:0/2550446961 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15a015cc50 0x7f15a00d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.926+0000 7f15a5200640 1 -- 172.21.15.133:0/2550446961 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15a015cc50 msgr2=0x7f15a00d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.926+0000 7f15a5200640 1 --2- 172.21.15.133:0/2550446961 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15a015cc50 0x7f15a00d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.926+0000 7f15a5200640 1 -- 172.21.15.133:0/2550446961 >> v1:172.21.15.137:6789/0 conn(0x7f15a00d2240 legacy=0x7f15a00cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:19.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.926+0000 7f15a5200640 1 -- 172.21.15.133:0/2550446961 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a00d10d0 con 0x7f15a00cfb80 2024-03-30T01:53:19.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.927+0000 7f15a5200640 1 --2- 172.21.15.133:0/2550446961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15a00cfb80 0x7f15a00b14f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1598009870 tx=0x7f159802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1864023a3db2f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:19.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.927+0000 7f159ea00640 1 -- 172.21.15.133:0/2550446961 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598031640 con 0x7f15a00cfb80 2024-03-30T01:53:19.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.927+0000 7f159ea00640 1 -- 172.21.15.133:0/2550446961 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15980317a0 con 0x7f15a00cfb80 2024-03-30T01:53:19.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.927+0000 7f159ea00640 1 -- 172.21.15.133:0/2550446961 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598031b30 con 0x7f15a00cfb80 2024-03-30T01:53:19.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.928+0000 7f15a7200640 1 -- 172.21.15.133:0/2550446961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15a00cfb80 msgr2=0x7f15a00b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:19.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.928+0000 7f15a7200640 1 --2- 172.21.15.133:0/2550446961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15a00cfb80 0x7f15a00b14f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1598009870 tx=0x7f159802b8f0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.928+0000 7f15a7200640 1 -- 172.21.15.133:0/2550446961 shutdown_connections 2024-03-30T01:53:19.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.928+0000 7f15a7200640 1 --2- 172.21.15.133:0/2550446961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15a00cfb80 0x7f15a00b14f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.928+0000 7f15a7200640 1 --2- 172.21.15.133:0/2550446961 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15a015cc50 0x7f15a00d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.928+0000 7f15a7200640 1 -- 172.21.15.133:0/2550446961 >> 172.21.15.133:0/2550446961 conn(0x7f15a0071a40 msgr2=0x7f15a006b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:19.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.928+0000 7f15a7200640 1 -- 172.21.15.133:0/2550446961 shutdown_connections 2024-03-30T01:53:19.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.928+0000 7f15a7200640 1 -- 172.21.15.133:0/2550446961 wait complete. 2024-03-30T01:53:19.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.930+0000 7f15a7200640 1 Processor -- start 2024-03-30T01:53:19.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.930+0000 7f15a7200640 1 -- start start 2024-03-30T01:53:19.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.931+0000 7f15a7200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15a00cfb80 0x7f15a01497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.931+0000 7f15a7200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15a00d2240 0x7f15a00b7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.931+0000 7f15a7200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15a015cc50 0x7f15a00b8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.931+0000 7f15a7200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a00ab300 con 0x7f15a015cc50 2024-03-30T01:53:19.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.931+0000 7f15a7200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a014a040 con 0x7f15a00cfb80 2024-03-30T01:53:19.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.931+0000 7f15a7200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a00aad40 con 0x7f15a00d2240 2024-03-30T01:53:19.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.931+0000 7f15a5200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15a015cc50 0x7f15a00b8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.931+0000 7f15a5200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15a015cc50 0x7f15a00b8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36018/0 (socket says 172.21.15.133:36018) 2024-03-30T01:53:19.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.931+0000 7f15a5200640 1 -- 172.21.15.133:0/2949930675 learned_addr learned my addr 172.21.15.133:0/2949930675 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:19.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.932+0000 7f159fe00640 1 --2- 172.21.15.133:0/2949930675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15a00cfb80 0x7f15a01497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.932+0000 7f159f400640 1 --2- 172.21.15.133:0/2949930675 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15a00d2240 0x7f15a00b7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.932+0000 7f15a5200640 1 -- 172.21.15.133:0/2949930675 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15a00d2240 msgr2=0x7f15a00b7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:19.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.932+0000 7f15a5200640 1 --2- 172.21.15.133:0/2949930675 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15a00d2240 0x7f15a00b7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.932+0000 7f15a5200640 1 -- 172.21.15.133:0/2949930675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15a00cfb80 msgr2=0x7f15a01497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:19.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.932+0000 7f15a5200640 1 --2- 172.21.15.133:0/2949930675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15a00cfb80 0x7f15a01497b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:19.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.932+0000 7f15a5200640 1 -- 172.21.15.133:0/2949930675 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15980094d0 con 0x7f15a015cc50 2024-03-30T01:53:19.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.932+0000 7f159f400640 1 --2- 172.21.15.133:0/2949930675 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15a00d2240 0x7f15a00b7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:19.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.932+0000 7f15a5200640 1 --2- 172.21.15.133:0/2949930675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15a015cc50 0x7f15a00b8410 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f159802b930 tx=0x7f15980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:19.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.933+0000 7f1597e00640 1 -- 172.21.15.133:0/2949930675 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159803ac60 con 0x7f15a015cc50 2024-03-30T01:53:19.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.933+0000 7f1597e00640 1 -- 172.21.15.133:0/2949930675 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159803adc0 con 0x7f15a015cc50 2024-03-30T01:53:19.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.933+0000 7f1597e00640 1 -- 172.21.15.133:0/2949930675 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598044630 con 0x7f15a015cc50 2024-03-30T01:53:19.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.933+0000 7f15a7200640 1 -- 172.21.15.133:0/2949930675 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a00ab020 con 0x7f15a015cc50 2024-03-30T01:53:19.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.933+0000 7f15a7200640 1 -- 172.21.15.133:0/2949930675 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a014a570 con 0x7f15a015cc50 2024-03-30T01:53:19.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.934+0000 7f15a7200640 1 -- 172.21.15.133:0/2949930675 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a00d2680 con 0x7f15a015cc50 2024-03-30T01:53:19.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.935+0000 7f1597e00640 1 -- 172.21.15.133:0/2949930675 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f159802f050 con 0x7f15a015cc50 2024-03-30T01:53:19.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.936+0000 7f1597e00640 1 --2- 172.21.15.133:0/2949930675 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f157c06ac00 0x7f157c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:19.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.936+0000 7f1597e00640 1 -- 172.21.15.133:0/2949930675 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f15980ab070 con 0x7f15a015cc50 2024-03-30T01:53:19.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.937+0000 7f159fe00640 1 --2- 172.21.15.133:0/2949930675 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f157c06ac00 0x7f157c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:19.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.937+0000 7f159fe00640 1 --2- 172.21.15.133:0/2949930675 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f157c06ac00 0x7f157c06d0c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f15900099c0 tx=0x7f1590003990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:19.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:19.941+0000 7f1597e00640 1 -- 172.21.15.133:0/2949930675 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f15980de580 con 0x7f15a015cc50 2024-03-30T01:53:20.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.130+0000 7f15a7200640 1 -- 172.21.15.133:0/2949930675 --> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f15a00d1970 con 0x7f157c06ac00 2024-03-30T01:53:20.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.131+0000 7f1597e00640 1 -- 172.21.15.133:0/2949930675 <== mgr.4105 v2:172.21.15.133:6832/37234 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f15900046c0 con 0x7f157c06ac00 2024-03-30T01:53:20.137 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 2 to deep-scrub 2024-03-30T01:53:20.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.134+0000 7f15a7200640 1 -- 172.21.15.133:0/2949930675 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f157c06ac00 msgr2=0x7f157c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:20.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.134+0000 7f15a7200640 1 --2- 172.21.15.133:0/2949930675 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f157c06ac00 0x7f157c06d0c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f15900099c0 tx=0x7f1590003990 comp rx=0 tx=0).stop 2024-03-30T01:53:20.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.134+0000 7f15a7200640 1 -- 172.21.15.133:0/2949930675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15a015cc50 msgr2=0x7f15a00b8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:20.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.134+0000 7f15a7200640 1 --2- 172.21.15.133:0/2949930675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15a015cc50 0x7f15a00b8410 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f159802b930 tx=0x7f15980046c0 comp rx=0 tx=0).stop 2024-03-30T01:53:20.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.134+0000 7f15a7200640 1 -- 172.21.15.133:0/2949930675 shutdown_connections 2024-03-30T01:53:20.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.134+0000 7f15a7200640 1 --2- 172.21.15.133:0/2949930675 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f157c06ac00 0x7f157c06d0c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:20.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.134+0000 7f15a7200640 1 --2- 172.21.15.133:0/2949930675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15a015cc50 0x7f15a00b8410 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:20.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.134+0000 7f15a7200640 1 --2- 172.21.15.133:0/2949930675 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15a00d2240 0x7f15a00b7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:20.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.134+0000 7f15a7200640 1 --2- 172.21.15.133:0/2949930675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15a00cfb80 0x7f15a01497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:20.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.134+0000 7f15a7200640 1 -- 172.21.15.133:0/2949930675 >> 172.21.15.133:0/2949930675 conn(0x7f15a0071a40 msgr2=0x7f15a015dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:20.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.134+0000 7f15a7200640 1 -- 172.21.15.133:0/2949930675 shutdown_connections 2024-03-30T01:53:20.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.134+0000 7f15a7200640 1 -- 172.21.15.133:0/2949930675 wait complete. 2024-03-30T01:53:20.157 INFO:tasks.ceph:Scrubbing osd.3 2024-03-30T01:53:20.157 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-30T01:53:20.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.358+0000 7f6ee1200640 1 Processor -- start 2024-03-30T01:53:20.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.358+0000 7f6ee1200640 1 -- start start 2024-03-30T01:53:20.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.360+0000 7f6ee1200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6edc0cb970 0x7f6edc06d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:20.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.360+0000 7f6ee1200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6edc06db40 0x7f6edc0b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:20.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.360+0000 7f6ee1200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6edc143720 con 0x7f6edc143340 2024-03-30T01:53:20.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.360+0000 7f6ee1200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6edc0cbf50 con 0x7f6edc06db40 2024-03-30T01:53:20.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.360+0000 7f6ee1200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0cc230 con 0x7f6edc0cb970 2024-03-30T01:53:20.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.360+0000 7f6ed9e00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6edc143340 0x7f6edc06e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49502/0 (socket says 172.21.15.133:49502) 2024-03-30T01:53:20.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.360+0000 7f6ed9e00640 1 -- 172.21.15.133:0/1842976926 learned_addr learned my addr 172.21.15.133:0/1842976926 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:20.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.360+0000 7f6eda800640 1 --2- 172.21.15.133:0/1842976926 >> v2:172.21.15.137:3300/0 conn(0x7f6edc06db40 0x7f6edc0b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:20.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.360+0000 7f6ed9400640 1 --2- 172.21.15.133:0/1842976926 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6edc0cb970 0x7f6edc06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:20.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.360+0000 7f6ed8a00640 1 -- 172.21.15.133:0/1842976926 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067162480 0 0) 0x7f6edc143720 con 0x7f6edc143340 2024-03-30T01:53:20.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.360+0000 7f6ed8a00640 1 -- 172.21.15.133:0/1842976926 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ec0003520 con 0x7f6edc143340 2024-03-30T01:53:20.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.361+0000 7f6ed8a00640 1 -- 172.21.15.133:0/1842976926 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1601995347 0 0) 0x7f6ec0003520 con 0x7f6edc143340 2024-03-30T01:53:20.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.361+0000 7f6ed8a00640 1 -- 172.21.15.133:0/1842976926 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6edc0cb970 msgr2=0x7f6edc06d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:20.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.361+0000 7f6ed8a00640 1 --2- 172.21.15.133:0/1842976926 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6edc0cb970 0x7f6edc06d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:20.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.361+0000 7f6ed8a00640 1 -- 172.21.15.133:0/1842976926 >> v2:172.21.15.137:3300/0 conn(0x7f6edc06db40 msgr2=0x7f6edc0b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:20.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.361+0000 7f6ed8a00640 1 --2- 172.21.15.133:0/1842976926 >> v2:172.21.15.137:3300/0 conn(0x7f6edc06db40 0x7f6edc0b2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:20.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.361+0000 7f6ed8a00640 1 -- 172.21.15.133:0/1842976926 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc06ce00 con 0x7f6edc143340 2024-03-30T01:53:20.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.361+0000 7f6ed8a00640 1 -- 172.21.15.133:0/1842976926 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f6ecc0019f0 con 0x7f6edc143340 2024-03-30T01:53:20.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.361+0000 7f6ed8a00640 1 -- 172.21.15.133:0/1842976926 >> v1:172.21.15.133:6789/0 conn(0x7f6edc143340 legacy=0x7f6edc06e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:20.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.361+0000 7f6ed8a00640 1 --2- 172.21.15.133:0/1842976926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ec0003970 0x7f6ec0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:20.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.361+0000 7f6ed8a00640 1 --2- 172.21.15.133:0/1842976926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ec00047c0 0x7f6ec0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:20.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.361+0000 7f6ed8a00640 1 --2- 172.21.15.133:0/1842976926 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6edc0cb970 0x7f6ec0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:20.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.361+0000 7f6ed8a00640 1 -- 172.21.15.133:0/1842976926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0cbf50 con 0x7f6ec0003970 2024-03-30T01:53:20.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.361+0000 7f6ed8a00640 1 -- 172.21.15.133:0/1842976926 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0cc230 con 0x7f6ec00047c0 2024-03-30T01:53:20.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.361+0000 7f6ed8a00640 1 -- 172.21.15.133:0/1842976926 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec000b980 con 0x7f6edc0cb970 2024-03-30T01:53:20.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.361+0000 7f6ed9e00640 1 --2- 172.21.15.133:0/1842976926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ec0003970 0x7f6ec0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:20.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.362+0000 7f6eda800640 1 --2- 172.21.15.133:0/1842976926 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6edc0cb970 0x7f6ec0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:20.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.362+0000 7f6ed9e00640 1 -- 172.21.15.133:0/1842976926 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6edc0cb970 msgr2=0x7f6ec0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:20.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.362+0000 7f6ed9e00640 1 --2- 172.21.15.133:0/1842976926 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6edc0cb970 0x7f6ec0005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:20.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.362+0000 7f6ed9e00640 1 -- 172.21.15.133:0/1842976926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ec00047c0 msgr2=0x7f6ec0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:20.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.362+0000 7f6ed9e00640 1 --2- 172.21.15.133:0/1842976926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ec00047c0 0x7f6ec0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:20.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.362+0000 7f6ed9e00640 1 -- 172.21.15.133:0/1842976926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec0003520 con 0x7f6ec0003970 2024-03-30T01:53:20.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.363+0000 7f6ed9e00640 1 --2- 172.21.15.133:0/1842976926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ec0003970 0x7f6ec0003d90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc00a830 tx=0x7f6ec00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f69e2ad63b193b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:20.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.363+0000 7f6ed8a00640 1 -- 172.21.15.133:0/1842976926 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc034630 con 0x7f6ec0003970 2024-03-30T01:53:20.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.363+0000 7f6ed8a00640 1 -- 172.21.15.133:0/1842976926 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ecc02f070 con 0x7f6ec0003970 2024-03-30T01:53:20.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.363+0000 7f6ed8a00640 1 -- 172.21.15.133:0/1842976926 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc0349b0 con 0x7f6ec0003970 2024-03-30T01:53:20.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.363+0000 7f6ee1200640 1 -- 172.21.15.133:0/1842976926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ec0003970 msgr2=0x7f6ec0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:20.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.363+0000 7f6ee1200640 1 --2- 172.21.15.133:0/1842976926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ec0003970 0x7f6ec0003d90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc00a830 tx=0x7f6ec00057f0 comp rx=0 tx=0).stop 2024-03-30T01:53:20.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.363+0000 7f6eda800640 1 -- 172.21.15.133:0/1842976926 reap_dead start 2024-03-30T01:53:20.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.363+0000 7f6ee1200640 1 -- 172.21.15.133:0/1842976926 shutdown_connections 2024-03-30T01:53:20.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.363+0000 7f6ee1200640 1 -- 172.21.15.133:0/1842976926 >> 172.21.15.133:0/1842976926 conn(0x7f6edc0b0810 msgr2=0x7f6edc0b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:20.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.364+0000 7f6ee1200640 1 -- 172.21.15.133:0/1842976926 shutdown_connections 2024-03-30T01:53:20.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.364+0000 7f6ee1200640 1 -- 172.21.15.133:0/1842976926 wait complete. 2024-03-30T01:53:20.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.365+0000 7f6ee1200640 1 Processor -- start 2024-03-30T01:53:20.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.365+0000 7f6ee1200640 1 -- start start 2024-03-30T01:53:20.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.366+0000 7f6ee1200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ec0003970 0x7f6edc1501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.366+0000 7f6ee1200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6edc159600 0x7f6edc152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.366+0000 7f6ee1200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6edc0af7a0 0x7f6edc0afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.366+0000 7f6ee1200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0b0160 con 0x7f6edc0af7a0 2024-03-30T01:53:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.366+0000 7f6ee1200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc138520 con 0x7f6ec0003970 2024-03-30T01:53:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.366+0000 7f6ee1200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc13ab60 con 0x7f6edc159600 2024-03-30T01:53:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.367+0000 7f6eda800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6edc0af7a0 0x7f6edc0afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.367+0000 7f6eda800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6edc0af7a0 0x7f6edc0afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36042/0 (socket says 172.21.15.133:36042) 2024-03-30T01:53:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.367+0000 7f6eda800640 1 -- 172.21.15.133:0/837019130 learned_addr learned my addr 172.21.15.133:0/837019130 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:20.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.367+0000 7f6eda800640 1 -- 172.21.15.133:0/837019130 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6edc159600 msgr2=0x7f6edc152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:20.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.367+0000 7f6eda800640 1 --2- 172.21.15.133:0/837019130 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6edc159600 0x7f6edc152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:20.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.367+0000 7f6eda800640 1 -- 172.21.15.133:0/837019130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ec0003970 msgr2=0x7f6edc1501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:20.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.367+0000 7f6eda800640 1 --2- 172.21.15.133:0/837019130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ec0003970 0x7f6edc1501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:20.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.367+0000 7f6eda800640 1 -- 172.21.15.133:0/837019130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc138da0 con 0x7f6edc0af7a0 2024-03-30T01:53:20.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.367+0000 7f6eda800640 1 --2- 172.21.15.133:0/837019130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6edc0af7a0 0x7f6edc0afc20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4010790 tx=0x7f6ed4010c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:20.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.367+0000 7f6ed2000640 1 -- 172.21.15.133:0/837019130 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed400e8d0 con 0x7f6edc0af7a0 2024-03-30T01:53:20.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.367+0000 7f6ed2000640 1 -- 172.21.15.133:0/837019130 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed400ea50 con 0x7f6edc0af7a0 2024-03-30T01:53:20.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.368+0000 7f6ed2000640 1 -- 172.21.15.133:0/837019130 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed400ee00 con 0x7f6edc0af7a0 2024-03-30T01:53:20.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.368+0000 7f6ee1200640 1 -- 172.21.15.133:0/837019130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6edc1f1fd0 con 0x7f6edc0af7a0 2024-03-30T01:53:20.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.368+0000 7f6ee1200640 1 -- 172.21.15.133:0/837019130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6edc13a5a0 con 0x7f6edc0af7a0 2024-03-30T01:53:20.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.369+0000 7f6ee1200640 1 -- 172.21.15.133:0/837019130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6edc0cc510 con 0x7f6edc0af7a0 2024-03-30T01:53:20.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.370+0000 7f6ed2000640 1 -- 172.21.15.133:0/837019130 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f6ed4020410 con 0x7f6edc0af7a0 2024-03-30T01:53:20.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.371+0000 7f6ed2000640 1 --2- 172.21.15.133:0/837019130 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6ebc06ac00 0x7f6ebc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:20.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.371+0000 7f6ed2000640 1 -- 172.21.15.133:0/837019130 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f6ed4089700 con 0x7f6edc0af7a0 2024-03-30T01:53:20.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.371+0000 7f6ed2000640 1 --2- 172.21.15.133:0/837019130 >> [v2:172.21.15.133:6800/37490,v1:172.21.15.133:6801/37490] conn(0x7f6ebc070b00 0x7f6ebc072f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:20.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.371+0000 7f6ed9e00640 1 --2- 172.21.15.133:0/837019130 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6ebc06ac00 0x7f6ebc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:20.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.371+0000 7f6ed2000640 1 -- 172.21.15.133:0/837019130 --> [v2:172.21.15.133:6800/37490,v1:172.21.15.133:6801/37490] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6ebc0735d0 con 0x7f6ebc070b00 2024-03-30T01:53:20.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.371+0000 7f6ed2000640 1 -- 172.21.15.133:0/837019130 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ed4089a70 con 0x7f6edc0af7a0 2024-03-30T01:53:20.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.371+0000 7f6ed9400640 1 --2- 172.21.15.133:0/837019130 >> [v2:172.21.15.133:6800/37490,v1:172.21.15.133:6801/37490] conn(0x7f6ebc070b00 0x7f6ebc072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:20.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.372+0000 7f6ed9e00640 1 --2- 172.21.15.133:0/837019130 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6ebc06ac00 0x7f6ebc06d0c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc034000 tx=0x7f6ecc007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:20.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.372+0000 7f6ed9400640 1 --2- 172.21.15.133:0/837019130 >> [v2:172.21.15.133:6800/37490,v1:172.21.15.133:6801/37490] conn(0x7f6ebc070b00 0x7f6ebc072f20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:20.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.373+0000 7f6ed2000640 1 -- 172.21.15.133:0/837019130 <== osd.3 v2:172.21.15.133:6800/37490 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f6ebc0735d0 con 0x7f6ebc070b00 2024-03-30T01:53:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.386+0000 7f6ee1200640 1 -- 172.21.15.133:0/837019130 --> [v2:172.21.15.133:6800/37490,v1:172.21.15.133:6801/37490] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6edc066d80 con 0x7f6ebc070b00 2024-03-30T01:53:20.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.387+0000 7f6ed2000640 1 -- 172.21.15.133:0/837019130 <== osd.3 v2:172.21.15.133:6800/37490 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6edc066d80 con 0x7f6ebc070b00 2024-03-30T01:53:20.393 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-03-30T01:53:20.393 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T01:53:20.393 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-03-30T01:53:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.387+0000 7f6ee1200640 1 -- 172.21.15.133:0/837019130 >> [v2:172.21.15.133:6800/37490,v1:172.21.15.133:6801/37490] conn(0x7f6ebc070b00 msgr2=0x7f6ebc072f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.387+0000 7f6ee1200640 1 --2- 172.21.15.133:0/837019130 >> [v2:172.21.15.133:6800/37490,v1:172.21.15.133:6801/37490] conn(0x7f6ebc070b00 0x7f6ebc072f20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.387+0000 7f6ee1200640 1 -- 172.21.15.133:0/837019130 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6ebc06ac00 msgr2=0x7f6ebc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.387+0000 7f6ee1200640 1 --2- 172.21.15.133:0/837019130 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f6ebc06ac00 0x7f6ebc06d0c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc034000 tx=0x7f6ecc007000 comp rx=0 tx=0).stop 2024-03-30T01:53:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.387+0000 7f6ee1200640 1 -- 172.21.15.133:0/837019130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6edc0af7a0 msgr2=0x7f6edc0afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.387+0000 7f6ee1200640 1 --2- 172.21.15.133:0/837019130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6edc0af7a0 0x7f6edc0afc20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4010790 tx=0x7f6ed4010c50 comp rx=0 tx=0).stop 2024-03-30T01:53:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.387+0000 7f6eda800640 1 -- 172.21.15.133:0/837019130 reap_dead start 2024-03-30T01:53:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.388+0000 7f6ee1200640 1 -- 172.21.15.133:0/837019130 shutdown_connections 2024-03-30T01:53:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.388+0000 7f6ee1200640 1 -- 172.21.15.133:0/837019130 >> 172.21.15.133:0/837019130 conn(0x7f6edc0b0810 msgr2=0x7f6edc0b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.388+0000 7f6ee1200640 1 -- 172.21.15.133:0/837019130 shutdown_connections 2024-03-30T01:53:20.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.388+0000 7f6ee1200640 1 -- 172.21.15.133:0/837019130 wait complete. 2024-03-30T01:53:20.411 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-30T01:53:20.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.613+0000 7fad3ae00640 1 Processor -- start 2024-03-30T01:53:20.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.613+0000 7fad3ae00640 1 -- start start 2024-03-30T01:53:20.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.614+0000 7fad3ae00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad340d0af0 0x7fad340cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:20.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.615+0000 7fad3ae00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad3415d030 con 0x7fad3415cc50 2024-03-30T01:53:20.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.615+0000 7fad3ae00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad340cfe40 con 0x7fad340cf9b0 2024-03-30T01:53:20.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.615+0000 7fad3ae00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad340d1c50 con 0x7fad340d0af0 2024-03-30T01:53:20.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.615+0000 7fad33e00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fad3415cc50 0x7fad340d2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49506/0 (socket says 172.21.15.133:49506) 2024-03-30T01:53:20.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.615+0000 7fad33e00640 1 -- 172.21.15.133:0/4269844815 learned_addr learned my addr 172.21.15.133:0/4269844815 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:20.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.615+0000 7fad33400640 1 --2- 172.21.15.133:0/4269844815 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad340d0af0 0x7fad340cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:20.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.615+0000 7fad32a00640 1 -- 172.21.15.133:0/4269844815 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 700557738 0 0) 0x7fad3415d030 con 0x7fad3415cc50 2024-03-30T01:53:20.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.615+0000 7fad32a00640 1 -- 172.21.15.133:0/4269844815 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad18003520 con 0x7fad3415cc50 2024-03-30T01:53:20.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.616+0000 7fad32a00640 1 -- 172.21.15.133:0/4269844815 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1520428131 0 0) 0x7fad18003520 con 0x7fad3415cc50 2024-03-30T01:53:20.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.616+0000 7fad32a00640 1 -- 172.21.15.133:0/4269844815 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad340d0af0 msgr2=0x7fad340cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:20.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.616+0000 7fad32a00640 1 --2- 172.21.15.133:0/4269844815 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad340d0af0 0x7fad340cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:20.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.616+0000 7fad32a00640 1 -- 172.21.15.133:0/4269844815 >> v1:172.21.15.137:6789/0 conn(0x7fad340cf9b0 legacy=0x7fad340b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:20.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.616+0000 7fad32a00640 1 -- 172.21.15.133:0/4269844815 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad340b5af0 con 0x7fad3415cc50 2024-03-30T01:53:20.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.616+0000 7fad32a00640 1 -- 172.21.15.133:0/4269844815 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fad24001670 con 0x7fad3415cc50 2024-03-30T01:53:20.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.616+0000 7fad32a00640 1 -- 172.21.15.133:0/4269844815 >> v1:172.21.15.133:6789/0 conn(0x7fad3415cc50 legacy=0x7fad340d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:20.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.616+0000 7fad32a00640 1 --2- 172.21.15.133:0/4269844815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad180039a0 0x7fad18003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:20.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.616+0000 7fad32a00640 1 --2- 172.21.15.133:0/4269844815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad180047c0 0x7fad18004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:20.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.616+0000 7fad32a00640 1 --2- 172.21.15.133:0/4269844815 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad340d0af0 0x7fad18005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:20.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.616+0000 7fad32a00640 1 -- 172.21.15.133:0/4269844815 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad340d1c50 con 0x7fad180039a0 2024-03-30T01:53:20.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.616+0000 7fad32a00640 1 -- 172.21.15.133:0/4269844815 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1800ba30 con 0x7fad180047c0 2024-03-30T01:53:20.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.616+0000 7fad32a00640 1 -- 172.21.15.133:0/4269844815 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1800bbf0 con 0x7fad340d0af0 2024-03-30T01:53:20.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.616+0000 7fad33e00640 1 --2- 172.21.15.133:0/4269844815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad180039a0 0x7fad18003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:20.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.617+0000 7fad33400640 1 --2- 172.21.15.133:0/4269844815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad180047c0 0x7fad18004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:20.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.617+0000 7fad38e00640 1 --2- 172.21.15.133:0/4269844815 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad340d0af0 0x7fad18005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:20.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.617+0000 7fad33e00640 1 -- 172.21.15.133:0/4269844815 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad340d0af0 msgr2=0x7fad18005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:20.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.617+0000 7fad33e00640 1 --2- 172.21.15.133:0/4269844815 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad340d0af0 0x7fad18005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:20.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.617+0000 7fad33e00640 1 -- 172.21.15.133:0/4269844815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad180047c0 msgr2=0x7fad18004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:20.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.617+0000 7fad33e00640 1 --2- 172.21.15.133:0/4269844815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad180047c0 0x7fad18004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:20.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.617+0000 7fad33e00640 1 -- 172.21.15.133:0/4269844815 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad18003520 con 0x7fad180039a0 2024-03-30T01:53:20.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.617+0000 7fad33400640 1 --2- 172.21.15.133:0/4269844815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad180047c0 0x7fad18004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:20.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.618+0000 7fad33e00640 1 --2- 172.21.15.133:0/4269844815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad180039a0 0x7fad18003dc0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fad24007fd0 tx=0x7fad180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff7b172dd687cde server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:20.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.618+0000 7fad32a00640 1 -- 172.21.15.133:0/4269844815 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad24005ad0 con 0x7fad180039a0 2024-03-30T01:53:20.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.618+0000 7fad32a00640 1 -- 172.21.15.133:0/4269844815 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad24005c50 con 0x7fad180039a0 2024-03-30T01:53:20.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.618+0000 7fad32a00640 1 -- 172.21.15.133:0/4269844815 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2402c850 con 0x7fad180039a0 2024-03-30T01:53:20.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.618+0000 7fad3ae00640 1 -- 172.21.15.133:0/4269844815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad180039a0 msgr2=0x7fad18003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:20.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.618+0000 7fad3ae00640 1 --2- 172.21.15.133:0/4269844815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad180039a0 0x7fad18003dc0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fad24007fd0 tx=0x7fad180057f0 comp rx=0 tx=0).stop 2024-03-30T01:53:20.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.619+0000 7fad38e00640 1 -- 172.21.15.133:0/4269844815 reap_dead start 2024-03-30T01:53:20.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.619+0000 7fad3ae00640 1 -- 172.21.15.133:0/4269844815 shutdown_connections 2024-03-30T01:53:20.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.619+0000 7fad3ae00640 1 -- 172.21.15.133:0/4269844815 >> 172.21.15.133:0/4269844815 conn(0x7fad34071a40 msgr2=0x7fad3406b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:20.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.619+0000 7fad3ae00640 1 -- 172.21.15.133:0/4269844815 shutdown_connections 2024-03-30T01:53:20.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.619+0000 7fad3ae00640 1 -- 172.21.15.133:0/4269844815 wait complete. 2024-03-30T01:53:20.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.620+0000 7fad3ae00640 1 Processor -- start 2024-03-30T01:53:20.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.621+0000 7fad3ae00640 1 -- start start 2024-03-30T01:53:20.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.621+0000 7fad3ae00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad180039a0 0x7fad340adbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:20.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.621+0000 7fad3ae00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad340ab210 0x7fad340ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:20.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.621+0000 7fad3ae00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad341f1420 0x7fad341f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:20.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.621+0000 7fad3ae00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad34149d20 con 0x7fad180039a0 2024-03-30T01:53:20.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.621+0000 7fad3ae00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3414a860 con 0x7fad341f1420 2024-03-30T01:53:20.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.621+0000 7fad3ae00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad34149f30 con 0x7fad340ab210 2024-03-30T01:53:20.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.622+0000 7fad33e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad180039a0 0x7fad340adbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:20.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.622+0000 7fad33e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad180039a0 0x7fad340adbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36058/0 (socket says 172.21.15.133:36058) 2024-03-30T01:53:20.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.622+0000 7fad33e00640 1 -- 172.21.15.133:0/201011299 learned_addr learned my addr 172.21.15.133:0/201011299 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:20.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.622+0000 7fad38e00640 1 --2- 172.21.15.133:0/201011299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad341f1420 0x7fad341f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:20.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.622+0000 7fad33400640 1 --2- 172.21.15.133:0/201011299 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad340ab210 0x7fad340ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:20.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.622+0000 7fad33e00640 1 -- 172.21.15.133:0/201011299 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad340ab210 msgr2=0x7fad340ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:20.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.622+0000 7fad33e00640 1 --2- 172.21.15.133:0/201011299 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad340ab210 0x7fad340ae100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:20.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.622+0000 7fad33e00640 1 -- 172.21.15.133:0/201011299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad341f1420 msgr2=0x7fad341f18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:20.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.622+0000 7fad33e00640 1 --2- 172.21.15.133:0/201011299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad341f1420 0x7fad341f18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:20.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.622+0000 7fad33e00640 1 -- 172.21.15.133:0/201011299 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3414a210 con 0x7fad180039a0 2024-03-30T01:53:20.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.622+0000 7fad33e00640 1 --2- 172.21.15.133:0/201011299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad180039a0 0x7fad340adbc0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fad2400c280 tx=0x7fad340b5c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:20.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.623+0000 7fad2be00640 1 -- 172.21.15.133:0/201011299 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2402cc60 con 0x7fad180039a0 2024-03-30T01:53:20.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.623+0000 7fad2be00640 1 -- 172.21.15.133:0/201011299 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2402cdc0 con 0x7fad180039a0 2024-03-30T01:53:20.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.623+0000 7fad2be00640 1 -- 172.21.15.133:0/201011299 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad24007270 con 0x7fad180039a0 2024-03-30T01:53:20.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.623+0000 7fad3ae00640 1 -- 172.21.15.133:0/201011299 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad3414a4f0 con 0x7fad180039a0 2024-03-30T01:53:20.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.623+0000 7fad3ae00640 1 -- 172.21.15.133:0/201011299 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad341f1fc0 con 0x7fad180039a0 2024-03-30T01:53:20.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.624+0000 7fad3ae00640 1 -- 172.21.15.133:0/201011299 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad3414a680 con 0x7fad180039a0 2024-03-30T01:53:20.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.625+0000 7fad2be00640 1 -- 172.21.15.133:0/201011299 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fad24032070 con 0x7fad180039a0 2024-03-30T01:53:20.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.625+0000 7fad2be00640 1 --2- 172.21.15.133:0/201011299 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fad1406ac30 0x7fad1406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:20.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.626+0000 7fad2be00640 1 -- 172.21.15.133:0/201011299 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fad2403c040 con 0x7fad180039a0 2024-03-30T01:53:20.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.626+0000 7fad33400640 1 --2- 172.21.15.133:0/201011299 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fad1406ac30 0x7fad1406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:20.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.626+0000 7fad33400640 1 --2- 172.21.15.133:0/201011299 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fad1406ac30 0x7fad1406d0f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fad20006ce0 tx=0x7fad20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:20.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.630+0000 7fad2be00640 1 -- 172.21.15.133:0/201011299 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fad240755b0 con 0x7fad180039a0 2024-03-30T01:53:20.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.823+0000 7fad3ae00640 1 -- 172.21.15.133:0/201011299 --> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fad3414a0a0 con 0x7fad1406ac30 2024-03-30T01:53:20.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.824+0000 7fad2be00640 1 -- 172.21.15.133:0/201011299 <== mgr.4105 v2:172.21.15.133:6832/37234 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fad3414a0a0 con 0x7fad1406ac30 2024-03-30T01:53:20.831 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 3 to deep-scrub 2024-03-30T01:53:20.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.827+0000 7fad3ae00640 1 -- 172.21.15.133:0/201011299 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fad1406ac30 msgr2=0x7fad1406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:20.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.827+0000 7fad3ae00640 1 --2- 172.21.15.133:0/201011299 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fad1406ac30 0x7fad1406d0f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fad20006ce0 tx=0x7fad20008040 comp rx=0 tx=0).stop 2024-03-30T01:53:20.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.827+0000 7fad3ae00640 1 -- 172.21.15.133:0/201011299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad180039a0 msgr2=0x7fad340adbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:20.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.827+0000 7fad3ae00640 1 --2- 172.21.15.133:0/201011299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad180039a0 0x7fad340adbc0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fad2400c280 tx=0x7fad340b5c80 comp rx=0 tx=0).stop 2024-03-30T01:53:20.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.827+0000 7fad3ae00640 1 -- 172.21.15.133:0/201011299 shutdown_connections 2024-03-30T01:53:20.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.827+0000 7fad3ae00640 1 --2- 172.21.15.133:0/201011299 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fad1406ac30 0x7fad1406d0f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:20.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.827+0000 7fad3ae00640 1 --2- 172.21.15.133:0/201011299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad341f1420 0x7fad341f18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:20.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.827+0000 7fad3ae00640 1 --2- 172.21.15.133:0/201011299 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad340ab210 0x7fad340ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:20.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.827+0000 7fad3ae00640 1 --2- 172.21.15.133:0/201011299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad180039a0 0x7fad340adbc0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:20.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.827+0000 7fad3ae00640 1 -- 172.21.15.133:0/201011299 >> 172.21.15.133:0/201011299 conn(0x7fad34071a40 msgr2=0x7fad3415f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:20.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.827+0000 7fad3ae00640 1 -- 172.21.15.133:0/201011299 shutdown_connections 2024-03-30T01:53:20.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:20.827+0000 7fad3ae00640 1 -- 172.21.15.133:0/201011299 wait complete. 2024-03-30T01:53:20.852 INFO:tasks.ceph:Scrubbing osd.4 2024-03-30T01:53:20.852 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-30T01:53:21.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.061+0000 7f97f8a00640 1 Processor -- start 2024-03-30T01:53:21.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.061+0000 7f97f8a00640 1 -- start start 2024-03-30T01:53:21.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.062+0000 7f97f8a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f97f413fbc0 0x7f97f40b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.062+0000 7f97f8a00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f406c4b0 con 0x7f97f41428d0 2024-03-30T01:53:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.063+0000 7f97f8a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f40b1380 con 0x7f97f40b05b0 2024-03-30T01:53:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.063+0000 7f97f8a00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f40b0ae0 con 0x7f97f413fbc0 2024-03-30T01:53:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.063+0000 7f97f2800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f97f413fbc0 0x7f97f40b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.063+0000 7f97f3200640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f97f41428d0 0x7f97f406c940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49520/0 (socket says 172.21.15.133:49520) 2024-03-30T01:53:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.063+0000 7f97f3200640 1 -- 172.21.15.133:0/352085708 learned_addr learned my addr 172.21.15.133:0/352085708 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.063+0000 7f97f2800640 1 -- 172.21.15.133:0/352085708 >> v1:172.21.15.137:6789/0 conn(0x7f97f40b05b0 legacy=0x7f97f41421c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.063+0000 7f97f2800640 1 -- 172.21.15.133:0/352085708 >> v1:172.21.15.133:6789/0 conn(0x7f97f41428d0 legacy=0x7f97f406c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.063+0000 7f97f2800640 1 -- 172.21.15.133:0/352085708 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f40b0dc0 con 0x7f97f413fbc0 2024-03-30T01:53:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.064+0000 7f97f2800640 1 --2- 172.21.15.133:0/352085708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97f413fbc0 0x7f97f40b0070 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f97e40097a0 tx=0x7f97e402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41cee0ece2e753f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.065+0000 7f97f1e00640 1 -- 172.21.15.133:0/352085708 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e402f050 con 0x7f97f413fbc0 2024-03-30T01:53:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.065+0000 7f97f1e00640 1 -- 172.21.15.133:0/352085708 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e4031700 con 0x7f97f413fbc0 2024-03-30T01:53:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.065+0000 7f97f1e00640 1 -- 172.21.15.133:0/352085708 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e4031a90 con 0x7f97f413fbc0 2024-03-30T01:53:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.065+0000 7f97f8a00640 1 -- 172.21.15.133:0/352085708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97f413fbc0 msgr2=0x7f97f40b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.065+0000 7f97f8a00640 1 --2- 172.21.15.133:0/352085708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97f413fbc0 0x7f97f40b0070 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f97e40097a0 tx=0x7f97e402b7a0 comp rx=0 tx=0).stop 2024-03-30T01:53:21.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.065+0000 7f97f8a00640 1 -- 172.21.15.133:0/352085708 shutdown_connections 2024-03-30T01:53:21.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.065+0000 7f97f8a00640 1 --2- 172.21.15.133:0/352085708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97f413fbc0 0x7f97f40b0070 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:21.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.065+0000 7f97f8a00640 1 -- 172.21.15.133:0/352085708 >> 172.21.15.133:0/352085708 conn(0x7f97f4066100 msgr2=0x7f97f4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:21.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.066+0000 7f97f8a00640 1 -- 172.21.15.133:0/352085708 shutdown_connections 2024-03-30T01:53:21.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.066+0000 7f97f8a00640 1 -- 172.21.15.133:0/352085708 wait complete. 2024-03-30T01:53:21.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.067+0000 7f97f8a00640 1 Processor -- start 2024-03-30T01:53:21.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.067+0000 7f97f8a00640 1 -- start start 2024-03-30T01:53:21.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.068+0000 7f97f8a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97f40b05b0 0x7f97f4145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:21.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.068+0000 7f97f8a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97f413fbc0 0x7f97f40ad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:21.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.068+0000 7f97f8a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97f41428d0 0x7f97f40ad910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:21.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.068+0000 7f97f8a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f41438c0 con 0x7f97f41428d0 2024-03-30T01:53:21.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.068+0000 7f97f8a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f41f5c90 con 0x7f97f40b05b0 2024-03-30T01:53:21.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.068+0000 7f97f8a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f40adfe0 con 0x7f97f413fbc0 2024-03-30T01:53:21.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.069+0000 7f97f3200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97f41428d0 0x7f97f40ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:21.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.069+0000 7f97f3200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97f41428d0 0x7f97f40ad910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36080/0 (socket says 172.21.15.133:36080) 2024-03-30T01:53:21.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.069+0000 7f97f3200640 1 -- 172.21.15.133:0/23057969 learned_addr learned my addr 172.21.15.133:0/23057969 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:21.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.069+0000 7f97f2800640 1 --2- 172.21.15.133:0/23057969 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97f40b05b0 0x7f97f4145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:21.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.069+0000 7f97ebe00640 1 --2- 172.21.15.133:0/23057969 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97f413fbc0 0x7f97f40ad3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:21.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.069+0000 7f97f3200640 1 -- 172.21.15.133:0/23057969 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97f413fbc0 msgr2=0x7f97f40ad3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:21.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.069+0000 7f97f3200640 1 --2- 172.21.15.133:0/23057969 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97f413fbc0 0x7f97f40ad3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:21.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.069+0000 7f97f3200640 1 -- 172.21.15.133:0/23057969 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97f40b05b0 msgr2=0x7f97f4145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:21.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.069+0000 7f97f3200640 1 --2- 172.21.15.133:0/23057969 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97f40b05b0 0x7f97f4145a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:21.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.069+0000 7f97f3200640 1 -- 172.21.15.133:0/23057969 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e4009400 con 0x7f97f41428d0 2024-03-30T01:53:21.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.069+0000 7f97f2800640 1 --2- 172.21.15.133:0/23057969 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97f40b05b0 0x7f97f4145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:21.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.069+0000 7f97ebe00640 1 --2- 172.21.15.133:0/23057969 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97f413fbc0 0x7f97f40ad3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:21.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.069+0000 7f97f3200640 1 --2- 172.21.15.133:0/23057969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97f41428d0 0x7f97f40ad910 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00cad0 tx=0x7f97ec00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:21.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.070+0000 7f97eaa00640 1 -- 172.21.15.133:0/23057969 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec00ac30 con 0x7f97f41428d0 2024-03-30T01:53:21.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.070+0000 7f97eaa00640 1 -- 172.21.15.133:0/23057969 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ec00ad90 con 0x7f97f41428d0 2024-03-30T01:53:21.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.070+0000 7f97f8a00640 1 -- 172.21.15.133:0/23057969 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f40ae2c0 con 0x7f97f41428d0 2024-03-30T01:53:21.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.070+0000 7f97eaa00640 1 -- 172.21.15.133:0/23057969 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec012600 con 0x7f97f41428d0 2024-03-30T01:53:21.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.070+0000 7f97f8a00640 1 -- 172.21.15.133:0/23057969 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f41434e0 con 0x7f97f41428d0 2024-03-30T01:53:21.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.071+0000 7f97f8a00640 1 -- 172.21.15.133:0/23057969 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f97f4073750 con 0x7f97f41428d0 2024-03-30T01:53:21.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.072+0000 7f97eaa00640 1 -- 172.21.15.133:0/23057969 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f97ec007070 con 0x7f97f41428d0 2024-03-30T01:53:21.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.073+0000 7f97eaa00640 1 --2- 172.21.15.133:0/23057969 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f97d006ac00 0x7f97d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:21.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.073+0000 7f97eaa00640 1 -- 172.21.15.133:0/23057969 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f97ec088de0 con 0x7f97f41428d0 2024-03-30T01:53:21.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.073+0000 7f97f2800640 1 --2- 172.21.15.133:0/23057969 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f97d006ac00 0x7f97d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:21.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.073+0000 7f97eaa00640 1 --2- 172.21.15.133:0/23057969 >> [v2:172.21.15.137:6805/37248,v1:172.21.15.137:6807/37248] conn(0x7f97d0070b00 0x7f97d0072f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:21.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.073+0000 7f97eaa00640 1 -- 172.21.15.133:0/23057969 --> [v2:172.21.15.137:6805/37248,v1:172.21.15.137:6807/37248] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f97d00735d0 con 0x7f97d0070b00 2024-03-30T01:53:21.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.073+0000 7f97eaa00640 1 -- 172.21.15.133:0/23057969 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97ec08b4a0 con 0x7f97f41428d0 2024-03-30T01:53:21.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.074+0000 7f97f2800640 1 --2- 172.21.15.133:0/23057969 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f97d006ac00 0x7f97d006d0c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f97e4035000 tx=0x7f97e4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:21.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.074+0000 7f97ebe00640 1 --2- 172.21.15.133:0/23057969 >> [v2:172.21.15.137:6805/37248,v1:172.21.15.137:6807/37248] conn(0x7f97d0070b00 0x7f97d0072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:21.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.075+0000 7f97ebe00640 1 --2- 172.21.15.133:0/23057969 >> [v2:172.21.15.137:6805/37248,v1:172.21.15.137:6807/37248] conn(0x7f97d0070b00 0x7f97d0072f20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:21.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.077+0000 7f97eaa00640 1 -- 172.21.15.133:0/23057969 <== osd.4 v2:172.21.15.137:6805/37248 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f97d00735d0 con 0x7f97d0070b00 2024-03-30T01:53:21.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.091+0000 7f97f8a00640 1 -- 172.21.15.133:0/23057969 --> [v2:172.21.15.137:6805/37248,v1:172.21.15.137:6807/37248] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f97f406b320 con 0x7f97d0070b00 2024-03-30T01:53:21.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.091+0000 7f97eaa00640 1 -- 172.21.15.133:0/23057969 <== osd.4 v2:172.21.15.137:6805/37248 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f97f406b320 con 0x7f97d0070b00 2024-03-30T01:53:21.098 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-03-30T01:53:21.098 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T01:53:21.098 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-03-30T01:53:21.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.092+0000 7f97f8a00640 1 -- 172.21.15.133:0/23057969 >> [v2:172.21.15.137:6805/37248,v1:172.21.15.137:6807/37248] conn(0x7f97d0070b00 msgr2=0x7f97d0072f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:21.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.092+0000 7f97f8a00640 1 --2- 172.21.15.133:0/23057969 >> [v2:172.21.15.137:6805/37248,v1:172.21.15.137:6807/37248] conn(0x7f97d0070b00 0x7f97d0072f20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:21.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.092+0000 7f97f8a00640 1 -- 172.21.15.133:0/23057969 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f97d006ac00 msgr2=0x7f97d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:21.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.092+0000 7f97f8a00640 1 --2- 172.21.15.133:0/23057969 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f97d006ac00 0x7f97d006d0c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f97e4035000 tx=0x7f97e4008030 comp rx=0 tx=0).stop 2024-03-30T01:53:21.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.092+0000 7f97f8a00640 1 -- 172.21.15.133:0/23057969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97f41428d0 msgr2=0x7f97f40ad910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:21.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.092+0000 7f97f8a00640 1 --2- 172.21.15.133:0/23057969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97f41428d0 0x7f97f40ad910 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00cad0 tx=0x7f97ec00cf90 comp rx=0 tx=0).stop 2024-03-30T01:53:21.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.092+0000 7f97f3200640 1 -- 172.21.15.133:0/23057969 reap_dead start 2024-03-30T01:53:21.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.092+0000 7f97f8a00640 1 -- 172.21.15.133:0/23057969 shutdown_connections 2024-03-30T01:53:21.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.092+0000 7f97f8a00640 1 -- 172.21.15.133:0/23057969 >> 172.21.15.133:0/23057969 conn(0x7f97f4066100 msgr2=0x7f97f40b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:21.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.092+0000 7f97f8a00640 1 -- 172.21.15.133:0/23057969 shutdown_connections 2024-03-30T01:53:21.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.092+0000 7f97f8a00640 1 -- 172.21.15.133:0/23057969 wait complete. 2024-03-30T01:53:21.116 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-30T01:53:21.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.310+0000 7ff367000640 1 Processor -- start 2024-03-30T01:53:21.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.311+0000 7ff367000640 1 -- start start 2024-03-30T01:53:21.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.312+0000 7ff367000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff3600cfb80 0x7ff3600b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:21.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.312+0000 7ff367000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff36015d030 con 0x7ff36015cc50 2024-03-30T01:53:21.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.312+0000 7ff367000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3600b5af0 con 0x7ff3600d0af0 2024-03-30T01:53:21.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.312+0000 7ff367000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3600d1c50 con 0x7ff3600cfb80 2024-03-30T01:53:21.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.313+0000 7ff365000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff3600cfb80 0x7ff3600b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:21.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.313+0000 7ff35fe00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff36015cc50 0x7ff3600d2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49526/0 (socket says 172.21.15.133:49526) 2024-03-30T01:53:21.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.313+0000 7ff35fe00640 1 -- 172.21.15.133:0/3901042206 learned_addr learned my addr 172.21.15.133:0/3901042206 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:21.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.313+0000 7ff365000640 1 -- 172.21.15.133:0/3901042206 >> v1:172.21.15.137:6789/0 conn(0x7ff3600d0af0 legacy=0x7ff3600cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:21.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.313+0000 7ff365000640 1 -- 172.21.15.133:0/3901042206 >> v1:172.21.15.133:6789/0 conn(0x7ff36015cc50 legacy=0x7ff3600d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:21.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.313+0000 7ff365000640 1 -- 172.21.15.133:0/3901042206 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3600d10d0 con 0x7ff3600cfb80 2024-03-30T01:53:21.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.313+0000 7ff35ea00640 1 -- 172.21.15.133:0/3901042206 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272121859 0 0) 0x7ff36015d030 con 0x7ff36015cc50 2024-03-30T01:53:21.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.314+0000 7ff365000640 1 --2- 172.21.15.133:0/3901042206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3600cfb80 0x7ff3600b14f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff3580097a0 tx=0x7ff35802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49cc9c698930854b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:21.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.314+0000 7ff35ea00640 1 -- 172.21.15.133:0/3901042206 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358031830 con 0x7ff3600cfb80 2024-03-30T01:53:21.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.314+0000 7ff35ea00640 1 -- 172.21.15.133:0/3901042206 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff358031990 con 0x7ff3600cfb80 2024-03-30T01:53:21.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.314+0000 7ff35ea00640 1 -- 172.21.15.133:0/3901042206 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358031d20 con 0x7ff3600cfb80 2024-03-30T01:53:21.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.315+0000 7ff367000640 1 -- 172.21.15.133:0/3901042206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3600cfb80 msgr2=0x7ff3600b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:21.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.315+0000 7ff367000640 1 --2- 172.21.15.133:0/3901042206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3600cfb80 0x7ff3600b14f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff3580097a0 tx=0x7ff35802b8d0 comp rx=0 tx=0).stop 2024-03-30T01:53:21.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.315+0000 7ff367000640 1 -- 172.21.15.133:0/3901042206 shutdown_connections 2024-03-30T01:53:21.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.315+0000 7ff367000640 1 --2- 172.21.15.133:0/3901042206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3600cfb80 0x7ff3600b14f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:21.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.315+0000 7ff367000640 1 -- 172.21.15.133:0/3901042206 >> 172.21.15.133:0/3901042206 conn(0x7ff360071a40 msgr2=0x7ff36006b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:21.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.315+0000 7ff367000640 1 -- 172.21.15.133:0/3901042206 shutdown_connections 2024-03-30T01:53:21.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.315+0000 7ff367000640 1 -- 172.21.15.133:0/3901042206 wait complete. 2024-03-30T01:53:21.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.317+0000 7ff367000640 1 Processor -- start 2024-03-30T01:53:21.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.317+0000 7ff367000640 1 -- start start 2024-03-30T01:53:21.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.318+0000 7ff367000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3600cfb80 0x7ff36014fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:21.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.318+0000 7ff367000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3600d0af0 0x7ff3600a9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:21.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.318+0000 7ff367000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff36015cc50 0x7ff3600cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:21.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.318+0000 7ff367000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3600aaf10 con 0x7ff3600d0af0 2024-03-30T01:53:21.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.318+0000 7ff367000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3600ab1f0 con 0x7ff36015cc50 2024-03-30T01:53:21.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.318+0000 7ff367000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3600ab4d0 con 0x7ff3600cfb80 2024-03-30T01:53:21.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.318+0000 7ff35f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3600d0af0 0x7ff3600a9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:21.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.318+0000 7ff35f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3600d0af0 0x7ff3600a9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36098/0 (socket says 172.21.15.133:36098) 2024-03-30T01:53:21.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.318+0000 7ff35f400640 1 -- 172.21.15.133:0/1394564378 learned_addr learned my addr 172.21.15.133:0/1394564378 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:21.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.319+0000 7ff35fe00640 1 --2- 172.21.15.133:0/1394564378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3600cfb80 0x7ff36014fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:21.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.319+0000 7ff365000640 1 --2- 172.21.15.133:0/1394564378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff36015cc50 0x7ff3600cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:21.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.319+0000 7ff35f400640 1 -- 172.21.15.133:0/1394564378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3600cfb80 msgr2=0x7ff36014fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:21.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.319+0000 7ff35f400640 1 --2- 172.21.15.133:0/1394564378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3600cfb80 0x7ff36014fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:21.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.319+0000 7ff35f400640 1 -- 172.21.15.133:0/1394564378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff36015cc50 msgr2=0x7ff3600cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:21.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.319+0000 7ff35f400640 1 --2- 172.21.15.133:0/1394564378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff36015cc50 0x7ff3600cbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:21.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.319+0000 7ff35f400640 1 -- 172.21.15.133:0/1394564378 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff358009400 con 0x7ff3600d0af0 2024-03-30T01:53:21.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.319+0000 7ff365000640 1 --2- 172.21.15.133:0/1394564378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff36015cc50 0x7ff3600cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:21.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.319+0000 7ff35f400640 1 --2- 172.21.15.133:0/1394564378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3600d0af0 0x7ff3600a9e80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff34800c430 tx=0x7ff34800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:21.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.319+0000 7ff357e00640 1 -- 172.21.15.133:0/1394564378 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff348011790 con 0x7ff3600d0af0 2024-03-30T01:53:21.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.319+0000 7ff357e00640 1 -- 172.21.15.133:0/1394564378 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3480118f0 con 0x7ff3600d0af0 2024-03-30T01:53:21.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.319+0000 7ff357e00640 1 -- 172.21.15.133:0/1394564378 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff348011ce0 con 0x7ff3600d0af0 2024-03-30T01:53:21.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.319+0000 7ff367000640 1 -- 172.21.15.133:0/1394564378 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3600ab7b0 con 0x7ff3600d0af0 2024-03-30T01:53:21.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.320+0000 7ff367000640 1 -- 172.21.15.133:0/1394564378 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3601503a0 con 0x7ff3600d0af0 2024-03-30T01:53:21.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.321+0000 7ff367000640 1 -- 172.21.15.133:0/1394564378 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3600abcd0 con 0x7ff3600d0af0 2024-03-30T01:53:21.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.321+0000 7ff357e00640 1 -- 172.21.15.133:0/1394564378 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ff34801c460 con 0x7ff3600d0af0 2024-03-30T01:53:21.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.322+0000 7ff357e00640 1 --2- 172.21.15.133:0/1394564378 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff33c06ac00 0x7ff33c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:21.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.322+0000 7ff357e00640 1 -- 172.21.15.133:0/1394564378 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff348089070 con 0x7ff3600d0af0 2024-03-30T01:53:21.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.322+0000 7ff35fe00640 1 --2- 172.21.15.133:0/1394564378 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff33c06ac00 0x7ff33c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:21.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.323+0000 7ff35fe00640 1 --2- 172.21.15.133:0/1394564378 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff33c06ac00 0x7ff33c06d0c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff3500012e0 tx=0x7ff350009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:21.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.326+0000 7ff357e00640 1 -- 172.21.15.133:0/1394564378 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7ff3480bc580 con 0x7ff3600d0af0 2024-03-30T01:53:21.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.521+0000 7ff367000640 1 -- 172.21.15.133:0/1394564378 --> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3600d1970 con 0x7ff33c06ac00 2024-03-30T01:53:21.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.522+0000 7ff357e00640 1 -- 172.21.15.133:0/1394564378 <== mgr.4105 v2:172.21.15.133:6832/37234 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff35000dc30 con 0x7ff33c06ac00 2024-03-30T01:53:21.528 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 4 to deep-scrub 2024-03-30T01:53:21.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.525+0000 7ff367000640 1 -- 172.21.15.133:0/1394564378 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff33c06ac00 msgr2=0x7ff33c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:21.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.525+0000 7ff367000640 1 --2- 172.21.15.133:0/1394564378 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff33c06ac00 0x7ff33c06d0c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff3500012e0 tx=0x7ff350009040 comp rx=0 tx=0).stop 2024-03-30T01:53:21.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.525+0000 7ff367000640 1 -- 172.21.15.133:0/1394564378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3600d0af0 msgr2=0x7ff3600a9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:21.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.525+0000 7ff367000640 1 --2- 172.21.15.133:0/1394564378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3600d0af0 0x7ff3600a9e80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff34800c430 tx=0x7ff34800c8f0 comp rx=0 tx=0).stop 2024-03-30T01:53:21.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.525+0000 7ff367000640 1 -- 172.21.15.133:0/1394564378 shutdown_connections 2024-03-30T01:53:21.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.525+0000 7ff367000640 1 --2- 172.21.15.133:0/1394564378 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7ff33c06ac00 0x7ff33c06d0c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:21.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.525+0000 7ff367000640 1 --2- 172.21.15.133:0/1394564378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff36015cc50 0x7ff3600cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:21.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.525+0000 7ff367000640 1 --2- 172.21.15.133:0/1394564378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3600d0af0 0x7ff3600a9e80 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:21.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.525+0000 7ff367000640 1 --2- 172.21.15.133:0/1394564378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3600cfb80 0x7ff36014fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:21.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.525+0000 7ff367000640 1 -- 172.21.15.133:0/1394564378 >> 172.21.15.133:0/1394564378 conn(0x7ff360071a40 msgr2=0x7ff3600c8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:21.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.525+0000 7ff367000640 1 -- 172.21.15.133:0/1394564378 shutdown_connections 2024-03-30T01:53:21.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.525+0000 7ff367000640 1 -- 172.21.15.133:0/1394564378 wait complete. 2024-03-30T01:53:21.550 INFO:tasks.ceph:Scrubbing osd.5 2024-03-30T01:53:21.551 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-30T01:53:21.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.758+0000 7f8075600640 1 Processor -- start 2024-03-30T01:53:21.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.758+0000 7f8075600640 1 -- start start 2024-03-30T01:53:21.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.759+0000 7f8075600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8070160290 0x7f80700b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:21.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.759+0000 7f8075600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80701607f0 0x7f80700d2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:21.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.759+0000 7f8075600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80700b6020 con 0x7f80700d2890 2024-03-30T01:53:21.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.759+0000 7f8075600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8070160c80 con 0x7f8070160290 2024-03-30T01:53:21.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.759+0000 7f8075600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8070160f60 con 0x7f80701607f0 2024-03-30T01:53:21.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.760+0000 7f806ea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8070160290 0x7f80700b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:21.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.760+0000 7f806ea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8070160290 0x7f80700b5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.133:41306/0 (socket says 172.21.15.133:41306) 2024-03-30T01:53:21.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.760+0000 7f806ea00640 1 -- 172.21.15.133:0/2751022324 learned_addr learned my addr 172.21.15.133:0/2751022324 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:21.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.760+0000 7f806e000640 1 --2- 172.21.15.133:0/2751022324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80701607f0 0x7f80700d2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.761+0000 7f806ea00640 1 -- 172.21.15.133:0/2751022324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80701607f0 msgr2=0x7f80700d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.761+0000 7f806ea00640 1 --2- 172.21.15.133:0/2751022324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80701607f0 0x7f80700d2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.761+0000 7f806ea00640 1 -- 172.21.15.133:0/2751022324 >> v1:172.21.15.137:6789/0 conn(0x7f80700d2890 legacy=0x7f80700b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.761+0000 7f806ea00640 1 -- 172.21.15.133:0/2751022324 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8070161240 con 0x7f8070160290 2024-03-30T01:53:21.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.762+0000 7f806ea00640 1 --2- 172.21.15.133:0/2751022324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8070160290 0x7f80700b5ae0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f80600098a0 tx=0x7f806002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6130db98187fede0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.763+0000 7f806d600640 1 -- 172.21.15.133:0/2751022324 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8060031640 con 0x7f8070160290 2024-03-30T01:53:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.763+0000 7f806d600640 1 -- 172.21.15.133:0/2751022324 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80600317a0 con 0x7f8070160290 2024-03-30T01:53:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.763+0000 7f806d600640 1 -- 172.21.15.133:0/2751022324 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8060031b30 con 0x7f8070160290 2024-03-30T01:53:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.764+0000 7f8075600640 1 -- 172.21.15.133:0/2751022324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8070160290 msgr2=0x7f80700b5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.764+0000 7f8075600640 1 --2- 172.21.15.133:0/2751022324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8070160290 0x7f80700b5ae0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f80600098a0 tx=0x7f806002b8f0 comp rx=0 tx=0).stop 2024-03-30T01:53:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.764+0000 7f8075600640 1 -- 172.21.15.133:0/2751022324 shutdown_connections 2024-03-30T01:53:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.764+0000 7f8075600640 1 --2- 172.21.15.133:0/2751022324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80701607f0 0x7f80700d2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.764+0000 7f8075600640 1 --2- 172.21.15.133:0/2751022324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8070160290 0x7f80700b5ae0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.764+0000 7f8075600640 1 -- 172.21.15.133:0/2751022324 >> 172.21.15.133:0/2751022324 conn(0x7f8070071a70 msgr2=0x7f80700cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.764+0000 7f8075600640 1 -- 172.21.15.133:0/2751022324 shutdown_connections 2024-03-30T01:53:21.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.764+0000 7f8075600640 1 -- 172.21.15.133:0/2751022324 wait complete. 2024-03-30T01:53:21.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.766+0000 7f8075600640 1 Processor -- start 2024-03-30T01:53:21.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.766+0000 7f8075600640 1 -- start start 2024-03-30T01:53:21.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.767+0000 7f8075600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80700d2890 0x7f80700cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:21.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.767+0000 7f8075600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8070160290 0x7f80700c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:21.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.767+0000 7f8075600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8070147ac0 0x7f80700b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:21.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.767+0000 7f8075600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8070155300 con 0x7f8070160290 2024-03-30T01:53:21.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.767+0000 7f8075600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8070155b60 con 0x7f80700d2890 2024-03-30T01:53:21.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.767+0000 7f8075600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80700cc6e0 con 0x7f8070147ac0 2024-03-30T01:53:21.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.767+0000 7f806e000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8070160290 0x7f80700c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:21.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.767+0000 7f806e000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8070160290 0x7f80700c86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36100/0 (socket says 172.21.15.133:36100) 2024-03-30T01:53:21.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.767+0000 7f806e000640 1 -- 172.21.15.133:0/4156875229 learned_addr learned my addr 172.21.15.133:0/4156875229 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:21.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.768+0000 7f806f400640 1 --2- 172.21.15.133:0/4156875229 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8070147ac0 0x7f80700b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:21.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.768+0000 7f806ea00640 1 --2- 172.21.15.133:0/4156875229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80700d2890 0x7f80700cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:21.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.768+0000 7f806e000640 1 -- 172.21.15.133:0/4156875229 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8070147ac0 msgr2=0x7f80700b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:21.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.768+0000 7f806e000640 1 --2- 172.21.15.133:0/4156875229 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8070147ac0 0x7f80700b3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:21.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.768+0000 7f806e000640 1 -- 172.21.15.133:0/4156875229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80700d2890 msgr2=0x7f80700cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:21.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.768+0000 7f806e000640 1 --2- 172.21.15.133:0/4156875229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80700d2890 0x7f80700cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:21.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.768+0000 7f806e000640 1 -- 172.21.15.133:0/4156875229 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80600094d0 con 0x7f8070160290 2024-03-30T01:53:21.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.768+0000 7f806e000640 1 --2- 172.21.15.133:0/4156875229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8070160290 0x7f80700c86e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f805800efc0 tx=0x7f805800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:21.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.768+0000 7f8066a00640 1 -- 172.21.15.133:0/4156875229 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8058009b80 con 0x7f8070160290 2024-03-30T01:53:21.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.768+0000 7f8066a00640 1 -- 172.21.15.133:0/4156875229 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805800f040 con 0x7f8070160290 2024-03-30T01:53:21.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.769+0000 7f8066a00640 1 -- 172.21.15.133:0/4156875229 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80580146a0 con 0x7f8070160290 2024-03-30T01:53:21.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.769+0000 7f8075600640 1 -- 172.21.15.133:0/4156875229 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8070155510 con 0x7f8070160290 2024-03-30T01:53:21.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.769+0000 7f8075600640 1 -- 172.21.15.133:0/4156875229 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80700cc390 con 0x7f8070160290 2024-03-30T01:53:21.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.770+0000 7f8075600640 1 -- 172.21.15.133:0/4156875229 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f807006b610 con 0x7f8070160290 2024-03-30T01:53:21.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.771+0000 7f8066a00640 1 -- 172.21.15.133:0/4156875229 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f8058014800 con 0x7f8070160290 2024-03-30T01:53:21.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.772+0000 7f8066a00640 1 --2- 172.21.15.133:0/4156875229 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f804c06ac00 0x7f804c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:21.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.772+0000 7f8066a00640 1 -- 172.21.15.133:0/4156875229 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8058089c30 con 0x7f8070160290 2024-03-30T01:53:21.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.772+0000 7f8066a00640 1 --2- 172.21.15.133:0/4156875229 >> [v2:172.21.15.137:6800/37249,v1:172.21.15.137:6801/37249] conn(0x7f804c070b00 0x7f804c072f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:21.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.772+0000 7f8066a00640 1 -- 172.21.15.133:0/4156875229 --> [v2:172.21.15.137:6800/37249,v1:172.21.15.137:6801/37249] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f804c0735d0 con 0x7f804c070b00 2024-03-30T01:53:21.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.772+0000 7f8066a00640 1 -- 172.21.15.133:0/4156875229 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f805808e2a0 con 0x7f8070160290 2024-03-30T01:53:21.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.772+0000 7f806ea00640 1 --2- 172.21.15.133:0/4156875229 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f804c06ac00 0x7f804c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:21.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.773+0000 7f806f400640 1 --2- 172.21.15.133:0/4156875229 >> [v2:172.21.15.137:6800/37249,v1:172.21.15.137:6801/37249] conn(0x7f804c070b00 0x7f804c072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:21.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.773+0000 7f806ea00640 1 --2- 172.21.15.133:0/4156875229 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f804c06ac00 0x7f804c06d0c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8060036000 tx=0x7f806003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:21.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.774+0000 7f806f400640 1 --2- 172.21.15.133:0/4156875229 >> [v2:172.21.15.137:6800/37249,v1:172.21.15.137:6801/37249] conn(0x7f804c070b00 0x7f804c072f20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:21.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.776+0000 7f8066a00640 1 -- 172.21.15.133:0/4156875229 <== osd.5 v2:172.21.15.137:6800/37249 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f804c0735d0 con 0x7f804c070b00 2024-03-30T01:53:21.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.790+0000 7f8075600640 1 -- 172.21.15.133:0/4156875229 --> [v2:172.21.15.137:6800/37249,v1:172.21.15.137:6801/37249] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8070066d80 con 0x7f804c070b00 2024-03-30T01:53:21.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.791+0000 7f8066a00640 1 -- 172.21.15.133:0/4156875229 <== osd.5 v2:172.21.15.137:6800/37249 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8070066d80 con 0x7f804c070b00 2024-03-30T01:53:21.797 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-03-30T01:53:21.797 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T01:53:21.797 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-03-30T01:53:21.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.791+0000 7f8075600640 1 -- 172.21.15.133:0/4156875229 >> [v2:172.21.15.137:6800/37249,v1:172.21.15.137:6801/37249] conn(0x7f804c070b00 msgr2=0x7f804c072f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:21.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.791+0000 7f8075600640 1 --2- 172.21.15.133:0/4156875229 >> [v2:172.21.15.137:6800/37249,v1:172.21.15.137:6801/37249] conn(0x7f804c070b00 0x7f804c072f20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:21.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.791+0000 7f8075600640 1 -- 172.21.15.133:0/4156875229 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f804c06ac00 msgr2=0x7f804c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:21.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.791+0000 7f8075600640 1 --2- 172.21.15.133:0/4156875229 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f804c06ac00 0x7f804c06d0c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8060036000 tx=0x7f806003c040 comp rx=0 tx=0).stop 2024-03-30T01:53:21.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.791+0000 7f8075600640 1 -- 172.21.15.133:0/4156875229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8070160290 msgr2=0x7f80700c86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:21.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.791+0000 7f8075600640 1 --2- 172.21.15.133:0/4156875229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8070160290 0x7f80700c86e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f805800efc0 tx=0x7f805800c490 comp rx=0 tx=0).stop 2024-03-30T01:53:21.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.791+0000 7f806f400640 1 -- 172.21.15.133:0/4156875229 reap_dead start 2024-03-30T01:53:21.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.791+0000 7f8075600640 1 -- 172.21.15.133:0/4156875229 shutdown_connections 2024-03-30T01:53:21.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.791+0000 7f8075600640 1 -- 172.21.15.133:0/4156875229 >> 172.21.15.133:0/4156875229 conn(0x7f8070071a70 msgr2=0x7f8070072ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:21.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.791+0000 7f8075600640 1 -- 172.21.15.133:0/4156875229 shutdown_connections 2024-03-30T01:53:21.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:21.791+0000 7f8075600640 1 -- 172.21.15.133:0/4156875229 wait complete. 2024-03-30T01:53:21.813 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-30T01:53:22.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.016+0000 7f75d1200640 1 Processor -- start 2024-03-30T01:53:22.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.016+0000 7f75d1200640 1 -- start start 2024-03-30T01:53:22.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.018+0000 7f75d1200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f75cc0ccd00 0x7f75cc1656c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:22.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.018+0000 7f75d1200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75cc13dba0 con 0x7f75cc0b42c0 2024-03-30T01:53:22.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.018+0000 7f75d1200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75cc1408b0 con 0x7f75cc15b9c0 2024-03-30T01:53:22.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.018+0000 7f75d1200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75cc15bda0 con 0x7f75cc0ccd00 2024-03-30T01:53:22.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.018+0000 7f75caa00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f75cc0b42c0 0x7f75cc0cc5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49538/0 (socket says 172.21.15.133:49538) 2024-03-30T01:53:22.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.018+0000 7f75caa00640 1 -- 172.21.15.133:0/3292780623 learned_addr learned my addr 172.21.15.133:0/3292780623 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:22.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.018+0000 7f75cbe00640 1 --2- 172.21.15.133:0/3292780623 >> v2:172.21.15.133:3300/0 conn(0x7f75cc0ccd00 0x7f75cc1656c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:22.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.018+0000 7f75ca000640 1 -- 172.21.15.133:0/3292780623 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299645631 0 0) 0x7f75cc13dba0 con 0x7f75cc0b42c0 2024-03-30T01:53:22.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.018+0000 7f75ca000640 1 -- 172.21.15.133:0/3292780623 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75b0003520 con 0x7f75cc0b42c0 2024-03-30T01:53:22.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.018+0000 7f75cbe00640 1 -- 172.21.15.133:0/3292780623 >> v1:172.21.15.137:6789/0 conn(0x7f75cc15b9c0 legacy=0x7f75cc0b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:22.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.018+0000 7f75cbe00640 1 -- 172.21.15.133:0/3292780623 >> v1:172.21.15.133:6789/0 conn(0x7f75cc0b42c0 legacy=0x7f75cc0cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:22.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.019+0000 7f75cbe00640 1 -- 172.21.15.133:0/3292780623 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc15ad40 con 0x7f75cc0ccd00 2024-03-30T01:53:22.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.020+0000 7f75cbe00640 1 --2- 172.21.15.133:0/3292780623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75cc0ccd00 0x7f75cc1656c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f75c4009d90 tx=0x7f75c402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826ca358caffd268 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:22.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.020+0000 7f75ca000640 1 -- 172.21.15.133:0/3292780623 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c402cd00 con 0x7f75cc0ccd00 2024-03-30T01:53:22.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.020+0000 7f75ca000640 1 -- 172.21.15.133:0/3292780623 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c402ce60 con 0x7f75cc0ccd00 2024-03-30T01:53:22.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.020+0000 7f75ca000640 1 -- 172.21.15.133:0/3292780623 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c4034660 con 0x7f75cc0ccd00 2024-03-30T01:53:22.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.020+0000 7f75d1200640 1 -- 172.21.15.133:0/3292780623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75cc0ccd00 msgr2=0x7f75cc1656c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:22.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.020+0000 7f75d1200640 1 --2- 172.21.15.133:0/3292780623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75cc0ccd00 0x7f75cc1656c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f75c4009d90 tx=0x7f75c402bf50 comp rx=0 tx=0).stop 2024-03-30T01:53:22.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.021+0000 7f75d1200640 1 -- 172.21.15.133:0/3292780623 shutdown_connections 2024-03-30T01:53:22.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.021+0000 7f75d1200640 1 --2- 172.21.15.133:0/3292780623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75cc0ccd00 0x7f75cc1656c0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.021+0000 7f75d1200640 1 -- 172.21.15.133:0/3292780623 >> 172.21.15.133:0/3292780623 conn(0x7f75cc0b05a0 msgr2=0x7f75cc0b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:22.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.021+0000 7f75d1200640 1 -- 172.21.15.133:0/3292780623 shutdown_connections 2024-03-30T01:53:22.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.021+0000 7f75d1200640 1 -- 172.21.15.133:0/3292780623 wait complete. 2024-03-30T01:53:22.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.022+0000 7f75d1200640 1 Processor -- start 2024-03-30T01:53:22.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.022+0000 7f75d1200640 1 -- start start 2024-03-30T01:53:22.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.023+0000 7f75d1200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f75cc0b42c0 0x7f75cc1f3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:22.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.023+0000 7f75d1200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75cc0ccd00 0x7f75cc1584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:22.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.023+0000 7f75d1200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75cc15b9c0 0x7f75cc158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:22.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.023+0000 7f75d1200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc154970 con 0x7f75cc0ccd00 2024-03-30T01:53:22.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.023+0000 7f75d1200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc156250 con 0x7f75cc15b9c0 2024-03-30T01:53:22.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.023+0000 7f75d1200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0ad540 con 0x7f75cc0b42c0 2024-03-30T01:53:22.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.024+0000 7f75caa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75cc0ccd00 0x7f75cc1584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:22.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.024+0000 7f75caa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75cc0ccd00 0x7f75cc1584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36130/0 (socket says 172.21.15.133:36130) 2024-03-30T01:53:22.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.024+0000 7f75caa00640 1 -- 172.21.15.133:0/1057020175 learned_addr learned my addr 172.21.15.133:0/1057020175 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:22.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.024+0000 7f75cbe00640 1 --2- 172.21.15.133:0/1057020175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75cc15b9c0 0x7f75cc158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:22.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.024+0000 7f75caa00640 1 -- 172.21.15.133:0/1057020175 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f75cc0b42c0 msgr2=0x7f75cc1f3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:22.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.024+0000 7f75caa00640 1 --2- 172.21.15.133:0/1057020175 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f75cc0b42c0 0x7f75cc1f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.024+0000 7f75caa00640 1 -- 172.21.15.133:0/1057020175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75cc15b9c0 msgr2=0x7f75cc158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:22.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.024+0000 7f75caa00640 1 --2- 172.21.15.133:0/1057020175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75cc15b9c0 0x7f75cc158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.024+0000 7f75caa00640 1 -- 172.21.15.133:0/1057020175 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c4009a70 con 0x7f75cc0ccd00 2024-03-30T01:53:22.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.024+0000 7f75caa00640 1 --2- 172.21.15.133:0/1057020175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75cc0ccd00 0x7f75cc1584c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f75b800c530 tx=0x7f75b800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:22.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.024+0000 7f75c3400640 1 -- 172.21.15.133:0/1057020175 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b8005ce0 con 0x7f75cc0ccd00 2024-03-30T01:53:22.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.025+0000 7f75c3400640 1 -- 172.21.15.133:0/1057020175 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b8005e40 con 0x7f75cc0ccd00 2024-03-30T01:53:22.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.025+0000 7f75c3400640 1 -- 172.21.15.133:0/1057020175 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b80072b0 con 0x7f75cc0ccd00 2024-03-30T01:53:22.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.025+0000 7f75d1200640 1 -- 172.21.15.133:0/1057020175 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75cc1f3880 con 0x7f75cc0ccd00 2024-03-30T01:53:22.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.025+0000 7f75d1200640 1 -- 172.21.15.133:0/1057020175 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75cc155c00 con 0x7f75cc0ccd00 2024-03-30T01:53:22.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.026+0000 7f75d1200640 1 -- 172.21.15.133:0/1057020175 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75cc073750 con 0x7f75cc0ccd00 2024-03-30T01:53:22.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.027+0000 7f75c3400640 1 -- 172.21.15.133:0/1057020175 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f75b8007410 con 0x7f75cc0ccd00 2024-03-30T01:53:22.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.028+0000 7f75c3400640 1 --2- 172.21.15.133:0/1057020175 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f75ac06ac00 0x7f75ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:22.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.028+0000 7f75c3400640 1 -- 172.21.15.133:0/1057020175 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f75b8088640 con 0x7f75cc0ccd00 2024-03-30T01:53:22.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.028+0000 7f75cb400640 1 --2- 172.21.15.133:0/1057020175 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f75ac06ac00 0x7f75ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:22.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.029+0000 7f75cb400640 1 --2- 172.21.15.133:0/1057020175 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f75ac06ac00 0x7f75ac06d0c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f75bc000f60 tx=0x7f75bc0079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:22.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.032+0000 7f75c3400640 1 -- 172.21.15.133:0/1057020175 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f75b8053c10 con 0x7f75cc0ccd00 2024-03-30T01:53:22.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.226+0000 7f75d1200640 1 -- 172.21.15.133:0/1057020175 --> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f75cc140260 con 0x7f75ac06ac00 2024-03-30T01:53:22.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.227+0000 7f75c3400640 1 -- 172.21.15.133:0/1057020175 <== mgr.4105 v2:172.21.15.133:6832/37234 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f75bc005080 con 0x7f75ac06ac00 2024-03-30T01:53:22.233 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 5 to deep-scrub 2024-03-30T01:53:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.229+0000 7f75d1200640 1 -- 172.21.15.133:0/1057020175 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f75ac06ac00 msgr2=0x7f75ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.229+0000 7f75d1200640 1 --2- 172.21.15.133:0/1057020175 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f75ac06ac00 0x7f75ac06d0c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f75bc000f60 tx=0x7f75bc0079b0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.229+0000 7f75d1200640 1 -- 172.21.15.133:0/1057020175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75cc0ccd00 msgr2=0x7f75cc1584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.230+0000 7f75d1200640 1 --2- 172.21.15.133:0/1057020175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75cc0ccd00 0x7f75cc1584c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f75b800c530 tx=0x7f75b800c9f0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.230+0000 7f75d1200640 1 -- 172.21.15.133:0/1057020175 shutdown_connections 2024-03-30T01:53:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.230+0000 7f75d1200640 1 --2- 172.21.15.133:0/1057020175 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f75ac06ac00 0x7f75ac06d0c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.230+0000 7f75d1200640 1 --2- 172.21.15.133:0/1057020175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75cc15b9c0 0x7f75cc158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.230+0000 7f75d1200640 1 --2- 172.21.15.133:0/1057020175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75cc0ccd00 0x7f75cc1584c0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.230+0000 7f75d1200640 1 --2- 172.21.15.133:0/1057020175 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f75cc0b42c0 0x7f75cc1f3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.230+0000 7f75d1200640 1 -- 172.21.15.133:0/1057020175 >> 172.21.15.133:0/1057020175 conn(0x7f75cc0b05a0 msgr2=0x7f75cc0b3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:22.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.230+0000 7f75d1200640 1 -- 172.21.15.133:0/1057020175 shutdown_connections 2024-03-30T01:53:22.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.230+0000 7f75d1200640 1 -- 172.21.15.133:0/1057020175 wait complete. 2024-03-30T01:53:22.254 INFO:tasks.ceph:Scrubbing osd.6 2024-03-30T01:53:22.254 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-30T01:53:22.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.457+0000 7f18cea00640 1 Processor -- start 2024-03-30T01:53:22.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.457+0000 7f18cea00640 1 -- start start 2024-03-30T01:53:22.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.459+0000 7f18cea00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18c8160290 0x7f18c80b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:22.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.459+0000 7f18cea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18c80b4710 0x7f18c80b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:22.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.459+0000 7f18cea00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18c80b50e0 con 0x7f18c81607f0 2024-03-30T01:53:22.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.459+0000 7f18cea00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c80b6020 con 0x7f18c8160290 2024-03-30T01:53:22.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.459+0000 7f18cea00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c80d2a60 con 0x7f18c80b4710 2024-03-30T01:53:22.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.459+0000 7f18c7e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18c8160290 0x7f18c80b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:22.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.459+0000 7f18c7e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18c8160290 0x7f18c80b5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36134/0 (socket says 172.21.15.133:36134) 2024-03-30T01:53:22.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.459+0000 7f18c7400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f18c81607f0 0x7f18c80d2350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49544/0 (socket says 172.21.15.133:49544) 2024-03-30T01:53:22.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.459+0000 7f18c7e00640 1 -- 172.21.15.133:0/123113031 learned_addr learned my addr 172.21.15.133:0/123113031 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:22.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.459+0000 7f18cca00640 1 --2- 172.21.15.133:0/123113031 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18c80b4710 0x7f18c80b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:22.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.459+0000 7f18c7e00640 1 -- 172.21.15.133:0/123113031 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18c80b4710 msgr2=0x7f18c80b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:22.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.460+0000 7f18c7e00640 1 --2- 172.21.15.133:0/123113031 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18c80b4710 0x7f18c80b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.460+0000 7f18c7e00640 1 -- 172.21.15.133:0/123113031 >> v1:172.21.15.133:6789/0 conn(0x7f18c81607f0 legacy=0x7f18c80d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:22.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.460+0000 7f18c7e00640 1 -- 172.21.15.133:0/123113031 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c8160c80 con 0x7f18c8160290 2024-03-30T01:53:22.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.461+0000 7f18c7e00640 1 --2- 172.21.15.133:0/123113031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18c8160290 0x7f18c80b5ae0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f18b8009e50 tx=0x7f18b802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d745b36ae4ff32d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:22.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.461+0000 7f18c6a00640 1 -- 172.21.15.133:0/123113031 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b802ca80 con 0x7f18c8160290 2024-03-30T01:53:22.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.461+0000 7f18c6a00640 1 -- 172.21.15.133:0/123113031 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b802cbe0 con 0x7f18c8160290 2024-03-30T01:53:22.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.461+0000 7f18c6a00640 1 -- 172.21.15.133:0/123113031 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b80343f0 con 0x7f18c8160290 2024-03-30T01:53:22.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.461+0000 7f18cea00640 1 -- 172.21.15.133:0/123113031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18c8160290 msgr2=0x7f18c80b5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:22.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.461+0000 7f18cea00640 1 --2- 172.21.15.133:0/123113031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18c8160290 0x7f18c80b5ae0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f18b8009e50 tx=0x7f18b802bee0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.462+0000 7f18cea00640 1 -- 172.21.15.133:0/123113031 shutdown_connections 2024-03-30T01:53:22.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.462+0000 7f18cea00640 1 --2- 172.21.15.133:0/123113031 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18c80b4710 0x7f18c80b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.462+0000 7f18cea00640 1 --2- 172.21.15.133:0/123113031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18c8160290 0x7f18c80b5ae0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.462+0000 7f18cea00640 1 -- 172.21.15.133:0/123113031 >> 172.21.15.133:0/123113031 conn(0x7f18c8071a70 msgr2=0x7f18c80cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:22.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.462+0000 7f18cea00640 1 -- 172.21.15.133:0/123113031 shutdown_connections 2024-03-30T01:53:22.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.462+0000 7f18cea00640 1 -- 172.21.15.133:0/123113031 wait complete. 2024-03-30T01:53:22.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.463+0000 7f18cea00640 1 Processor -- start 2024-03-30T01:53:22.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.464+0000 7f18cea00640 1 -- start start 2024-03-30T01:53:22.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.464+0000 7f18cea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18c80b4710 0x7f18c81f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:22.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.464+0000 7f18cea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18c8160290 0x7f18c815aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:22.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.464+0000 7f18cea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18c8072ec0 0x7f18c8073330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:22.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.464+0000 7f18cea00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c8073870 con 0x7f18c8160290 2024-03-30T01:53:22.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.465+0000 7f18cea00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c815d200 con 0x7f18c8072ec0 2024-03-30T01:53:22.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.465+0000 7f18cea00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c80c7fd0 con 0x7f18c80b4710 2024-03-30T01:53:22.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.465+0000 7f18c7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18c8160290 0x7f18c815aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:22.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.465+0000 7f18c7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18c8160290 0x7f18c815aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36146/0 (socket says 172.21.15.133:36146) 2024-03-30T01:53:22.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.465+0000 7f18c7400640 1 -- 172.21.15.133:0/2335681339 learned_addr learned my addr 172.21.15.133:0/2335681339 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:22.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.465+0000 7f18c7e00640 1 --2- 172.21.15.133:0/2335681339 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18c80b4710 0x7f18c81f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:22.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.465+0000 7f18cca00640 1 --2- 172.21.15.133:0/2335681339 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18c8072ec0 0x7f18c8073330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:22.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.465+0000 7f18c7400640 1 -- 172.21.15.133:0/2335681339 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18c80b4710 msgr2=0x7f18c81f39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:22.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.465+0000 7f18c7400640 1 --2- 172.21.15.133:0/2335681339 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18c80b4710 0x7f18c81f39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.465+0000 7f18c7400640 1 -- 172.21.15.133:0/2335681339 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18c8072ec0 msgr2=0x7f18c8073330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:22.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.465+0000 7f18c7400640 1 --2- 172.21.15.133:0/2335681339 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18c8072ec0 0x7f18c8073330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.465+0000 7f18c7400640 1 -- 172.21.15.133:0/2335681339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b8009b30 con 0x7f18c8160290 2024-03-30T01:53:22.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.465+0000 7f18c7400640 1 --2- 172.21.15.133:0/2335681339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18c8160290 0x7f18c815aef0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f18b400c3e0 tx=0x7f18b400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:22.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.466+0000 7f18bfe00640 1 -- 172.21.15.133:0/2335681339 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b40074e0 con 0x7f18c8160290 2024-03-30T01:53:22.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.466+0000 7f18bfe00640 1 -- 172.21.15.133:0/2335681339 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b4007640 con 0x7f18c8160290 2024-03-30T01:53:22.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.466+0000 7f18bfe00640 1 -- 172.21.15.133:0/2335681339 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b40049e0 con 0x7f18c8160290 2024-03-30T01:53:22.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.466+0000 7f18cea00640 1 -- 172.21.15.133:0/2335681339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c815d450 con 0x7f18c8160290 2024-03-30T01:53:22.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.466+0000 7f18cea00640 1 -- 172.21.15.133:0/2335681339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c815da10 con 0x7f18c8160290 2024-03-30T01:53:22.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.467+0000 7f18cea00640 1 -- 172.21.15.133:0/2335681339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f18c8161520 con 0x7f18c8160290 2024-03-30T01:53:22.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.468+0000 7f18bfe00640 1 -- 172.21.15.133:0/2335681339 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f18b4004b40 con 0x7f18c8160290 2024-03-30T01:53:22.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.469+0000 7f18bfe00640 1 --2- 172.21.15.133:0/2335681339 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f18a806ac00 0x7f18a806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:22.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.469+0000 7f18bfe00640 1 -- 172.21.15.133:0/2335681339 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f18b4088a90 con 0x7f18c8160290 2024-03-30T01:53:22.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.469+0000 7f18c7e00640 1 --2- 172.21.15.133:0/2335681339 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f18a806ac00 0x7f18a806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:22.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.469+0000 7f18bfe00640 1 --2- 172.21.15.133:0/2335681339 >> [v2:172.21.15.137:6824/37271,v1:172.21.15.137:6825/37271] conn(0x7f18a8070b00 0x7f18a8072f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:22.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.469+0000 7f18bfe00640 1 -- 172.21.15.133:0/2335681339 --> [v2:172.21.15.137:6824/37271,v1:172.21.15.137:6825/37271] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f18a80735d0 con 0x7f18a8070b00 2024-03-30T01:53:22.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.469+0000 7f18bfe00640 1 -- 172.21.15.133:0/2335681339 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18b408d2a0 con 0x7f18c8160290 2024-03-30T01:53:22.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.470+0000 7f18c7e00640 1 --2- 172.21.15.133:0/2335681339 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f18a806ac00 0x7f18a806d0c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f18b8035000 tx=0x7f18b8030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:22.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.470+0000 7f18cca00640 1 --2- 172.21.15.133:0/2335681339 >> [v2:172.21.15.137:6824/37271,v1:172.21.15.137:6825/37271] conn(0x7f18a8070b00 0x7f18a8072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:22.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.471+0000 7f18cca00640 1 --2- 172.21.15.133:0/2335681339 >> [v2:172.21.15.137:6824/37271,v1:172.21.15.137:6825/37271] conn(0x7f18a8070b00 0x7f18a8072f20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:22.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.473+0000 7f18bfe00640 1 -- 172.21.15.133:0/2335681339 <== osd.6 v2:172.21.15.137:6824/37271 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f18a80735d0 con 0x7f18a8070b00 2024-03-30T01:53:22.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.486+0000 7f18cea00640 1 -- 172.21.15.133:0/2335681339 --> [v2:172.21.15.137:6824/37271,v1:172.21.15.137:6825/37271] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f18c8161240 con 0x7f18a8070b00 2024-03-30T01:53:22.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.487+0000 7f18bfe00640 1 -- 172.21.15.133:0/2335681339 <== osd.6 v2:172.21.15.137:6824/37271 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f18c0009400 con 0x7f18a8070b00 2024-03-30T01:53:22.493 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-03-30T01:53:22.494 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T01:53:22.494 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-03-30T01:53:22.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.488+0000 7f18cea00640 1 -- 172.21.15.133:0/2335681339 >> [v2:172.21.15.137:6824/37271,v1:172.21.15.137:6825/37271] conn(0x7f18a8070b00 msgr2=0x7f18a8072f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:22.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.488+0000 7f18cea00640 1 --2- 172.21.15.133:0/2335681339 >> [v2:172.21.15.137:6824/37271,v1:172.21.15.137:6825/37271] conn(0x7f18a8070b00 0x7f18a8072f20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.488+0000 7f18cea00640 1 -- 172.21.15.133:0/2335681339 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f18a806ac00 msgr2=0x7f18a806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:22.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.488+0000 7f18cea00640 1 --2- 172.21.15.133:0/2335681339 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f18a806ac00 0x7f18a806d0c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f18b8035000 tx=0x7f18b8030000 comp rx=0 tx=0).stop 2024-03-30T01:53:22.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.488+0000 7f18cea00640 1 -- 172.21.15.133:0/2335681339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18c8160290 msgr2=0x7f18c815aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:22.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.488+0000 7f18cea00640 1 --2- 172.21.15.133:0/2335681339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18c8160290 0x7f18c815aef0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f18b400c3e0 tx=0x7f18b400c8a0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.488+0000 7f18cca00640 1 -- 172.21.15.133:0/2335681339 reap_dead start 2024-03-30T01:53:22.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.488+0000 7f18cea00640 1 -- 172.21.15.133:0/2335681339 shutdown_connections 2024-03-30T01:53:22.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.488+0000 7f18cea00640 1 -- 172.21.15.133:0/2335681339 >> 172.21.15.133:0/2335681339 conn(0x7f18c8071a70 msgr2=0x7f18c80d2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:22.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.488+0000 7f18cea00640 1 -- 172.21.15.133:0/2335681339 shutdown_connections 2024-03-30T01:53:22.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.488+0000 7f18cea00640 1 -- 172.21.15.133:0/2335681339 wait complete. 2024-03-30T01:53:22.512 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-30T01:53:22.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.713+0000 7faeaa800640 1 Processor -- start 2024-03-30T01:53:22.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.713+0000 7faeaa800640 1 -- start start 2024-03-30T01:53:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.715+0000 7faeaa800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faea4143220 0x7faea40cd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.715+0000 7faeaa800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea40ce400 con 0x7faea4070c10 2024-03-30T01:53:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.715+0000 7faeaa800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea406d0e0 con 0x7faea406e2e0 2024-03-30T01:53:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.715+0000 7faeaa800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea40cc5c0 con 0x7faea4143220 2024-03-30T01:53:22.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.715+0000 7faea3e00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7faea4070c10 0x7faea415d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49546/0 (socket says 172.21.15.133:49546) 2024-03-30T01:53:22.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.715+0000 7faea3e00640 1 -- 172.21.15.133:0/339607123 learned_addr learned my addr 172.21.15.133:0/339607123 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:22.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.716+0000 7faea3400640 1 --2- 172.21.15.133:0/339607123 >> v2:172.21.15.137:3300/0 conn(0x7faea4143220 0x7faea40cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:22.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.716+0000 7faea2a00640 1 -- 172.21.15.133:0/339607123 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839575806 0 0) 0x7faea40ce400 con 0x7faea4070c10 2024-03-30T01:53:22.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.716+0000 7faea2a00640 1 -- 172.21.15.133:0/339607123 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae88003520 con 0x7faea4070c10 2024-03-30T01:53:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.716+0000 7faea2a00640 1 -- 172.21.15.133:0/339607123 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1357394326 0 0) 0x7fae88003520 con 0x7faea4070c10 2024-03-30T01:53:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.716+0000 7faea2a00640 1 -- 172.21.15.133:0/339607123 >> v2:172.21.15.137:3300/0 conn(0x7faea4143220 msgr2=0x7faea40cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.716+0000 7faea2a00640 1 --2- 172.21.15.133:0/339607123 >> v2:172.21.15.137:3300/0 conn(0x7faea4143220 0x7faea40cd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.716+0000 7faea2a00640 1 -- 172.21.15.133:0/339607123 >> v1:172.21.15.137:6789/0 conn(0x7faea406e2e0 legacy=0x7faea4070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.716+0000 7faea2a00640 1 -- 172.21.15.133:0/339607123 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea406d3c0 con 0x7faea4070c10 2024-03-30T01:53:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.716+0000 7faea2a00640 1 -- 172.21.15.133:0/339607123 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7fae9c0019f0 con 0x7faea4070c10 2024-03-30T01:53:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.716+0000 7faea2a00640 1 -- 172.21.15.133:0/339607123 >> v1:172.21.15.133:6789/0 conn(0x7faea4070c10 legacy=0x7faea415d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.716+0000 7faea2a00640 1 --2- 172.21.15.133:0/339607123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae88003970 0x7fae88003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.716+0000 7faea2a00640 1 --2- 172.21.15.133:0/339607123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae880047c0 0x7fae88004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.717+0000 7faea2a00640 1 --2- 172.21.15.133:0/339607123 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae88005180 0x7fae8800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.717+0000 7faea2a00640 1 -- 172.21.15.133:0/339607123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8800bff0 con 0x7fae880047c0 2024-03-30T01:53:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.717+0000 7faea2a00640 1 -- 172.21.15.133:0/339607123 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8800c160 con 0x7fae88003970 2024-03-30T01:53:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.717+0000 7faea2a00640 1 -- 172.21.15.133:0/339607123 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8800c320 con 0x7fae88005180 2024-03-30T01:53:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.717+0000 7fae9be00640 1 --2- 172.21.15.133:0/339607123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae880047c0 0x7fae88004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.717+0000 7faea3400640 1 --2- 172.21.15.133:0/339607123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae88003970 0x7fae88003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.717+0000 7faea3e00640 1 --2- 172.21.15.133:0/339607123 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae88005180 0x7fae8800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.717+0000 7fae9be00640 1 -- 172.21.15.133:0/339607123 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae88005180 msgr2=0x7fae8800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.717+0000 7fae9be00640 1 --2- 172.21.15.133:0/339607123 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae88005180 0x7fae8800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.717+0000 7fae9be00640 1 -- 172.21.15.133:0/339607123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae88003970 msgr2=0x7fae88003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.717+0000 7fae9be00640 1 --2- 172.21.15.133:0/339607123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae88003970 0x7fae88003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.717+0000 7fae9be00640 1 -- 172.21.15.133:0/339607123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae88003520 con 0x7fae880047c0 2024-03-30T01:53:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.717+0000 7faea3e00640 1 --2- 172.21.15.133:0/339607123 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae88005180 0x7fae8800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.718+0000 7faea3e00640 1 -- 172.21.15.133:0/339607123 reap_dead start 2024-03-30T01:53:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.718+0000 7fae9be00640 1 --2- 172.21.15.133:0/339607123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae880047c0 0x7fae88004c40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fae8c001750 tx=0x7fae880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb494b2624a739ee server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.719+0000 7faea2a00640 1 -- 172.21.15.133:0/339607123 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c0052d0 con 0x7fae880047c0 2024-03-30T01:53:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.719+0000 7faea2a00640 1 -- 172.21.15.133:0/339607123 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8c02e050 con 0x7fae880047c0 2024-03-30T01:53:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.719+0000 7faea2a00640 1 -- 172.21.15.133:0/339607123 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c003830 con 0x7fae880047c0 2024-03-30T01:53:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.719+0000 7faeaa800640 1 -- 172.21.15.133:0/339607123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae880047c0 msgr2=0x7fae88004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.719+0000 7faeaa800640 1 --2- 172.21.15.133:0/339607123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae880047c0 0x7fae88004c40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fae8c001750 tx=0x7fae880057f0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.719+0000 7faeaa800640 1 -- 172.21.15.133:0/339607123 shutdown_connections 2024-03-30T01:53:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.719+0000 7faeaa800640 1 --2- 172.21.15.133:0/339607123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae880047c0 0x7fae88004c40 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.719+0000 7faeaa800640 1 -- 172.21.15.133:0/339607123 >> 172.21.15.133:0/339607123 conn(0x7faea40b07a0 msgr2=0x7faea40b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.720+0000 7faeaa800640 1 -- 172.21.15.133:0/339607123 shutdown_connections 2024-03-30T01:53:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.720+0000 7faeaa800640 1 -- 172.21.15.133:0/339607123 wait complete. 2024-03-30T01:53:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.721+0000 7faeaa800640 1 Processor -- start 2024-03-30T01:53:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.721+0000 7faeaa800640 1 -- start start 2024-03-30T01:53:22.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.722+0000 7faeaa800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae880047c0 0x7faea415a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.722+0000 7faeaa800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faea40ca3c0 0x7faea40ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.722+0000 7faeaa800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faea40c7f60 0x7faea40c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.722+0000 7faeaa800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea412f070 con 0x7fae880047c0 2024-03-30T01:53:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.722+0000 7faeaa800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea412e110 con 0x7faea40ca3c0 2024-03-30T01:53:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.722+0000 7faeaa800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea412e3f0 con 0x7faea40c7f60 2024-03-30T01:53:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.723+0000 7faea3400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae880047c0 0x7faea415a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.723+0000 7faea3400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae880047c0 0x7faea415a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36158/0 (socket says 172.21.15.133:36158) 2024-03-30T01:53:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.723+0000 7faea3400640 1 -- 172.21.15.133:0/1542314537 learned_addr learned my addr 172.21.15.133:0/1542314537 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:22.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.723+0000 7faea3e00640 1 --2- 172.21.15.133:0/1542314537 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faea40c7f60 0x7faea40c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:22.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.723+0000 7faea3400640 1 -- 172.21.15.133:0/1542314537 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faea40c7f60 msgr2=0x7faea40c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.723+0000 7faea3400640 1 --2- 172.21.15.133:0/1542314537 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faea40c7f60 0x7faea40c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.723+0000 7faea3400640 1 -- 172.21.15.133:0/1542314537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faea40ca3c0 msgr2=0x7faea40ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.723+0000 7faea3400640 1 --2- 172.21.15.133:0/1542314537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faea40ca3c0 0x7faea40ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.723+0000 7faea3400640 1 -- 172.21.15.133:0/1542314537 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea412e6d0 con 0x7fae880047c0 2024-03-30T01:53:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.723+0000 7faea3e00640 1 --2- 172.21.15.133:0/1542314537 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faea40c7f60 0x7faea40c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.723+0000 7faea3400640 1 --2- 172.21.15.133:0/1542314537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae880047c0 0x7faea415a060 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fae940116d0 tx=0x7fae94011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.724+0000 7fae9b400640 1 -- 172.21.15.133:0/1542314537 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9400f9c0 con 0x7fae880047c0 2024-03-30T01:53:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.724+0000 7fae9b400640 1 -- 172.21.15.133:0/1542314537 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9400fb20 con 0x7fae880047c0 2024-03-30T01:53:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.724+0000 7fae9b400640 1 -- 172.21.15.133:0/1542314537 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9400fe90 con 0x7fae880047c0 2024-03-30T01:53:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.724+0000 7faeaa800640 1 -- 172.21.15.133:0/1542314537 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea412e9b0 con 0x7fae880047c0 2024-03-30T01:53:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.724+0000 7faeaa800640 1 -- 172.21.15.133:0/1542314537 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea415a5a0 con 0x7fae880047c0 2024-03-30T01:53:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.725+0000 7faeaa800640 1 -- 172.21.15.133:0/1542314537 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea412c1b0 con 0x7fae880047c0 2024-03-30T01:53:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.726+0000 7fae9b400640 1 -- 172.21.15.133:0/1542314537 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fae94015460 con 0x7fae880047c0 2024-03-30T01:53:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.727+0000 7fae9b400640 1 --2- 172.21.15.133:0/1542314537 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fae8006ac00 0x7fae8006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.727+0000 7fae9b400640 1 -- 172.21.15.133:0/1542314537 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fae94089680 con 0x7fae880047c0 2024-03-30T01:53:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.727+0000 7fae9be00640 1 --2- 172.21.15.133:0/1542314537 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fae8006ac00 0x7fae8006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.728+0000 7fae9be00640 1 --2- 172.21.15.133:0/1542314537 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fae8006ac00 0x7fae8006d0c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fae8c033000 tx=0x7fae8c02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:22.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.731+0000 7fae9b400640 1 -- 172.21.15.133:0/1542314537 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fae94054b00 con 0x7fae880047c0 2024-03-30T01:53:22.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.924+0000 7faeaa800640 1 -- 172.21.15.133:0/1542314537 --> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7faea4143600 con 0x7fae8006ac00 2024-03-30T01:53:22.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.924+0000 7fae9b400640 1 -- 172.21.15.133:0/1542314537 <== mgr.4105 v2:172.21.15.133:6832/37234 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fae8c0052c0 con 0x7fae8006ac00 2024-03-30T01:53:22.931 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 6 to deep-scrub 2024-03-30T01:53:22.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.927+0000 7faeaa800640 1 -- 172.21.15.133:0/1542314537 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fae8006ac00 msgr2=0x7fae8006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:22.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.927+0000 7faeaa800640 1 --2- 172.21.15.133:0/1542314537 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fae8006ac00 0x7fae8006d0c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fae8c033000 tx=0x7fae8c02f000 comp rx=0 tx=0).stop 2024-03-30T01:53:22.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.927+0000 7faeaa800640 1 -- 172.21.15.133:0/1542314537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae880047c0 msgr2=0x7faea415a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.927+0000 7faeaa800640 1 --2- 172.21.15.133:0/1542314537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae880047c0 0x7faea415a060 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fae940116d0 tx=0x7fae94011b90 comp rx=0 tx=0).stop 2024-03-30T01:53:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.927+0000 7faeaa800640 1 -- 172.21.15.133:0/1542314537 shutdown_connections 2024-03-30T01:53:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.927+0000 7faeaa800640 1 --2- 172.21.15.133:0/1542314537 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fae8006ac00 0x7fae8006d0c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.927+0000 7faeaa800640 1 --2- 172.21.15.133:0/1542314537 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faea40c7f60 0x7faea40c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.927+0000 7faeaa800640 1 --2- 172.21.15.133:0/1542314537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faea40ca3c0 0x7faea40ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.927+0000 7faeaa800640 1 --2- 172.21.15.133:0/1542314537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae880047c0 0x7faea415a060 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.927+0000 7faeaa800640 1 -- 172.21.15.133:0/1542314537 >> 172.21.15.133:0/1542314537 conn(0x7faea40b07a0 msgr2=0x7faea40cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.927+0000 7faeaa800640 1 -- 172.21.15.133:0/1542314537 shutdown_connections 2024-03-30T01:53:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:22.928+0000 7faeaa800640 1 -- 172.21.15.133:0/1542314537 wait complete. 2024-03-30T01:53:22.950 INFO:tasks.ceph:Scrubbing osd.7 2024-03-30T01:53:22.950 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-30T01:53:23.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.152+0000 7effce400640 1 Processor -- start 2024-03-30T01:53:23.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.152+0000 7effce400640 1 -- start start 2024-03-30T01:53:23.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.153+0000 7effce400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effc815a9f0 0x7effc80b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:23.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.154+0000 7effce400640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc80b0810 con 0x7effc815add0 2024-03-30T01:53:23.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.154+0000 7effce400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc80b0af0 con 0x7effc8098c20 2024-03-30T01:53:23.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.154+0000 7effce400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc80b1490 con 0x7effc815a9f0 2024-03-30T01:53:23.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.154+0000 7effc6a00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7effc815add0 0x7effc80b18b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49562/0 (socket says 172.21.15.133:49562) 2024-03-30T01:53:23.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.154+0000 7effc6a00640 1 -- 172.21.15.133:0/3611701938 learned_addr learned my addr 172.21.15.133:0/3611701938 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:23.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.154+0000 7effc7400640 1 --2- 172.21.15.133:0/3611701938 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effc815a9f0 0x7effc80b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.155+0000 7effc6000640 1 -- 172.21.15.133:0/3611701938 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540834089 0 0) 0x7effc80b0810 con 0x7effc815add0 2024-03-30T01:53:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.155+0000 7effc6000640 1 -- 172.21.15.133:0/3611701938 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effa8003520 con 0x7effc815add0 2024-03-30T01:53:23.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.155+0000 7effc6000640 1 -- 172.21.15.133:0/3611701938 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2794262892 0 0) 0x7effa8003520 con 0x7effc815add0 2024-03-30T01:53:23.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.155+0000 7effc6000640 1 -- 172.21.15.133:0/3611701938 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effc815a9f0 msgr2=0x7effc80b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.155+0000 7effc6000640 1 --2- 172.21.15.133:0/3611701938 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effc815a9f0 0x7effc80b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.155+0000 7effc6000640 1 -- 172.21.15.133:0/3611701938 >> v1:172.21.15.137:6789/0 conn(0x7effc8098c20 legacy=0x7effc80adec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.155+0000 7effc6000640 1 -- 172.21.15.133:0/3611701938 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc80b0dd0 con 0x7effc815add0 2024-03-30T01:53:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.155+0000 7effc6000640 1 -- 172.21.15.133:0/3611701938 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7effb0001670 con 0x7effc815add0 2024-03-30T01:53:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.155+0000 7effc6000640 1 -- 172.21.15.133:0/3611701938 >> v1:172.21.15.133:6789/0 conn(0x7effc815add0 legacy=0x7effc80b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.155+0000 7effc6000640 1 --2- 172.21.15.133:0/3611701938 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effc815a9f0 0x7effa80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.155+0000 7effc6000640 1 --2- 172.21.15.133:0/3611701938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effa8003f20 0x7effa80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.155+0000 7effc6000640 1 --2- 172.21.15.133:0/3611701938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effa8004d00 0x7effa8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.155+0000 7effc6000640 1 -- 172.21.15.133:0/3611701938 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc80b1490 con 0x7effa8003f20 2024-03-30T01:53:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.155+0000 7effc6000640 1 -- 172.21.15.133:0/3611701938 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa800ba60 con 0x7effa8004d00 2024-03-30T01:53:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.155+0000 7effc6000640 1 -- 172.21.15.133:0/3611701938 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa800bc20 con 0x7effc815a9f0 2024-03-30T01:53:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.155+0000 7effc6a00640 1 --2- 172.21.15.133:0/3611701938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effa8003f20 0x7effa80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.156+0000 7effc7400640 1 --2- 172.21.15.133:0/3611701938 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effc815a9f0 0x7effa80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.156+0000 7effc7e00640 1 --2- 172.21.15.133:0/3611701938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effa8004d00 0x7effa8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.156+0000 7effc6a00640 1 -- 172.21.15.133:0/3611701938 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effc815a9f0 msgr2=0x7effa80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.156+0000 7effc6a00640 1 --2- 172.21.15.133:0/3611701938 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effc815a9f0 0x7effa80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.156+0000 7effc6a00640 1 -- 172.21.15.133:0/3611701938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effa8004d00 msgr2=0x7effa8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.156+0000 7effc6a00640 1 --2- 172.21.15.133:0/3611701938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effa8004d00 0x7effa8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.156+0000 7effc6a00640 1 -- 172.21.15.133:0/3611701938 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa8003520 con 0x7effa8003f20 2024-03-30T01:53:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.156+0000 7effc7400640 1 --2- 172.21.15.133:0/3611701938 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effc815a9f0 0x7effa80039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.157+0000 7effc6a00640 1 --2- 172.21.15.133:0/3611701938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effa8003f20 0x7effa80047c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7effb000c210 tx=0x7effa80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6d4f374723c25c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.157+0000 7effc6000640 1 -- 172.21.15.133:0/3611701938 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb0005ad0 con 0x7effa8003f20 2024-03-30T01:53:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.157+0000 7effc6000640 1 -- 172.21.15.133:0/3611701938 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb0005c50 con 0x7effa8003f20 2024-03-30T01:53:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.157+0000 7effc6000640 1 -- 172.21.15.133:0/3611701938 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb002c890 con 0x7effa8003f20 2024-03-30T01:53:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.158+0000 7effce400640 1 -- 172.21.15.133:0/3611701938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effa8003f20 msgr2=0x7effa80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.158+0000 7effce400640 1 --2- 172.21.15.133:0/3611701938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effa8003f20 0x7effa80047c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7effb000c210 tx=0x7effa80057f0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.158+0000 7effc7e00640 1 -- 172.21.15.133:0/3611701938 reap_dead start 2024-03-30T01:53:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.158+0000 7effce400640 1 -- 172.21.15.133:0/3611701938 shutdown_connections 2024-03-30T01:53:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.158+0000 7effce400640 1 -- 172.21.15.133:0/3611701938 >> 172.21.15.133:0/3611701938 conn(0x7effc80b5fb0 msgr2=0x7effc80b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.158+0000 7effce400640 1 -- 172.21.15.133:0/3611701938 shutdown_connections 2024-03-30T01:53:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.158+0000 7effce400640 1 -- 172.21.15.133:0/3611701938 wait complete. 2024-03-30T01:53:23.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.160+0000 7effce400640 1 Processor -- start 2024-03-30T01:53:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.160+0000 7effce400640 1 -- start start 2024-03-30T01:53:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.161+0000 7effce400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effa8003f20 0x7effc81f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.161+0000 7effce400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effc8156b70 0x7effc81507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.161+0000 7effce400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effc8152210 0x7effc8152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.161+0000 7effce400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc80b1fc0 con 0x7effa8003f20 2024-03-30T01:53:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.161+0000 7effce400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc8152bd0 con 0x7effc8156b70 2024-03-30T01:53:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.161+0000 7effce400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc8151020 con 0x7effc8152210 2024-03-30T01:53:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.161+0000 7effc7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effa8003f20 0x7effc81f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.161+0000 7effc7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effa8003f20 0x7effc81f2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36176/0 (socket says 172.21.15.133:36176) 2024-03-30T01:53:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.161+0000 7effc7400640 1 -- 172.21.15.133:0/4249575288 learned_addr learned my addr 172.21.15.133:0/4249575288 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.161+0000 7effc6a00640 1 --2- 172.21.15.133:0/4249575288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effc8156b70 0x7effc81507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.161+0000 7effc7400640 1 -- 172.21.15.133:0/4249575288 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effc8152210 msgr2=0x7effc8152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.161+0000 7effc7e00640 1 --2- 172.21.15.133:0/4249575288 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effc8152210 0x7effc8152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.162+0000 7effc7400640 1 --2- 172.21.15.133:0/4249575288 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effc8152210 0x7effc8152690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.162+0000 7effc7400640 1 -- 172.21.15.133:0/4249575288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effc8156b70 msgr2=0x7effc81507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.162+0000 7effc7400640 1 --2- 172.21.15.133:0/4249575288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effc8156b70 0x7effc81507d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.162+0000 7effc7400640 1 -- 172.21.15.133:0/4249575288 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc8151300 con 0x7effa8003f20 2024-03-30T01:53:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.162+0000 7effc7400640 1 --2- 172.21.15.133:0/4249575288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effa8003f20 0x7effc81f2800 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7effb80108b0 tx=0x7effb8010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.162+0000 7effbf400640 1 -- 172.21.15.133:0/4249575288 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb800eb00 con 0x7effa8003f20 2024-03-30T01:53:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.162+0000 7effbf400640 1 -- 172.21.15.133:0/4249575288 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb800ec60 con 0x7effa8003f20 2024-03-30T01:53:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.162+0000 7effce400640 1 -- 172.21.15.133:0/4249575288 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc81515e0 con 0x7effa8003f20 2024-03-30T01:53:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.162+0000 7effbf400640 1 -- 172.21.15.133:0/4249575288 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb801c400 con 0x7effa8003f20 2024-03-30T01:53:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.162+0000 7effce400640 1 -- 172.21.15.133:0/4249575288 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc8151ba0 con 0x7effa8003f20 2024-03-30T01:53:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.163+0000 7effce400640 1 -- 172.21.15.133:0/4249575288 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7effc809a1f0 con 0x7effa8003f20 2024-03-30T01:53:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.164+0000 7effbf400640 1 -- 172.21.15.133:0/4249575288 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7effb801c560 con 0x7effa8003f20 2024-03-30T01:53:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.165+0000 7effbf400640 1 --2- 172.21.15.133:0/4249575288 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7effa406ac00 0x7effa406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.165+0000 7effbf400640 1 -- 172.21.15.133:0/4249575288 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7effb80896f0 con 0x7effa8003f20 2024-03-30T01:53:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.166+0000 7effc6a00640 1 --2- 172.21.15.133:0/4249575288 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7effa406ac00 0x7effa406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.166+0000 7effbf400640 1 --2- 172.21.15.133:0/4249575288 >> [v2:172.21.15.137:6816/37250,v1:172.21.15.137:6817/37250] conn(0x7effa4070b00 0x7effa4072f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.166+0000 7effbf400640 1 -- 172.21.15.133:0/4249575288 --> [v2:172.21.15.137:6816/37250,v1:172.21.15.137:6817/37250] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7effa40735d0 con 0x7effa4070b00 2024-03-30T01:53:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.166+0000 7effbf400640 1 -- 172.21.15.133:0/4249575288 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7effb808bd80 con 0x7effa8003f20 2024-03-30T01:53:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.166+0000 7effc7e00640 1 --2- 172.21.15.133:0/4249575288 >> [v2:172.21.15.137:6816/37250,v1:172.21.15.137:6817/37250] conn(0x7effa4070b00 0x7effa4072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.166+0000 7effc6a00640 1 --2- 172.21.15.133:0/4249575288 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7effa406ac00 0x7effa406d0c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7effb0034000 tx=0x7effb0009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.167+0000 7effc7e00640 1 --2- 172.21.15.133:0/4249575288 >> [v2:172.21.15.137:6816/37250,v1:172.21.15.137:6817/37250] conn(0x7effa4070b00 0x7effa4072f20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:23.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.169+0000 7effbf400640 1 -- 172.21.15.133:0/4249575288 <== osd.7 v2:172.21.15.137:6816/37250 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7effa40735d0 con 0x7effa4070b00 2024-03-30T01:53:23.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.183+0000 7effce400640 1 -- 172.21.15.133:0/4249575288 --> [v2:172.21.15.137:6816/37250,v1:172.21.15.137:6817/37250] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7effc8066d80 con 0x7effa4070b00 2024-03-30T01:53:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.184+0000 7effbf400640 1 -- 172.21.15.133:0/4249575288 <== osd.7 v2:172.21.15.137:6816/37250 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7effc8066d80 con 0x7effa4070b00 2024-03-30T01:53:23.190 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-03-30T01:53:23.190 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T01:53:23.190 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-03-30T01:53:23.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.184+0000 7effce400640 1 -- 172.21.15.133:0/4249575288 >> [v2:172.21.15.137:6816/37250,v1:172.21.15.137:6817/37250] conn(0x7effa4070b00 msgr2=0x7effa4072f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:23.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.184+0000 7effce400640 1 --2- 172.21.15.133:0/4249575288 >> [v2:172.21.15.137:6816/37250,v1:172.21.15.137:6817/37250] conn(0x7effa4070b00 0x7effa4072f20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.184+0000 7effce400640 1 -- 172.21.15.133:0/4249575288 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7effa406ac00 msgr2=0x7effa406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:23.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.184+0000 7effce400640 1 --2- 172.21.15.133:0/4249575288 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7effa406ac00 0x7effa406d0c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7effb0034000 tx=0x7effb0009030 comp rx=0 tx=0).stop 2024-03-30T01:53:23.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.184+0000 7effce400640 1 -- 172.21.15.133:0/4249575288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effa8003f20 msgr2=0x7effc81f2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:23.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.184+0000 7effce400640 1 --2- 172.21.15.133:0/4249575288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effa8003f20 0x7effc81f2800 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7effb80108b0 tx=0x7effb8010d70 comp rx=0 tx=0).stop 2024-03-30T01:53:23.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.184+0000 7effc7e00640 1 -- 172.21.15.133:0/4249575288 reap_dead start 2024-03-30T01:53:23.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.184+0000 7effce400640 1 -- 172.21.15.133:0/4249575288 shutdown_connections 2024-03-30T01:53:23.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.184+0000 7effce400640 1 -- 172.21.15.133:0/4249575288 >> 172.21.15.133:0/4249575288 conn(0x7effc80b5fb0 msgr2=0x7effc80ae0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:23.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.185+0000 7effce400640 1 -- 172.21.15.133:0/4249575288 shutdown_connections 2024-03-30T01:53:23.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.185+0000 7effce400640 1 -- 172.21.15.133:0/4249575288 wait complete. 2024-03-30T01:53:23.209 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-30T01:53:23.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.413+0000 7efd96e00640 1 Processor -- start 2024-03-30T01:53:23.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.413+0000 7efd96e00640 1 -- start start 2024-03-30T01:53:23.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.414+0000 7efd96e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efd90143220 0x7efd900cd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:23.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.414+0000 7efd96e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9006e2e0 0x7efd90070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:23.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.414+0000 7efd96e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efd900cded0 0x7efd90070a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:23.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.414+0000 7efd96e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd900cc5c0 con 0x7efd900cded0 2024-03-30T01:53:23.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.414+0000 7efd96e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd900ce400 con 0x7efd90143220 2024-03-30T01:53:23.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.414+0000 7efd96e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9006d0e0 con 0x7efd9006e2e0 2024-03-30T01:53:23.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.415+0000 7efd94e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efd900cded0 0x7efd90070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:23.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.415+0000 7efd94e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efd900cded0 0x7efd90070a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36186/0 (socket says 172.21.15.133:36186) 2024-03-30T01:53:23.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.415+0000 7efd94e00640 1 -- 172.21.15.133:0/1091867961 learned_addr learned my addr 172.21.15.133:0/1091867961 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:23.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.415+0000 7efd8fe00640 1 --2- 172.21.15.133:0/1091867961 >> v2:172.21.15.137:3300/0 conn(0x7efd90143220 0x7efd900cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:23.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.415+0000 7efd87400640 1 --2- 172.21.15.133:0/1091867961 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9006e2e0 0x7efd90070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:23.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.415+0000 7efd94e00640 1 -- 172.21.15.133:0/1091867961 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9006e2e0 msgr2=0x7efd90070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:23.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.415+0000 7efd94e00640 1 --2- 172.21.15.133:0/1091867961 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9006e2e0 0x7efd90070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.415+0000 7efd94e00640 1 -- 172.21.15.133:0/1091867961 >> v2:172.21.15.137:3300/0 conn(0x7efd90143220 msgr2=0x7efd900cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:23.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.415+0000 7efd94e00640 1 --2- 172.21.15.133:0/1091867961 >> v2:172.21.15.137:3300/0 conn(0x7efd90143220 0x7efd900cd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.415+0000 7efd94e00640 1 -- 172.21.15.133:0/1091867961 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9006d3c0 con 0x7efd900cded0 2024-03-30T01:53:23.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.416+0000 7efd94e00640 1 --2- 172.21.15.133:0/1091867961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd900cded0 0x7efd90070a40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7efd90071590 tx=0x7efd8802e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755736990c27d3d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:23.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.417+0000 7efd8f400640 1 -- 172.21.15.133:0/1091867961 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8802ee90 con 0x7efd900cded0 2024-03-30T01:53:23.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.417+0000 7efd8f400640 1 -- 172.21.15.133:0/1091867961 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd88036440 con 0x7efd900cded0 2024-03-30T01:53:23.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.417+0000 7efd8f400640 1 -- 172.21.15.133:0/1091867961 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd880367d0 con 0x7efd900cded0 2024-03-30T01:53:23.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.417+0000 7efd96e00640 1 -- 172.21.15.133:0/1091867961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd900cded0 msgr2=0x7efd90070a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:23.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.417+0000 7efd96e00640 1 --2- 172.21.15.133:0/1091867961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd900cded0 0x7efd90070a40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7efd90071590 tx=0x7efd8802e0e0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.417+0000 7efd96e00640 1 -- 172.21.15.133:0/1091867961 shutdown_connections 2024-03-30T01:53:23.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.417+0000 7efd96e00640 1 --2- 172.21.15.133:0/1091867961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd900cded0 0x7efd90070a40 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.417+0000 7efd96e00640 1 --2- 172.21.15.133:0/1091867961 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9006e2e0 0x7efd90070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.417+0000 7efd96e00640 1 --2- 172.21.15.133:0/1091867961 >> v2:172.21.15.137:3300/0 conn(0x7efd90143220 0x7efd900cd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.417+0000 7efd96e00640 1 -- 172.21.15.133:0/1091867961 >> 172.21.15.133:0/1091867961 conn(0x7efd900b07a0 msgr2=0x7efd900b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:23.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.417+0000 7efd96e00640 1 -- 172.21.15.133:0/1091867961 shutdown_connections 2024-03-30T01:53:23.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.418+0000 7efd96e00640 1 -- 172.21.15.133:0/1091867961 wait complete. 2024-03-30T01:53:23.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.419+0000 7efd96e00640 1 Processor -- start 2024-03-30T01:53:23.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.419+0000 7efd96e00640 1 -- start start 2024-03-30T01:53:23.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.420+0000 7efd96e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9006e2e0 0x7efd90153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:23.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.420+0000 7efd96e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd900cded0 0x7efd90159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:23.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.420+0000 7efd96e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd90143220 0x7efd90155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:23.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.420+0000 7efd96e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd901542d0 con 0x7efd900cded0 2024-03-30T01:53:23.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.420+0000 7efd96e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd900c82b0 con 0x7efd90143220 2024-03-30T01:53:23.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.420+0000 7efd96e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9015c6a0 con 0x7efd9006e2e0 2024-03-30T01:53:23.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.420+0000 7efd87400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd900cded0 0x7efd90159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:23.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.420+0000 7efd87400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd900cded0 0x7efd90159df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36200/0 (socket says 172.21.15.133:36200) 2024-03-30T01:53:23.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.421+0000 7efd87400640 1 -- 172.21.15.133:0/3441399269 learned_addr learned my addr 172.21.15.133:0/3441399269 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:23.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.421+0000 7efd8fe00640 1 --2- 172.21.15.133:0/3441399269 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9006e2e0 0x7efd90153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:23.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.421+0000 7efd94e00640 1 --2- 172.21.15.133:0/3441399269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd90143220 0x7efd90155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:23.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.421+0000 7efd87400640 1 -- 172.21.15.133:0/3441399269 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9006e2e0 msgr2=0x7efd90153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:23.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.421+0000 7efd87400640 1 --2- 172.21.15.133:0/3441399269 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9006e2e0 0x7efd90153d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.421+0000 7efd87400640 1 -- 172.21.15.133:0/3441399269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd90143220 msgr2=0x7efd90155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:23.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.421+0000 7efd87400640 1 --2- 172.21.15.133:0/3441399269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd90143220 0x7efd90155610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.421+0000 7efd87400640 1 -- 172.21.15.133:0/3441399269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8800b770 con 0x7efd900cded0 2024-03-30T01:53:23.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.421+0000 7efd87400640 1 --2- 172.21.15.133:0/3441399269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd900cded0 0x7efd90159df0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7efd7800d7d0 tx=0x7efd7800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:23.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.421+0000 7efd8cc00640 1 -- 172.21.15.133:0/3441399269 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7800b6c0 con 0x7efd900cded0 2024-03-30T01:53:23.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.421+0000 7efd8cc00640 1 -- 172.21.15.133:0/3441399269 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7800b820 con 0x7efd900cded0 2024-03-30T01:53:23.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.421+0000 7efd8cc00640 1 -- 172.21.15.133:0/3441399269 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7800bbb0 con 0x7efd900cded0 2024-03-30T01:53:23.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.422+0000 7efd96e00640 1 -- 172.21.15.133:0/3441399269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd9015c980 con 0x7efd900cded0 2024-03-30T01:53:23.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.422+0000 7efd96e00640 1 -- 172.21.15.133:0/3441399269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd900c7f40 con 0x7efd900cded0 2024-03-30T01:53:23.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.423+0000 7efd96e00640 1 -- 172.21.15.133:0/3441399269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd90066d80 con 0x7efd900cded0 2024-03-30T01:53:23.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.424+0000 7efd8cc00640 1 -- 172.21.15.133:0/3441399269 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7efd7800bd10 con 0x7efd900cded0 2024-03-30T01:53:23.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.424+0000 7efd8cc00640 1 --2- 172.21.15.133:0/3441399269 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efd6c06ac00 0x7efd6c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:23.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.425+0000 7efd8cc00640 1 -- 172.21.15.133:0/3441399269 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7efd78089600 con 0x7efd900cded0 2024-03-30T01:53:23.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.425+0000 7efd8fe00640 1 --2- 172.21.15.133:0/3441399269 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efd6c06ac00 0x7efd6c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:23.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.425+0000 7efd8fe00640 1 --2- 172.21.15.133:0/3441399269 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efd6c06ac00 0x7efd6c06d0c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efd900c7e30 tx=0x7efd8000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:23.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.429+0000 7efd8cc00640 1 -- 172.21.15.133:0/3441399269 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7efd78054a80 con 0x7efd900cded0 2024-03-30T01:53:23.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.622+0000 7efd96e00640 1 -- 172.21.15.133:0/3441399269 --> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7efd90143600 con 0x7efd6c06ac00 2024-03-30T01:53:23.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.623+0000 7efd8cc00640 1 -- 172.21.15.133:0/3441399269 <== mgr.4105 v2:172.21.15.133:6832/37234 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efd80009e30 con 0x7efd6c06ac00 2024-03-30T01:53:23.629 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 7 to deep-scrub 2024-03-30T01:53:23.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.625+0000 7efd96e00640 1 -- 172.21.15.133:0/3441399269 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efd6c06ac00 msgr2=0x7efd6c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:23.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.625+0000 7efd96e00640 1 --2- 172.21.15.133:0/3441399269 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efd6c06ac00 0x7efd6c06d0c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efd900c7e30 tx=0x7efd8000b040 comp rx=0 tx=0).stop 2024-03-30T01:53:23.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.625+0000 7efd96e00640 1 -- 172.21.15.133:0/3441399269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd900cded0 msgr2=0x7efd90159df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:23.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.625+0000 7efd96e00640 1 --2- 172.21.15.133:0/3441399269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd900cded0 0x7efd90159df0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7efd7800d7d0 tx=0x7efd7800dc90 comp rx=0 tx=0).stop 2024-03-30T01:53:23.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.625+0000 7efd96e00640 1 -- 172.21.15.133:0/3441399269 shutdown_connections 2024-03-30T01:53:23.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.625+0000 7efd96e00640 1 --2- 172.21.15.133:0/3441399269 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7efd6c06ac00 0x7efd6c06d0c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.625+0000 7efd96e00640 1 --2- 172.21.15.133:0/3441399269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd90143220 0x7efd90155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.625+0000 7efd96e00640 1 --2- 172.21.15.133:0/3441399269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd900cded0 0x7efd90159df0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.625+0000 7efd96e00640 1 --2- 172.21.15.133:0/3441399269 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9006e2e0 0x7efd90153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.625+0000 7efd96e00640 1 -- 172.21.15.133:0/3441399269 >> 172.21.15.133:0/3441399269 conn(0x7efd900b07a0 msgr2=0x7efd9013e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:23.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.625+0000 7efd96e00640 1 -- 172.21.15.133:0/3441399269 shutdown_connections 2024-03-30T01:53:23.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.626+0000 7efd96e00640 1 -- 172.21.15.133:0/3441399269 wait complete. 2024-03-30T01:53:23.648 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T01:53:23.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.837+0000 7fd17e200640 1 Processor -- start 2024-03-30T01:53:23.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.837+0000 7fd17e200640 1 -- start start 2024-03-30T01:53:23.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.839+0000 7fd17e200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd178153010 0x7fd178159a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.839+0000 7fd17e200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd1780b38c0 0x7fd17815c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.839+0000 7fd17e200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd17806e5f0 0x7fd1780b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.839+0000 7fd17e200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd178159570 con 0x7fd17806e5f0 2024-03-30T01:53:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.839+0000 7fd17e200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd17815d5f0 con 0x7fd1780b38c0 2024-03-30T01:53:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.839+0000 7fd17e200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17815d030 con 0x7fd178153010 2024-03-30T01:53:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.839+0000 7fd177e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd17806e5f0 0x7fd1780b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.839+0000 7fd177e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd17806e5f0 0x7fd1780b18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36216/0 (socket says 172.21.15.133:36216) 2024-03-30T01:53:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.839+0000 7fd177e00640 1 -- 172.21.15.133:0/4120930602 learned_addr learned my addr 172.21.15.133:0/4120930602 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.839+0000 7fd176a00640 1 --2- 172.21.15.133:0/4120930602 >> v2:172.21.15.137:3300/0 conn(0x7fd1780b38c0 0x7fd17815c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.839+0000 7fd177400640 1 --2- 172.21.15.133:0/4120930602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd178153010 0x7fd178159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.839+0000 7fd177e00640 1 -- 172.21.15.133:0/4120930602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd178153010 msgr2=0x7fd178159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.840+0000 7fd177e00640 1 --2- 172.21.15.133:0/4120930602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd178153010 0x7fd178159a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.840+0000 7fd177e00640 1 -- 172.21.15.133:0/4120930602 >> v2:172.21.15.137:3300/0 conn(0x7fd1780b38c0 msgr2=0x7fd17815c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.840+0000 7fd177e00640 1 --2- 172.21.15.133:0/4120930602 >> v2:172.21.15.137:3300/0 conn(0x7fd1780b38c0 0x7fd17815c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.840+0000 7fd177e00640 1 -- 172.21.15.133:0/4120930602 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17815d310 con 0x7fd17806e5f0 2024-03-30T01:53:23.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.841+0000 7fd177e00640 1 --2- 172.21.15.133:0/4120930602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd17806e5f0 0x7fd1780b18c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd178071240 tx=0x7fd17002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63aa4302efc163a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:23.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.841+0000 7fd176000640 1 -- 172.21.15.133:0/4120930602 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd170031870 con 0x7fd17806e5f0 2024-03-30T01:53:23.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.841+0000 7fd176000640 1 -- 172.21.15.133:0/4120930602 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1700319d0 con 0x7fd17806e5f0 2024-03-30T01:53:23.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.841+0000 7fd176000640 1 -- 172.21.15.133:0/4120930602 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd170031d60 con 0x7fd17806e5f0 2024-03-30T01:53:23.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.841+0000 7fd17e200640 1 -- 172.21.15.133:0/4120930602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd17806e5f0 msgr2=0x7fd1780b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:23.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.841+0000 7fd17e200640 1 --2- 172.21.15.133:0/4120930602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd17806e5f0 0x7fd1780b18c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd178071240 tx=0x7fd17002b910 comp rx=0 tx=0).stop 2024-03-30T01:53:23.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.842+0000 7fd17e200640 1 -- 172.21.15.133:0/4120930602 shutdown_connections 2024-03-30T01:53:23.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.842+0000 7fd17e200640 1 --2- 172.21.15.133:0/4120930602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd17806e5f0 0x7fd1780b18c0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.842+0000 7fd17e200640 1 --2- 172.21.15.133:0/4120930602 >> v2:172.21.15.137:3300/0 conn(0x7fd1780b38c0 0x7fd17815c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.842+0000 7fd17e200640 1 --2- 172.21.15.133:0/4120930602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd178153010 0x7fd178159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.842+0000 7fd17e200640 1 -- 172.21.15.133:0/4120930602 >> 172.21.15.133:0/4120930602 conn(0x7fd1780b07a0 msgr2=0x7fd1780b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:23.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.842+0000 7fd17e200640 1 -- 172.21.15.133:0/4120930602 shutdown_connections 2024-03-30T01:53:23.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.842+0000 7fd17e200640 1 -- 172.21.15.133:0/4120930602 wait complete. 2024-03-30T01:53:23.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.843+0000 7fd17e200640 1 Processor -- start 2024-03-30T01:53:23.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.843+0000 7fd17e200640 1 -- start start 2024-03-30T01:53:23.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.844+0000 7fd17e200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd17806e5f0 0x7fd17815aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:23.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.844+0000 7fd17e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1780b38c0 0x7fd1781f2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:23.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.844+0000 7fd17e200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd178153010 0x7fd1781f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:23.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.844+0000 7fd17e200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1781f3fa0 con 0x7fd17806e5f0 2024-03-30T01:53:23.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.844+0000 7fd17e200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1781f33a0 con 0x7fd1780b38c0 2024-03-30T01:53:23.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.844+0000 7fd17e200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1781f3600 con 0x7fd178153010 2024-03-30T01:53:23.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.845+0000 7fd177400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd17806e5f0 0x7fd17815aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:23.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.845+0000 7fd177400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd17806e5f0 0x7fd17815aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36226/0 (socket says 172.21.15.133:36226) 2024-03-30T01:53:23.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.845+0000 7fd177400640 1 -- 172.21.15.133:0/2625813429 learned_addr learned my addr 172.21.15.133:0/2625813429 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:23.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.845+0000 7fd177400640 1 -- 172.21.15.133:0/2625813429 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd178153010 msgr2=0x7fd1781f2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:23.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.845+0000 7fd177400640 1 --2- 172.21.15.133:0/2625813429 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd178153010 0x7fd1781f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.845+0000 7fd177400640 1 -- 172.21.15.133:0/2625813429 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1780b38c0 msgr2=0x7fd1781f2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:23.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.845+0000 7fd176a00640 1 --2- 172.21.15.133:0/2625813429 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1780b38c0 0x7fd1781f2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:23.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.845+0000 7fd177400640 1 --2- 172.21.15.133:0/2625813429 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1780b38c0 0x7fd1781f2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.845+0000 7fd177400640 1 -- 172.21.15.133:0/2625813429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1700094d0 con 0x7fd17806e5f0 2024-03-30T01:53:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.845+0000 7fd177400640 1 --2- 172.21.15.133:0/2625813429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd17806e5f0 0x7fd17815aea0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd16800ccd0 tx=0x7fd16800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.845+0000 7fd16f400640 1 -- 172.21.15.133:0/2625813429 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd168003990 con 0x7fd17806e5f0 2024-03-30T01:53:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.846+0000 7fd16f400640 1 -- 172.21.15.133:0/2625813429 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd168003af0 con 0x7fd17806e5f0 2024-03-30T01:53:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.846+0000 7fd16f400640 1 -- 172.21.15.133:0/2625813429 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd168004020 con 0x7fd17806e5f0 2024-03-30T01:53:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.846+0000 7fd17e200640 1 -- 172.21.15.133:0/2625813429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1781f38e0 con 0x7fd17806e5f0 2024-03-30T01:53:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.846+0000 7fd17e200640 1 -- 172.21.15.133:0/2625813429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1781f43c0 con 0x7fd17806e5f0 2024-03-30T01:53:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.847+0000 7fd17e200640 1 -- 172.21.15.133:0/2625813429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1781f4210 con 0x7fd17806e5f0 2024-03-30T01:53:23.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.848+0000 7fd16f400640 1 -- 172.21.15.133:0/2625813429 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd168004180 con 0x7fd17806e5f0 2024-03-30T01:53:23.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.849+0000 7fd16f400640 1 --2- 172.21.15.133:0/2625813429 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd15406ac00 0x7fd15406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:23.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.849+0000 7fd16f400640 1 -- 172.21.15.133:0/2625813429 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd1680894f0 con 0x7fd17806e5f0 2024-03-30T01:53:23.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.849+0000 7fd176a00640 1 --2- 172.21.15.133:0/2625813429 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd15406ac00 0x7fd15406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:23.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.850+0000 7fd176a00640 1 --2- 172.21.15.133:0/2625813429 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd15406ac00 0x7fd15406d0c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd160006fd0 tx=0x7fd160008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:23.853+0000 7fd16f400640 1 -- 172.21.15.133:0/2625813429 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fd1680548d0 con 0x7fd17806e5f0 2024-03-30T01:53:24.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:24.045+0000 7fd17e200640 1 -- 172.21.15.133:0/2625813429 --> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd17815cc20 con 0x7fd15406ac00 2024-03-30T01:53:24.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:24.050+0000 7fd16f400640 1 -- 172.21.15.133:0/2625813429 <== mgr.4105 v2:172.21.15.133:6832/37234 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48213 (secure 0 0 0) 0x7fd16000c040 con 0x7fd15406ac00 2024-03-30T01:53:24.056 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:53:24.057 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-03-30T01:53:24.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:24.053+0000 7fd17e200640 1 -- 172.21.15.133:0/2625813429 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd15406ac00 msgr2=0x7fd15406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:24.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:24.053+0000 7fd17e200640 1 --2- 172.21.15.133:0/2625813429 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd15406ac00 0x7fd15406d0c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd160006fd0 tx=0x7fd160008040 comp rx=0 tx=0).stop 2024-03-30T01:53:24.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:24.053+0000 7fd17e200640 1 -- 172.21.15.133:0/2625813429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd17806e5f0 msgr2=0x7fd17815aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:24.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:24.053+0000 7fd17e200640 1 --2- 172.21.15.133:0/2625813429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd17806e5f0 0x7fd17815aea0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd16800ccd0 tx=0x7fd16800a5c0 comp rx=0 tx=0).stop 2024-03-30T01:53:24.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:24.053+0000 7fd17e200640 1 -- 172.21.15.133:0/2625813429 shutdown_connections 2024-03-30T01:53:24.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:24.053+0000 7fd17e200640 1 --2- 172.21.15.133:0/2625813429 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fd15406ac00 0x7fd15406d0c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:24.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:24.053+0000 7fd17e200640 1 --2- 172.21.15.133:0/2625813429 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd178153010 0x7fd1781f2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:24.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:24.053+0000 7fd17e200640 1 --2- 172.21.15.133:0/2625813429 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1780b38c0 0x7fd1781f2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:24.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:24.053+0000 7fd17e200640 1 --2- 172.21.15.133:0/2625813429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd17806e5f0 0x7fd17815aea0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:24.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:24.053+0000 7fd17e200640 1 -- 172.21.15.133:0/2625813429 >> 172.21.15.133:0/2625813429 conn(0x7fd1780b07a0 msgr2=0x7fd17815b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:24.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:24.053+0000 7fd17e200640 1 -- 172.21.15.133:0/2625813429 shutdown_connections 2024-03-30T01:53:24.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:24.053+0000 7fd17e200640 1 -- 172.21.15.133:0/2625813429 wait complete. 2024-03-30T01:53:24.076 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-03-30T01:53:23.729505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220872,"kb_used_data":4704,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753848,"statfs":{"total":773094113280,"available":772867940352,"internally_reserved":0,"allocated":4816896,"data_stored":2640138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.864073"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-03-30T01:53:12.947455+0000","last_change":"2024-03-30T01:51:23.358245+0000","last_active":"2024-03-30T01:53:12.947455+0000","last_peered":"2024-03-30T01:53:12.947455+0000","last_clean":"2024-03-30T01:53:12.947455+0000","last_became_active":"2024-03-30T01:51:23.355914+0000","last_became_peered":"2024-03-30T01:51:23.355914+0000","last_unstale":"2024-03-30T01:53:12.947455+0000","last_undegraded":"2024-03-30T01:53:12.947455+0000","last_fullsized":"2024-03-30T01:53:12.947455+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T01:51:21.990253+0000","last_clean_scrub_stamp":"2024-03-30T01:51:21.990253+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T10:21:19.291194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":773048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.498}]},{"osd":1,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":1.276},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.67200000000000004}]},{"osd":2,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.083},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.1859999999999999}]},{"osd":3,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.82099999999999995}]},{"osd":4,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":1.5349999999999999}]},{"osd":5,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.129,"5min":2.129,"15min":2.129},"last":1.3879999999999999}]},{"osd":6,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.427}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":182680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.86699999999999999}]},{"osd":1,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.98899999999999999}]},{"osd":2,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.81200000000000006}]},{"osd":3,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":1.052}]},{"osd":4,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.121}]},{"osd":5,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.202},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.528,"5min":2.528,"15min":2.528},"last":1.157}]},{"osd":7,"last update":"Sat Mar 30 01:52:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.274},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.4350000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":1.2929999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27460,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":454656,"data_stored":182680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":13.811999999999999,"5min":13.811999999999999,"15min":13.811999999999999},"last":1.522},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.5030000000000001,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":1.3979999999999999}]},{"osd":1,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":9.9900000000000002,"5min":9.9900000000000002,"15min":9.9900000000000002},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":6.024,"5min":6.024,"15min":6.024},"last":1.0669999999999999}]},{"osd":2,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":6.109,"5min":6.109,"15min":6.109},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.476}]},{"osd":3,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":6.6950000000000003,"5min":6.6950000000000003,"15min":6.6950000000000003},"last":1.141},{"interface":"front","average":{"1min":1.956,"5min":1.956,"15min":1.956},"min":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"max":{"1min":9.9489999999999998,"5min":9.9489999999999998,"15min":9.9489999999999998},"last":1.6080000000000001}]},{"osd":4,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":6.1520000000000001,"5min":6.1520000000000001,"15min":6.1520000000000001},"last":1.6830000000000001},{"interface":"front","average":{"1min":1.819,"5min":1.819,"15min":1.819},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":6.6100000000000003,"5min":6.6100000000000003,"15min":6.6100000000000003},"last":1.649}]},{"osd":6,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":2.052,"5min":2.052,"15min":2.052},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":9.8160000000000007,"5min":9.8160000000000007,"15min":9.8160000000000007},"last":1.431},{"interface":"front","average":{"1min":2,"5min":2,"15min":2},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":6.0679999999999996,"5min":6.0679999999999996,"15min":6.0679999999999996},"last":1.7490000000000001}]},{"osd":7,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":1.831,"15min":1.831},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":1.7769999999999999},{"interface":"front","average":{"1min":2.214,"5min":2.214,"15min":2.214},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":9.8650000000000002,"5min":9.8650000000000002,"15min":9.8650000000000002},"last":1.7270000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":182680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.79900000000000004}]},{"osd":1,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":0.60399999999999998}]},{"osd":2,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":0.70699999999999996}]},{"osd":3,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":4.9969999999999999,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"min":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":4.6680000000000001,"5min":4.6680000000000001,"15min":4.6680000000000001},"last":0.752}]},{"osd":5,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.9729999999999999,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":3.4790000000000001,"5min":3.4790000000000001,"15min":3.4790000000000001},"last":0.63200000000000001}]},{"osd":6,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":0.95599999999999996}]},{"osd":7,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.625,"5min":1.625,"15min":1.625},"min":{"1min":1.113,"5min":1.113,"15min":1.113},"max":{"1min":2.4409999999999998,"5min":2.4409999999999998,"15min":2.4409999999999998},"last":0.92700000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":182680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":9.298,"5min":9.298,"15min":9.298},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.806,"5min":3.806,"15min":3.806},"last":0.39700000000000002}]},{"osd":1,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":3.1070000000000002,"5min":3.1070000000000002,"15min":3.1070000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":9.3659999999999997,"5min":9.3659999999999997,"15min":9.3659999999999997},"last":0.84099999999999997}]},{"osd":2,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":5.7949999999999999,"5min":5.7949999999999999,"15min":5.7949999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":6.7240000000000002,"5min":6.7240000000000002,"15min":6.7240000000000002},"last":0.58799999999999997}]},{"osd":4,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":6.1280000000000001,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.96699999999999997}]},{"osd":5,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":18.904,"5min":18.904,"15min":18.904},"last":1.159}]},{"osd":6,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":3.9209999999999998,"5min":3.9209999999999998,"15min":3.9209999999999998},"last":0.87},{"interface":"front","average":{"1min":1.738,"5min":1.738,"15min":1.738},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":5.0919999999999996,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":0.82399999999999995}]},{"osd":7,"last update":"Sat Mar 30 01:52:25 2024","interfaces":[{"interface":"back","average":{"1min":1.903,"5min":1.903,"15min":1.903},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":6.8600000000000003,"5min":6.8600000000000003,"15min":6.8600000000000003},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":4.4669999999999996,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":0.91900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27460,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":450560,"data_stored":181661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.7030000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":2.0649999999999999}]},{"osd":1,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.071},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.74199999999999999}]},{"osd":3,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":4.742,"5min":4.742,"15min":4.742},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.296}]},{"osd":4,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.5609999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.123}]},{"osd":5,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":3.012,"5min":3.012,"15min":3.012},"last":1.266},{"interface":"front","average":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":8.125,"5min":8.125,"15min":8.125},"last":1.385}]},{"osd":6,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":5.6449999999999996,"5min":5.6449999999999996,"15min":5.6449999999999996},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.413}]},{"osd":7,"last update":"Sat Mar 30 01:52:23 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.3460000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":182680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2,"5min":2,"15min":2},"last":0.53200000000000003}]},{"osd":2,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.7549999999999999,"5min":4.7549999999999999,"15min":4.7549999999999999},"last":0.627}]},{"osd":3,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":3.0619999999999998,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":6.04,"5min":6.04,"15min":6.04},"last":0.65100000000000002}]},{"osd":4,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.629,"5min":2.629,"15min":2.629},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":3.7669999999999999,"5min":3.7669999999999999,"15min":3.7669999999999999},"last":0.81299999999999994}]},{"osd":5,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.532,"5min":1.532,"15min":1.532},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":4.2480000000000002,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.753},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":3.9359999999999999,"5min":3.9359999999999999,"15min":3.9359999999999999},"last":0.73599999999999999}]},{"osd":6,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.4209999999999998,"5min":2.4209999999999998,"15min":2.4209999999999998},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":3.2559999999999998,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":0.85599999999999998}]},{"osd":7,"last update":"Sat Mar 30 01:52:22 2024","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.6869999999999998,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":0.874},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.83899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1044480,"data_stored":772029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.6190000000000002,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":1.218}]},{"osd":2,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.095}]},{"osd":3,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":5.2679999999999998,"5min":5.2679999999999998,"15min":5.2679999999999998},"last":0.97299999999999998}]},{"osd":4,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.256},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":3.3540000000000001,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":1.4099999999999999}]},{"osd":5,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":1.127},{"interface":"front","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.319}]},{"osd":6,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.9279999999999999,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.8690000000000002,"5min":2.8690000000000002,"15min":2.8690000000000002},"last":1.1739999999999999}]},{"osd":7,"last update":"Sat Mar 30 01:52:21 2024","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.8010000000000002,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":4.923,"5min":4.923,"15min":4.923},"last":1.3089999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T01:53:24.080 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-30T01:51:21.990253+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=30, tm_hour=1, tm_min=51, tm_sec=21, tm_wday=5, tm_yday=90, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=30, tm_hour=1, tm_min=53, tm_sec=17, tm_wday=5, tm_yday=90, tm_isdst=0) 2024-03-30T01:53:24.080 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-30T01:53:44.081 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T01:53:44.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.288+0000 7f712a800640 1 Processor -- start 2024-03-30T01:53:44.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.288+0000 7f712a800640 1 -- start start 2024-03-30T01:53:44.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.289+0000 7f712a800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71240d1010 0x7f71240cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:44.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.289+0000 7f712a800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71240cff00 con 0x7f71240cfad0 2024-03-30T01:53:44.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.289+0000 7f712a800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71240d15d0 con 0x7f712415cf90 2024-03-30T01:53:44.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.289+0000 7f712a800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71240d18b0 con 0x7f71240d1010 2024-03-30T01:53:44.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.289+0000 7f7123e00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f71240cfad0 0x7f71240b63f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57962/0 (socket says 172.21.15.133:57962) 2024-03-30T01:53:44.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.289+0000 7f7123e00640 1 -- 172.21.15.133:0/2416600824 learned_addr learned my addr 172.21.15.133:0/2416600824 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:44.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.290+0000 7f7122a00640 1 --2- 172.21.15.133:0/2416600824 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71240d1010 0x7f71240cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:44.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.290+0000 7f7122000640 1 -- 172.21.15.133:0/2416600824 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437164569 0 0) 0x7f71240cff00 con 0x7f71240cfad0 2024-03-30T01:53:44.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.290+0000 7f7122000640 1 -- 172.21.15.133:0/2416600824 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7108003520 con 0x7f71240cfad0 2024-03-30T01:53:44.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.290+0000 7f7122000640 1 -- 172.21.15.133:0/2416600824 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2193212868 0 0) 0x7f7108003520 con 0x7f71240cfad0 2024-03-30T01:53:44.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.290+0000 7f7122000640 1 -- 172.21.15.133:0/2416600824 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71240d1010 msgr2=0x7f71240cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:44.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.290+0000 7f7122000640 1 --2- 172.21.15.133:0/2416600824 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71240d1010 0x7f71240cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:44.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.290+0000 7f7122000640 1 -- 172.21.15.133:0/2416600824 >> v1:172.21.15.137:6789/0 conn(0x7f712415cf90 legacy=0x7f71240ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:44.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.290+0000 7f7122000640 1 -- 172.21.15.133:0/2416600824 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71240d1b90 con 0x7f71240cfad0 2024-03-30T01:53:44.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.290+0000 7f7122000640 1 -- 172.21.15.133:0/2416600824 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f711c001670 con 0x7f71240cfad0 2024-03-30T01:53:44.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.290+0000 7f7122000640 1 -- 172.21.15.133:0/2416600824 >> v1:172.21.15.133:6789/0 conn(0x7f71240cfad0 legacy=0x7f71240b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:44.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.291+0000 7f7122000640 1 --2- 172.21.15.133:0/2416600824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71080039a0 0x7f7108003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:44.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.291+0000 7f7122000640 1 --2- 172.21.15.133:0/2416600824 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71240d1010 0x7f71080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:44.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.291+0000 7f7122000640 1 --2- 172.21.15.133:0/2416600824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7108004d00 0x7f7108005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:44.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.291+0000 7f7122000640 1 -- 172.21.15.133:0/2416600824 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71240d18b0 con 0x7f71080039a0 2024-03-30T01:53:44.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.291+0000 7f7122000640 1 -- 172.21.15.133:0/2416600824 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710800ba60 con 0x7f7108004d00 2024-03-30T01:53:44.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.291+0000 7f7122000640 1 -- 172.21.15.133:0/2416600824 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710800bc20 con 0x7f71240d1010 2024-03-30T01:53:44.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.291+0000 7f7123400640 1 --2- 172.21.15.133:0/2416600824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71080039a0 0x7f7108003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:44.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.291+0000 7f7122a00640 1 --2- 172.21.15.133:0/2416600824 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71240d1010 0x7f71080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:44.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.291+0000 7f7123e00640 1 --2- 172.21.15.133:0/2416600824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7108004d00 0x7f7108005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:44.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.291+0000 7f7123400640 1 -- 172.21.15.133:0/2416600824 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71240d1010 msgr2=0x7f71080047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:44.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.291+0000 7f7123400640 1 --2- 172.21.15.133:0/2416600824 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71240d1010 0x7f71080047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:44.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.291+0000 7f7123400640 1 -- 172.21.15.133:0/2416600824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7108004d00 msgr2=0x7f7108005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:44.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.291+0000 7f7123400640 1 --2- 172.21.15.133:0/2416600824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7108004d00 0x7f7108005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:44.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.291+0000 7f7123400640 1 -- 172.21.15.133:0/2416600824 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7108003520 con 0x7f71080039a0 2024-03-30T01:53:44.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.292+0000 7f7123400640 1 --2- 172.21.15.133:0/2416600824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71080039a0 0x7f7108003dc0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f71240d0090 tx=0x7f71080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db27cf74b8ae481c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:44.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.293+0000 7f7122000640 1 -- 172.21.15.133:0/2416600824 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c0052d0 con 0x7f71080039a0 2024-03-30T01:53:44.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.293+0000 7f7122000640 1 -- 172.21.15.133:0/2416600824 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710c02e050 con 0x7f71080039a0 2024-03-30T01:53:44.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.293+0000 7f7122000640 1 -- 172.21.15.133:0/2416600824 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c0035f0 con 0x7f71080039a0 2024-03-30T01:53:44.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.293+0000 7f712a800640 1 -- 172.21.15.133:0/2416600824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71080039a0 msgr2=0x7f7108003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:44.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.293+0000 7f712a800640 1 --2- 172.21.15.133:0/2416600824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71080039a0 0x7f7108003dc0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f71240d0090 tx=0x7f71080057f0 comp rx=0 tx=0).stop 2024-03-30T01:53:44.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.293+0000 7f7123e00640 1 -- 172.21.15.133:0/2416600824 reap_dead start 2024-03-30T01:53:44.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.293+0000 7f712a800640 1 -- 172.21.15.133:0/2416600824 shutdown_connections 2024-03-30T01:53:44.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.293+0000 7f712a800640 1 -- 172.21.15.133:0/2416600824 >> 172.21.15.133:0/2416600824 conn(0x7f7124071a40 msgr2=0x7f712406b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:44.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.293+0000 7f712a800640 1 -- 172.21.15.133:0/2416600824 shutdown_connections 2024-03-30T01:53:44.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.293+0000 7f712a800640 1 -- 172.21.15.133:0/2416600824 wait complete. 2024-03-30T01:53:44.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.295+0000 7f712a800640 1 Processor -- start 2024-03-30T01:53:44.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.295+0000 7f712a800640 1 -- start start 2024-03-30T01:53:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.296+0000 7f712a800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71080039a0 0x7f7124157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.296+0000 7f712a800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f712415ef50 0x7f71240b4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.296+0000 7f712a800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f712415f3d0 0x7f71240b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.296+0000 7f712a800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712415f9a0 con 0x7f712415f3d0 2024-03-30T01:53:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.296+0000 7f712a800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71241f3680 con 0x7f71080039a0 2024-03-30T01:53:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.296+0000 7f712a800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71241f3960 con 0x7f712415ef50 2024-03-30T01:53:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.297+0000 7f7123e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f712415f3d0 0x7f71240b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.297+0000 7f7123e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f712415f3d0 0x7f71240b4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55072/0 (socket says 172.21.15.133:55072) 2024-03-30T01:53:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.297+0000 7f7123e00640 1 -- 172.21.15.133:0/3606160979 learned_addr learned my addr 172.21.15.133:0/3606160979 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.297+0000 7f7123400640 1 --2- 172.21.15.133:0/3606160979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71080039a0 0x7f7124157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.297+0000 7f7123e00640 1 -- 172.21.15.133:0/3606160979 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f712415ef50 msgr2=0x7f71240b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:44.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.297+0000 7f7123e00640 1 --2- 172.21.15.133:0/3606160979 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f712415ef50 0x7f71240b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:44.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.297+0000 7f7123e00640 1 -- 172.21.15.133:0/3606160979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71080039a0 msgr2=0x7f7124157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:44.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.297+0000 7f7123e00640 1 --2- 172.21.15.133:0/3606160979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71080039a0 0x7f7124157310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:44.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.297+0000 7f7123e00640 1 -- 172.21.15.133:0/3606160979 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71241f3c40 con 0x7f712415f3d0 2024-03-30T01:53:44.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.297+0000 7f7123e00640 1 --2- 172.21.15.133:0/3606160979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f712415f3d0 0x7f71240b4dd0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f711c001200 tx=0x7f711c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:44.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.298+0000 7f711b400640 1 -- 172.21.15.133:0/3606160979 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c0072d0 con 0x7f712415f3d0 2024-03-30T01:53:44.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.298+0000 7f711b400640 1 -- 172.21.15.133:0/3606160979 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c007430 con 0x7f712415f3d0 2024-03-30T01:53:44.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.298+0000 7f711b400640 1 -- 172.21.15.133:0/3606160979 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c0047e0 con 0x7f712415f3d0 2024-03-30T01:53:44.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.298+0000 7f712a800640 1 -- 172.21.15.133:0/3606160979 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71241f3f20 con 0x7f712415f3d0 2024-03-30T01:53:44.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.298+0000 7f712a800640 1 -- 172.21.15.133:0/3606160979 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71241f2500 con 0x7f712415f3d0 2024-03-30T01:53:44.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.299+0000 7f712a800640 1 -- 172.21.15.133:0/3606160979 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7124066d80 con 0x7f712415f3d0 2024-03-30T01:53:44.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.300+0000 7f711b400640 1 -- 172.21.15.133:0/3606160979 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f711c004940 con 0x7f712415f3d0 2024-03-30T01:53:44.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.301+0000 7f711b400640 1 --2- 172.21.15.133:0/3606160979 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f710006ac30 0x7f710006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:44.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.301+0000 7f711b400640 1 -- 172.21.15.133:0/3606160979 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f711c088c50 con 0x7f712415f3d0 2024-03-30T01:53:44.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.301+0000 7f7123400640 1 --2- 172.21.15.133:0/3606160979 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f710006ac30 0x7f710006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:44.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.302+0000 7f7123400640 1 --2- 172.21.15.133:0/3606160979 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f710006ac30 0x7f710006d0f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f710c033000 tx=0x7f710c009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:44.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.308+0000 7f711b400640 1 -- 172.21.15.133:0/3606160979 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f711c08e020 con 0x7f712415f3d0 2024-03-30T01:53:44.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.502+0000 7f712a800640 1 -- 172.21.15.133:0/3606160979 --> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f712415fc80 con 0x7f710006ac30 2024-03-30T01:53:44.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.508+0000 7f711b400640 1 -- 172.21.15.133:0/3606160979 <== mgr.4105 v2:172.21.15.133:6832/37234 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48297 (secure 0 0 0) 0x7f712415fc80 con 0x7f710006ac30 2024-03-30T01:53:44.514 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:53:44.515 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-03-30T01:53:44.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.510+0000 7f712a800640 1 -- 172.21.15.133:0/3606160979 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f710006ac30 msgr2=0x7f710006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:44.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.511+0000 7f712a800640 1 --2- 172.21.15.133:0/3606160979 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f710006ac30 0x7f710006d0f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f710c033000 tx=0x7f710c009030 comp rx=0 tx=0).stop 2024-03-30T01:53:44.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.511+0000 7f712a800640 1 -- 172.21.15.133:0/3606160979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f712415f3d0 msgr2=0x7f71240b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:44.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.511+0000 7f712a800640 1 --2- 172.21.15.133:0/3606160979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f712415f3d0 0x7f71240b4dd0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f711c001200 tx=0x7f711c00dc00 comp rx=0 tx=0).stop 2024-03-30T01:53:44.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.511+0000 7f712a800640 1 -- 172.21.15.133:0/3606160979 shutdown_connections 2024-03-30T01:53:44.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.511+0000 7f712a800640 1 --2- 172.21.15.133:0/3606160979 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f710006ac30 0x7f710006d0f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:44.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.511+0000 7f712a800640 1 --2- 172.21.15.133:0/3606160979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f712415f3d0 0x7f71240b4dd0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:44.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.511+0000 7f712a800640 1 --2- 172.21.15.133:0/3606160979 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f712415ef50 0x7f71240b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:44.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.511+0000 7f712a800640 1 --2- 172.21.15.133:0/3606160979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71080039a0 0x7f7124157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:44.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.511+0000 7f712a800640 1 -- 172.21.15.133:0/3606160979 >> 172.21.15.133:0/3606160979 conn(0x7f7124071a40 msgr2=0x7f71240b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:44.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.511+0000 7f712a800640 1 -- 172.21.15.133:0/3606160979 shutdown_connections 2024-03-30T01:53:44.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.511+0000 7f712a800640 1 -- 172.21.15.133:0/3606160979 wait complete. 2024-03-30T01:53:44.537 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2024-03-30T01:53:43.734968+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220856,"kb_used_data":4704,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753864,"statfs":{"total":773094113280,"available":772867956736,"internally_reserved":0,"allocated":4816896,"data_stored":2640138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003394"},"pg_stats":[{"pgid":"1.0","version":"39'119","reported_seq":196,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-30T01:53:25.260612+0000","last_change":"2024-03-30T01:53:25.260612+0000","last_active":"2024-03-30T01:53:25.260612+0000","last_peered":"2024-03-30T01:53:25.260612+0000","last_clean":"2024-03-30T01:53:25.260612+0000","last_became_active":"2024-03-30T01:51:23.355914+0000","last_became_peered":"2024-03-30T01:51:23.355914+0000","last_unstale":"2024-03-30T01:53:25.260612+0000","last_undegraded":"2024-03-30T01:53:25.260612+0000","last_fullsized":"2024-03-30T01:53:25.260612+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'119","last_scrub_stamp":"2024-03-30T01:53:25.260432+0000","last_deep_scrub":"39'119","last_deep_scrub_stamp":"2024-03-30T01:53:25.260432+0000","last_clean_scrub_stamp":"2024-03-30T01:53:25.260432+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T03:15:28.653725+0000","scrub_duration":0.010722008999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1048576,"data_stored":773048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:53:27 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.137,"15min":1.143},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.8600000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.206,"15min":1.1890000000000001},"min":{"1min":0.78700000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.929,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.3799999999999999}]},{"osd":1,"last update":"Sat Mar 30 01:53:27 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.169,"15min":1.173},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.625,"5min":1.946,"15min":1.946},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0109999999999999,"15min":1.0049999999999999},"min":{"1min":0.67200000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.4470000000000001,"5min":1.677,"15min":1.677},"last":1.212}]},{"osd":2,"last update":"Sat Mar 30 01:53:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0569999999999999,"15min":1.0600000000000001},"min":{"1min":0.67300000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.7390000000000001,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.111,"15min":1.1040000000000001},"min":{"1min":0.81100000000000005,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5940000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.331}]},{"osd":3,"last update":"Sat Mar 30 01:53:27 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.2010000000000001,"15min":1.208},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.6739999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.21,"5min":1.3340000000000001,"15min":1.355},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.5700000000000001,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.2869999999999999}]},{"osd":4,"last update":"Sat Mar 30 01:53:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.292,"15min":1.302},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8839999999999999,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.506},{"interface":"front","average":{"1min":1.208,"5min":1.381,"15min":1.4099999999999999},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.55,"5min":2.552,"15min":2.552},"last":0.998}]},{"osd":5,"last update":"Sat Mar 30 01:53:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.423,"15min":1.4390000000000001},"min":{"1min":1.0389999999999999,"5min":0.996,"15min":0.996},"max":{"1min":1.77,"5min":1.982,"15min":1.982},"last":1.575},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3999999999999999,"15min":1.4059999999999999},"min":{"1min":1.131,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.774,"5min":2.129,"15min":2.129},"last":1.4239999999999999}]},{"osd":6,"last update":"Sat Mar 30 01:53:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.5,"15min":1.5089999999999999},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":2.0339999999999998,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.4550000000000001,"15min":1.474},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.8049999999999999,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.0660000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":182680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:53:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.056,"15min":1.0580000000000001},"min":{"1min":0.73799999999999999,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.4470000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.048},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.048,"15min":1.0469999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.5349999999999999,"5min":1.605,"15min":1.605},"last":0.83899999999999997}]},{"osd":1,"last update":"Sat Mar 30 01:53:27 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0429999999999999,"15min":1.0549999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.143,"5min":1.147,"15min":1.147},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.8320000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.089}]},{"osd":2,"last update":"Sat Mar 30 01:53:27 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1379999999999999,"15min":1.139},"min":{"1min":0.80800000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.522,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.395},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.03,"15min":1.03},"min":{"1min":0.58899999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.258,"5min":1.694,"15min":1.694},"last":1.0209999999999999}]},{"osd":3,"last update":"Sat Mar 30 01:53:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.3009999999999999,"15min":1.3129999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5369999999999999,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.298,"15min":1.3080000000000001},"min":{"1min":0.79500000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.708,"5min":2.016,"15min":2.016},"last":0.97499999999999998}]},{"osd":4,"last update":"Sat Mar 30 01:53:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.371,"15min":1.381},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.7649999999999999,"5min":2.27,"15min":2.27},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3879999999999999,"15min":1.401},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.8169999999999999,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.163}]},{"osd":5,"last update":"Sat Mar 30 01:53:27 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.421,"15min":1.427},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8759999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.452},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.28,"15min":1.29},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.5860000000000001,"5min":2.528,"15min":2.528},"last":1.2190000000000001}]},{"osd":7,"last update":"Sat Mar 30 01:53:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.5489999999999999,"15min":1.5609999999999999},"min":{"1min":0.95999999999999996,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.9259999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.415,"15min":1.4299999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.7589999999999999,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":1.139}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27460,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":454656,"data_stored":182680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:53:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.768,"15min":1.8440000000000001},"min":{"1min":0.755,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":3.278,"5min":13.811999999999999,"15min":13.811999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.294,"15min":1.27},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":7.3049999999999997,"5min":7.3049999999999997,"15min":7.3049999999999997},"last":1.1830000000000001}]},{"osd":1,"last update":"Sat Mar 30 01:53:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.5649999999999999,"15min":1.6180000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":4.7370000000000001,"5min":9.9900000000000002,"15min":9.9900000000000002},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.5740000000000001,"15min":1.611},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":3.3889999999999998,"5min":6.024,"15min":6.024},"last":0.98799999999999999}]},{"osd":2,"last update":"Sat Mar 30 01:53:27 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.641,"15min":1.6830000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":3.3380000000000001,"5min":6.109,"15min":6.109},"last":1.145},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.4279999999999999,"15min":1.4119999999999999},"min":{"1min":0.86899999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":7.3609999999999998,"5min":7.3609999999999998,"15min":7.3609999999999998},"last":1.04}]},{"osd":3,"last update":"Sat Mar 30 01:53:27 2024","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.7929999999999999,"15min":1.823},"min":{"1min":0.96199999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":7.5049999999999999,"5min":7.5049999999999999,"15min":7.5049999999999999},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.8360000000000001,"15min":1.9159999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":4.5030000000000001,"5min":9.9489999999999998,"15min":9.9489999999999998},"last":1.591}]},{"osd":4,"last update":"Sat Mar 30 01:53:27 2024","interfaces":[{"interface":"back","average":{"1min":1.8420000000000001,"5min":1.8240000000000001,"15min":1.821},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":9.5879999999999992,"5min":9.5879999999999992,"15min":9.5879999999999992},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.6919999999999999,"5min":1.7929999999999999,"15min":1.8100000000000001},"min":{"1min":0.86199999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":7.6769999999999996,"5min":7.6769999999999996,"15min":7.6769999999999996},"last":1.292}]},{"osd":6,"last update":"Sat Mar 30 01:53:27 2024","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.931,"15min":2.0110000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":4.4390000000000001,"5min":9.8160000000000007,"15min":9.8160000000000007},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.9790000000000001,"5min":1.9950000000000001,"15min":1.998},"min":{"1min":0.91500000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":9.5199999999999996,"5min":9.5199999999999996,"15min":9.5199999999999996},"last":1.452}]},{"osd":7,"last update":"Sat Mar 30 01:53:27 2024","interfaces":[{"interface":"back","average":{"1min":1.849,"5min":1.8340000000000001,"15min":1.8320000000000001},"min":{"1min":1.085,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":7.6340000000000003,"5min":7.6340000000000003,"15min":7.6340000000000003},"last":1.476},{"interface":"front","average":{"1min":1.6799999999999999,"5min":2.1070000000000002,"15min":2.1779999999999999},"min":{"1min":1.1100000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":4.7889999999999997,"5min":9.8650000000000002,"15min":9.8650000000000002},"last":1.651}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":182680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.129,"15min":1.149},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.155,"15min":1.173},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.5229999999999999,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":1.0269999999999999}]},{"osd":1,"last update":"Sat Mar 30 01:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.1439999999999999,"15min":1.165},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.427,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.016,"5min":1.224,"15min":1.2589999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.298,"5min":2.718,"15min":2.718},"last":1.5389999999999999}]},{"osd":2,"last update":"Sat Mar 30 01:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.149,"15min":1.153},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.339},{"interface":"front","average":{"1min":1.157,"5min":1.26,"15min":1.2769999999999999},"min":{"1min":0.70699999999999996,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5329999999999999,"5min":2.23,"15min":2.23},"last":1.111}]},{"osd":3,"last update":"Sat Mar 30 01:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.444,"15min":1.4690000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8939999999999999,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.496,"15min":1.522},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.762,"5min":4.6680000000000001,"15min":4.6680000000000001},"last":1.2450000000000001}]},{"osd":5,"last update":"Sat Mar 30 01:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.3380000000000001,"15min":1.3520000000000001},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.706,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.421,"5min":1.4790000000000001,"15min":1.4890000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.9910000000000001,"5min":3.4790000000000001,"15min":3.4790000000000001},"last":1.595}]},{"osd":6,"last update":"Sat Mar 30 01:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.4399999999999999,"15min":1.454},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.845,"5min":1.879,"15min":1.879},"last":1.661},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.538,"15min":1.5549999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.0619999999999998,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.161}]},{"osd":7,"last update":"Sat Mar 30 01:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.532,"5min":1.5469999999999999,"15min":1.5489999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0489999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.504,"5min":1.6000000000000001,"15min":1.6160000000000001},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.085,"5min":2.4409999999999998,"15min":2.4409999999999998},"last":1.387}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":182680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:53:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":1.292,"15min":1.3779999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.276,"5min":9.298,"15min":9.298},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.97999999999999998,"15min":1.0069999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2609999999999999,"5min":3.806,"15min":3.806},"last":1.018}]},{"osd":1,"last update":"Sat Mar 30 01:53:30 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":1.0569999999999999,"15min":1.107},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.216,"5min":3.1070000000000002,"15min":3.1070000000000002},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.403,"15min":1.4830000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.325,"5min":9.3659999999999997,"15min":9.3659999999999997},"last":1.3160000000000001}]},{"osd":2,"last update":"Sat Mar 30 01:53:30 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.3260000000000001,"15min":1.3859999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.52,"5min":5.7949999999999999,"15min":5.7949999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.399,"15min":1.472},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.47,"5min":6.7240000000000002,"15min":6.7240000000000002},"last":0.91800000000000004}]},{"osd":4,"last update":"Sat Mar 30 01:53:30 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.407,"15min":1.4530000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.575,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.415,"15min":1.458},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.5409999999999999,"5min":2.657,"15min":2.657},"last":1.2529999999999999}]},{"osd":5,"last update":"Sat Mar 30 01:53:30 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.4490000000000001,"15min":1.4950000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.605,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.264,"5min":2.1949999999999998,"15min":2.3500000000000001},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.4950000000000001,"5min":18.904,"15min":18.904},"last":1.0800000000000001}]},{"osd":6,"last update":"Sat Mar 30 01:53:30 2024","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.377,"15min":1.407},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.843,"5min":3.9209999999999998,"15min":3.9209999999999998},"last":1.232},{"interface":"front","average":{"1min":1.202,"5min":1.6299999999999999,"15min":1.702},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.5800000000000001,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":1.425}]},{"osd":7,"last update":"Sat Mar 30 01:53:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.7689999999999999,"15min":1.8580000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.6299999999999999,"5min":6.8600000000000003,"15min":6.8600000000000003},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.5009999999999999,"15min":1.5389999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.9039999999999999,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":1.3380000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27460,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":450560,"data_stored":181661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:53:24 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.90600000000000003,"15min":0.92200000000000004},"min":{"1min":0.41699999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.7030000000000001,"5min":1.714,"15min":1.714},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.98099999999999998,"15min":0.98599999999999999},"min":{"1min":0.443,"5min":0.439,"15min":0.439},"max":{"1min":2.0649999999999999,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.0980000000000001}]},{"osd":1,"last update":"Sat Mar 30 01:53:24 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.85899999999999999,"15min":0.86799999999999999},"min":{"1min":0.374,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.349,"5min":1.589,"15min":1.589},"last":1.3979999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.98499999999999999,"15min":0.996},"min":{"1min":0.51900000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4570000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.89300000000000002}]},{"osd":3,"last update":"Sat Mar 30 01:53:24 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.1379999999999999,"15min":1.1699999999999999},"min":{"1min":0.57899999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3919999999999999,"5min":4.742,"15min":4.742},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.1419999999999999,"15min":1.1639999999999999},"min":{"1min":0.65300000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5469999999999999,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.075}]},{"osd":4,"last update":"Sat Mar 30 01:53:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2849999999999999,"15min":1.2989999999999999},"min":{"1min":0.84599999999999997,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.639,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":1.24},{"interface":"front","average":{"1min":1.139,"5min":1.258,"15min":1.278},"min":{"1min":0.79700000000000004,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.4710000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.4379999999999999}]},{"osd":5,"last update":"Sat Mar 30 01:53:24 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.3400000000000001,"15min":1.3580000000000001},"min":{"1min":0.97799999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.4610000000000001,"5min":3.012,"15min":3.012},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.5840000000000001,"15min":1.625},"min":{"1min":0.873,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.774,"5min":8.125,"15min":8.125},"last":1.1319999999999999}]},{"osd":6,"last update":"Sat Mar 30 01:53:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.4530000000000001,"15min":1.4810000000000001},"min":{"1min":0.80100000000000005,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.7050000000000001,"5min":5.6449999999999996,"15min":5.6449999999999996},"last":1.363},{"interface":"front","average":{"1min":1.353,"5min":1.407,"15min":1.4159999999999999},"min":{"1min":1.008,"5min":0.871,"15min":0.871},"max":{"1min":1.6659999999999999,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.484}]},{"osd":7,"last update":"Sat Mar 30 01:53:24 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.3320000000000001,"15min":1.3360000000000001},"min":{"1min":0.878,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.8260000000000001,"5min":2.27,"15min":2.27},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.327,"5min":1.4099999999999999,"15min":1.4239999999999999},"min":{"1min":0.82999999999999996,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.8120000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.627}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":182680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 01:53:23 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.93400000000000005,"15min":0.94399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.5189999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.98599999999999999,"15min":1.006},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7450000000000001,"5min":2,"15min":2},"last":1.196}]},{"osd":2,"last update":"Sat Mar 30 01:53:23 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":1.0389999999999999,"15min":1.0740000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.4590000000000001,"5min":1.867,"15min":1.867},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.1459999999999999,"15min":1.198},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.3580000000000001,"5min":4.7549999999999999,"15min":4.7549999999999999},"last":1.0409999999999999}]},{"osd":3,"last update":"Sat Mar 30 01:53:23 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":1.056,"15min":1.103},"min":{"1min":0.39300000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.456,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.359,"15min":1.425},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.571,"5min":6.04,"15min":6.04},"last":0.96499999999999997}]},{"osd":4,"last update":"Sat Mar 30 01:53:23 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.351,"15min":1.4019999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.5820000000000001,"5min":2.629,"15min":2.629},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.3720000000000001,"15min":1.4119999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.6040000000000001,"5min":3.7669999999999999,"15min":3.7669999999999999},"last":1.284}]},{"osd":5,"last update":"Sat Mar 30 01:53:23 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.456,"15min":1.506},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.51,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":1.087},{"interface":"front","average":{"1min":1.165,"5min":1.4059999999999999,"15min":1.446},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.627,"5min":3.9359999999999999,"15min":3.9359999999999999},"last":1.4570000000000001}]},{"osd":6,"last update":"Sat Mar 30 01:53:23 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.353,"15min":1.395},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.5640000000000001,"5min":2.4209999999999998,"15min":2.4209999999999998},"last":1.302},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.4590000000000001,"15min":1.502},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.571,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":1.153}]},{"osd":7,"last update":"Sat Mar 30 01:53:23 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.4359999999999999,"15min":1.464},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.9419999999999999,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.198,"5min":1.411,"15min":1.4470000000000001},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6830000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.2310000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1044480,"data_stored":772029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 30 01:53:22 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.84899999999999998,"15min":0.86899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.4139999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.92400000000000004,"15min":0.94099999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.462,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":1.0800000000000001}]},{"osd":2,"last update":"Sat Mar 30 01:53:22 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":1.022,"15min":1.0449999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.5740000000000001,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.871,"5min":0.94899999999999995,"15min":0.96199999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.367,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.228}]},{"osd":3,"last update":"Sat Mar 30 01:53:22 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.85199999999999998,"15min":0.86599999999999999},"min":{"1min":0.41299999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.21,"5min":1.478,"15min":1.478},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.879,"5min":1.2969999999999999,"15min":1.367},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.522,"5min":5.2679999999999998,"15min":5.2679999999999998},"last":1.3600000000000001}]},{"osd":4,"last update":"Sat Mar 30 01:53:22 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1870000000000001,"15min":1.2050000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.345,"5min":1.978,"15min":1.978},"last":1.036},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.349,"15min":1.375},"min":{"1min":0.749,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.8480000000000001,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":1.423}]},{"osd":5,"last update":"Sat Mar 30 01:53:22 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.2230000000000001,"15min":1.2430000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.528,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":1.139},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.4379999999999999,"15min":1.4710000000000001},"min":{"1min":0.70099999999999996,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.974,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.2609999999999999}]},{"osd":6,"last update":"Sat Mar 30 01:53:22 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.3160000000000001,"15min":1.337},"min":{"1min":0.82499999999999996,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6419999999999999,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.349,"15min":1.341},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":5.6689999999999996,"5min":5.6689999999999996,"15min":5.6689999999999996},"last":1.458}]},{"osd":7,"last update":"Sat Mar 30 01:53:22 2024","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.3280000000000001,"15min":1.343},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.6679999999999999,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.292},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.516,"15min":1.5660000000000001},"min":{"1min":0.85299999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.579,"5min":4.923,"15min":4.923},"last":1.3140000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T01:53:44.538 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-30T01:53:44.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.721+0000 7f7957000640 1 Processor -- start 2024-03-30T01:53:44.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.721+0000 7f7957000640 1 -- start start 2024-03-30T01:53:44.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.723+0000 7f7957000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f795015cac0 0x7f7950160670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:44.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.723+0000 7f7957000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79500b5b50 con 0x7f79500cddb0 2024-03-30T01:53:44.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.723+0000 7f7957000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7950161100 con 0x7f7950160bb0 2024-03-30T01:53:44.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.723+0000 7f7957000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79500d1020 con 0x7f795015cac0 2024-03-30T01:53:44.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.723+0000 7f7956600640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f79500cddb0 0x7f79500d1440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57972/0 (socket says 172.21.15.133:57972) 2024-03-30T01:53:44.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.723+0000 7f7956600640 1 -- 172.21.15.133:0/1828369222 learned_addr learned my addr 172.21.15.133:0/1828369222 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:44.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.723+0000 7f7955c00640 1 --2- 172.21.15.133:0/1828369222 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f795015cac0 0x7f7950160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:44.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.724+0000 7f794fe00640 1 -- 172.21.15.133:0/1828369222 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406210336 0 0) 0x7f79500b5b50 con 0x7f79500cddb0 2024-03-30T01:53:44.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.724+0000 7f794fe00640 1 -- 172.21.15.133:0/1828369222 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7938003520 con 0x7f79500cddb0 2024-03-30T01:53:44.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.724+0000 7f794fe00640 1 -- 172.21.15.133:0/1828369222 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2546381647 0 0) 0x7f7938003520 con 0x7f79500cddb0 2024-03-30T01:53:44.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.724+0000 7f794fe00640 1 -- 172.21.15.133:0/1828369222 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f795015cac0 msgr2=0x7f7950160670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:44.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.724+0000 7f794fe00640 1 --2- 172.21.15.133:0/1828369222 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f795015cac0 0x7f7950160670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:44.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.724+0000 7f794fe00640 1 -- 172.21.15.133:0/1828369222 >> v1:172.21.15.137:6789/0 conn(0x7f7950160bb0 legacy=0x7f79500cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:44.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.724+0000 7f794fe00640 1 -- 172.21.15.133:0/1828369222 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79501613e0 con 0x7f79500cddb0 2024-03-30T01:53:44.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.724+0000 7f794fe00640 1 -- 172.21.15.133:0/1828369222 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 216976335 0 0) 0x7f79480019f0 con 0x7f79500cddb0 2024-03-30T01:53:44.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.724+0000 7f794fe00640 1 -- 172.21.15.133:0/1828369222 >> v1:172.21.15.133:6789/0 conn(0x7f79500cddb0 legacy=0x7f79500d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:44.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.724+0000 7f794fe00640 1 --2- 172.21.15.133:0/1828369222 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f795015cac0 0x7f79380039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:44.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.724+0000 7f794fe00640 1 --2- 172.21.15.133:0/1828369222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7938003f20 0x7f79380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:44.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.724+0000 7f794fe00640 1 --2- 172.21.15.133:0/1828369222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7938004d00 0x7f7938005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:44.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.724+0000 7f794fe00640 1 -- 172.21.15.133:0/1828369222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79500d1020 con 0x7f7938003f20 2024-03-30T01:53:44.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.724+0000 7f794fe00640 1 -- 172.21.15.133:0/1828369222 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793800ba60 con 0x7f7938004d00 2024-03-30T01:53:44.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.724+0000 7f794fe00640 1 -- 172.21.15.133:0/1828369222 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793800bc20 con 0x7f795015cac0 2024-03-30T01:53:44.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.724+0000 7f7955200640 1 --2- 172.21.15.133:0/1828369222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7938003f20 0x7f79380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:44.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.725+0000 7f7955c00640 1 --2- 172.21.15.133:0/1828369222 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f795015cac0 0x7f79380039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:44.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.725+0000 7f7956600640 1 --2- 172.21.15.133:0/1828369222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7938004d00 0x7f7938005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:44.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.725+0000 7f7955200640 1 -- 172.21.15.133:0/1828369222 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f795015cac0 msgr2=0x7f79380039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:44.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.725+0000 7f7955200640 1 --2- 172.21.15.133:0/1828369222 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f795015cac0 0x7f79380039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:44.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.725+0000 7f7955200640 1 -- 172.21.15.133:0/1828369222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7938004d00 msgr2=0x7f7938005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:44.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.725+0000 7f7955200640 1 --2- 172.21.15.133:0/1828369222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7938004d00 0x7f7938005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:44.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.725+0000 7f7955200640 1 -- 172.21.15.133:0/1828369222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7938003520 con 0x7f7938003f20 2024-03-30T01:53:44.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.726+0000 7f7955200640 1 --2- 172.21.15.133:0/1828369222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7938003f20 0x7f79380047c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f793c001750 tx=0x7f79380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ec605549a10b70 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:44.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.726+0000 7f794fe00640 1 -- 172.21.15.133:0/1828369222 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c0052d0 con 0x7f7938003f20 2024-03-30T01:53:44.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.726+0000 7f794fe00640 1 -- 172.21.15.133:0/1828369222 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c02e050 con 0x7f7938003f20 2024-03-30T01:53:44.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.726+0000 7f794fe00640 1 -- 172.21.15.133:0/1828369222 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c003830 con 0x7f7938003f20 2024-03-30T01:53:44.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.727+0000 7f7957000640 1 -- 172.21.15.133:0/1828369222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7938003f20 msgr2=0x7f79380047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:44.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.727+0000 7f7957000640 1 --2- 172.21.15.133:0/1828369222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7938003f20 0x7f79380047c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f793c001750 tx=0x7f79380057f0 comp rx=0 tx=0).stop 2024-03-30T01:53:44.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.727+0000 7f7956600640 1 -- 172.21.15.133:0/1828369222 reap_dead start 2024-03-30T01:53:44.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.727+0000 7f7957000640 1 -- 172.21.15.133:0/1828369222 shutdown_connections 2024-03-30T01:53:44.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.727+0000 7f7957000640 1 -- 172.21.15.133:0/1828369222 >> 172.21.15.133:0/1828369222 conn(0x7f79500cf770 msgr2=0x7f79500cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:44.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.727+0000 7f7957000640 1 -- 172.21.15.133:0/1828369222 shutdown_connections 2024-03-30T01:53:44.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.727+0000 7f7957000640 1 -- 172.21.15.133:0/1828369222 wait complete. 2024-03-30T01:53:44.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.730+0000 7f7957000640 1 Processor -- start 2024-03-30T01:53:44.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.730+0000 7f7957000640 1 -- start start 2024-03-30T01:53:44.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.731+0000 7f7957000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7938003f20 0x7f795015b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:44.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.731+0000 7f7957000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f795015fae0 0x7f7950151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:44.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.731+0000 7f7957000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79500b4680 0x7f79500b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:44.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.731+0000 7f7957000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79500b5040 con 0x7f79500b4680 2024-03-30T01:53:44.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.731+0000 7f7957000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79500a9610 con 0x7f7938003f20 2024-03-30T01:53:44.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.731+0000 7f7957000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795015dc80 con 0x7f795015fae0 2024-03-30T01:53:44.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.732+0000 7f7956600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79500b4680 0x7f79500b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:44.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.732+0000 7f7956600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79500b4680 0x7f79500b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55094/0 (socket says 172.21.15.133:55094) 2024-03-30T01:53:44.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.732+0000 7f7956600640 1 -- 172.21.15.133:0/650659410 learned_addr learned my addr 172.21.15.133:0/650659410 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:44.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.732+0000 7f7955c00640 1 --2- 172.21.15.133:0/650659410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7938003f20 0x7f795015b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:44.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.732+0000 7f7956600640 1 -- 172.21.15.133:0/650659410 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f795015fae0 msgr2=0x7f7950151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:44.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.732+0000 7f7956600640 1 --2- 172.21.15.133:0/650659410 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f795015fae0 0x7f7950151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:44.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.732+0000 7f7956600640 1 -- 172.21.15.133:0/650659410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7938003f20 msgr2=0x7f795015b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:44.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.732+0000 7f7956600640 1 --2- 172.21.15.133:0/650659410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7938003f20 0x7f795015b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:44.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.732+0000 7f7956600640 1 -- 172.21.15.133:0/650659410 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795015d020 con 0x7f79500b4680 2024-03-30T01:53:44.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.732+0000 7f7956600640 1 --2- 172.21.15.133:0/650659410 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79500b4680 0x7f79500b4b00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f79500ccdb0 tx=0x7f794800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:44.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.733+0000 7f794d600640 1 -- 172.21.15.133:0/650659410 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948004d60 con 0x7f79500b4680 2024-03-30T01:53:44.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.733+0000 7f794d600640 1 -- 172.21.15.133:0/650659410 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794800bb80 con 0x7f79500b4680 2024-03-30T01:53:44.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.733+0000 7f7957000640 1 -- 172.21.15.133:0/650659410 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795015ff60 con 0x7f79500b4680 2024-03-30T01:53:44.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.733+0000 7f794d600640 1 -- 172.21.15.133:0/650659410 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948007110 con 0x7f79500b4680 2024-03-30T01:53:44.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.733+0000 7f7957000640 1 -- 172.21.15.133:0/650659410 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795015d350 con 0x7f79500b4680 2024-03-30T01:53:44.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.734+0000 7f7957000640 1 -- 172.21.15.133:0/650659410 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7950073750 con 0x7f79500b4680 2024-03-30T01:53:44.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.736+0000 7f794d600640 1 -- 172.21.15.133:0/650659410 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f7948007270 con 0x7f79500b4680 2024-03-30T01:53:44.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.737+0000 7f794d600640 1 --2- 172.21.15.133:0/650659410 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f793006ac00 0x7f793006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:44.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.737+0000 7f794d600640 1 -- 172.21.15.133:0/650659410 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f79480892f0 con 0x7f79500b4680 2024-03-30T01:53:44.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.737+0000 7f7955c00640 1 --2- 172.21.15.133:0/650659410 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f793006ac00 0x7f793006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:44.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.738+0000 7f7955c00640 1 --2- 172.21.15.133:0/650659410 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f793006ac00 0x7f793006d0c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7944009950 tx=0x7f7944008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:44.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.742+0000 7f794d600640 1 -- 172.21.15.133:0/650659410 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f7948054800 con 0x7f79500b4680 2024-03-30T01:53:44.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.938+0000 7f7957000640 1 -- 172.21.15.133:0/650659410 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f79500d0040 con 0x7f79500b4680 2024-03-30T01:53:44.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.946+0000 7f794d600640 1 -- 172.21.15.133:0/650659410 <== mon.0 v2:172.21.15.133:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7948054800 con 0x7f79500b4680 2024-03-30T01:53:44.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.946+0000 7f794d600640 1 -- 172.21.15.133:0/650659410 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f7948057e20 con 0x7f79500b4680 2024-03-30T01:53:44.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.950+0000 7f7957000640 1 -- 172.21.15.133:0/650659410 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f793006ac00 msgr2=0x7f793006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:44.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.950+0000 7f7957000640 1 --2- 172.21.15.133:0/650659410 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f793006ac00 0x7f793006d0c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7944009950 tx=0x7f7944008040 comp rx=0 tx=0).stop 2024-03-30T01:53:44.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.950+0000 7f7957000640 1 -- 172.21.15.133:0/650659410 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79500b4680 msgr2=0x7f79500b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:44.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.950+0000 7f7957000640 1 --2- 172.21.15.133:0/650659410 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79500b4680 0x7f79500b4b00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f79500ccdb0 tx=0x7f794800b4a0 comp rx=0 tx=0).stop 2024-03-30T01:53:44.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.950+0000 7f7957000640 1 -- 172.21.15.133:0/650659410 shutdown_connections 2024-03-30T01:53:44.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.950+0000 7f7957000640 1 --2- 172.21.15.133:0/650659410 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7f793006ac00 0x7f793006d0c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:44.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.950+0000 7f7957000640 1 --2- 172.21.15.133:0/650659410 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79500b4680 0x7f79500b4b00 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:44.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.950+0000 7f7957000640 1 --2- 172.21.15.133:0/650659410 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f795015fae0 0x7f7950151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:44.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.950+0000 7f7957000640 1 --2- 172.21.15.133:0/650659410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7938003f20 0x7f795015b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:44.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.950+0000 7f7957000640 1 -- 172.21.15.133:0/650659410 >> 172.21.15.133:0/650659410 conn(0x7f79500cf770 msgr2=0x7f79500b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:44.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.950+0000 7f7957000640 1 -- 172.21.15.133:0/650659410 shutdown_connections 2024-03-30T01:53:44.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:44.951+0000 7f7957000640 1 -- 172.21.15.133:0/650659410 wait complete. 2024-03-30T01:53:44.975 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-30T01:53:44.975 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T01:53:45.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.153+0000 7fcf3fc00640 1 Processor -- start 2024-03-30T01:53:45.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.153+0000 7fcf3fc00640 1 -- start start 2024-03-30T01:53:45.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.154+0000 7fcf3fc00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcf38143790 0x7fcf380cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:45.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.154+0000 7fcf3fc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf38070500 0x7fcf38070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:45.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.154+0000 7fcf3fc00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf380a76a0 con 0x7fcf380cc530 2024-03-30T01:53:45.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.154+0000 7fcf3fc00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf380b38e0 con 0x7fcf38143790 2024-03-30T01:53:45.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.154+0000 7fcf3fc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf380cd180 con 0x7fcf38070500 2024-03-30T01:53:45.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.154+0000 7fcf3d200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcf38143790 0x7fcf380cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:45.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.154+0000 7fcf3dc00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcf380cc530 0x7fcf380cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57976/0 (socket says 172.21.15.133:57976) 2024-03-30T01:53:45.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.154+0000 7fcf3dc00640 1 -- 172.21.15.133:0/2532293903 learned_addr learned my addr 172.21.15.133:0/2532293903 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-03-30T01:53:45.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.155+0000 7fcf3d200640 1 -- 172.21.15.133:0/2532293903 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf38070500 msgr2=0x7fcf38070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T01:53:45.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.155+0000 7fcf37e00640 1 --2- 172.21.15.133:0/2532293903 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf38070500 0x7fcf38070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:45.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.155+0000 7fcf3d200640 1 --2- 172.21.15.133:0/2532293903 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf38070500 0x7fcf38070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:45.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.155+0000 7fcf3d200640 1 -- 172.21.15.133:0/2532293903 >> v1:172.21.15.133:6789/0 conn(0x7fcf380cc530 legacy=0x7fcf380cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:45.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.155+0000 7fcf37400640 1 -- 172.21.15.133:0/2532293903 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387488285 0 0) 0x7fcf380a76a0 con 0x7fcf380cc530 2024-03-30T01:53:45.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.155+0000 7fcf3d200640 1 -- 172.21.15.133:0/2532293903 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf38070ea0 con 0x7fcf38143790 2024-03-30T01:53:45.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.155+0000 7fcf37e00640 1 --2- 172.21.15.133:0/2532293903 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf38070500 0x7fcf38070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T01:53:45.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.156+0000 7fcf3d200640 1 --2- 172.21.15.133:0/2532293903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf38143790 0x7fcf380cbb10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fcf280097a0 tx=0x7fcf2802b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810e8ffdc1e6a7b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:45.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.156+0000 7fcf37400640 1 -- 172.21.15.133:0/2532293903 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf28030800 con 0x7fcf38143790 2024-03-30T01:53:45.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.156+0000 7fcf37400640 1 -- 172.21.15.133:0/2532293903 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcf28030960 con 0x7fcf38143790 2024-03-30T01:53:45.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.156+0000 7fcf37400640 1 -- 172.21.15.133:0/2532293903 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf28030d10 con 0x7fcf38143790 2024-03-30T01:53:45.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.156+0000 7fcf3fc00640 1 -- 172.21.15.133:0/2532293903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf38143790 msgr2=0x7fcf380cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:45.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.156+0000 7fcf3fc00640 1 --2- 172.21.15.133:0/2532293903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf38143790 0x7fcf380cbb10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fcf280097a0 tx=0x7fcf2802b940 comp rx=0 tx=0).stop 2024-03-30T01:53:45.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.157+0000 7fcf3fc00640 1 -- 172.21.15.133:0/2532293903 shutdown_connections 2024-03-30T01:53:45.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.157+0000 7fcf3fc00640 1 --2- 172.21.15.133:0/2532293903 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf38070500 0x7fcf38070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:45.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.157+0000 7fcf3fc00640 1 --2- 172.21.15.133:0/2532293903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf38143790 0x7fcf380cbb10 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:45.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.157+0000 7fcf3fc00640 1 -- 172.21.15.133:0/2532293903 >> 172.21.15.133:0/2532293903 conn(0x7fcf380b07a0 msgr2=0x7fcf380b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:45.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.157+0000 7fcf3fc00640 1 -- 172.21.15.133:0/2532293903 shutdown_connections 2024-03-30T01:53:45.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.157+0000 7fcf3fc00640 1 -- 172.21.15.133:0/2532293903 wait complete. 2024-03-30T01:53:45.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.158+0000 7fcf3fc00640 1 Processor -- start 2024-03-30T01:53:45.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.158+0000 7fcf3fc00640 1 -- start start 2024-03-30T01:53:45.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.159+0000 7fcf3fc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf38070500 0x7fcf3813d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:45.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.159+0000 7fcf3fc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf380cc530 0x7fcf3813e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:45.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.159+0000 7fcf3fc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf38143790 0x7fcf380acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:45.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.159+0000 7fcf3fc00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3813c6c0 con 0x7fcf38070500 2024-03-30T01:53:45.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.159+0000 7fcf3fc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3813ef30 con 0x7fcf380cc530 2024-03-30T01:53:45.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.159+0000 7fcf3fc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3813c910 con 0x7fcf38143790 2024-03-30T01:53:45.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.159+0000 7fcf3d200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf38070500 0x7fcf3813d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:45.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.159+0000 7fcf3d200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf38070500 0x7fcf3813d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55112/0 (socket says 172.21.15.133:55112) 2024-03-30T01:53:45.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.160+0000 7fcf3d200640 1 -- 172.21.15.133:0/4059514422 learned_addr learned my addr 172.21.15.133:0/4059514422 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-03-30T01:53:45.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.160+0000 7fcf3d200640 1 -- 172.21.15.133:0/4059514422 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf38143790 msgr2=0x7fcf380acbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:45.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.160+0000 7fcf3d200640 1 --2- 172.21.15.133:0/4059514422 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf38143790 0x7fcf380acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:45.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.160+0000 7fcf3d200640 1 -- 172.21.15.133:0/4059514422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf380cc530 msgr2=0x7fcf3813e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:45.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.160+0000 7fcf3d200640 1 --2- 172.21.15.133:0/4059514422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf380cc530 0x7fcf3813e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:45.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.160+0000 7fcf3d200640 1 -- 172.21.15.133:0/4059514422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf28009400 con 0x7fcf38070500 2024-03-30T01:53:45.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.160+0000 7fcf3d200640 1 --2- 172.21.15.133:0/4059514422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf38070500 0x7fcf3813d3f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fcf28000c00 tx=0x7fcf280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:45.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.160+0000 7fcf34c00640 1 -- 172.21.15.133:0/4059514422 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2803e070 con 0x7fcf38070500 2024-03-30T01:53:45.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.160+0000 7fcf34c00640 1 -- 172.21.15.133:0/4059514422 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcf28039d10 con 0x7fcf38070500 2024-03-30T01:53:45.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.160+0000 7fcf3fc00640 1 -- 172.21.15.133:0/4059514422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3813cbf0 con 0x7fcf38070500 2024-03-30T01:53:45.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.160+0000 7fcf34c00640 1 -- 172.21.15.133:0/4059514422 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf28042650 con 0x7fcf38070500 2024-03-30T01:53:45.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.161+0000 7fcf3fc00640 1 -- 172.21.15.133:0/4059514422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3813eb00 con 0x7fcf38070500 2024-03-30T01:53:45.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.162+0000 7fcf3fc00640 1 -- 172.21.15.133:0/4059514422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3813d110 con 0x7fcf38070500 2024-03-30T01:53:45.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.162+0000 7fcf34c00640 1 -- 172.21.15.133:0/4059514422 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fcf280427b0 con 0x7fcf38070500 2024-03-30T01:53:45.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.163+0000 7fcf34c00640 1 --2- 172.21.15.133:0/4059514422 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fcf1806ac00 0x7fcf1806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T01:53:45.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.163+0000 7fcf34c00640 1 -- 172.21.15.133:0/4059514422 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fcf280ab2f0 con 0x7fcf38070500 2024-03-30T01:53:45.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.163+0000 7fcf37e00640 1 --2- 172.21.15.133:0/4059514422 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fcf1806ac00 0x7fcf1806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T01:53:45.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.164+0000 7fcf37e00640 1 --2- 172.21.15.133:0/4059514422 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fcf1806ac00 0x7fcf1806d0c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcf24006fd0 tx=0x7fcf24008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T01:53:45.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.168+0000 7fcf34c00640 1 -- 172.21.15.133:0/4059514422 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fcf3813d110 con 0x7fcf38070500 2024-03-30T01:53:45.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.417+0000 7fcf3fc00640 1 -- 172.21.15.133:0/4059514422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf3813d110 con 0x7fcf38070500 2024-03-30T01:53:45.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.418+0000 7fcf34c00640 1 -- 172.21.15.133:0/4059514422 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fcf28034de0 con 0x7fcf38070500 2024-03-30T01:53:45.423 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-03-30T01:53:45.424 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/820901593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":820901593},{"type":"v1","addr":"172.21.15.137:6834","nonce":820901593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3524452213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3524452213},{"type":"v1","addr":"172.21.15.137:6835","nonce":3524452213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3989486478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3989486478},{"type":"v1","addr":"172.21.15.133:6837","nonce":3989486478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/284770169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":284770169},{"type":"v1","addr":"172.21.15.133:6836","nonce":284770169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2024-03-30T01:53:45.424 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 26 2024-03-30T01:53:45.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.421+0000 7fcf3fc00640 1 -- 172.21.15.133:0/4059514422 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fcf1806ac00 msgr2=0x7fcf1806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:45.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.421+0000 7fcf3fc00640 1 --2- 172.21.15.133:0/4059514422 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fcf1806ac00 0x7fcf1806d0c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcf24006fd0 tx=0x7fcf24008040 comp rx=0 tx=0).stop 2024-03-30T01:53:45.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.421+0000 7fcf3fc00640 1 -- 172.21.15.133:0/4059514422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf38070500 msgr2=0x7fcf3813d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T01:53:45.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.421+0000 7fcf3fc00640 1 --2- 172.21.15.133:0/4059514422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf38070500 0x7fcf3813d3f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fcf28000c00 tx=0x7fcf280046c0 comp rx=0 tx=0).stop 2024-03-30T01:53:45.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.421+0000 7fcf3fc00640 1 -- 172.21.15.133:0/4059514422 shutdown_connections 2024-03-30T01:53:45.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.421+0000 7fcf3fc00640 1 --2- 172.21.15.133:0/4059514422 >> [v2:172.21.15.133:6832/37234,v1:172.21.15.133:6833/37234] conn(0x7fcf1806ac00 0x7fcf1806d0c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:45.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.421+0000 7fcf3fc00640 1 --2- 172.21.15.133:0/4059514422 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf38143790 0x7fcf380acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:45.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.421+0000 7fcf3fc00640 1 --2- 172.21.15.133:0/4059514422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf380cc530 0x7fcf3813e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:45.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.421+0000 7fcf3fc00640 1 --2- 172.21.15.133:0/4059514422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf38070500 0x7fcf3813d3f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T01:53:45.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.421+0000 7fcf3fc00640 1 -- 172.21.15.133:0/4059514422 >> 172.21.15.133:0/4059514422 conn(0x7fcf380b07a0 msgr2=0x7fcf38142ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T01:53:45.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.421+0000 7fcf3fc00640 1 -- 172.21.15.133:0/4059514422 shutdown_connections 2024-03-30T01:53:45.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-03-30T01:53:45.421+0000 7fcf3fc00640 1 -- 172.21.15.133:0/4059514422 wait complete. 2024-03-30T01:53:45.442 DEBUG:tasks.cephfs.filesystem:already dead... 2024-03-30T01:53:45.442 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-30T01:53:45.443 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-30T01:53:45.443 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T01:53:45.459 INFO:tasks.ceph.mds.a:Stopped 2024-03-30T01:53:45.459 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-30T01:53:45.459 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T01:53:45.524 INFO:tasks.ceph.mds.c:Stopped 2024-03-30T01:53:45.524 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-30T01:53:45.524 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T01:53:45.550 INFO:tasks.ceph.mds.b:Stopped 2024-03-30T01:53:45.550 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-30T01:53:45.550 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T01:53:45.618 INFO:tasks.ceph.mds.d:Stopped 2024-03-30T01:53:45.618 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-30T01:53:45.619 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-30T01:53:45.619 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T01:53:45.679 INFO:tasks.ceph.osd.0:Stopped 2024-03-30T01:53:45.679 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-30T01:53:45.679 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T01:53:45.759 INFO:tasks.ceph.osd.1:Stopped 2024-03-30T01:53:45.759 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-30T01:53:45.759 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T01:53:45.803 INFO:tasks.ceph.osd.2:Stopped 2024-03-30T01:53:45.804 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-30T01:53:45.804 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T01:53:45.859 INFO:tasks.ceph.osd.3:Stopped 2024-03-30T01:53:45.859 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-30T01:53:45.859 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T01:53:45.927 INFO:tasks.ceph.osd.4:Stopped 2024-03-30T01:53:45.927 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-30T01:53:45.928 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T01:53:45.980 INFO:tasks.ceph.osd.5:Stopped 2024-03-30T01:53:45.980 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-30T01:53:45.980 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T01:53:46.030 INFO:tasks.ceph.osd.6:Stopped 2024-03-30T01:53:46.030 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-30T01:53:46.031 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T01:53:46.091 INFO:tasks.ceph.osd.7:Stopped 2024-03-30T01:53:46.092 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-30T01:53:46.092 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-30T01:53:46.092 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T01:53:46.161 INFO:tasks.ceph.mgr.y:Stopped 2024-03-30T01:53:46.162 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-30T01:53:46.162 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T01:53:46.239 INFO:tasks.ceph.mgr.x:Stopped 2024-03-30T01:53:46.239 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-30T01:53:46.239 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-30T01:53:46.240 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T01:53:46.280 INFO:tasks.ceph.mon.a:Stopped 2024-03-30T01:53:46.281 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-30T01:53:46.281 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T01:53:46.303 INFO:tasks.ceph.mon.b:Stopped 2024-03-30T01:53:46.304 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-30T01:53:46.304 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T01:53:46.387 INFO:tasks.ceph.mon.c:Stopped 2024-03-30T01:53:46.387 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-30T01:53:46.388 DEBUG:teuthology.orchestra.run.smithi133:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-03-30T01:53:46.491 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi133.front.sepia.ceph.com 2024-03-30T01:53:46.491 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-30T01:53:46.757 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi133.front.sepia.ceph.com 2024-03-30T01:53:46.757 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-30T01:53:46.905 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi133.front.sepia.ceph.com 2024-03-30T01:53:46.905 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-30T01:53:47.030 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi133.front.sepia.ceph.com 2024-03-30T01:53:47.030 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-30T01:53:47.200 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi137.front.sepia.ceph.com 2024-03-30T01:53:47.200 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-30T01:53:47.429 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi137.front.sepia.ceph.com 2024-03-30T01:53:47.430 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-30T01:53:47.579 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi137.front.sepia.ceph.com 2024-03-30T01:53:47.579 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-30T01:53:47.733 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi137.front.sepia.ceph.com 2024-03-30T01:53:47.733 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-30T01:53:47.873 INFO:tasks.ceph:Archiving mon data... 2024-03-30T01:53:47.874 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-03-29_18:05:24-fs-wip-rishabh-testing-20240327.051042-reef-testing-default-smithi/7629323/data/mon.a.tgz 2024-03-30T01:53:47.874 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2024-03-30T01:53:47.933 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.vsYZs63iip 2024-03-30T01:53:47.933 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.vsYZs63iip 2024-03-30T01:53:48.108 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.vsYZs63iip 2024-03-30T01:53:48.255 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.vsYZs63iip is 293KB 2024-03-30T01:53:48.362 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.vsYZs63iip 2024-03-30T01:53:48.417 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-03-29_18:05:24-fs-wip-rishabh-testing-20240327.051042-reef-testing-default-smithi/7629323/data/mon.b.tgz 2024-03-30T01:53:48.417 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-03-30T01:53:48.471 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.9vzRgrYyfL 2024-03-30T01:53:48.471 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.9vzRgrYyfL 2024-03-30T01:53:48.661 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.9vzRgrYyfL 2024-03-30T01:53:48.806 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.9vzRgrYyfL is 390KB 2024-03-30T01:53:48.910 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.9vzRgrYyfL 2024-03-30T01:53:48.962 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T01:53:48.967 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-03-29_18:05:24-fs-wip-rishabh-testing-20240327.051042-reef-testing-default-smithi/7629323/data/mon.c.tgz 2024-03-30T01:53:48.967 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-03-30T01:53:48.970 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T01:53:49.015 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.pftrDQGs9d 2024-03-30T01:53:49.016 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.pftrDQGs9d 2024-03-30T01:53:49.230 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.pftrDQGs9d 2024-03-30T01:53:49.377 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.pftrDQGs9d is 390KB 2024-03-30T01:53:49.442 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.pftrDQGs9d 2024-03-30T01:53:49.495 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-30T01:53:49.495 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-30T01:53:49.503 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-30T01:53:49.592 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-03-30T01:53:49.592 DEBUG:teuthology.orchestra.run.smithi133:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-03-30T01:53:49.597 DEBUG:teuthology.orchestra.run.smithi137:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-03-30T01:53:49.688 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-03-30T01:53:49.699 INFO:teuthology.orchestra.run.smithi137.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-03-30T01:53:49.713 INFO:tasks.ceph:Archiving crash dumps... 2024-03-30T01:53:49.715 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-03-29_18:05:24-fs-wip-rishabh-testing-20240327.051042-reef-testing-default-smithi/7629323/remote/smithi133/crash 2024-03-30T01:53:49.716 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-30T01:53:49.796 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-03-29_18:05:24-fs-wip-rishabh-testing-20240327.051042-reef-testing-default-smithi/7629323/remote/smithi137/crash 2024-03-30T01:53:49.797 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-30T01:53:49.886 INFO:tasks.ceph:Shutting down logrotate 2024-03-30T01:53:49.887 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T01:53:49.894 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T01:53:50.028 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-30T01:53:50.125 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-30T01:53:50.225 INFO:tasks.ceph:Compressing logs... 2024-03-30T01:53:50.225 DEBUG:teuthology.orchestra.run.smithi133:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-30T01:53:50.233 DEBUG:teuthology.orchestra.run.smithi137:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-30T01:53:51.194 INFO:tasks.ceph:Archiving logs... 2024-03-30T01:53:51.194 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-03-29_18:05:24-fs-wip-rishabh-testing-20240327.051042-reef-testing-default-smithi/7629323/remote/smithi133/log 2024-03-30T01:53:51.195 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-30T01:53:51.536 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-03-29_18:05:24-fs-wip-rishabh-testing-20240327.051042-reef-testing-default-smithi/7629323/remote/smithi137/log 2024-03-30T01:53:51.537 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-30T01:53:51.723 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-30T01:53:51.746 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-30T01:53:51.746 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-30T01:53:51.754 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-30T01:53:51.909 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-30T01:53:51.918 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-30T01:53:51.919 DEBUG:teuthology.orchestra.run.smithi133:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T01:53:51.927 DEBUG:teuthology.orchestra.run.smithi137:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T01:53:51.975 INFO:teuthology.orchestra.run.smithi133.stderr:bash: line 1: ntpq: command not found 2024-03-30T01:53:51.981 INFO:teuthology.orchestra.run.smithi137.stderr:bash: line 1: ntpq: command not found 2024-03-30T01:53:51.985 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-30T01:53:51.985 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2024-03-30T01:53:51.985 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 23 +626us[ +634us] +/- 93ms 2024-03-30T01:53:51.985 INFO:teuthology.orchestra.run.smithi133.stdout:^* hv02.front.sepia.ceph.com 3 6 377 22 -897us[ -889us] +/- 72ms 2024-03-30T01:53:51.985 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 +483us[ +483us] +/- 75ms 2024-03-30T01:53:51.985 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T01:53:51.989 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-30T01:53:51.989 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2024-03-30T01:53:51.989 INFO:teuthology.orchestra.run.smithi137.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 22 +600us[ +600us] +/- 93ms 2024-03-30T01:53:51.989 INFO:teuthology.orchestra.run.smithi137.stdout:^* hv02.front.sepia.ceph.com 3 6 377 24 -900us[ -879us] +/- 72ms 2024-03-30T01:53:51.989 INFO:teuthology.orchestra.run.smithi137.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 +494us[ +494us] +/- 75ms 2024-03-30T01:53:51.989 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T01:53:51.991 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-30T01:53:52.000 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-30T01:53:52.000 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-30T01:53:52.009 DEBUG:teuthology.orchestra.run.smithi133:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-30T01:53:52.221 DEBUG:teuthology.orchestra.run.smithi137:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-30T01:53:52.435 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-30T01:53:52.536 INFO:teuthology.orchestra.run.smithi133.stdout:type=AVC msg=audit(1711762861.094:200): avc: denied { checkpoint_restore } for pid=1209 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1 2024-03-30T01:53:52.538 DEBUG:teuthology.task.selinux:ubuntu@smithi133.front.sepia.ceph.com has 1 denials 2024-03-30T01:53:52.538 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-30T01:53:52.639 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T01:53:52.639 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 166, in teardown self.get_new_denials() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 215, in get_new_denials raise SELinuxError(node=remote, teuthology.exceptions.SELinuxError: SELinux denials found on ubuntu@smithi133.front.sepia.ceph.com: ['type=AVC msg=audit(1711762861.094:200): avc: denied { checkpoint_restore } for pid=1209 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'] 2024-03-30T01:53:52.640 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-30T01:53:52.650 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-30T01:53:52.660 INFO:teuthology.task.internal:Duration was 774.644620 seconds 2024-03-30T01:53:52.660 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-30T01:53:52.669 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-30T01:53:52.669 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-30T01:53:52.678 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-30T01:53:52.836 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-30T01:53:52.845 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-30T01:53:53.174 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-30T01:53:53.174 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi133.front.sepia.ceph.com 2024-03-30T01:53:53.175 DEBUG:teuthology.orchestra.run.smithi133:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-30T01:53:53.237 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi137.front.sepia.ceph.com 2024-03-30T01:53:53.238 DEBUG:teuthology.orchestra.run.smithi137:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-30T01:53:53.313 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-30T01:53:53.313 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-30T01:53:53.321 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-30T01:53:53.414 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-30T01:53:53.414 DEBUG:teuthology.orchestra.run.smithi133:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-30T01:53:53.420 DEBUG:teuthology.orchestra.run.smithi137:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-30T01:53:53.599 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-30T01:53:53.609 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-30T01:53:53.609 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-30T01:53:53.699 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-30T01:53:53.797 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-30T01:53:53.808 DEBUG:teuthology.orchestra.run.smithi133:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-30T01:53:53.816 DEBUG:teuthology.orchestra.run.smithi137:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-30T01:53:53.918 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = core 2024-03-30T01:53:53.925 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = core 2024-03-30T01:53:53.979 DEBUG:teuthology.orchestra.run.smithi133:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-30T01:53:54.027 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T01:53:54.028 DEBUG:teuthology.orchestra.run.smithi137:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-30T01:53:54.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T01:53:54.081 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-30T01:53:54.092 INFO:teuthology.task.internal:Transferring archived files... 2024-03-30T01:53:54.093 DEBUG:teuthology.misc:Transferring archived files from smithi133:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-03-29_18:05:24-fs-wip-rishabh-testing-20240327.051042-reef-testing-default-smithi/7629323/remote/smithi133 2024-03-30T01:53:54.093 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-30T01:53:54.198 DEBUG:teuthology.misc:Transferring archived files from smithi137:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-03-29_18:05:24-fs-wip-rishabh-testing-20240327.051042-reef-testing-default-smithi/7629323/remote/smithi137 2024-03-30T01:53:54.198 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-30T01:53:54.302 INFO:teuthology.task.internal:Removing archive directory... 2024-03-30T01:53:54.302 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-30T01:53:54.310 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-30T01:53:54.366 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-30T01:53:54.379 INFO:teuthology.task.internal:Not uploading archives. 2024-03-30T01:53:54.379 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-30T01:53:54.390 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-30T01:53:54.390 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-30T01:53:54.398 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-30T01:53:54.447 INFO:teuthology.orchestra.run.smithi133.stdout: 393249 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 30 01:53 /home/ubuntu/cephtest 2024-03-30T01:53:54.453 INFO:teuthology.orchestra.run.smithi137.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 30 01:53 /home/ubuntu/cephtest 2024-03-30T01:53:54.457 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-30T01:53:54.468 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-30T01:53:54.480 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: SELinuxError: SELinux denials found on ubuntu@smithi133.front.sepia.ceph.com: ['type=AVC msg=audit(1711762861.094:200): avc: denied { checkpoint_restore } for pid=1209 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'] 2024-03-30T01:53:54.480 INFO:teuthology.nuke:Checking targets against current locks 2024-03-30T01:53:54.503 DEBUG:teuthology.nuke:shortname: smithi133 2024-03-30T01:53:54.504 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-30T01:53:54.527 DEBUG:teuthology.nuke:shortname: smithi137 2024-03-30T01:53:54.527 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-30T01:53:54.533 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-29_18:05:24-fs-wip-rishabh-testing-20240327.051042-reef-testing-default-smithi/7629323', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 01:30:37.879677', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOSuTrqf4XLFxbxEGVf3lm4FTHfI2eVG8nvVoSuw1yJKr7E7bP+mRHT+oAAQEwaZ4xu1xJqmmPmIEzTbbYTO3zk='} 2024-03-30T01:53:54.556 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-29_18:05:24-fs-wip-rishabh-testing-20240327.051042-reef-testing-default-smithi/7629323', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 01:30:37.878272', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOqmzwCL+rBy2C4wUVFStlUDYJcUFIqIDFMGspGAl4hYeLtG+p+tu0DdMAZBRVQqAjo7tbBP9D+saAJ6F1WSNhg='} 2024-03-30T01:53:54.588 INFO:teuthology.orchestra.console.smithi133:Power off 2024-03-30T01:53:54.588 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-30T01:53:54.612 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2024-03-30T01:53:54.612 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T01:53:54.628 INFO:teuthology.orchestra.console.smithi137:Power off 2024-03-30T01:53:54.628 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-30T01:53:54.638 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-03-30T01:53:54.653 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off 2024-03-30T01:53:54.653 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T01:53:54.677 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-03-30T01:53:58.639 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T01:53:58.678 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T01:53:58.749 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-03-30T01:53:58.788 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-03-30T01:54:02.753 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T01:54:02.789 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T01:54:02.863 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-03-30T01:54:02.900 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-03-30T01:54:02.965 INFO:teuthology.orchestra.console.smithi133:Power off completed 2024-03-30T01:54:03.001 INFO:teuthology.orchestra.console.smithi137:Power off completed 2024-03-30T01:54:03.107 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 client.1-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/recovery-fs} duration: 774.6446197032928 failure_reason: 'SELinux denials found on ubuntu@smithi133.front.sepia.ceph.com: [''type=AVC msg=audit(1711762861.094:200): avc: denied { checkpoint_restore } for pid=1209 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'']' flavor: default owner: scheduled_rishabh@teuthology status: fail success: false 2024-03-30T01:54:03.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T01:54:03.194 INFO:teuthology.run:FAIL